计算机工程与应用
計算機工程與應用
계산궤공정여응용
COMPUTER ENGINEERING AND APPLICATIONS
2015年
15期
266-270
,共5页
Hadoop%云平台%调度算法%集群负载
Hadoop%雲平檯%調度算法%集群負載
Hadoop%운평태%조도산법%집군부재
Hadoop%cloud platform%scheduling algorithm%cluster load
风电场数据中心包含状态监测、数据采集等实时类作业和非实时类作业,采用C/S结构存在资源利用率不平衡、管理与维护成本高等缺点。设计了一种基于Hadoop云平台的数据中心架构;针对开源Hadoop平台现有FIFO调度器不能满足实时监测系统要求,在原有FIFO调度器的基础上,设计了一种双队列的作业调度器,综合考虑作业的截止时间和优先级来进行作业调度决策,实验结果表明,与FIFO调度器相比,双队列的作业调度器在集群负载较大时能够表现出较好的性能,保证实时类作业能够优先执行,为风电机组的安全运行提供保障。
風電場數據中心包含狀態鑑測、數據採集等實時類作業和非實時類作業,採用C/S結構存在資源利用率不平衡、管理與維護成本高等缺點。設計瞭一種基于Hadoop雲平檯的數據中心架構;針對開源Hadoop平檯現有FIFO調度器不能滿足實時鑑測繫統要求,在原有FIFO調度器的基礎上,設計瞭一種雙隊列的作業調度器,綜閤攷慮作業的截止時間和優先級來進行作業調度決策,實驗結果錶明,與FIFO調度器相比,雙隊列的作業調度器在集群負載較大時能夠錶現齣較好的性能,保證實時類作業能夠優先執行,為風電機組的安全運行提供保障。
풍전장수거중심포함상태감측、수거채집등실시류작업화비실시류작업,채용C/S결구존재자원이용솔불평형、관리여유호성본고등결점。설계료일충기우Hadoop운평태적수거중심가구;침대개원Hadoop평태현유FIFO조도기불능만족실시감측계통요구,재원유FIFO조도기적기출상,설계료일충쌍대렬적작업조도기,종합고필작업적절지시간화우선급래진행작업조도결책,실험결과표명,여FIFO조도기상비,쌍대렬적작업조도기재집군부재교대시능구표현출교호적성능,보증실시류작업능구우선집행,위풍전궤조적안전운행제공보장。
Wind data center contains status monitoring, data acquisition real-time jobs and other non-real-time jobs. The structure of C/S has been widely used, but it has many disadvantages, such as the imbalance of resource utilization, the high cost of management and maintenance, etc. This paper presents a data center architecture based on cloud computing platform;in order to solve the FIFO scheduler in the open source Hadoop platform can not satisfy the real-time monitoring jobs’requirements, it designs a dual queue job scheduler based on the existing FIFO scheduler, which considers the deadline time and priority of the job to make schedule job decisions. Compared with the FIFO scheduler, the experimental results show that the dual queue job scheduler can make a good performance when the cluster load is large to make the real-time jobs can be executed first, and provides a guarantee for the safe operation of the wind turbines.