中国电子商情:通信市场
中國電子商情:通信市場
중국전자상정:통신시장
2012年
1期
105-110
,共6页
Hadoop%作业调度%FIFO%公平调度器
Hadoop%作業調度%FIFO%公平調度器
Hadoop%작업조도%FIFO%공평조도기
Hadoop%Job scheduling%FIFO%Fair scheduler
Hadoop平台下的作业调度器主要有三种:先进先出调度器(FIFO)、计算能力调度器(Capacity Scheduler)和公平调度器(Fair Scheduler),其中公平调度器是为应对多用户共享集群下多类型作业的并行执行而设计。本文首先介绍了Hadoop平台下作业调度机制,然后分析了公平调度器的算法,针对存在的不足之处提出了相应的改进方法。最后对作业调度技术的发展趋势进行了展望。
Hadoop平檯下的作業調度器主要有三種:先進先齣調度器(FIFO)、計算能力調度器(Capacity Scheduler)和公平調度器(Fair Scheduler),其中公平調度器是為應對多用戶共享集群下多類型作業的併行執行而設計。本文首先介紹瞭Hadoop平檯下作業調度機製,然後分析瞭公平調度器的算法,針對存在的不足之處提齣瞭相應的改進方法。最後對作業調度技術的髮展趨勢進行瞭展望。
Hadoop평태하적작업조도기주요유삼충:선진선출조도기(FIFO)、계산능력조도기(Capacity Scheduler)화공평조도기(Fair Scheduler),기중공평조도기시위응대다용호공향집군하다류형작업적병행집행이설계。본문수선개소료Hadoop평태하작업조도궤제,연후분석료공평조도기적산법,침대존재적불족지처제출료상응적개진방법。최후대작업조도기술적발전추세진행료전망。
Job scheduler in the Hadoop platform are mainly three types: FIFO scheduler, Capacity Scheduler and the Fair Scheduler, The Fair Scheduler was designed for the parallel processing of multiple types of operations in the multi-user shared cluster. This paper introduces the job scheduling mechanism in Hadoop platform firstly, and then analyzes algorithm of Fair scheduler, for the goal of resolving existing algorithms'defects. At last, the paper prospects the tendency of the scheduling technology.