南京晓庄学院学报
南京曉莊學院學報
남경효장학원학보
JOURNAL OF NANJING XIAOZHUANG COLLEGE
2014年
6期
82-86
,共5页
朱洁%李雯睿%王江平
硃潔%李雯睿%王江平
주길%리문예%왕강평
MapReduce%任务调度%任务属性%优先级
MapReduce%任務調度%任務屬性%優先級
MapReduce%임무조도%임무속성%우선급
MapReduce%task scheduling%task attributes%priority
针对MapReduce任务调度中任务属性取默认值的不合理性以及人为指定值的不确定性,对调度算法实现动态调整任务优先级、计算合理的Reduce任务数、明确Reduce任务启动时机等改进,达到提升任务并行度、缩短作业执行时间的目的。 Fair与LATE算法改进前后的实验结果表明,基于任务属性的改进能提高调度算法性能与作业整体执行效率。
針對MapReduce任務調度中任務屬性取默認值的不閤理性以及人為指定值的不確定性,對調度算法實現動態調整任務優先級、計算閤理的Reduce任務數、明確Reduce任務啟動時機等改進,達到提升任務併行度、縮短作業執行時間的目的。 Fair與LATE算法改進前後的實驗結果錶明,基于任務屬性的改進能提高調度算法性能與作業整體執行效率。
침대MapReduce임무조도중임무속성취묵인치적불합이성이급인위지정치적불학정성,대조도산법실현동태조정임무우선급、계산합리적Reduce임무수、명학Reduce임무계동시궤등개진,체도제승임무병행도、축단작업집행시간적목적。 Fair여LATE산법개진전후적실험결과표명,기우임무속성적개진능제고조도산법성능여작업정체집행효솔。
Task scheduling is the core problem in MapReduce. Researches on scheduling algorithm rarely involve task attributes. Aiming at the irrationality of default values of the task attributes and the uncertainty of artificially specified values, this study made dynamic priority adjustments and calculated the rational number and the starting time of Reduce tasks, with a view to enhancing tasks parallelism and reducing the executing time of jobs. The re-sults of the experiments based on Fair and LATE algorithms show that the improvement based on task attributes im-proves the scheduling algorithm performance and the overall jobs execution efficiency.