计算机工程与应用
計算機工程與應用
계산궤공정여응용
Computer Engineering and Applications
2015年
19期
61-65
,共5页
云计算%作业调度%Hadoop%加权%MapReduce编程模型
雲計算%作業調度%Hadoop%加權%MapReduce編程模型
운계산%작업조도%Hadoop%가권%MapReduce편정모형
cloud computing%job scheduling%Hadoop%weighting%MaPreduce programming model
在计算能力调度算法中没有全面考虑各资源特征的分配是否满足作业多样的服务要求,提出一种基于优先级的计算能力加权调度算法,根据作业的优先级以及提交时间等因素来计算作业的权重。依据作业的权重对作业队列进行排序并分配空闲的slot给队首的作业,从而避免调度陷入局部最优也能更好地满足作业的多样性服务要求。在搭建的Hadoop平台上进行实验表明,改进后的算法能较均衡地分配系统资源减少一些作业的等待时间,并且运行全部作业的用时有所减少。
在計算能力調度算法中沒有全麵攷慮各資源特徵的分配是否滿足作業多樣的服務要求,提齣一種基于優先級的計算能力加權調度算法,根據作業的優先級以及提交時間等因素來計算作業的權重。依據作業的權重對作業隊列進行排序併分配空閒的slot給隊首的作業,從而避免調度陷入跼部最優也能更好地滿足作業的多樣性服務要求。在搭建的Hadoop平檯上進行實驗錶明,改進後的算法能較均衡地分配繫統資源減少一些作業的等待時間,併且運行全部作業的用時有所減少。
재계산능력조도산법중몰유전면고필각자원특정적분배시부만족작업다양적복무요구,제출일충기우우선급적계산능력가권조도산법,근거작업적우선급이급제교시간등인소래계산작업적권중。의거작업적권중대작업대렬진행배서병분배공한적slot급대수적작업,종이피면조도함입국부최우야능경호지만족작업적다양성복무요구。재탑건적Hadoop평태상진행실험표명,개진후적산법능교균형지분배계통자원감소일사작업적등대시간,병차운행전부작업적용시유소감소。
Among capacity scheduling algorithms, it is not fully taken into account whether the allocation of resources meets job varied service requirements. This paper presents a priority based weighted capacity scheduling algorithm which calculates the weight based on the priority of jobs, job’s wait time and other factors of job. Based on the weight of the job to sort the job queue and assign free slot to the team’s first job, so as to avoid falling into local optimal solution and better meet job varied service requirements. Experimental results on Hadoop platform show that improved algorithm can be more balanced with the resources, reduce waiting time for some jobs, and decrease the total run time of the job.