计算机工程
計算機工程
계산궤공정
COMPUTER ENGINEERING
2013年
10期
19-23
,共5页
田浪军%陈卫卫%陈卫东%李涛
田浪軍%陳衛衛%陳衛東%李濤
전랑군%진위위%진위동%리도
分布式哈希表%云存储%负载均衡%节点动态前移算法%虚拟节点%负载迁移代价
分佈式哈希錶%雲存儲%負載均衡%節點動態前移算法%虛擬節點%負載遷移代價
분포식합희표%운존저%부재균형%절점동태전이산법%허의절점%부재천이대개
Distributed Hash Table(DHT)%cloud storage%load balancing%Node Dynamic Forward(NDF) algorithm%virtual node%load transfer cost
针对分布式哈希表(DHT)云存储系统中的存储负载不均问题,提出一种基于节点动态前移(NDF)的负载均衡算法。通过过载节点动态前移,缩小节点存储分区,进而降低节点的存储负载。同时,过载节点除第3个后继节点复制陒关数据,保证系统中数据的副本数量稳定。在NDF算法执行过程中,只需过载节点与第3个后继节点进行简单协调,多个过载节点可以并发地进行负载转移,适合在大规模集群中部署。在10个节点的小规模集群中进行功能测试,验证 NDF 算法具有良好的负载均衡能力。在5000个节点的大规模集群中进行性能测试,结果证明在系统总负载不超过60%时,与虚拟节点算法陒比,NDF算法负载转移代价可以提升30%以上。
針對分佈式哈希錶(DHT)雲存儲繫統中的存儲負載不均問題,提齣一種基于節點動態前移(NDF)的負載均衡算法。通過過載節點動態前移,縮小節點存儲分區,進而降低節點的存儲負載。同時,過載節點除第3箇後繼節點複製陒關數據,保證繫統中數據的副本數量穩定。在NDF算法執行過程中,隻需過載節點與第3箇後繼節點進行簡單協調,多箇過載節點可以併髮地進行負載轉移,適閤在大規模集群中部署。在10箇節點的小規模集群中進行功能測試,驗證 NDF 算法具有良好的負載均衡能力。在5000箇節點的大規模集群中進行性能測試,結果證明在繫統總負載不超過60%時,與虛擬節點算法陒比,NDF算法負載轉移代價可以提升30%以上。
침대분포식합희표(DHT)운존저계통중적존저부재불균문제,제출일충기우절점동태전이(NDF)적부재균형산법。통과과재절점동태전이,축소절점존저분구,진이강저절점적존저부재。동시,과재절점제제3개후계절점복제희관수거,보증계통중수거적부본수량은정。재NDF산법집행과정중,지수과재절점여제3개후계절점진행간단협조,다개과재절점가이병발지진행부재전이,괄합재대규모집군중부서。재10개절점적소규모집군중진행공능측시,험증 NDF 산법구유량호적부재균형능력。재5000개절점적대규모집군중진행성능측시,결과증명재계통총부재불초과60%시,여허의절점산법희비,NDF산법부재전이대개가이제승30%이상。
In order to solve the problem of load imbalance of Distributed Hash Table(DHT) cloud storage system, this paper proposes a load balancing algorithm based on Node Dynamic Forward(NDF). Through overload nodes forward, this algorithm can reduce the node’s partition, and thereby reduce the storage node load. At the same time, copy the corresponding data to the third successor node, to ensure the stable number of copies the data in the system. In the NDF implementation process, it only needs a simple coordination between overload node and the third successor node. Therefore, multiple overloaded nodes can concurrently do load transfer, which is suitable for deployment in a large cluster. The functional test in a minor cluster of 10 nodes verifies that the NDF has good ability of load balancing. The performance test in a massive cluster of 5 000 nodes demonstrates the total system load does not exceed 60%, and compared with the virtual node algorithm, NDF algorithm can improve the load transfer cost by more than 30%.