信息网络安全
信息網絡安全
신식망락안전
NETINFO SECURITY
2013年
11期
87-89
,共3页
Hadoop%PB级%海量数据处理%分布式存储
Hadoop%PB級%海量數據處理%分佈式存儲
Hadoop%PB급%해량수거처리%분포식존저
Hadoop%petabyte-scale%mass data processing%distributed storage
随着互联网的普及，PB级海量数据的存储、处理需求越来越大，传统数据库和存储架构已不能满足如此大数据量下的快速响应需求。作为一个开源的分布式系统基础架构，Hadoop提供了高可靠性的分布式存储架构和高速的海量数据计算方式，被视为解决海量数据处理瓶颈的有效途径。文章通过搭建Hadoop集群平台对1PB海量数据进行存储、处理，大大提高了系统处理性能。
隨著互聯網的普及，PB級海量數據的存儲、處理需求越來越大，傳統數據庫和存儲架構已不能滿足如此大數據量下的快速響應需求。作為一箇開源的分佈式繫統基礎架構，Hadoop提供瞭高可靠性的分佈式存儲架構和高速的海量數據計算方式，被視為解決海量數據處理瓶頸的有效途徑。文章通過搭建Hadoop集群平檯對1PB海量數據進行存儲、處理，大大提高瞭繫統處理性能。
수착호련망적보급，PB급해량수거적존저、처리수구월래월대，전통수거고화존저가구이불능만족여차대수거량하적쾌속향응수구。작위일개개원적분포식계통기출가구，Hadoop제공료고가고성적분포식존저가구화고속적해량수거계산방식，피시위해결해량수거처리병경적유효도경。문장통과탑건Hadoop집군평태대1PB해량수거진행존저、처리，대대제고료계통처이성능。
With the popularization of internet, the needs of petabyte-scale data storage and processing are bigger and bigger, traditional database and storage structure couldn’t meet the quick response based on so large amount of data. As a open source distributed system structure, Hadoop gives high-reliability distributed storage structure and high-speed mass data computing methods, is considered a effective way to resolve the bottleneck of mass data processing. In this paper, we build a hadoop platform to store and process a petabyte data, and the system performance is improved greatly.
