计算机系统应用
計算機繫統應用
계산궤계통응용
APPLICATIONS OF THE COMPUTER SYSTEMS
2014年
5期
37-42
,共6页
谌章义%毕伟%向万红%王国安%吴爱国
諶章義%畢偉%嚮萬紅%王國安%吳愛國
심장의%필위%향만홍%왕국안%오애국
Hadoop%Hive%海量数据%电费数据处理%财务管理系统
Hadoop%Hive%海量數據%電費數據處理%財務管理繫統
Hadoop%Hive%해량수거%전비수거처리%재무관리계통
hadoop%hive%massive data%electricity data process%financial management system
随着电费数据量的快速增长,某特大型集团公司财务管理信息系统传统的电费数据处理模式已经成为系统的性能瓶颈。 Hadoop是一个可实现大规模分布式计算的开源框架,具有高效、可靠、可伸缩的优点,被广泛应用于海量数据处理领域。本文在对电费业务和 Hadoop 进行分析和研究的基础上,提出了电费数据新的处理模型,建立了基于Hadoop和Hive的电费明细数据处理平台。实验证明该模型可以有效解决目前海量电费数据处理面临的性能瓶颈,提高电费数据处理的速度和效率,并且可以提供高性能的明细数据查询功能。
隨著電費數據量的快速增長,某特大型集糰公司財務管理信息繫統傳統的電費數據處理模式已經成為繫統的性能瓶頸。 Hadoop是一箇可實現大規模分佈式計算的開源框架,具有高效、可靠、可伸縮的優點,被廣汎應用于海量數據處理領域。本文在對電費業務和 Hadoop 進行分析和研究的基礎上,提齣瞭電費數據新的處理模型,建立瞭基于Hadoop和Hive的電費明細數據處理平檯。實驗證明該模型可以有效解決目前海量電費數據處理麵臨的性能瓶頸,提高電費數據處理的速度和效率,併且可以提供高性能的明細數據查詢功能。
수착전비수거량적쾌속증장,모특대형집단공사재무관리신식계통전통적전비수거처리모식이경성위계통적성능병경。 Hadoop시일개가실현대규모분포식계산적개원광가,구유고효、가고、가신축적우점,피엄범응용우해량수거처리영역。본문재대전비업무화 Hadoop 진행분석화연구적기출상,제출료전비수거신적처리모형,건립료기우Hadoop화Hive적전비명세수거처리평태。실험증명해모형가이유효해결목전해량전비수거처리면림적성능병경,제고전비수거처리적속도화효솔,병차가이제공고성능적명세수거사순공능。
The traditional electricity data processing methods of a corporation’s financial management information system have difficulty as the amount of electricity data is growing rapidly. Hadoop is a large-scale distributed computing framework that has the advantages of high efficient, reliable and scalable. Hadoop is widely used in the massive data processing field. Based on the analysis and research of electricity process and Hadoop, this paper proposed a novel electricity process model which includes a distributed computing platform based on Hadoop and Hive. The experimental results show the platform can effectively solve the performance bottleneck that the electricity processing service is facing and improve the speed and efficiency of electricity process. In addition, the new model can provide high-performance electricity detailed query functions.