计算机科学与探索
計算機科學與探索
계산궤과학여탐색
JOURNAL OF FRONTIERS OF COMPUTER SCIENCE & TECHNOLOGY
2013年
3期
236-246
,共11页
数据库迁移%SQL Server%HBase%分布式数据库模式
數據庫遷移%SQL Server%HBase%分佈式數據庫模式
수거고천이%SQL Server%HBase%분포식수거고모식
database migration%SQL Server%HBase%distributed database pattern
当今互联网中的巨大信息量使得整个应用朝着数据海量化,用户访问高并行化的方向发展,这对在应用中承受巨大负荷的数据库层提出了更高的性能要求,应用分布式数据库HBase可以解决这一问题.以分布式数据库HBase为基础,提出了在存储海量数据的前提下如何将数据库从关系型数据库向HBase迁移的方法, 并依据所提出的四种表模式变换方法实现了半自动化迁移工具.以HouseDIY家居设计系统这个Web3D可视化电子商务类应用为例,阐述了该半自动化迁移工具的具体工作过程及细节,并证明了该迁移工具能够有效地把原有基于SQL Server数据库的Web应用简单、快速地移植到HBase数据库上.最后,该工具与Kettle进行了比较,证明了经该工具迁移后数据库在连接查询下的高效性.
噹今互聯網中的巨大信息量使得整箇應用朝著數據海量化,用戶訪問高併行化的方嚮髮展,這對在應用中承受巨大負荷的數據庫層提齣瞭更高的性能要求,應用分佈式數據庫HBase可以解決這一問題.以分佈式數據庫HBase為基礎,提齣瞭在存儲海量數據的前提下如何將數據庫從關繫型數據庫嚮HBase遷移的方法, 併依據所提齣的四種錶模式變換方法實現瞭半自動化遷移工具.以HouseDIY傢居設計繫統這箇Web3D可視化電子商務類應用為例,闡述瞭該半自動化遷移工具的具體工作過程及細節,併證明瞭該遷移工具能夠有效地把原有基于SQL Server數據庫的Web應用簡單、快速地移植到HBase數據庫上.最後,該工具與Kettle進行瞭比較,證明瞭經該工具遷移後數據庫在連接查詢下的高效性.
당금호련망중적거대신식량사득정개응용조착수거해양화,용호방문고병행화적방향발전,저대재응용중승수거대부하적수거고층제출료경고적성능요구,응용분포식수거고HBase가이해결저일문제.이분포식수거고HBase위기출,제출료재존저해량수거적전제하여하장수거고종관계형수거고향HBase천이적방법, 병의거소제출적사충표모식변환방법실현료반자동화천이공구.이HouseDIY가거설계계통저개Web3D가시화전자상무류응용위례,천술료해반자동화천이공구적구체공작과정급세절,병증명료해천이공구능구유효지파원유기우SQL Server수거고적Web응용간단、쾌속지이식도HBase수거고상.최후,해공구여Kettle진행료비교,증명료경해공구천이후수거고재련접사순하적고효성.
Nowadays, the large amount of information generated in Internet makes the entire applications become larger in the scale of data and have higher visit capacity. And it requires better performance in the database layer of an application which bears enormous loads, while the distributed database HBase can solve this problem. Based on HBase which is a very popular distributed database, this paper proposes the methods to design a tool to migrate database which is on the huge amounts of data from the relational database to HBase, and realizes this semi-automated migration tool according to the four ways of converting table patterns mentioned here. Then this paper chooses the HouseDIY which is a typical E-commerce Web application as an example, shows how this tool works in detail, and demonstrates that this tool can do migration from the original SQL Server database of an application to HBase easily and quickly. Finally, this paper compares the tool with Kettle and explains that the tool has high performance in joins query.