电子科技大学学报
電子科技大學學報
전자과기대학학보
JOURNAL OF UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA
2014年
3期
457-463
,共7页
赵勇%李有福%李小龙%刘鹏%田文洪
趙勇%李有福%李小龍%劉鵬%田文洪
조용%리유복%리소룡%류붕%전문홍
计算平台%分布式集群%高性能计算%大规模并行计算%科学工作流
計算平檯%分佈式集群%高性能計算%大規模併行計算%科學工作流
계산평태%분포식집군%고성능계산%대규모병행계산%과학공작류
computing platform%distributed cluster%high performance computing%large scale parallel computing%scientific workflow
科学工作流为科学计算提供了工作流定义、流程管理和任务并行化等支持,高性能计算为大规模数据处理提供了集群管理、任务管理、资源调度等机制。如今正进入一个“大数据”时代,将科学工作流系统与高性能计算结合实现高性能计算平台上大规模并行计算具有重要意义。集成中间件与上层工作流系统和底层高性能计算平台进行交互,提供任务提交与状态监控功能。同时,集成方案为分布式集群中计算平台提供新的参考实现。基于上述分析以Swift科学工作流与Windows高性能计算平台集成方案为例,通过NASA MODIS图片处理工作流来分析并验证集成方案的可行性和性能。
科學工作流為科學計算提供瞭工作流定義、流程管理和任務併行化等支持,高性能計算為大規模數據處理提供瞭集群管理、任務管理、資源調度等機製。如今正進入一箇“大數據”時代,將科學工作流繫統與高性能計算結閤實現高性能計算平檯上大規模併行計算具有重要意義。集成中間件與上層工作流繫統和底層高性能計算平檯進行交互,提供任務提交與狀態鑑控功能。同時,集成方案為分佈式集群中計算平檯提供新的參攷實現。基于上述分析以Swift科學工作流與Windows高性能計算平檯集成方案為例,通過NASA MODIS圖片處理工作流來分析併驗證集成方案的可行性和性能。
과학공작류위과학계산제공료공작류정의、류정관리화임무병행화등지지,고성능계산위대규모수거처리제공료집군관리、임무관리、자원조도등궤제。여금정진입일개“대수거”시대,장과학공작류계통여고성능계산결합실현고성능계산평태상대규모병행계산구유중요의의。집성중간건여상층공작류계통화저층고성능계산평태진행교호,제공임무제교여상태감공공능。동시,집성방안위분포식집군중계산평태제공신적삼고실현。기우상술분석이Swift과학공작류여Windows고성능계산평태집성방안위례,통과NASA MODIS도편처리공작류래분석병험증집성방안적가행성화성능。
Scientific workflow provides scientific computing with workflow specification, workflow process management, task parallelism, etc. High performance computing provides mechanisms and development interfaces such as cluster management, task management, task scheduling, etc. to scientific computing. While we are entering into a“big data”era, it is necessary to integrate scientific workflow with high performance computing to implement the large scale parallel computing on high performance computing platform. The integration middleware interact with upper workflow systems and underlying HPC platform provides the support for task submission and status monitoring. The integration architecture will be a reference solution to the construction of computing platforms in distributed cluster environment. Taking Swift scientific workflow system and Windows HPC platform integration solution as references, a case study by using a NASA MODIS image processing workflow is presented to analyze and demonstrate the capability of the integrated system.