CAJ | 학술논문

针对海量流数据的在线处理需求，提出一种不同于传统 Map/Reduce 流数据处理的系统模型 Flexible workflow.该模型对 workflow 处理单元进行在线 Map/Reduce 并行化，实现了 SPATE 系统；同时为该系统定义一组关于作业的建立、管理和维护的通信规程，即拓扑管理协议.SPATE 系统解决了在线 Map/Reduce 流数据处理过程中要求实时性及可扩展性的问题.实验验证了拓扑管理协议的有效性，拓扑管理协议能有效管理 Flexible workflow 流数据处理模型.
침대해량류수거적재선처리수구，제출일충불동우전통 Map/Reduce 류수거처리적계통모형 Flexible workflow.해모형대 workflow 처리단원진행재선 Map/Reduce 병행화，실현료 SPATE 계통；동시위해계통정의일조관우작업적건립、관리화유호적통신규정，즉탁복관리협의.SPATE 계통해결료재선 Map/Reduce 류수거처리과정중요구실시성급가확전성적문제.실험험증료탁복관리협의적유효성，탁복관리협의능유효관리 Flexible workflow 류수거처리모형.
To meet the requirements for online processing massive stream data,the authors proposed a novel system model,Flexible workflow,which is different from the traditional Map/Reduce stream data processing.This model conducts the online Map/Reduce parallelization of the process unit of workflow and executes a system of SPATE.A set of topology management protocol was designed for dynamic online Map/Reduce stream data processing model. The protocol includes a group of communication rules about setting up,managing and maintaining jobs.The experimental results validate the topology management protocol is effective, and can manage the Flexible workflow processing model availably.