CAJ | 학술논문

大型科学与工程计算需要实现空前复杂的数值模拟计算和处理空前庞大的数据,有必要设计一个容错环境,自动调度加载故障程序.基于并行作业和系统提供的checkpoint/restart功能,本文设计了一个用户级的并行作业容错自动调度环境,包括并行程序容错调度的自动感知、自动加载和数据完整性保证算法.测试结果表明,并行作业容错自动调度环境保证了checkpoint数据的完整性,并在应用程序出错退出以后,调度环境可以自动感知,自动提交运行作业,实现了并行作业无需用户干预的容错自动调度计算,避免了系统资源和计算时间的浪费.
대형과학여공정계산수요실현공전복잡적수치모의계산화처리공전방대적수거,유필요설계일개용착배경,자동조도가재고장정서.기우병행작업화계통제공적checkpoint/restart공능,본문설계료일개용호급적병행작업용착자동조도배경,포괄병행정서용착조도적자동감지、자동가재화수거완정성보증산법.측시결과표명,병행작업용착자동조도배경보증료checkpoint수거적완정성,병재응용정서출착퇴출이후,조도배경가이자동감지,자동제교운행작업,실현료병행작업무수용호간예적용착자동조도계산,피면료계통자원화계산시간적낭비.
Large-scale scientific and engineering computing needs to realize unprecedented complex numerical simulation and process huge data,and it is necessary to design a fault-tolerant environment for auto-reloading the failed parallel tasks. Based on parallel jobs and the system-provided checkpoint/restart function, we design a user-level,fault-tolerant environment for job auto-scheduling, including the auto-perception of fault-tolerant parallel program scheduing, auto-reloading, and data integrity ensuring. The experimental results demonstrate that the design of the fault-tolerant environment achieves the de-sign requirements of parallel program scheduling which requires auto-reloading the failed applications and ensures the cor-rectness and completeness of the checkpoint data.