CAJ | 학술논문

面向大规模的数据进行知识约简是近年来粗糙集理论研究的热点。传统不完备信息系统的知识约简是假设在初始时将所有需要处理的数据一次性地装入内存中，这明显不适合处理海量数据，更不适合处理含有缺失信息的海量数据。为此，深入剖析了带有缺失信息的数据特征，把缺失属性的值用该属性所有可能的取值表示，并结合知识约简算法中的可并行性，从属性(集)的可辨识性和不可辨识性出发，并在MapReduce框架下设计了可用来处理不完备信息系统的知识约简算法。实验结果表明，该算法是有效可行的，能够对不完备信息系统中的海量数据进行知识约简。
면향대규모적수거진행지식약간시근년래조조집이론연구적열점。전통불완비신식계통적지식약간시가설재초시시장소유수요처리적수거일차성지장입내존중，저명현불괄합처리해량수거，경불괄합처리함유결실신식적해량수거。위차，심입부석료대유결실신식적수거특정，파결실속성적치용해속성소유가능적취치표시，병결합지식약간산법중적가병행성，종속성(집)적가변식성화불가변식성출발，병재MapReduce광가하설계료가용래처리불완비신식계통적지식약간산법。실험결과표명，해산법시유효가행적，능구대불완비신식계통중적해량수거진행지식약간。
Knowledge reduction for massive datasets has attracted many research interests in rough set theory. Traditional knowledge re-duction algorithms of incomplete information system assume that all the datasets can be loaded into the main memory,which are obvious-ly infeasible for large-scale datasets,especially for massive datasets with missing information. To this end,deeply analyze the characteris-tics of massive datasets with missing information,and allow the missing attribute value to take all possible values. Then,by combining the parallel computations used in classical knowledge reduction algorithms with the discernibility ( indiscernibility) of the attributes,a knowl-edge reduction algorithm is designed for incomplete information systems under MapReduce framework. The experimental results demon-strate that this algorithm is effective and feasible,which can efficiently process massive datasets for knowledge reduction in incomplete in-formation systems.