CAJ | 학술논문

在机器学习领域,核方法是解决非线性模式识别问题的一种有效手段.目前,用多核学习方法代替传统的单核学习已经成为一个新的研究热点,它在处理异构、不规则和分布不平坦的样本数据情况下,表现出了更好的灵活性、可解释性以及更优异的泛化性能.结合有监督学习中的多核学习方法,提出了基于Lp范数约束的多核半监督支持向量机(semi-supervised support vector machine,简称S3VM)的优化模型.该模型的待优化参数包括高维空间的决策函数fm和核组合权系数θm.同时,该模型继承了单核半监督支持向量机的非凸非平滑特性.采用双层优化过程来优化这两组参数,并采用改进的拟牛顿法和基于成对标签交换的局部搜索算法分别解决模型关于 fm的非平滑及非凸问题,以得到模型近似最优解.在多核框架中同时加入基本核和流形核,以充分利用数据的几何性质.实验结果验证了算法的有效性及较好的泛化性能.
재궤기학습영역,핵방법시해결비선성모식식별문제적일충유효수단.목전,용다핵학습방법대체전통적단핵학습이경성위일개신적연구열점,타재처리이구、불규칙화분포불평탄적양본수거정황하,표현출료경호적령활성、가해석성이급경우이적범화성능.결합유감독학습중적다핵학습방법,제출료기우Lp범수약속적다핵반감독지지향량궤(semi-supervised support vector machine,간칭S3VM)적우화모형.해모형적대우화삼수포괄고유공간적결책함수fm화핵조합권계수θm.동시,해모형계승료단핵반감독지지향량궤적비철비평활특성.채용쌍층우화과정래우화저량조삼수,병채용개진적의우돈법화기우성대표첨교환적국부수색산법분별해결모형관우 fm적비평활급비철문제,이득도모형근사최우해.재다핵광가중동시가입기본핵화류형핵,이충분이용수거적궤하성질.실험결과험증료산법적유효성급교호적범화성능.
Kernel method is an effective approach to solve the nonlinear pattern recognition problems in the field of machine learning. At present, multiple kernel method has become a new research focus. Compared with the traditional single kernel method, multiple kernel method is more flexible, more interpretable and has better generalization performance when dealing with heterogeneous, irregular and non-flat distribution samples. A multi-kernel S3VM optimization model based on Lp norm constraint is presented in this paper in accordance with kernel method of supervised learning. Such model has two sets of parameters including decision functions fm in reproducing kernel Hilbert space and weighted kernel combination coefficients, and inherits the non-smooth and non-convex properties from single-kernel based S3VM. A two-layer optimization procedure is adopted to optimize these two groups of parameters, and an improved Quasi-Newton method named subBFGS as well as a local search algorithm based on label switching in pair are used to solve non-smooth and non-convex problems respectively with respect to fm. Base kernels and manifold kernels are added into the multi-kernel framework to exploit the geometric properties of the data. Experimental results show that the proposed algorithm is effective and has excellent generation performance.