CAJ | 학술논문

在极限学习机( extreme learning machine,ELM)网络中,对可加型隐单元的激活函数通常选择的是Sigmoid函数。因此,首先提出一种新型修正线性函数的近似平滑函数Softplus来替代它。 Softplus激活函数因为更接近生物学的激活模型且具有一定的稀疏能力,可进一步优化网络性能。其次,为了使ELM算法训练的网络具有更好的分类性能,考虑了类内距和类间距的约束,提出了基于改进Fisher判别约束的ELM算法,从而使解析求得的输出权值更加利于分类,进一步改进了识别性能。最后,在手写数字库和人脸库上的实验证明了改进ELM算法的可行性和优越性。
재겁한학습궤( extreme learning machine,ELM)망락중,대가가형은단원적격활함수통상선택적시Sigmoid함수。인차,수선제출일충신형수정선성함수적근사평활함수Softplus래체대타。 Softplus격활함수인위경접근생물학적격활모형차구유일정적희소능력,가진일보우화망락성능。기차,위료사ELM산법훈련적망락구유경호적분류성능,고필료류내거화류간거적약속,제출료기우개진Fisher판별약속적ELM산법,종이사해석구득적수출권치경가리우분류,진일보개진료식별성능。최후,재수사수자고화인검고상적실험증명료개진ELM산법적가행성화우월성。
In the extreme learning machine ( ELM ) network, sigmoid activation function is usually chosen for additive hidden neurons. Therefore, this paper replaced this activation function with a smooth approximation called softplus function. Because of being closer to the biological activation model and having certain sparseness, softplus activation function can further optimize network performance. In order to have a better classification performance, the optimization model of ELM by the improved Fisher discriminative analysis was restricted, and animproved ELM algorithm was proposed. Thus the output weights can be obtained analytically and are more conducive for classification. Finally, the experiments on handwritten digit database and face database prove the feasibility and superiority of the improved ELM algorithm.