CAJ | 학술논문

为了有效利用深度学习技术自动提取特征的能力，并解决当训练样本量减少或者迭代次数降低时识别性能急速下降的问题，提出了基于Fisher准则的深度学习算法。该方法在前馈传播时，采用卷积神经网络自动提取图像的结构信息等特征，同时利用卷积网络共享权值和池化、下采样等方法减少了权值个数，降低了模型复杂度；在反向传播权值调整时，采用了基于Fisher的约束准则。在权值的迭代调整时既考虑误差的最小化，又同时让样本保持类内距离小，类间距离大，从而使权值能更加快速地逼近有利于分类的最优值，当样本量不足或训练迭代次数不多时可有效地提高系统的识别率。大量的实验结果证明：该基于Fisher准则的混合深度学习算法在标签样本不足或者较少训练次数的情况下依然能达到较好的识别效果。
위료유효이용심도학습기술자동제취특정적능력，병해결당훈련양본량감소혹자질대차수강저시식별성능급속하강적문제，제출료기우Fisher준칙적심도학습산법。해방법재전궤전파시，채용권적신경망락자동제취도상적결구신식등특정，동시이용권적망락공향권치화지화、하채양등방법감소료권치개수，강저료모형복잡도；재반향전파권치조정시，채용료기우Fisher적약속준칙。재권치적질대조정시기고필오차적최소화，우동시양양본보지류내거리소，류간거리대，종이사권치능경가쾌속지핍근유리우분류적최우치，당양본량불족혹훈련질대차수불다시가유효지제고계통적식별솔。대량적실험결과증명：해기우Fisher준칙적혼합심도학습산법재표첨양본불족혹자교소훈련차수적정황하의연능체도교호적식별효과。
To effectively make use of deep learning technology automatic feature extraction ability, and solve the problem when the training sample size reduced or the iteration times reduced the recognition performance fell sharply, this paper proposed a deep learning algorithm based on Fisher criterion. In the feed forward spread, this method used convolution neural network to extract automatically image features such as structural information, and used convolution network of sharing weights and pooling, sub-sampling methods to reduce the weight number, and the method reduced the model complexity. When the back propagation adjusted the weights, it adopted the constraints based on Fisher criterion. At the same time, it kept the samples in small distance with-class and large distance between-class, so that the weights could be more close the optimal value for classification. It improved the recognition rate effectively when the sample size was insufficient or when it had few training iterations. A large number of experiments show that when the label samples are insufficient and the training iteration fewer, the hybrid deep learning algorithm based on Fisher criterion still achieves good recognition effect.