计算机应用研究
計算機應用研究
계산궤응용연구
APPLICATION RESEARCH OF COMPUTERS
2015年
2期
403-408
,共6页
混沌时间序列%多分支递归神经网络%BPTT学习算法
混沌時間序列%多分支遞歸神經網絡%BPTT學習算法
혼돈시간서렬%다분지체귀신경망락%BPTT학습산법
chaotic time series%recurrent neural network with multiple branches%BPTT study algorithm
针对传统递归神经网络中出现的网络结构与计算复杂性,提出了使用多分支递归神经网络学习算法,并将其应用到混沌时间序列预测领域。首先缩减了部分冗余的分支,只保留了节点与自身之间以及节点与代表以后时刻的节点之间的分支;然后使用规则导数代替惯用的一般偏导数,有助于同时反映权值对目标函数的直接影响和间接影响;最后使学习率根据学习情况进行动态调整,有助于加快学习算法的收敛速度。仿真实验表明,当参数的选取合理时,多分支递归神经网络能够达到较高的性能。
針對傳統遞歸神經網絡中齣現的網絡結構與計算複雜性,提齣瞭使用多分支遞歸神經網絡學習算法,併將其應用到混沌時間序列預測領域。首先縮減瞭部分冗餘的分支,隻保留瞭節點與自身之間以及節點與代錶以後時刻的節點之間的分支;然後使用規則導數代替慣用的一般偏導數,有助于同時反映權值對目標函數的直接影響和間接影響;最後使學習率根據學習情況進行動態調整,有助于加快學習算法的收斂速度。倣真實驗錶明,噹參數的選取閤理時,多分支遞歸神經網絡能夠達到較高的性能。
침대전통체귀신경망락중출현적망락결구여계산복잡성,제출료사용다분지체귀신경망락학습산법,병장기응용도혼돈시간서렬예측영역。수선축감료부분용여적분지,지보류료절점여자신지간이급절점여대표이후시각적절점지간적분지;연후사용규칙도수대체관용적일반편도수,유조우동시반영권치대목표함수적직접영향화간접영향;최후사학습솔근거학습정황진행동태조정,유조우가쾌학습산법적수렴속도。방진실험표명,당삼수적선취합리시,다분지체귀신경망락능구체도교고적성능。
In view of the network structure and the computational complexity of the traditional recurrent neural network,this paper proposed the use of multi branch of recurrent neural network learning algorithm,and its application to the prediction of chaotic time series field.First it cut the branch part of redundant,branch only retained between node and node and between itself and the later time points.Secondly,it replaced general partial derivative by using the rules of derivative,helped to re-flect both the direct effects of weight on the objective function and the indirect influence.Finally it made the learning rate ac-cording to the study of dynamic adjustment,helped to speed up the convergence of learning algorithm.Simulation results show that,when the reasonable selection of parameters,the performance of multi branch recursive neural network can achieve higher.