Journal of South China University of Technology (Natural Science Edition) ›› 2006, Vol. 34 ›› Issue (6): 49-54.

• Electronics, Communication & Automation Technology • Previous Articles     Next Articles

QLMBP：A Quick BP Neural Network Algorithm

Li Jiong-cheng  Huang Han-xiong   

  1. College of Industrial Equipment and Control Engineering,South China Univ.of Tech. ,Guangzhou 5 10640,Guangdong,China
  • Received:2005-05-13 Online:2006-06-25 Published:2006-06-25
  • Contact: 李炯城(1972-)，男，博士生，主要从事机械设计理论、人工神经网络和全局优化方面的研究 E-mail:majichli@scut.edu.cn
  • About author:李炯城(1972-)，男，博士生，主要从事机械设计理论、人工神经网络和全局优化方面的研究
  • Supported by:

    高校博士点专项科研基金(20015106002)；教育部高等学校优秀青年教师教学科研奖励计划

PDF

621

Abstract:

The improved version of BP(Back Propagation)algorithm with the fastest convergence speed,LMBP (Levenberg-Marquardt BP)algorithm,is investigated,finding out the bottlenecks of the convergence speed,that is,the initialization of iteration controlling parameters has a great influence on the iterated number.the calculation of the inverse matrix involved in each iteration is the most time-consuming ,and it will take long to carry out a certain interation if the sum of squared el'TOrs in each interation is not decreased.To solve these problems,LU(Lower-Upper)decomposition is employed to avoid the time-consuming calculation of inverse matrix.and the one-di-mension searching is adopted to accelerate the decrease of the object function.Thus,a quick BP neurM network al-gorithm named QLMBP(Quick LMBP)is proposed.The proposed QLMBP algorithm is independent on the itera tion controlling parameters and its convergence speed is about 100 times that of the LMBP algorithm convergence speed.

Key words: Palgorithm, Levenberg-Marquardt algorithm, LU(Lower-Upper)decomposition, Marquardt sensi-tivity matrix