International Journal of Computational Intelligence 4;1 2008 An Improved Conjugate Gradient Based Learning Algorithm for Back Propagation Neural Networks
BibTeX
@MISC{Nawi_internationaljournal,
author = {N. M. Nawi and R. S. Ransing and M. R. Ransing},
title = {International Journal of Computational Intelligence 4;1 2008 An Improved Conjugate Gradient Based Learning Algorithm for Back Propagation Neural Networks},
year = {}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
Abstract—The conjugate gradient optimization algorithm is combined with the modified back propagation algorithm to yield a computationally efficient algorithm for training multilayer perceptron (MLP) networks (CGFR/AG). The computational efficiency is enhanced by adaptively modifying initial search direction as described in the following steps: (1) Modification on standard back propagation algorithm by introducing a gain variation term in the activation function, (2) Calculation of the gradient descent of error with respect to the weights and gains values and (3) the determination of a new search direction by using information calculated in step (2). The performance of the proposed method is demonstrated by comparing accuracy and computation time with the conjugate gradient algorithm used in MATLAB neural network toolbox. The results show that the computational efficiency of the proposed method was better than the standard conjugate gradient algorithm. Keywords—Adaptive gain variation, back-propagation, activation function, conjugate gradient, search direction. G I.
