## Constructive Algorithms for Structure Learning in Feedforward Neural Networks for Regression Problems (1997)

Venue: | IEEE Transactions on Neural Networks |

Citations: | 66 - 2 self |

### BibTeX

@ARTICLE{Kwok97constructivealgorithms,

author = {Tin-yau Kwok and Dit-Yan Yeung},

title = {Constructive Algorithms for Structure Learning in Feedforward Neural Networks for Regression Problems},

journal = {IEEE Transactions on Neural Networks},

year = {1997},

volume = {8},

pages = {630--645}

}

### Years of Citing Articles

### OpenURL

### Abstract

In this survey paper, we review the constructive algorithms for structure learning in feedforward neural networks for regression problems. The basic idea is to start with a small network, then add hidden units and weights incrementally until a satisfactory solution is found. By formulating the whole problem as a state space search, we first describe the general issues in constructive algorithms, with special emphasis on the search strategy. A taxonomy, based on the differences in the state transition mapping, the training algorithm and the network architecture, is then presented. Keywords--- Constructive algorithm, structure learning, state space search, dynamic node creation, projection pursuit regression, cascade-correlation, resource-allocating network, group method of data handling. I. Introduction A. Problems with Fixed Size Networks I N recent years, many neural network models have been proposed for pattern classification, function approximation and regression problems. Among...