Abstract

Evolutionary Artificial Neural Networks (EANNs) can be considered as a combination of artificial neural networks (ANNs) and evolutionary search procedures, such as genetic algorithms (GAs). This paper distinguishes among three levels of evolution in EANNs, i.e., the evolution of connection weights, architectures, and learning rules. It first reviews each kind of evolution in detail and then analyses major issues related to each kind of evolution. It is shown in the paper that although there is a lot of work on the evolution of connection weights and architectures, research on the evolution of learning rules is still in its early stages. Interactions among different levels of evolution are far from being understood. It is argued in the paper that the evolution of learning rules and its interactions with other levels of evolution play a vital role in EANNs. Keywords --- Evolutionary Artificial Neural Networks, Learning, Evolution, Genetic Algorithms. X. Yao: Evolutionary Artificial Ne...

Citations

6071	Genetic Algorithms - Goldberg - 1989
2801	Optimization by Simulated Annealing - Kirkpatrick, Gelatt, et al. - 1983
2304	Learning Internal Representations by Error Propagation - Rumelhart, Hinton, et al. - 1986
1530	Introduction to the Theory of Neural Computation - Hertz, Krogh, et al. - 1991
982	Handbook of Genetic Algorithms - Davis, Mitchell - 1991
891	Modeling by shortest data description - Rissanen - 1978
590	The cascade-correlation learning architecture - Fahlman, Lebiere - 1990
538	Artificial Intelligence Through Simulated Evolution - Fogel, Owens, et al. - 1966
447	Adaptive switching circuits - Widrow, Ho€ - 1960
442	Numerical optimization of computer models - Schwefel - 1981
439	Beyond Regression: New Tools for Prediction and Analysis - Werbos
413	Parallel networks that learn to pronounce English text - Sejnowski, Rosenberg - 1987
375	Optimum brain damage - Cun, Denker, et al. - 1990
302	How learning can guide evolution - Hinton, Nowlan - 1987
290	Connectionist Learning Procedures - Hinton - 1990
283	Increased rates of convergence through learning rate adaptation - Jacobs
277	The GENITOR algorithm and selection pressure: why rank-based allocation of reproductive trials is best - Whitley - 1989
273	Designing neural networks using genetic algorithms with graph generation system - Kitano - 1990
235	Faster-learning variations on back-propagation: An empirical study - Fahlman - 1988
217	Evolving dynamic neural networks for adaptive behavior - Beer, Gallagher - 1992
214	A connectionist machine for genetic hillclimbing - Ackley - 1987
210	Neural Darwinism: The theory of neuronal group selection - Edelman - 1987
195	Interactions between learning and evolution - Ackley, Littman - 1992
192	S.U.Hegde. Designing neural networks using genetic algorithms - Miller
190	A survey of evolution strategies - Back, Schwefel - 1991
177	Training Feedforward Neural Networks Using Genetic Algorithms - Davis
171	Evolving networks: Using the genetic algorithm with connectionist learning - Belew, McInerney, et al. - 1990
168	The upstart algorithm: A method for constructing and training feedforward neural networks, Neural Comput - Frean - 1990
151	A time-delay neural network architecture for isolated word recognition - Lang, Waibel, et al. - 1990
124	Learning and evolution in neural networks - Nolfi, Elman, et al. - 1994
119	Combinations of Genetic Algorithms and Neural Networks: A Survey of the State of the Art - Whitley, Eshelman
115	Genetic algorithms and neural networks: optimizing connections and connectivity - Starkweather, Bogart - 1990
111	A technique for trimming the fat from a network via relevance assessment - Mozer, Smolensky, et al. - 1988
97	Equivalence class analysis of genetic algorithms - Radcliffe - 1991
83	An adaptive crossover distribution mechanism for genetic algorithms - Schaffer, Morishima - 1987
81	Towards the Genetic Synthesis of Neural Networks - Harp, Samad, et al. - 1989
81	Dynamic Parameter Encoding for genetic algorithms - Schraudolph, Belew - 1992
75	Back-propagation algorithm which varies the number of hidden units - HIROSE, YAMSHITA, et al. - 1991
75	The evolution of learning: An experiment in genetic connectionism - Chalmers - 1991
74	Glove-Talk: A Neural Network Interface Between a Data-Glove and a Speech Synthesizer - Fels, Hinton - 1993
73	Econets: Neural networks that learn in an environment. Network - Parisi, Cecconi, et al. - 1990
70	Genetic reinforcement learning for neurocontrol problems - Whitley, Dominic, et al. - 1993
68	Genetic generation of both the weights and architecture for a neural network - Koza, Rice - 1991
67	Optimizing Neural Networks using Faster, more Accurate Genetic Search - Whitley, Hanson - 1989
66	A New Interpretation of Schema Notation that Overturns the Binary Encoding Constraint - Antonisse - 1989
59	Progress in supervised neural networks - Hush, Horne - 1993
53	Evolving neural network controllers for unstable systems - Wieland - 1991
53	Evolution, learning and culture: computational metaphors for adaptive search - Belew - 1990
52	Simulation of genetic populations with biochemical properties - Rosenberg - 1967
51	Backpropagation learning for multilayer feed-forward neural networks using the conjugate gradient method - Johansson, Dowla, et al. - 1992