Abstract

this paper. Let us place it within the neural network perspective, and particularly that of learning. The area of neural networks has greatly benefited from its unique position at the crossroads of several diverse scientific and engineering disciplines including statistics and probability theory, physics, biology, control and signal processing, information theory, complexity theory, and psychology (see [45]). Neural networks have provided a fertile soil for the infusion (and occasionally confusion) of ideas, as well as a meeting ground for comparing viewpoints, sharing tools, and renovating approaches. It is within the ill-defined boundaries of the field of neural networks that researchers in traditionally distant fields have come to the realization that they have been attacking fundamentally similar optimization problems.

Citations

6231	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird, et al. - 1977
3340	Pattern Classification and Scene Analysis - Duda, Hart - 1973
3011	Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images - Geman, Geman - 1984
2801	Optimization by Simulated Annealing - Kirkpatrick, Gelatt, et al. - 1983
2715	Neural networks: A comprehensive foundation (2nd ed.). Upper Saddle River - Haykin - 1999
1644	Equation of state calculation by fast computing machines - Metropolis, AN, et al. - 1953
1300	Vector Quantization and Signal Compression - Gersho, Gray - 1991
1255	Some methods for classification and analysis of multivariate observations - MacQueen - 1967
1131	A new look at the statistical model identification - Akaike - 1974
1117	Clustering Algorithms - Hartigan - 1975
1105	Information theory and reliable communication - Gallager - 1968
976	An algorithm for vector quantizer design - Linde, Buzo, et al. - 1980
665	Adaptive mixtures of local experts - Jacobs, Jordan, et al. - 1991
634	Hierarchical mixtures of experts and the EM algorithm - Jordan, Jacobs - 1994
573	A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains - Baum, Petrie, et al. - 1970
558	Least squares quantization in PCM - Lloyd - 1982
511	DM: Statistical Analysis of Finite Mixture Distributions Chichester - Titterington - 1985
448	Information theory and statistical mechanics - Jaynes - 1957
376	Mixture Models: Inference and Applications to Clustering - McLachlan, Basford - 1988
283	A mathematical theory of communication,” Bell Syst - Shannon - 1948
218	Stochastic complexity and modeling - Rissanen - 1986
217	K.: Neural-gas network for vector quantization and its application to time-series prediction - Martinetz, Schulten - 1993
216	A graduated assignment algorithm for graph matching - Gold, Rangarajan - 1996
192	A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact WellSeperated Clusters - Dunn
171	Pairwise data clustering by deterministic annealing - Hofmann, Buhmann - 1997
167	Quantizing for minimum distortion - Max - 1960
161	Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy - Shore, Johnson - 1980
152	Rate Distortion Theory - Berger - 1971
150	Willshaw D: An analogue approach to the traveling salesman problem using an elastic net method. Nature - Durbin - 1987
129	Computation of channel capacity and rate-distortion function - Blahut - 1972
129	Entropy-constrained vector quantization - Chou, Lookabaugh, et al. - 1989
126	Parallel and Deterministic Algorithms from MRF's: Surface Reconstruction - Geiger, Girosi - 1991
119	Neural networks and related methods for classification - Ripley - 1994
99	A study of vector quantization for noisy channels - Farvardin - 1990
91	Statistical Pattern Recognition with Neural Networks: BenchPopulation Based Incremental Learning marking Studies - Kohonen, Barna, et al. - 1988
77	Hedonic prices and the demand for clean air - Harrison, Rubinfield - 1978
74	Nonlinear gated experts for time-series - discovering regimes and avoiding overfitting - Weigend, Mangeas, et al. - 1995
72	A deterministic annealing approach to clustering - Rose, Gurewitz, et al. - 1990
61	Optimal partitioning for classification and regression trees - Chou - 1991
61	Regression modeling in back-propagation and projection pursuit learning - Hwang, Lay, et al. - 1994
60	A Clustering Technique for Summarizing Multivariate Data - Ball, Hall - 1967
59	On the performance and complexity of channeloptimized vector quantizers - Farvadin, Vaishampayan - 1991
59	On the training of radial basis function classifiers. Neural Networks - Musavi, Ahmed, et al. - 1992
52	Vector Quantization with Complexity Costs - Buhmann, Kühnel - 1993
52	Learning piecewise control strategies in a modular neural network architecture - Jacobs, Jordan - 1993
50	A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms - Bezdek - 1990
49	Optimum quantizer performance for a class of non-Gaussian memoryless sources - Farvardin, Modestino - 1984
46	A construction of vector quantizers for noisy channels - Kumazawa, Kasahara, et al. - 1984
44	Generalized deformable models, statistical physics and matching problems - Yuille - 1990
43	A.: An analysis of the elastic net approach to the traveling salesman problem. Neural Computation 1(3 - Durbin, Szeliski, et al. - 1989