Abstract

this paper. Let us place it within the neural network perspective, and particularly that of learning. The area of neural networks has greatly benefited from its unique position at the crossroads of several diverse scientific and engineering disciplines including statistics and probability theory, physics, biology, control and signal processing, information theory, complexity theory, and psychology (see [45]). Neural networks have provided a fertile soil for the infusion (and occasionally confusion) of ideas, as well as a meeting ground for comparing viewpoints, sharing tools, and renovating approaches. It is within the ill-defined boundaries of the field of neural networks that researchers in traditionally distant fields have come to the realization that they have been attacking fundamentally similar optimization problems.

Citations

8033	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird, et al. - 1977
3908	Pattern Classification and Scene Analysis - Duda, Hart - 1973
3703	Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images - Geman, Geman - 1984
3573	Neural Networks: A Comprehensive Foundation - Haykin - 1994
3492	Optimization by simulated annealing - Kirkpatrick, Jr, et al. - 1983
2207	Equation of the State calculations by Fast Computing Machines - Metropolis, Roenbluth, et al. - 1953
1838	Some methods for classification and analysis of multivariate observations - MacQueen - 1967
1812	A new look at the statistical model identification - Akaike - 1974
1639	Vector Quantization and Signal Compression - Gray - 1992
1483	A.: Clustering Algorithms - Hartigan - 1975
1476	Information Theory and Reliable Communication - Gallager - 1971
1209	An algorithm for vector quantizer design - Lmde, Buzo, et al. - 1980
837	Least squares quantization in PCM - Lloyd - 1982
769	Adaptive mixtures of local experts - Jacobs, Jordan, et al. - 1991
765	A maximization technique occurring in the statistical analysis of probabilistic functions of markov chains - Baum, Petrie, et al. - 1970
723	Hierarchical mixture of experts and the em algorithm - Jordan, Jacobs - 1994
660	Information theory and statistical mechanics - Jaynes - 1963
621	Statistical analysis of finite mixture distributions - Titterington, Smith, et al. - 1985
464	Mixture models: inference and applications to clustering - McLachlan, Basford - 1988
421	A mathematical theory of communication,” Bell Syst - Shannon - 1948
293	A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters - Dunn - 1973
282	A graduated assignment algorithm for graph matching - Gold, Rangarajan - 1996
250	Neural-gas network for vector quantization and its application to time-series prediction - Martinetz, Schulten - 1993
248	Stochastic complexity and modeling - Rissanen - 1986
205	Quantizing for minimum distortion - Max - 1960
201	Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy - Shore, Johnson - 1980
196	Pairwise data clustering by deterministic annealing - Hofmann, Buhmann - 1997
190	Rate Distortion Theory - Berger - 1971
181	Computation of channel capacity and rate-distortion functions - Blahut - 1972
169	An Analogue Approach to the Traveling Salesman Problem using an Elastic Net Method", Nature 326 - Durbin, Willshaw - 1987
144	Parallel and Deterministic Algorithms from MFRs: Surface Reconstruction - Geiger, Girosi - 1991
140	R.: Entropy-constrained vector quantization - Chou, Lookbaugh, et al. - 1989
136	A Study of Vector Quantization for Noisy Channels - Farvardin - 1990
136	Neural networks and related methods for classification - Ripley - 1994
100	Statistical pattern recognition with neural network: Benchmarking studies - Kohonen, Barna, et al. - 1988
91	Hedonic prices and the demand for clean air - Harrison, Rubinfeld - 1978
91	A deterministic annealing approach to clustering - Rose, Gurewitz, et al. - 1990
87	A clustering technique for summarizing multivariate data - BALL, HALL - 1967
82	On the performance and complexity of channel-optimized vector quantizers - Farvardin, Vaishampayan - 1991
81	Nonlinear Gated Experts for Time Series: Discovering Regimes and Avoiding Overfitting - Weigend, Mangeas, et al. - 1995
69	A convergence theorem for the fuzzy isodata clustering algorithms - Bezdek - 1980
68	Optimal Partitioning for Classification and Regression Trees - Chou - 1991
65	Regression modeling in back-propagation and projection pursuit learning - Hwang, Lay, et al. - 1994
65	A construction of vector quantizers for noisy channels,” Electronics Eng - Kumazawa, Kasahara, et al. - 1984
65	On the training of radial basis function classifiers. Neural networks - Musavi, Ahmed, et al. - 1992
58	Modestino, “Optimum quantizer performance for a class of non-Gaussian memoryless sources - Farvardin, W - 1984
55	Learning piecewise control strategies in a modular neural network - Jacobs, Jordan - 1993
53	Vector quantization with complexity costs - Buhmann, Kühnel - 1993
51	An Analysis of the Elastic Net Approach to the Traveling Salesman Problem - Durbin, Szeliski, et al. - 1989
50	The design of joint source and channel trellis waveform coders - Ayanoglu, Gray - 1987