Abstract

Hidden Markov Models (HMMs) are statistical models of sequential data that have been used successfully in many machine learning applications, especially for speech recognition. Furthermore, in the last few years, many new and promising probabilistic models related to HMMs have been proposed. We first summarize the basics of HMMs, and then review several recent related learning algorithms and extensions of HMMs, including in particular hybrids of HMMs with artificial neural networks, Input-Output HMMs (which are conditional HMMs using neural networks to compute probabilities), weighted transducers, variable-length Markov models and Markov switching state-space models. Finally, we discuss some of the challenges of future research in this very active area. 1 Introduction Hidden Markov Models (HMMs) are statistical models of sequential data that have been used successfully in many applications in artificial intelligence, pattern recognition, speech recognition, and modeling of biological ...

Citations

6232	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird, et al. - 1977
5666	Probabilistic reasoning in intelligent systems - Pearl - 1988
3116	A tutorial on hidden Markov models and selected applications in speech recognition - Rabiner - 1989
2304	Learning Internal Representations by Error Propagation - Rumelhart, Hinton, et al. - 1986
1515	A Theory of the Learnable - Valiant - 1984
874	Error bounds for convolutional codes and an asymptotically optimum decoding algorithm - Viterbi - 1967
710	A tutorial on learning with Bayesian networks - Heckerman - 1995
666	An introduction to hidden Markov models - Rabiner, Juang - 1986
653	A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle - Hamilton - 1989
612	Statistical Methods for Speech Recognition - Jelinek - 1997
573	A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains - Baum, Petrie, et al. - 1970
515	Vector quantization - Gray - 1984
487	Gradient-based learning applied to document recognition - LeCun, Bottou, et al. - 1998
436	Hidden Markov models in computational biology. Applications to protein modeling - Krogh, Brown, et al. - 1994
422	An Inequality and Associated Maximization Technique in Statistical Estimation of a Markov Process - Baum - 1972
375	Factorial hidden markov models - Ghahramani, Jordan - 1997
368	Connectionist Speech Recognition: A Hybrid Approach - Bourlard, Morgan - 1993
308	Theory and Practice of Recursive Identification - Ljung, Söderström - 1983
287	Dynamic programming algorithm optimization for spoken word recognition - Sakoe, Chiba - 1978
285	The Optimal Control of Partially Observable Markov Processes - Sondik - 1971
260	Finite-state transducers in language and speech processing - Mohri - 1997
240	On Gibbs Sampling for State Space Models - Carter, Kohn - 1994
227	Hidden Markov Models for Speech Recognition - Huang, Ariki, et al. - 1990
213	Operations for learning with graphical models - Buntine - 1994
190	The wake-sleep algorithm for unsupervised neural networks - Hinton, Dayan, et al. - 1995
179	The EM algorithm for graphical association models with missing data - Lauritzen - 1995
177	Bayesian analysis in expert systems - Spiegelhalter, Dawid, et al. - 1993
176	Automatic Speech Recognition: The Development of the SPHINX System - Lee - 1989
173	Reinforcement learning with perceptual aliasing: The perceptual distinctions approach - Chrisman - 1992
166	Statistical Field Theory - Parisi - 1988
165	The Helmholtz machine - Dayan, Hinton, et al. - 1995
160	An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition - Levinson, Rabiner, et al. - 1983
160	An Approach to Time Series Smoothing and Forecasting Using the EM - Shumway, Stoffer - 1982
160	Connectionist learning of belief networks - Neal - 1992
154	Probabilistic independence networks for hidden markov probability models - Smyth - 1997
152	Continuous speech recognition by statistical methods - Jelinek - 1976
148	The power of amnesia: learning probabilistic automata with variable memory length - Ron, Singer, et al. - 1996
142	Discriminative Learning for Minimum Error Classification - Juang, Katagiri - 1992
141	Analysis of Time Series Subject to Changes in Regime - Hamilton - 1990
139	Dynamic Linear Models with Markov-Switching - Kim - 1994
139	Estimation and Tracking - Bar-Shalom, Li - 1998
132	Problem-Solving Methods in Artificial Intelligence - Nilsson, Machines, et al. - 1971
128	Hidden Markov models of biological primary sequence information - Baldi, Chauvin, et al. - 1994
124	Hidden Markov Model Induction by Bayesian Model Merging - Stolcke, Omohundro - 1993
113	Parameter Estimation for Linear Dynamical Systems - Ghahramani, Hinton - 1996
113	Clustering sequences with hidden markov models - Smyth - 1997
112	Autoregressive Conditional Heteroskedasticity and Changes in Regime - Hamilton, Susmel - 1994
103	Speech Recognition by Composition of Weighted Finite Automata - Pereira, Riley - 1997
102	Mean field theory for sigmoid belief networks - Zemel, Saul, et al. - 1996
97	An Input Output HMM Architecture - Bengio, Frasconi - 1995