Minimum Classification Error Training In Exponential Language Models (2000)
| Citations: | 5 - 1 self |
BibTeX
@MISC{Paciorek00minimumclassification,
author = {Chris Paciorek and Roni Rosenfeld},
title = {Minimum Classification Error Training In Exponential Language Models},
year = {2000}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
Minimum Classification Error (MCE) training is difficult to apply to language modeling due to inherent scarcity of training data (N-best lists). However, a whole-sentence exponential language model is particularly suitable for MCE training, because it can use a relatively small number of powerful features to capture global sentential phenomena. We review the model, discuss feature induction, find features in both the Broadcast News and Switchboard domains, and build an MCE-trained model for the latter. Our experiments show that even models with relatively few features are prone to overfitting and are sensitive to initial parameter setting, leading us to examine alternative weight optimization criteria and search algorithms.
Citations
| 464 | Inducing Features of Random Fields - Pietra, Pietra, et al. - 1997 |
| 355 | Generalized Iterative Scaling for Log-Linear Models - Darroch, Ratcliff - 1972 |
| 102 | Minimum classification error rate methods for speech recognition - Juang, Hou, et al. - 1997 |
| 25 | A whole sentence maximum entropy language model - Rosenfeld - 1997 |
| 17 | Efficient Sampling and Feature Selection in Whole Sentence maximum Entropy Language Models - Chen, Rosenfeld - 1999 |
| 7 | Linguistic features for whole sentence maximum entropy language models - Zhu, Chen, et al. - 1999 |
| 7 | Exponential language models, logistic regression, and semantic coherence - Cai, Wasserman, et al. - 2000 |
| 5 | Interactive feature induction and logistic regression for whole sentence exponential language models - Rosenfeld, Wasserman, et al. - 1999 |
