Abstract

We present a corpus{based approach to word{sense disambiguation that only requires information that can be automatically extracted from untagged text. We use unsupervised techniques to estimate the parameters of a model describing the conditional distribution of the sense group given the known contextual features. Both the EM algorithm and Gibbs Sampling are evaluated to determine which is most appropriate for our data. We compare their disambiguation accuracy in an experiment with thirteen di erent words and three feature sets. Gibbs Sampling results in small but consistent improvement in disambiguation accuracy over the EM algorithm.

Citations

6236	Maximum likelihood from incomplete data via EM algorithm - Dempster, Laird, et al. - 1977
3011	Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images - Geman, Geman - 1984
204	Integrating multiple knowledge sources to disambiguate word sense: An exemplar-based approach - Ng, Lee - 1996
200	A method for disambiguating word senses in a large corpus. Computers and the Humanities - Gale, Church, et al. - 1992
178	The EM algorithm for graphical association models with missing data - Lauritzen - 1995
177	Evaluating the accuracy of sampling-based approaches to calculating posterior moments - Geweke - 1992
124	Word-sense disambiguation using decomposable models - Bruce, Wiebe - 1994
99	Comparative experiments on disambiguating word senses: An illustration of the role of bias in machine learning - Mooney - 1996
65	Corpus-based statistical sense resolution - Leacock, Towell, et al. - 1993
59	R.: Distinguishing word senses in untagged text - Pedersen, Bruce - 1997
43	Exemplar-based word sense disambiguation: Some recent improvements - Ng - 1997
24	A new supervised learning algorithm for word sense disambiguation - Pedersen, Bruce - 1997
23	The measure of a model - Bruce, Wiebe, et al. - 1996
21	Discrimination decisions for 100,000 dimensional spaces - Gale, Church, et al. - 1995
5	The EM algorithm – an old folk–song sung to a new fast tune (with discussion - Meng, Dyk - 1997
4	Automatic word sense discrimination. Computational Linguistics, Vol 24 No 1 - Schütze - 1998
2	Comparative experiments on disambiguatingword senses: An illustration of the role of bias in machine learning - Mooney - 1996