Abstract

In this paper we describe an unsupervised learning algorithm for automatically training a rule-based part of speech tagger without using a manually tagged corpus. We compare this algorithm to the Baum-Welch algorithm, used for unsupervised training of stochastic taggers. Next, we show a method for combining unsupervised and supervised rule-based training algorithms to create a highly accurate tagger using only a small amount of manually tagged text.

Citations

1655	M: Building a Large Annotated Corpus of English: The Penn Tree Bank - Marcus, Santorini, et al. - 1993
649	A stochastic parts program and noun phrase parser for unrestricted text - Church - 1988
433	A simple rule-based part of speech tagger - Brill - 1992
422	An Inequality and Associated Maximization Technique in Statistical Estimation of a Markov Process - Baum - 1972
325	A Practical Part-of-Speech Tagger - Cutting, Kupiec, et al. - 1991
302	Self-Organized Language Modeling for Speech Recognition - Jelinek - 1990
259	Frequency analysis of English usage: Lexicon and grammar - Francis, Kucera - 1982
212	Tagging English text with probabilistic model - Merialdo - 1994
177	Robust part-of-speech tagging using hidden Markov model - Kupiec - 1992
148	Grammatical category disambiguation by statistical optimization - DeRose - 1988
132	Some Advances in Rulebased Part of Speech Tagging - Brill - 1994
126	Coping with Ambiguity and Unknown Words through Probabilistic Models - Weischedel, Meteer, et al. - 1993
125	A rule-based approach to prepositional phrase attachment disambiguation - Brill, Resnik - 1994
120	Automatic grammar induction and parsing free text: A transformationbased approach - Brill - 1993
86	Does Baum-Welch re-estimation help taggers - Elworthy - 1994
63	Parsing the LOB corpus - Marcken - 1990
61	Acquiring disambiguation rules from text - Hindle - 1989
33	A computational approach to grammatical coding of english words - Klein, Simmons - 1963
31	Transformation-Based Error-Driven Parsing - Brill - 1993
29	Decision tree models applied to the labeling of text with parts-of-speech - Black, Jelinek, et al. - 1992
20	Exploring the statistical derivation of transformation rule sequences for part-of-speech tagging - Ramshaw, Marcus - 1994
15	String Analysis of Language Structure - Harris - 1962
11	Equations for part of speech tagging - Charniak, Hendrickson, et al. - 1993
9	Generation of Pronunciations from Orthographies using Transformation-based Error-driven Learning - Huang, Son-Bell, et al. - 1994
6	Automatic Model Refinement - with an application to tagging - Lin, Chiang, et al. - 1994
4	Deterministic part of speech tagging with finite state transducers - Roche, Schabes - 1995
4	Part of speech tagging using a variable memory Markov model - Schutze, Singer - 1994
2	Deterministic part of speech tagging with nite state transducers - Roche, Schabes - 1995
1	Automatic model re nement with an application to tagging - Lin, Chiang, et al. - 1994
1	Part of speech tagging using avariable memory Markov model - Schutze, Singer - 1994
1	Automatic model refinement with an apphcation to tagging - Lin, Chiang, et al. - 1994