MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

A generalized CYK algorithm for parsing stochastic CFG (1998) [36 citations — 10 self]

by J.-C. Chappelier ,  M. Rajman ,  Ch- Lausanne
Add To MetaCart

Abstract:

We present a bottom-up parsing algorithm for stochastic context-free grammars that is able (1) to deal with multiple interpretations of sentences containing compound words; (2) to extract N-most probable parses in O(n 3 ) and compute at the same time all possible parses of any portion of the input sequence with their probabilities; (3) to deal with #out of vocabulary# words. Explicitly extracting all the parse trees associated to a given input sentence depends on the complexity of the grammar, but even in the case where this number is exponential in n, the chart used by the algorithm for the representation is of O(n 2 ) space complexity. 1 Introduction This article presents CYK+, a bottom-up parsing algorithm for stochastic context-free grammars that is able: 1. to deal multiple interpretations of sentences containing compound words; 2. to extract N-most probable parses in O(n 3 ) and compute at the same time all possible parses of any portion of the input sequence with their p...

Citations

449 Statistical Language Learning – Charniak - 1997
258 The estimation of stochastic context-free grammars using the Inside-Outside Algorithm – Lari, Young - 1990
207 Stochastic inversion transduction grammars and bilingual parsing of parallel corpora – Wu - 1997
192 Trainable grammars for speech recognition – Baker - 1979
134 An Efficient Probabilistic Context-Free Parsing Algorithm that – Stolcke - 1995
98 Basic methods of probabilistic context free grammars – Jelinek, Lafferty, et al. - 1992
79 Applying probability measures to abstract languages – Booth, Thompson - 1973
71 An improved context-free recognizer – Graham, Harrison, et al. - 1980
18 A trellis-based algorithm for estimating the parameters of a hidden stochastic contextfree grammar – Kupiec - 1991
14 Parsing of Context-Free languages – Sikkel, Nijholt - 1997
7 Probabilistic Grammars for Natural Languages", Synthese 22 – Suppes - 1970
5 Bottom-up Earley deduction – Erbach - 1994
2 A new, bottom-up, general parsing algorithm – Voisin, Raoult - 1990
1 The linguist's guide to statistics. available at http://www.coli.uni-sb.de/- ~christer/stat cl.ps – Krenn, Samuelsson - 1997