Abstract

tens @ scs.lecd s.ac.uk Common wisdom has it that tile bias of stochastic grammars in favor of shorter deriwttions of a sentence is hamfful and should be redressed. We show that the common wisdom is wrong for stochastic grammars that use elementary trees instead o1 ' conlext-l'ree rules, such as Stochastic Tree-Substitution Grammars used by Data-Oriented Parsing models. For such grammars a non-probabilistic metric based on tile shortest derivation outperforms a probabilistic metric on the ATIS and OVIS corpora, while it obtains competitive results on the Wall Street Journal (WSJ) corpus. This paper also contains the first publislmd experiments with DOP on the WSJ. 1.

Citations

5477	A mathematical theory of communication - Shannon - 1948
2007	Building a large annotated corpus of English: the Penn treebank - Marcus, Marcinkiewicz, et al. - 1993
917	Head-driven Statistical Models for Natural Language Parsing - Collins - 1999
786	A Maximum-Entropy-Inspired Parser - Charniak - 2000
490	Three generative, lexicalised models for statistical parsing - Collins - 1997
361	The estimation of stochastic context-free grammars using the inside-outside algorithm. Computer Speech and Language - Lari, Young - 1990
354	parsing with a context-free grammar and word statistics - Charniak
221	A procedure for quantitatively comparing the syntactic coverage of English grammars - Black, Abney, et al. - 1991
221	Treebank grammars - Charniak - 1996
188	Generalised probabilistic LR parsing of natural language (corpora) with unification-based grammars - Briscoe, Carroll - 1993
157	Learning to parse natural language with maximum entropy models - Ratnaparkhi - 1999
136	Beyond Grammar: An experience-based theory of language, CSLI - Bod - 1998
133	Coping with Ambiguity and Unknown Words through Probabilistic Models - Weischedel, Meteer, et al. - 1993
96	Computational complexity of probabilistic disambiguation: NP-completeness results for language and speech processing - Sima’an
76	Parsing inside-out - Goodman - 1998
68	Figures of merit for best-first probabilistic chart parsing - CARABALLO, CHARNIAK
57	A Probabilistic CorpusDriven Model for Lexical Functional Analysis - Bod, Kaplan - 1998
56	Pearl: A probabilistic chart parser - MAGERMAN, MARCUS - 1991
46	Using an Annotated Corpus as a Stochastic Grammar - Bod - 1993
45	Bilexical grammars and a cubic-time probabilistic parser - Eisner - 1997
40	Statistical Parsing of Messages - Chitrao, Grishman - 1990
35	A DOP model for semantic interpretation - Bonnema, Bod, et al. - 1997
33	An optimized algorithm for Data Oriented Parsing - Sima'an - 1995
25	A CorpusBased Approach to Semantic Interpretation - Berg, Bod, et al. - 1994
22	Automatic extraction of stochastic lexicalized tree grammars from treebanks - Neumann - 1998
18	Learning Stochastic Lexicalized Tree Grammars from HPSG", DFKI - Neumann, Flickinger - 1999
14	A Hybrid Architecture for Robust MT using LFG-DOP - Way - 1999
8	An Empirical Evaluation of LFG-DOP - Bod
5	A New Probability Model for Data-Oriented Parsing - Bonnema, Buying, et al. - 1999
5	Extending DOP1 with the Insertion Operation - Hoogweg
2	The DOP Estimation Method is Biased and Inconsistent", squib - Johnson - 1998
1	l)ata-Oriented Parsing (I)OP - Bod - 1992
1	Using an Annotated Corpus as a Stochastic Grammar", l'roceedings European ChcqJter q/" the ACL'93 - Bod - 1993
1	Two Questions about l)ata Oriented Parsing - Bod - 1996
1	Beyond Grammar: An EaT,erience-l~ased Theot3, of Language - Bod - 1998
1	An Empirical Evaluation of LI~G-I)OP - Bod
1	A Probal)ilistic Corpusl)rivcn Model lkw l,cxical Ftmctional Analysis", l't'oceedings COIJNf;-ACI,'9 - Bed - 1998
1	A New I'robalfilily Model for I)ata-()ricntcd Parsing", lb-oceedings o.f the Amsterdam Colloqttittm - Bonncma, Buying, et al. - 1999
1	Generalized I'robabilistic IA~. I'arsing of Natural l,anguage (Corpora) with Uni ficalion-I~ased Gramnlars - Briscoe, Carroll - 1993
1	Monte Carlo Sampling Ior Nl'-hard Maximization I'roblems in the l"ramework of Wc ghtcd Parsing", iu Natmcd l.altguag<! l)roce.ssing - 2000, l.eclure Not,:!.,; i,q Arttl/h:ial lnlelligence 1835 - Chappclicr, l, et al. - 2000
1	Statistical Parsing wilh a Contcxl-l:rcc Grammar and Word Statistics", l'roceedinw AAAI-97. Menlo Park. Ca - Charniak - 1997
1	Three generalive lexicaliscd models tbr statistical parsing", l'roceedittgs EACI/ACL'97 - Collins - 1997
1	llead-l)riven Statistical Models./br Natural I,anguagc I'arsing - Collins - 1999
1	Bilexical Granlnlars and a Cubic-Time Probabilistic Parser - Eisner - 1997
1	Palwing lnsMe-Out, Ph.l). thesis, l larwu'd - Goodman - 1998
1	Extending DOPI with the Insertion Operation - loogweg - 2000
1	The I)OP Estimatkm Method is Biased and Inconsistent", squib - Johnson - 1998
1	The Estimation of Stochastic Context-Free Granunars Using the lnside-()utsidc Algorithm", ()mtl~ltlel",~'1~(3cc11 alld l,angttctge, d - ari, K, et al. - 1990
1	Pearl: A Probabilislic Chart Parser - Marcus - 1991
1	lhtikling a l'u-e - Marcus, Santorini, et al. - 1993