Abstract

tens @ scs.lecd s.ac.uk Common wisdom has it that tile bias of stochastic grammars in favor of shorter deriwttions of a sentence is hamfful and should be redressed. We show that the common wisdom is wrong for stochastic grammars that use elementary trees instead o1 ' conlext-l'ree rules, such as Stochastic Tree-Substitution Grammars used by Data-Oriented Parsing models. For such grammars a non-probabilistic metric based on tile shortest derivation outperforms a probabilistic metric on the ATIS and OVIS corpora, while it obtains competitive results on the Wall Street Journal (WSJ) corpus. This paper also contains the first publislmd experiments with DOP on the WSJ. 1.

Citations

4403	A mathematical theory of communication - Shannon - 1948
1654	B.: Building a large annotated corpus of english: The Penn treebank - Marcus, Marcinkiewicz, et al. - 1993
780	Head-Driven Statistical Models for Natural Language Parsing - Collins - 1999
671	A Maximum-Entropy-Inspired Parser - Charniak - 2000
427	Three Generative, Lexicalised Models for Statistical Parsing - Collins - 1997
324	Statistical Parsing with a Context-Free Grammar and Word Statistics - Charniak - 1997
316	The estimation of stochastic context-free grammars using the inside-outside algorithm. Computer Speech and Language - Lari, Young - 1990
203	Tree-Bank Grammars - Charniak - 1996
184	A Procedure for Quantitatively Comparing the Syntactic Coverage of English Grammars - Black - 1991
178	Generalised probabilistic LR parsing of natural language (corpora) with unification-based grammars - Briscoe, Carroll - 1993
136	Learning to Parse Natural Language with Maximum Entropy Models’. Machine Learning 34:151–175 - Ratnaparkhi - 1999
129	Beyond Grammar: An Experience-Based Theory of Language. Center for the Study of Language and Inf - Bod - 1998
126	Coping with Ambiguity and Unknown Words through Probabilistic Models - Weischedel, Meteer, et al. - 1993
85	Computational complexity of probabilistic disambiguation - Sima’an - 2002
65	New figures of merit for best first probabilistic chart parsing - Caraballo, Charniak - 1997
65	Parsing Inside-Out - Goodman - 1998
56	A Probabilistic CorpusDriven Model for Lexical Functional Analysis - Bod, Kaplan - 1998
54	Pearl: A Probabilistic Chart Parser - Magerman, Marcus - 1991
43	Using an annotated corpus as a stochastic grammar - Bod - 1993
42	Bilexical Grammars and a CubicTime Probabilistic Parser - Eisner - 1997
40	Statistical Parsing of Messages - Chitrao, Grishman - 1992
31	A DOP Model for Semantic Interpretation - Bonnema, Bod, et al. - 1997
31	An optimized algorithm for Data Oriented Parsing - Sima’an - 1996
25	A Corpus-Based Approach to Semantic Interpretation - Berg, Bod, et al. - 1994
22	Automatic extraction of stochastic lexicalized tree grammars from treebanks - Neumann - 1998
18	Learning Stochastic Lexicalized Tree Grammars from HPSG", DFKI - Neumann, Flickinger - 1999
14	A hybrid architecture for robust MT using LFG-DOP - Way - 1999
8	An Empirical Evaluation of LFG-DOP - Bod - 2000
5	A New Probability Model for Data-Oriented Parsing - Bonnema, Buying, et al. - 1999
5	Extending DOP1 with the insertion operation - Hoogweg - 2000
1	l)ata-Oriented Parsing (I)OP - Bod - 1992
1	Using an Annotated Corpus as a Stochastic Grammar", l'roceedings European ChcqJter q/" the ACL'93 - Bod - 1993
1	Two Questions about l)ata Oriented Parsing - Bod - 1996
1	Beyond Grammar: An EaT,erience-l~ased Theot3, of Language - Bod - 1998
1	An Empirical Evaluation of LI~G-I)OP - Bod
1	A Probal)ilistic Corpusl)rivcn Model lkw l,cxical Ftmctional Analysis", l't'oceedings COIJNf;-ACI,'9 - Bed - 1998
1	A New I'robalfilily Model for I)ata-()ricntcd Parsing", lb-oceedings o.f the Amsterdam Colloqttittm - Bonncma, Buying, et al. - 1999
1	Generalized I'robabilistic IA~. I'arsing of Natural l,anguage (Corpora) with Uni ficalion-I~ased Gramnlars - Briscoe, Carroll - 1993
1	Monte Carlo Sampling Ior Nl'-hard Maximization I'roblems in the l"ramework of Wc ghtcd Parsing", iu Natmcd l.altguag<! l)roce.ssing - 2000, l.eclure Not,:!.,; i,q Arttl/h:ial lnlelligence 1835 - Chappclicr, l, et al. - 2000
1	Statistical Parsing wilh a Contcxl-l:rcc Grammar and Word Statistics", l'roceedinw AAAI-97. Menlo Park. Ca - Charniak - 1997
1	Three generalive lexicaliscd models tbr statistical parsing", l'roceedittgs EACI/ACL'97 - Collins - 1997
1	llead-l)riven Statistical Models./br Natural I,anguagc I'arsing - Collins - 1999
1	Bilexical Granlnlars and a Cubic-Time Probabilistic Parser - Eisner - 1997
1	Palwing lnsMe-Out, Ph.l). thesis, l larwu'd - Goodman - 1998
1	Extending DOPI with the Insertion Operation - loogweg - 2000
1	The I)OP Estimatkm Method is Biased and Inconsistent", squib - Johnson - 1998
1	The Estimation of Stochastic Context-Free Granunars Using the lnside-()utsidc Algorithm", ()mtl~ltlel",~'1~(3cc11 alld l,angttctge, d - ari, K, et al. - 1990
1	Pearl: A Probabilislic Chart Parser - Marcus - 1991
1	lhtikling a l'u-e - Marcus, Santorini, et al. - 1993
1	Automatic Extraction of Slochastic Imxicalizcd Tree C;r~.lllllllals flonl Treebanks - Nculnann - 1998