Parsing with the Shortest Derivation

Parsing with the Shortest Derivation (2000)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Rens Bod

Venue:	Proceedings COLING-2000
Citations:	39 - 15 self

BibTeX

@INPROCEEDINGS{Bod00parsingwith,
    author = {Rens Bod},
    title = {Parsing with the Shortest Derivation},
    booktitle = {Proceedings COLING-2000},
    year = {2000}
}

OpenURL

Abstract

tens @ scs.lecd s.ac.uk Common wisdom has it that tile bias of stochastic grammars in favor of shorter deriwttions of a sentence is hamfful and should be redressed. We show that the common wisdom is wrong for stochastic grammars that use elementary trees instead o1 ' conlext-l'ree rules, such as Stochastic Tree-Substitution Grammars used by Data-Oriented Parsing models. For such grammars a non-probabilistic metric based on tile shortest derivation outperforms a probabilistic metric on the ATIS and OVIS corpora, while it obtains competitive results on the Wall Street Journal (WSJ) corpus. This paper also contains the first publislmd experiments with DOP on the WSJ. 1.

Keyphrases

shortest derivation stochastic grammar tile bias first publislmd experiment stochastic tree-substitution grammar ree rule elementary tree wall street journal ovis corpus uk common wisdom common wisdom competitive result data-oriented parsing model