DMCA
Building a Large Annotated Corpus of English: The Penn Treebank (1993)
Cached
Download Links
| Venue: | COMPUTATIONAL LINGUISTICS |
| Citations: | 2740 - 10 self |
BibTeX
@ARTICLE{Marcus93buildinga,
author = {Mitchell P. Marcus and Beatrice Santorini and Mary Ann Marcinkiewicz},
title = {Building a Large Annotated Corpus of English: The Penn Treebank},
journal = {COMPUTATIONAL LINGUISTICS},
year = {1993},
volume = {19},
number = {2},
pages = {313--330}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
There is a growing consensus that significant, rapid progress can be made in both text understanding and spoken language understanding by investigating those phenomena that occur most centrally in naturally occurring unconstrained materials and by attempting to automatically extract information about language from very large corpora. Such corpora are beginning to serve as important research tools for investigators in natural language processing, speech recognition, and integrated spoken language systems, as well as in theoretical linguistics. Annotated corpora promise to be valuable for enterprises as diverse as the automatic construction of statistical models for the grammar of the written and the colloquial spoken language, the development of explicit formal theories of the differing grammars of writing and speech, the investigation of prosodic phenomena in speech, and the evaluation and comparison of the adequacy of parsing models. In this paper, we review our experience with constructing one such large annotated corpus--the Penn Treebank, a corpus 1 consisting of over 4.5 million words of American English. During the first three-year phase of the Penn Treebank Project (1989-1992), this corpus has been annotated for part-of-speech (POS) information. In addition, over half of it has been annotated for skeletal syntactic structure. These materials are available to members of the Linguistic Data Consortium; for details, see Section 5.1.
Keyphrases
penn treebank large annotated corpus speech recognition annotated corpus promise linguistic data consortium unconstrained material american english spoken language understanding colloquial spoken language natural language processing skeletal syntactic structure spoken language system first three-year phase automatic construction rapid progress large corpus prosodic phenomenon explicit formal theory statistical model important research tool text understanding penn treebank project theoretical linguistics
