Abstract

This paper addresses the problem of how to identify the intended meaning of individual words in unrestricted texts, without necessarily having access to complete representations of sentences. To discriminate senses, an understander can consider a diversity of information, including syntactic tags, word frequencies, collocations, semantic context, role-related expectations, and syntactic restrictions. However, current approaches make use of only small subsets of this information. Here we will describe how to use the whole range of information. Our discussion will include how the preference cues relate to general lexical and conceptual knowledge and to more specialized knowledge of collocations and contexts. We will describe a method of combining cues on the basis of their individual specificity, rather than a fixed ranking among cue-types. We will also discuss an application of the approach in a system that computes sense tags for arbitrary texts, even when it is unable to determine a single syntactic or semantic representation for some sentences.

Citations

649	A stochastic parts program and noun phrase parser for unrestricted text - Church - 1988
627	Word association norms, mutual information, and lexicography - Church, Hanks - 1990
164	Seven principles of surface structure parsing in natural language - Kimball - 1973
156	Interaction with context during human sentence processing - Altmann, Steedman - 1988
153	Semantic interpretation and the resolution of ambiguity - Hirst - 1987
147	On not being led up the garden path: the use of context by the psychological parser - Crain, Steedman - 1985
94	The computational analysis of English. A corpus-based approach - Garside, Leech, et al. - 1987
86	A Competence-Based Theory of Syntactic Closure - Ford, Bresnan, et al. - 1982
72	Parsing a natural language using mutual information statistics - Magerman, Marcus - 1990
71	The Interaction of Syntax and Semantics During Sentence Processing: Eye Movement in the Analysis of Semantically Biased Sentences. Journal of Verbal Learning and Verbal Behavior 22:358–374 - Rayner, Carlson, et al. - 1983
63	Parsing the LOB corpus - Marcken - 1990
59	Automatically extracting and representing collocations for language generation - Smadja, McKeown - 1990
46	Information extraction and text summarization using linguistic knowledge acquisition - Rau, Jacobs, et al. - 1989
45	Passing Markers: A Theory of Contextual Influence - Charniak - 1983
43	Parsing strategies and constraints on transformations - Fodor - 1978
41	Lexical cohesion, the thesaurus, and the structure of text - Morris, Hirst - 1991
39	Empirical study of predictive powers of simple attachment schemes for post-modifier prepositional phrases - Whittemore, Ferrara, et al. - 1990
38	Sentence disambiguation by shift-reduce parsing technique - Shieber - 1983
25	Are there Preference Trade-offs in Attachment Decisions - Schubert - 1986
21	Syntax, preference and right attachment - Wilks, Huang, et al. - 1985
20	Knowledge representation for commonsense reasoning with text - Dahlgren, McDowell, et al. - 1989
19	Building a large thesaurus for information retrieval - Fox, Nutter, et al. - 1988
19	Taking on semantic commitments: Processing multiple meanings vs. multiple senses - Frazier, Rayner - 1990
18	Extracting company names from text - Rau - 1991
17	Disambiguating and interpreting verb definitions - Ravin - 1990
16	Parsing with flexibility, dynamic strategies, and idioms in mind - Stock - 1989
12	Is the human sentence parsing mechanism an ATN - Fodor, Frazier - 1980
9	Lexical Acquisition and Information Retrieval - Krovetz - 1991
7	Integrating marker-passing and problem solving - Hendler - 1990
6	A knowledge framework for natural language analysis - Jacobs - 1987
6	Implications of lexical ambiguity resolution for word recognition and comprehension - Simpson, Burgess - 1989
5	Encoding and acquiring meanings for figurative phrases - Dyer, Zernik - 1986
4	TRUMP: A transportable language understanding program - Jacobs - 1989
3	Memory capacity and sentence processing - Gibson - 1990
3	Language analysis in not-so-limited domains - Jacobs - 1986
2	Automatic Sense Disambiguation with ldoce: Enriching Syntactically Analyzed Corpora with Semantic Data - Janssen - 1990
2	Race-based syntactic attachment - McRoy, Hirst - 1990
1	Verbs with Prepositions and Particles. Volume 1 of Oxford Dictionary of Current Susan W. McRoy Using Multiple Knowledge Sources Idiomatic English - Cowie, Mackin - 1975
1	Clause and Sentence Idioms. Volume 2 of Oxford Dictionary of Current Idiomatic English - Cowie, Mackin, et al. - 1983
1	Studies in syntactic ambiguity resolution." Doctoral dissertation - Kurtzman - 1984
1	Computational Linguistics Volume 18, Number 1 "Lexical cohesion computed by thesaural relations as an indicator of the structure of text - Morris, Hirst - 1991