Abstract

Information Retrieval (IR) is concerned with locating documents that are relevant for a user's information need or query from a large collection of documents. A fundamental problem for information retrieval is word mismatch. A query is usually a short and incomplete description of the underlying information need. The users of IR systems and the authors of the documents often use different words to refer to the same concepts. This thesis addresses the word mismatch problem through automatic text analysis. We investigate two text analysis techniques, corpus analysis and local context analysis, and apply them in two domains of word mismatch, stemming and general query expansion. Experimental results show that these techniques ca...

Citations

7321	Introduction to Algorithms - Cormen, Leiserson, et al. - 2001
5666	Probabilistic reasoning in intelligent systems - Pearl - 1988
2168	Indexing by latent semantic analysis - Deerwester, Dumais, et al. - 1990
1459	An algorithm for suffix stripping - Porter - 1980
787	Human Behavior and the Principle of Least-Effort - Zipf - 1949
728	Relevance feedback in information retrieval - Rocchio - 1971
627	Word association norms, mutual information, and lexicography - Church, Hanks - 1990
620	Automatic text processing - Salton - 1988
538	Improving retrieval performance by relevance feedback - Salton, Buckley - 1990
353	The vocabulary problem in human-system communication - Furnas, Landauer, et al. - 1987
331	Reexamining the cluster hypothesis: scatter/gather on retrieval results - Hearst, Pedersen - 1996
313	M.: Pivoted document length normalization - Singhal, Buckley, et al. - 1996
309	The INQUERY retrieval system - Callan, Croft, et al. - 1992
252	Query expansion using lexical-semantic relations - Voorhees - 1994
236	Viewing morphology as an inference process - Krovetz - 1993
212	Inference networks for document retrieval - Turtle - 1990
205	Mathematical Statistics and Data Analysis - Rice - 2001
196	The probability ranking principle in ir - Robertson - 1997
186	Overview of the Third Text REtrieval Conference (TREC-3 - Harman - 1995
184	Development of a stemming algorithm - Lovins - 1968
179	Passage-level evidence in document retrieval - Callan - 1994
151	Using probabilistic models of document retrieval without relevance information - Croft, Harper - 1979
149	Using Statistical Testing in the Evaluation of Retrieval Experiments - Hull - 1993
147	Concept based query expansion - Qiu, Frei - 1993
141	Representation and Learning in Information Retrieval - Lewis - 1992
138	Stemming algorithms: A case study for detailed evaluation - Hull - 1996
132	An association thesaurus for information retrieval - Jing, Croft - 1994
122	New retrieval approaches using smart: Trec 4 - Buckley, Amit - 1995
118	How effective is suffixing - Harman - 1991
110	M.E.: Computer evaluation of indexing and text processing - Salton, Lesk - 1968
107	Automatic keyword classification for information retrieval - Jones - 1971
102	Information extraction as a basis for high-precision text classification - Riloff, Lehnert - 1994
82	The limitations of term co- occurrence data for query expansion in document retrieval systems - Peat, Willett - 1991
77	Information retrieval using a singular value decomposition model of latent semantic structure - Furnas, Deerwester, et al. - 1988
71	Viewing Stemming as Recall Enhancement - Kraaij, Pohlmann - 1996
69	On the use of spreading activation methods in automatic information - Salton, Buckley - 1988
66	A cooccurrence-based thesaurus and two applications to information retrieval - Schütze, Pedersen - 1997
66	Towards an information logic - RIJSBERGEN - 1989
61	Local feedback in full-text retrieval systems - Attar, Fraenkel - 1977
60	Probabilistic Datalog - a logic for powerful retrieval methods - Fuhr - 1995
53	Word-word associations in document retrieval systems - Lesk - 1969
48	Recent experiments with INQUERY - Allan, Ballesteros, et al. - 1996
47	The Effectiveness of Stemming For Natural-Language Access to Slovene Textual Data - Popovic, Willett - 1992
46	Latent Semantic Indexing (LSI): TREC-3 report," in Overview of the Third Text REtrieval Conference - Dumais - 1994
41	Document retrieval and routing using the INQUERY System - Broglio, Callan, et al. - 1995
41	Experiments in automatic statistical thesaurus construction - Crouch, Yang - 1992
35	A relevance terminological logic for information retrieval - Meghini, Straccia - 1996
34	Special Issue, WordNet: An online lexical database - Miller - 1990
31	Similarity measures for short queries - Wilkinson, Zobel, et al. - 1995
31	On modeling of information retrieval concepts in vector spaces - Wong, Ziarko, et al. - 1987