Abstract

In this work, we discuss and evaluate solutions to text classification problems associated with the events that are reported in on-line sources of news. We present solutions to three related classification problems: new event detection, event clustering, and event tracking. The primary focus of this thesis is new event detection, where the goal is to identify news stories that have not previously been reported, in a stream of broadcast news comprising radio, television, and newswire. We present an algorithm for new event detection, and analyze the effects of incorporating domain properties into the classification algorithm. We explore a solution that models the temporal relationship between news stories, and investigate the use of proper noun phrase

Citations

1611	Computational geometry: An introduction - Preparata, Shamos - 1985
1459	An algorithm for suffix stripping - Porter - 1980
1216	Term-weighting approaches in automatic text retrieval - Salton, Buckley - 1988
936	Self-Organized Formation of Topologically Correct Feature Maps - Kohonen - 1982
728	Relevance feedback in information retrieval - Rocchio - 1971
650	The logic of scientific discovery - Popper - 1959
620	Automatic text processing - Salton - 1988
528	A study of cross-validation and bootstrap for accuracy estimation and model selection - Kohavi - 1995
510	Relevance weighting of search terms - Robertson, Jones - 1976
502	A statistical approach to machine translation - Brown, Cocke, et al. - 1990
413	An Evaluation of Statistical Approaches to Text Categorization - Yang - 1999
384	Query expansion using local and global document analysis - Xu, Croft - 1996
365	A sequential algorithm for training text classifiers - Lewis, Gale - 1994
331	Reexamining the cluster hypothesis: scatter/gather on retrieval results - Hearst, Pedersen - 1996
315	Empirical Methods for Artificial Intelligence - Cohen - 1995
296	Statistical Inference - Casella, Berger - 1990
236	Viewing morphology as an inference process - Krovetz - 1993
216	Training algorithms for linear text classi ers - Lewis, Shapire, et al. - 1996
212	Inference networks for document retrieval - Turtle - 1990
203	Tree-Bank Grammars - Charniak - 1996
196	Exponentiated gradient versus gradient descent for linear predictors - Kivinen, Warmuth - 1997
192	Measuring the accuracy of diagnostic systems - SWETS - 1988
191	Topic detection and tracking pilot study: Final report - Allan, Carbonell, et al. - 1998
183	The DET curve in assessment of detection task performance - Martin, Doddington, et al. - 1997
181	Recent trends in hierarchical document clustering: A critical review - Willett - 1988
179	Statistical models for text segmentation - Beeferman, Berger, et al. - 1999
151	Using probabilistic models of document retrieval without relevance information - Croft, Harper - 1979
143	Resolving Ambiguity for Cross-Language Retrieval - Ballesteros, Croft - 1998
141	Representation and Learning in Information Retrieval - Lewis - 1992
118	How effective is suffixing - Harman - 1991
106	On-line new event detection and tracking - Allan, Papka, et al. - 1998
105	Optimization of Relevance Feedback Weights - Buckley, Salton - 1995
104	A study of retrospective and on-line event detection - Yang, Pierce, et al. - 1998
102	Information extraction as a basis for high-precision text classification - Riloff, Lehnert - 1994
90	Incremental Relevance Feedback for Information Filtering - Allan - 1996
85	Okapi at TREC-7: Automatic ad hoc, filtering, VLC and interactive track - Robertson, Walker, et al. - 1999
84	Classification algorithms - James - 1985
70	A comparison of text retrieval models - Turtle, Croft - 1992
67	Text segmentation by topic - Ponte, Croft - 1997
53	Support for browsing in an intelligent text retrieval system - Thompson, Croft - 1989
50	Learning routing queries in a query zone - Singhal, Mitra, et al. - 1997
49	Fawcett T: Robust classification systems for imprecise environments - Provost - 1998
48	Recent experiments with INQUERY - Allan, Ballesteros, et al. - 1996
46	Document filtering with inference networks - Callan - 1996
45	A model of cluster searching based on classification - Croft - 1980
34	The effectiveness and efficiency of agglomerative hierarchical clustering in document retrieval (Tech - Voorhees - 1985
29	P.: Proximity operators - so near and yet so far - Hawking, Thistlewaite - 1995
28	Interactive cluster visualization for information retrieval - Leuski, Allan - 1998
26	Optimizing Ranking Functions: A Connectionist Approach to Adaptive Information Retrieval - Bartell - 1994
21	A Probabilistic Approach to Language Understanding - Goldman - 1990