Abstract

This paper studies noise reduction for computational efficiency improvements in a statistical learning method for text categorization, the Linear Least Squares Fit (LLSF) mapping. Multiple noise reduction strategies are proposedand evaluated, including: an aggressive removal of “non-informative words ” from texts before training; the use of a truncated singular value decomposition to cut off noisy “latent semantic structures ” during training; the elimination of non-influential components in the LLSF solution (a word-concept association matrix) after training. Text collections in different domains were used for evaluation. Significant improvements in computational efficiency without losing categorization accuracy were evident in the testing results. 1

Citations

2168	Indexing by latent semantic analysis - Deerwester, Dumais, et al. - 1990
1095	Automatic text processing: The transformation, analysis, and retrieval of information by computer - Salton
133	Expert network: Effective and efficient learning from human decisions in text categorization and retrieval - Yang - 1994
100	An example-based mapping method for text categorization and retrieval - Yang, Chute - 1994
87	Latent Semantic Indexing (LSI) and TREC-2 - Dumais - 1993
78	Classifying news stories using memory based reasoning - Masand, Linoff, et al. - 1992
64	Automatic Retrieval with Locality Information using SMART - Buckley, Salton, et al. - 1993
48	Automatic indexing based on bayesian inference networks - Tzeras, Hartmann - 1993
46	Air/x - a rule-based multistage indexing system for large subject fields - Fuhr, Hartmann, et al. - 1991
21	A Linear Least Squares Fit Mapping Method for Information Retrieval from Natural Language Texts - Yang, Chute - 1992
16	The automatic identification of stop words - Wilbur, Sirotkin - 1992
15	Chute: An Application of Least Squares Fit Mapping To Text Information Retrieval - Yang, Christopher - 1983
4	Latent semantic indexing of medical diagnoses using UMLS Semantic Structures - CG, Yang - 1991
3	Using Corpus Statistics to Remove Redundant Words - Yang - 1996
2	LINPACK Users' Guide - JJ, CB, et al. - 1979
1	Matrix Computations, 2nd Edition - GH, CE - 1989
1	LanczosAlgorithm for Large Symmetric Eigenvalue Computations. Vol.1: Theory - RA - 1985
1	Large-Scale Sparse Singular Value Computations - MW - 1992
1	Evaluating Text Categorization - DD - 1991
1	Review of "Methods for statistical data analysis of multivariate observations - JE - 1978
1	ACM Guide to Computing Literature Baltimore, MD: Association for Computing Machinery - Harman, Ed - 1984
1	Review of “Methods for statistical data analysis of multivariate observations” Technometrics Vol 20 - JE - 1978
1	Indexing by Latent Semantic analysis. JAmer Soc Inf Sci 41 - Deerwester, ST, et al. - 1990