MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

A Re-Examination of Text Categorization Methods (1999) [450 citations — 14 self]

Abstract:

This paper reports a controlled study with statistical significance tests on five text categorization methods: the Support Vector Machines (SVM), a k-Nearest Neighbor (kNN) classifier, a neural network (NNet) approach, the Linear Leastsquares Fit (LLSF) mapping and a Naive Bayes (NB) classifier. We focus on the robustness of these methods in dealing with a skewed category distribution, and their performance as function of the training-set category frequency. Our results show that SVM, kNN and LLSF significantly outperform NNet and NB when the number of positive training instances per category are small (less than ten), and that all the methods perform comparably when the categories are sufficiently common (over 300 instances).

Citations

1094 Support–vector networks – Cortes, Vapnik - 1995
1054 Text categorization with support vector machines: learning with many relevant features – Joachims - 1998
567 A comparative study on feature selection in text categorization – Yang, Pedersen - 1997
514 A comparison of event models for Naive Bayes text classification – McCallum, Nigam - 1998
347 An evaluation of statistical approaches to text categorization – Yang - 1999
302 Hierarchically classifying documents using very few words – Koller, Sahami - 1997
213 A comparison of two learning algorithms for text categorization – Lewis - 1994
209 Training algorithms for linear text classifiers – Lewis, Schapire, et al. - 1996
199 Nearest Neighbor (NN) Norms: NN Pattern Recognition Classification Techniques – Dasarathy - 1991
194 Context sensitive learning methods for text categorization – Cohen - 1999
149 Sequential minimal optimization: A fast algorithm for training support vector machines – Platt - 1998
127 Expert network: Effective and efficient learning from human decisions in text categorization and retrieval – Yang - 1994
126 Support vector machines: Training and applications – Osuna, Freund, et al. - 1997
116 A neural network approach to topic spotting – Wiener, Pedersen, et al. - 1995
89 Feature selection, perceptron learning, and a usability case study for text categorization – Ng, Goh, et al. - 1997
83 An example-based mapping method for text-categorization and retrieval – Chute - 1994
74 Towards language independent automated learning of text categorization models – Apté, Damerau, et al. - 1994
70 Classifying news stories using memory based reasoning – Masand, Linoff, et al. - 1992
57 Construe/tis: a system for content-based indexing of a database of news stories – Hayes, Weinstein - 1990
56 Text Categorization and Relational Learning – Cohen - 1995
55 Feature selection in statistical learning of text categorization – Yang, Pedersen - 1997
45 Using a generalized instance set for automatic text categorization – Lam, CY - 1998
44 Air/x - a rulebased multistage indexing systems for large subject fields – Fuhr, Hartmanna, et al. - 1991
44 Cluster-Based Text Categorization: A Comparison of Category Search Strategies – Iwayama, Tokunaga - 1995
43 Automatic indexing based on bayesian inference networks – Tzeras, Hartman - 1993
37 Text categorization: a symbolic approach – Moulinier, Raˇskinis, et al. - 1996
20 Text mining with decision rules and decision trees – Apte, Damerau - 1998
14 The Nature of Statistical Learning Theory – Vapnic - 1995
11 Statistics: Theory and Methods – Berry, Lindgren - 1996
11 Is learning bias an issue on the text categorization problem – Moulinier - 1997
10 Distributional clustering of words for text categorization – Baker, Mccallum - 1998
8 Sampling strategies and learning efficiency in text categorization – Yang - 1996
3 A comparison of event models for naivebayes text classi – McCallum, Nigam - 1998
3 Expert network: E ective and e cient learning from human decisions in text categorization and retrieval – Yang - 1994
1 Statistics: Theory and Methods. Brooks/Cole, Paci c – Berry, Lindgren - 1990
1 Sampling strategies and learning e ciency in text categorization – Yang - 1996
View or Download | Add to My Collection | Correct Errors