Abstract

This paper applies error-correcting output coding (ECOC) to the task of document categorization. ECOC, of recent vintage in the AI literature, is a method for decomposing a multiway classification problem into many binary classification tasks, and then combining the results of the subtasks into a hypothesized solution to the original problem. There has been much recent interest in the machine learning community about algorithms which integrate "advice" from many subordinate predictors into a single classifier, and error-correcting output coding is one such technique. We provide experimental results on several real-world datasets, extracted from the Internet, which demonstrate that ECOC can o#er significant improvements in accuracy over conventional classification algorithms. 1

Citations

1998	Bagging predictors - Breiman - 1996
1714	Schapire R: A decision-theoretic generalization of online learning and an application to boosting - Freund - 1997
1605	The Theory of Error-Correcting Codes - MacWilliams, Sloane - 1978
619	Nigam K: A comparison of event models for naïve Bayes text classification - McCallum - 1998
583	Learning representations by back-propagating errors - Rumelhart, Hinton, et al. - 1986
290	DiPasquo,“Learning to extract Symbolic Knowledge from the World Wide Web - Craven, Freitag, et al. - 1998
271	Syskill and Webert: Identifying Interesting Web Sites - Pazzani, Muramatsu, et al. - 1996
268	Naive (Bayes) at forty: The independence assumption in information retrieval - Lewis - 1998
131	Error-correcting output coding corrects bias and variance - Kong, Dietterich - 1995
109	Combining instance-based and model-based learning - Quinlan - 1993
77	arcing classifiers - Bias - 1996
70	Improving Regression Estimation: Averaging methods for variance reduction with extensions to general convex measure optimization - Perrone - 1993
66	Newsweeder: Learning to filter news - Lang - 1995
23	Achieving highaccuracy text-to-speech with machine learning. Data mining in speech synthesis - Bakiri, Dietterich - 1999
22	Cloud classification using error-correcting output codes - Aha, Bankert - 1997
10	T.: The Error Coding Method and PICT’s - James, Hastie - 1998
8	M.: Majority Vote Classifiers: Theory and Applications - James - 1998
7	An application of Expert Network to clinical classification and MEDLINE indexing - Yang, CG - 1994
3	Distributional clustering for text classification - Baker, McCallum - 1998