Abstract

This paper presents a new approach to inductive learning that combines aspects of instancebased learning and rule induction in a single simple algorithm. The RISE system searches for rules in a specific-to-general fashion, starting with one rule per training example, and avoids some of the difficulties of separate-andconquer approaches by evaluating each proposed induction step globally, i.e., through an efficient procedure that is equivalent to checking the accuracy of the rule set as a whole on every training example. Classification is performed using a best-match strategy, and reduces to nearest-neighbor if all generalizations of instances were rejected. An extensive empirical study shows that RISE consistently achieves higher accuracies than state-of-the-art representatives of its "parent" paradigms (PEBLS and CN2), and also outperforms a decision-tree learner (C4.5) in 13 out of 15 test domains (in 10 with 95% confidence). 1 Introduction Several well-developed approaches to indu...

Citations

4071	C4.5: Programs for machine learning - Quinlan - 1993
3340	Pattern Classification and Scene Analysis - Duda, Hart - 1973
897	Instance-Based Learning Algorithms - Aha, Kibler, et al. - 1991
682	The CN2 induction algorithm - Clark, Niblett - 1989
662	Repository of machine learning databases - Murphy, Aha - 1994
439	Toward memory-based reasoning - Stanfill, Waltz - 1986
419	Probability and statistics - Degroot - 1989
296	The multi-purpose incremental learning system aq15 and its testing application to three medical domains - Michalski, Mozetic, et al. - 1986
291	Rule induction with cn2: Some recent improvements - Clark, Boswell - 1991
249	A weighted nearest neighbor algorithm for learning with symbolic features - Cost, Salzberg - 1993
171	Evolving networks: Using the genetic algorithm with connectionist learning - Belew, McInerney, et al. - 1990
153	A nearest hyperrectangle learning method - Salzberg - 1990
140	A Conservation Law for Generalization Performance - Schaffer - 1994
136	Concept Learning and the Problem of Small Disjuncts - Holte, Acker, et al. - 1989
129	Generating production rules from decision trees - Quinlan - 1987
109	Combining instance-based and model-based learning - Quinlan - 1993
81	An experimental comparison of the nearest-neighbor and nearesthyperrectangle algorithms - Wettschereck, Dietterich - 1995
66	Feature selection for case-based classification of cloud types: an empirical comparison - Aha, Bankert - 1994
65	Constructing Decision Trees in Noisy Domains - Niblett - 1987
64	Improving Rule-Based Systems Through Case-Based Reasoning - Golding, Rosenbloom - 1991
59	Addressing the selective superiority problem: Automatic algorithm /model class selection - Brodley - 1993
56	Megainduction: A test flight - Catlett - 1991
55	Perceptron trees: A case study in hybrid concept representations - Utgoff - 1989
44	Machine learning: A Multistrategy Approach - MICHALSKI, TECUCI - 1994
33	An experimentalcomparison of the nearest-neighbor and nearest-hyperrectangle algorithms - Wettschereck, T - 1995
24	An optimal weighting criterion of case indexing for both numeric and symbolic attributes - Mohri, Tanaka - 1994
9	A hybrid rule-based/Bayesian classifier - Smyth, Goodman - 1990
4	A Method that Combines Inductive Learning with Exemplar-Based Learning - Zhang - 1990