Toward integrating feature selection algorithms for classification and clustering

Toward integrating feature selection algorithms for classification and clustering (2005)

Cached

Download Links

[www.cs.binghamton.edu]
[www.public.asu.edu]

Other Repositories/Bibliography

DBLP

by Huan Liu , Lei Yu

Venue:	IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
Citations:	71 - 6 self

BibTeX

@ARTICLE{Liu05towardintegrating,
    author = {Huan Liu and Lei Yu},
    title = {Toward integrating feature selection algorithms for classification and clustering},
    journal = {IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING},
    year = {2005},
    volume = {17},
    pages = {491--502}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper introduces concepts and algorithms of feature selection, surveys existing feature selection algorithms for classification and clustering, groups and compares different algorithms with a categorizing framework based on search strategies, evaluation criteria, and data mining tasks, reveals unattempted combinations, and provides guidelines in selecting feature selection algorithms. With the categorizing framework, we continue our efforts toward building an integrated system for intelligent feature selection. A unifying platform is proposed as an intermediate step. An illustrative example is presented to show how existing feature selection algorithms can be integrated into a meta algorithm that can take advantage of individual algorithms. An added advantage of doing so is to help a user employ a suitable algorithm without knowing details of each algorithm. Some real-world applications are included to demonstrate the use of feature selection in data mining. We conclude this work by identifying trends and challenges of feature selection research and development.

Citations

1429	The Elements of Statistical Learning - Hastie, Tibshirani, et al. - 2001
1303	Data Mining: Concepts and Techniques - Han, Kamber - 2000
775	G: Wrappers for Feature Subset Selection - Kohavi, John - 1996
632	Text classification from labeled and unlabeled documents using - Nigram, McCallum, et al.
547	P.: From data mining to knowledge discovery: An overview. In - Piatetsky-Shapiro, Fayyad, et al. - 1996
531	Pattern Recognition: A statistical approach - PA, Kittler - 1982
531	Multi-interval discretization of continuousvalued attributes for classification learning - Fayyad, Irani - 1993
359	Sampling Techniques - Cochran - 1977
301	Toward optimal feature selection - Koller, Sahami - 1996
247	Database Mining : A Performance Perspective - Agrawal, Imienski, et al.
238	Feature selection: Evaluation, application, and small sample performance - JAIN, ZONGKER - 1997
231	Estimating attributes: analysis and extensions of RELIEF - Kononenko - 1994
203	Feature selection for knowledge discovery & data mining - Liu, Motoda - 1998
201	The Feature Selection Problem: Traditional Methods and a New Algorithm - Kira, Rendell - 1992
187	Learning with many irrelevant features. In - Almuallim, Dietterich - 1991
186	Training a 3-node neural networks is np-complete - Blum, Rivest - 1992
183	AJ: Subset selection in regression - Miller - 1990
176	Data preparation for data mining - Pyle - 1999
172	Greedy attribute selection - Caruana, Freitag
153	A branch and bound algorithm for feature subset selection - NARENDRA, FUKUNAGA - 1977
148	Feature subset selection using a genetic algorithm - YANG, V - 1998
122	Prototype and feature selection by sampling and random mutation hill climbing algorithms - Skalak - 1994
117	M.S.: Efficient algorithms for minimizing cross validation error - Moore, Lee - 1994
104	2004) Subspace clustering for high dimensional data: A review - Lance, Haque, et al.
95	Feature Selection for High-Dimensional Genomic Microarray Data - Xing, Jordan, et al. - 2001
91	Feature selection for high dimensional data: A fast correlation based filter solution - Yu, Liu - 2003
88	Fundamentals of Algorithmics - Brassard, Bratley - 1996
88	Correlation-based Feature Selection for Discrete and Numeric - Hall - 2000
87	On automatic feature selection - Siedlecki, Sklansky - 1988
86	A probabilistic approach to feature selection - a filter solution - Liu, Setiono - 1996
85	Using decision trees to improve case-based learning - Cardie - 1993
80	Dietterich,” Learning Boolean concepts in the presence of many irrelevant features - Almuallim, Thomas - 1994
70	Unsupervised Feature Selection Using Feature Similarity - Mitra
67	Langley P: Selection of relevant features and examples in machine learning - Blum - 1997
65	Text Categorization with Support Vector Machines: How to Represent Text - Leopold, Kingermann - 2002
59	Efficiently inducing determinations: A complete and systematic search algorithm that uses optimal pruning - Schlimmer - 1993
57	M.: Discretization: An Enabling Technique - Liu, Husain, et al. - 2002
54	H: Feature Selection for Classification. Intelligent Data Analysis - Dash, Liu - 1997
54	Context-sensitive feature selection for lazy learners - Domingos - 1997
51	Feature Subset Selection and Order Identification for Unsupervised Leanring - Dy, Brodley - 2000
49	Adaptive Intrusion Detection: A Data Mining Approach - Lee, Stolfo, et al. - 2000
48	Feature selection in unsupervised learning via evolutionary search - Kim, Street, et al.
42	Advances in instance selection for instance-based learning algorithms - Brighton, Mellish
41	An Evaluation of Feature Selection Methods and Their Application to Computer Security - Doak - 1992
39	Feature selection using roughsets theory - Modrzejewski - 1993
34	Feature selection for clustering - Dash, Liu
34	Feature selection as a preprocessing step for hierarchical clustering - Talavera - 1999
32	On feature selection: Learning with exponentially many irrelevant features as training examples - Ng - 1998
29	a boosting-based hybrid for feature selection - Filters - 2001
29	A Comparison of Seven Techniques for Choosing Subsets of Pattern Recognition properties - Mucciardi, Gose - 1971