Classification in Very High Dimensional Problems with Handfuls of Examples

Classification in Very High Dimensional Problems with Handfuls of Examples

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Mark Palatucci , Tom M. Mitchell

Citations:

3 - 0 self

BibTeX

@MISC{Palatucci_classificationin,
    author = {Mark Palatucci and Tom M. Mitchell},
    title = {Classification in Very High Dimensional Problems with Handfuls of Examples},
    year = {}
}

Bookmark

OpenURL

Abstract

Abstract. Modern classification techniques perform well when the number of training examples exceed the number of features. If, however, the number of features greatly exceed the number of training examples, then these same techniques can fail. To address this problem, we present a hierarchical Bayesian framework that shares information between features by modeling similarities between their parameters. We believe this approach is applicable to many sparse, high dimensional problems and especially relevant to those with both spatial and temporal components. One such problem is fMRI time series, and we present a case study that shows how we can successfully classify in this domain with 80,000 original features and only 2 training examples per class. 1

Citations

887	D: Bayesian Data Analysis - Gelman, Carlin, et al. - 1995
328	Multitask learning - Caruana - 1997
166	On bias, variance, 0/1 - loss, and the curse-of-dimensionality, Data Mining and Knowledge Discovery 1 - Friedman - 1997
92	Learning to decode cognitive states from brain images. Machine Learning 57 - TM, Hutchinson, et al. - 2004
69	R.: Exploiting task relatedness for multiple task learning - Ben-David, Schuller - 2003
55	A bayesian/information theoretic model of learning to learn via multiple task sampling - Baxter - 1997
24	Classifying spatial patterns of brain activity with machine learning methods: application to lie detection. Neuroimage - Davatzikos, Ruparel, et al. - 2005
14	Solving a huge number of similar tasks: a combination of multi-task learning and hierarchical Bayesian modeling - Heskes - 1998
13	Bayesian statistics - Lee - 1997
10	Bayesian network learning with parameter constraints - Niculescu, Mitchell
7	Hidden process models - Hutchinson, Mitchell, et al. - 2006
6	Exploiting Parameter Domain Knowledge for Learning in Bayesian Networks - Niculescu - 2005
6	Learning to learn: Introduction - Thrun - 1996
5	Exploiting temporal information in functional magnetic resonance imaging brain data - Zhang, Samaras, et al. - 2005
1	Hierarchical gaussian naive bayes classifier for multiple-subject fmri data - Rustandi - 2006