BibTeX
@MISC{Buntine04applyingdiscrete,
author = {Wray Buntine and Aleks Jakulin},
title = { Applying Discrete PCA in Data Analysis},
year = {2004}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
Methods for analysis of principal components in discrete data have existed for some time under various names such as grade of membership modelling, probabilistic latent semantic analysis, and genotype inference with admixture. In this paper we explore a number of extensions to the common theory, and present some application of these methods to some common statistical tasks. We show that these methods can be interpreted as a discrete version of ICA. We develop a hierarchical version yielding components at different levels of detail, and additional techniques for Gibbs sampling. We compare the algorithms on a text prediction task using support vector machines, and to information retrieval.
Citations
| 1369 | Latent Dirichlet allocation - Blei, Andrew, et al. |
| 1086 | Making large-scale SVM learning practical - Joachims - 1999 |
| 1019 | E.: Independent Component Analysis - HYVÄRINEN, KARHUNEN, et al. - 2001 |
| 545 | Probabilistic latent semantic indexing - Hofmann - 1999 |
| 212 | Inference of population structure using multilocus genotype data - Pritchard, Stephens, et al. - 2000 |
| 173 | Statistical language modeling for information retrieval - Croft, Liu - 2005 |
| 171 | Pairwise data clustering by deterministic annealing - Hofmann, Buhmann - 1997 |
| 89 | Propagation algorithms for variational Bayesian learning - Ghahramani, Beal |
| 84 | Expectation-propagation for the generative aspect model - Minka, Lafferty - 2002 |
| 21 | Analyzing attribute dependencies - Jakulin, Bratko - 2003 |
| 2 | Variational extensions to EM and multinomial PCA. ECML - Buntine - 2002 |
