Abstract

Latent class models are used for cluster analysis of categorical data. Underlying such a model is the assumption that the observed variables are mutually independent given the class variable. A serious problem with the use of latent class models, known as local dependence, is that this assumption is often untrue. In this paper we propose hierarchical latent class models as a framework where the local dependence problem can be addressed in a principled manner. We develop a search-based algorithm for learning hierarchical latent class models from data. The algorithm is evaluated using both synthetic and real-world data.

Citations

6515	Elements of Information Theory - Cover, Thomas - 1991
6232	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird, et al. - 1977
1581	Estimating the dimension of a model - SCHWARZ - 1978
1131	A new look at the statistical model identification - Akaike - 1974
994	Finding Groups in Data: An Introduction to Cluster Analysis - Kaufman, Rousseeuw - 1990
598	Biological sequence analysis: probabilistic models of proteins and nucleic acids. Cambridge Univ - Durbin, Eddy, et al. - 2000
500	Probabilistic Networks and Expert Systems - Cowell, Dawid, et al. - 1999
486	Approximating discrete probability distributions with dependence trees - Chow, Liu - 1968
416	Bayesian classification (AutoClass): Theory and results - Cheeseman, Stutz - 1996
366	Cluster analysis - Everitt - 1993
156	Latent Variable Models and Factor Analysis - Bartholomew, Knott - 1999
155	Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables - Chickering, Heckerman - 1997
100	Latent Structure Analysis - Lazarsfeld, Henry - 1968
79	Exploratory latent structure analysis using both identifiable and unidentifiable models - Goodman - 1974
43	Algorithms for model-based Gaussian hierarchical clustering - Fraley - 1998
43	M: Maximum likelihood inference of protein phylogeny and the origin of chloroplasts - Kishino, Miyata, et al. - 1990
41	Stratified Exponential Families: Graphical Models and Model Selection - Geiger, King
39	A structural EM algorithm for phylogenetic inference - Friedman, Ninio, et al. - 2002
38	Discovering hidden variables: A structure-based approach - Elidan, Lotner, et al. - 2001
37	Introduction to Mathematical Sociology - Coleman - 1964
30	Bayesian classification with correlation and inheritance - Hanson, Stutz, et al. - 1991
23	Learning the dimensionality of hidden variables - Elidan, Friedman - 2001
19	Rissanen: Intertwining themes in theories of model order estimation - Lanterman, “Schwarz - 2001
16	Discrete factor analysis: Learning hidden variables in Bayesian networks - Martin, VanLehn - 1995
16	Learning with mixtures of trees - Meilă-Predoviciu - 1999
16	DL: PAUP 4.0* - Phylogenetic Analysis Using Parsimony (*and Other Methods - Swofford
14	Constructing hidden variables in Bayesian networks via conceptual learning - Connolly - 1993
13	The Analysis of Systems of Qualitative Variables When Some of the Variables are Unobservable Part 1-A: Modified Latent Structure Approach - Goodman - 1974
13	Dimension correction for hierarchical latent class models - Kočka, Zhang - 2002
12	Penalized likelihood - Green - 1999
7	Latent structure models with direct effects between indicators: local dependence models - Hagenaars - 1988
7	Latent class cluster analysis - Vermunt, Magidson - 2002
6	Using latent class models to characterize and assess relative error in discrete measurements - Espeland, Handelman - 1989
6	Three multivariate models: Factor analysis, latent structure analysis, and latent profile analysis - Gibson - 1959
5	Latent Gold user’s guide - JK, Magidson
4	Latent class model diagnosis - Garrett, Zeger - 2000
2	A method for predicting individual HIV infection status in the absence of clinical information - Biggar, J, et al. - 1988
2	Statistics for social data analysis (3rd Edition - Bohrnstedt, Knoke - 1994
2	Using Latent Class Models to analyze Response Patterns in Epidemiologic Mail Surveys - Kohlmann, Formann - 1997
2	A practical guide to local dependence in latent class models. http://ourworld.compuserve.com/homepages/jsuebersax/condep.htm - Uebersax - 2000
2	Activity and severity of rheumatoid arthritis in Hannover/FRG and in one regional referral center - Wasmus, Kindel, et al. - 1989
2	I-A Modified latent structure approach - Part
1	DSM-III Major depressive disorder in the community: A latent class analysis of data from the NIMH epidemiologic catchment area programme - Eaton, Dryman, et al. - 1989