Abstract

We survey the literature on methods for inference and learning in Bayesian Networks composed of discrete and continuous nodes, in which the continuous nodes have a multivariate Gaussian distribution, whose mean and variance depends on the values of the discrete nodes. We also briefly consider hybrid Dynamic Bayesian Networks, an extension of switching Kalman filters. This report is meant to summarize what is known at a sufficient level of detail to enable someone to implement the algorithms, but without dwelling on formalities.

Citations

5666	Probabilistic reasoning in intelligent systems - Pearl - 1988
1081	Local Computations with Probabilities on graphical structures and their applications to expert systems (with discussion - Lauritzen, Spiegelhalter
848	Graphical Models - Lauritzen - 1996
726	The EM algorithm and extensions - McLachlan, Krishnan - 1997
719	FV: An Introduction to Bayesian Networks - Jensen - 1996
612	A view of the EM algorithm that justifies incremental, sparse, and other variants - Neal, Hinton - 1998
576	Tracking and Data Association - Bar-Shalom, Fortmann - 1988
512	Optimal Statistical Decisions - DeGroot - 1970
511	DM: Statistical Analysis of Finite Mixture Distributions Chichester - Titterington - 1985
500	Probabilistic Networks and Expert Systems - Cowell, Dawid, et al. - 1999
425	Mixture densities, maximum likelihood, and the EM algorithm - Redner, Walker - 1984
354	Graphical Models in Applied Multivariate Statistics - Whittaker
316	Gaussian influence diagrams - Shachter, Kenley - 1989
288	Planning and Control - Dean, Wellman - 1991
240	Context-specific independence in bayesian networks - Boutilier, Friedman, et al. - 1996
228	Tractable inference for complex stochastic processes - Boyen, Koller - 1998
213	Operations for learning with graphical models - Buntine - 1994
212	Bayesian forecasting and dynamic models - West, Harrison - 1997
208	Learning Bayesian networks with local structure - Friedman, Goldszmidt - 1999
208	A unifying review of linear Gaussian models - Roweis - 1999
154	Probabilistic independence networks for hidden markov probability models - Smyth - 1997
145	Graphical models for the association between variables, some of which are qualitative and some - Lauritzen, Wermuth - 1989
139	Dynamic Linear Models with Markov-Switching - Kim - 1994
133	Adaptive probabilistic networks with hidden variables - Binder, Koller, et al. - 1997
125	Propagation of probabilities, means, variances in mixed graphical association models - Lauritzen - 1992
123	D: Introduction to Graphical Modelling - Edwards
114	On convergence properties of the EM algorithm for Gaussian mixtures - Xu, Jordan - 1996
101	Learning dynamic Bayesian networks - Ghahramani - 1997
93	Learning Gaussian networks - Geiger, Heckerman - 1994
92	From influence diagrams to junction trees - Jensen, Jensen, et al. - 1994
51	A view of the EM algorithm that justies incremental, sparse, and other variants - Neal, Hinton - 1998
39	A variational approximation for bayesian networks with discrete and continuous latent variables - Murphy - 1999
37	Switching State-Space Models - Ghahramani, Hinton - 1998
34	Approximate learning of dynamic models - Boyen, Koller - 1998
26	A view of the EM algorithm that justi es incremental, sparse, and other variants - Neal, Hinton - 1998
24	Evaluating In uence Diagrams - Shachter - 1986
21	Evaluating in diagrams - Shachter - 1986
20	Implementation of continuous Bayesian networks using sums of weighted Gaussians - Driver, Morrell - 1995
19	Structure and parameter learning for causal independence and causal interaction models - Meek, Heckerman - 1997
18	Causal probabilistic networks with both discrete and continuous variables - Olesen - 1993
11	Symbolic Probabilistic Inference with both Discrete and Continuous Variables - Chang, Fung - 1995
10	Frominfluence diagrams to junction trees - Jensen, Jensen, et al. - 1994
10	A computational scheme for reasoning in dynamic probabilistic networks - Kjaerul - 1993
10	Computing marginals for arbitrary subsets from marginal representation in markov trees - Xu - 1995
8	Statistical Analysis of Mixture Distributions - Titterington, Smith, et al. - 1985
8	Statistical analysis of �nite mixture distributions - Titterington, Smith, et al. - 1985
7	Fusion and propogation with multiple observations in belief networks - Peot, Shachter - 1991
5	Inference Using Message Propogation and Topology Transformation in Vector Gaussian Continuous Networks - Alag - 1996
5	A smooth learning algorithm for hidden Markov models - Baldi, Chauvin - 1993
4	Stable local compuation with conditional Gaussian distributions - Lauritzen, Jensen - 1999