Learning Bayesian belief networks: An approach based on the MDL principle

Learning Bayesian belief networks: An approach based on the MDL principle (1994)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Wai Lam , Fahiem Bacchus

Venue:	Computational Intelligence
Citations:	164 - 7 self

BibTeX

@ARTICLE{Lam94learningbayesian,
    author = {Wai Lam and Fahiem Bacchus},
    title = {Learning Bayesian belief networks: An approach based on the MDL principle},
    journal = {Computational Intelligence},
    year = {1994},
    volume = {10},
    pages = {269--293}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

A new approach for learning Bayesian belief networks from raw data is presented. The approach is based on Rissanen's Minimal Description Length (MDL) principle, which is particularly well suited for this task. Our approach does not require any prior assumptions about the distribution being learned. In particular, our method can learn unrestricted multiply-connected belief networks. Furthermore, unlike other approaches our method allows us to tradeo accuracy and complexity in the learned model. This is important since if the learned model is very complex (highly connected) it can be conceptually and computationally intractable. In such a case it would be preferable to use a simpler model even if it is less accurate. The MDL principle o ers a reasoned method for making this tradeo. We also show that our method generalizes previous approaches based on Kullback cross-entropy. Experiments have been conducted to demonstrate the feasibility of the approach. Keywords: Knowledge Acquisition � Bayes Nets � Uncertainty Reasoning. 1

Citations

5664	Probabilistic Reasoning in Intelligent Systems - Pearl - 1988
891	Modeling by shortest data description - Rissanen - 1978
809	On information and sufficiency - Kullback, Leibler - 1951
496	The computational complexity of probabilistic inference using bayesian belief networks - Cooper - 1990
487	Approximating discrete probability distributions with dependence trees - Chow, Liu - 1968
428	Stochastic complexity - Rissanen - 1987
298	Fusion, propagation, and structuring in belief networks - Pearl - 1986
240	Bayesian updating in causal probabilistic networks by local computations - Jensen, Lauritzen, et al. - 1990
220	Approximating probabilistic inference in Bayesian belief networks is NP-hard - Dagum, Luby - 1993
201	The ALARM monitoring system: A case study with two probabilistic inference techniques for belief networks - Beinlich, Suermondt, et al. - 1989
179	Equivalence and synthesis of causal models - Verma, Pearl
175	TS: A theory of inferred causation - Pearl, Verma
158	Propagating uncertainty in Bayesian networks by probabilistic logic sampling, in - Henrion - 1988
142	Simulation approaches to general probabilistic inference on belief networks - Shachter, Peot - 1989
86	Weighting and integrating evidence for stochastic simulation in Bayesian networks - FUNG, CHANG - 1990
86	Evidential reasoning using stochastic simulation of causal models - Pearl - 1987
81	Data compression - Lelewer, Hirschberg - 1987
62	Causality: Models - Pearl
61	A Bayesian method for constructing Bayesian belief networks from databases - Cooper, Herskovits - 1990
42	The recovery of causal poly-trees from statistical data - Rebane, Pearl - 1989
41	A probabilistic causal model for diagnostic problem solving – Part I: Integrating symbolic causal inference with numeric probabilistic inference - Peng, Reggia - 1987
38	Search-based methods to bound diagnostic probabilities in very large belief networks - Henrion - 1991
37	Counting unlabeled acyclic digraphs - Robinson - 1977
24	Learning causal trees from dependence information - Geiger, Paz, et al. - 1990
24	Causality from Probability - Spirtes, Glymour, et al. - 1990
21	A randomized approximation algorithm for probabilistic inference on Bayesian Belief networks - Chavez, Cooper - 1990
16	On information and su ciency - Kullback, Leibler - 1951
14	ARCO1: an application of belief networks to the oil market - Abramson - 1991
12	Introduction to Algorithms. MITPress - Cormen, Leiserson, et al. - 1990
9	Nestor: A computer-based medical diagnosis that integrates causal and probabilistic knowledge - Cooper - 1984
8	The minimum description length principle and its application to online learning of handprinted characters - Gao, Li - 1989
4	Towards efficient inference in multiply connected belief networks - Henrion - 1990
4	Propagating uncertainty inBayesian networks by probabilistic logic sampling - Henrion - 1988
2	Architectures and approximation algorithms for probabilistic expert systems - Chavez - 1990
2	Towards e cient inference in multiply connected belief networks - Henrion - 1990