There are many different ways of representing knowledge, and for each of these ways there are many different discovery algorithms. How can we compare different representations? How can we mix, match and merge representations and algorithms on new problems with their own unique requirements? This chapter introduces probabilistic modeling as a philosophy for addressing these questions and presents graphical models for representing probabilistic models. Probabilistic graphical models are a unified qualitative and quantitative framework for representing and reasoning with probabilities and independencies. 4.1 Introduction Perhaps one common element of the discovery systems described in this and previous books on knowledge discovery is that they are all different. Since the class of discovery problems is a challenging one, we cannot write a single program to address all of knowledge discovery. The KEFIR discovery system applied to health care by Matheus, Piatetsky-Shapiro, and McNeill (199...
|
4701
|
Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference
– Pearl
- 1988
|
|
1405
|
Introduction to the Theory of Neural Computation
– Hertz, Krogh, et al.
- 1991
|
|
1151
|
Tcl and the Tk Toolkit
– OUSTERHOUT
- 1994
|
|
615
|
Generalized linear models
– Nelder, Wedderburn
- 1972
|
|
600
|
Bayesian Theory
– Bernardo, Smith
- 1994
|
|
567
|
An Introduction to hidden Markov models
– Rabiner, Juang
- 1986
|
|
416
|
Statistical Analysis of Finite Mixture Distributions
– Titterington, Smith, et al.
- 1985
|
|
281
|
Planning and Control
– Dean, Wellman
- 1991
|
|
278
|
Evaluating influence diagrams
– Shachter
- 1986
|
|
203
|
Statistical inference
– Casella, Berger
- 1990
|
|
178
|
Operations for learning with graphical models
– Buntine
- 1994
|
|
170
|
Refinement of approximate domain theories by knowledge-based artificial neural networks
– Towell, Shavlik
- 1990
|
|
164
|
Bayesian analysis in expert systems
– Spiegelhalter, Dawid, et al.
- 1993
|
|
135
|
Theory refinement of Bayesian networks
– Buntine
- 1991
|
|
121
|
The process of knowledge discovery in databases: A human-centered approach
– Brachman, Anand
- 1996
|
|
111
|
Probabilistic Similarity Networks
– Heckerman
- 1991
|
|
109
|
Independence properties of directed Markov fields
– Lauritzen, Dawid, et al.
- 1990
|
|
96
|
Learning Classification Trees
– Buntine
- 1992
|
|
93
|
Subjective Bayesian Methods for RuleBased Inference Systems
– Duda, Hart, et al.
- 1976
|
|
76
|
A language and program for complex Bayesian modeling
– Gilks, Thomas, et al.
- 1994
|
|
61
|
Decision Analysis and Expert Systems
– Henrion, Breese, et al.
- 1991
|
|
41
|
Global conditioning for probabilistic inference in belief networks
– Shachter, Andersen
- 1994
|
|
31
|
Automatic knowledge base refinement for classification systems
– Ginsberg, Weiss, et al.
- 1988
|
|
28
|
Bayesian classification with correlation and inheritance
– Hanson, Stutz, et al.
- 1991
|
|
27
|
A program for numerical classification
– Boulton, Wallace
- 1970
|
|
18
|
Myths and legends in learning classification rules
– Buntine
- 1990
|
|
16
|
Uncertain reasoning and forecasting
– Dagum, Galper, et al.
- 1995
|
|
16
|
Thinking backwards for knowledge acquisition
– Shachter, Heckerman
- 1987
|
|
13
|
Detecting novel classes with applications to fault diagnosis
– Smyth, Mellstrom
- 1992
|
|
10
|
Supervised learning and divide-and-conquer: A statistical approach
– Jordan, Jacobs
- 1993
|
|
9
|
Decision Analysis with Continuous and Discrete Variables: A Mixture Distribution Approach
– Poland
- 1994
|
|
7
|
Automated knowledge acquisition for PROSPECTOR-like expert systems
– Berka
- 1994
|
|
5
|
Initial exploration of the ASRS database
– Kraft, Buntine
- 1993
|
|
3
|
Structural controllability and observability in influence diagrams
– Chan, Shachter
- 1992
|
|
2
|
A computational scheme for reasoning in dynamic probabilistic networks
– Kjaeruff
- 1992
|
|
1
|
Bayesian clustering
– Cheeseman, Stutz
- 1995
|
|
1
|
The SKICAT system for sky survey cataloging and analysis
– Fayyad, Djorgovski, et al.
- 1995
|
|
1
|
Graphical Models for Discovering Knowledge 85
– Heckerman
- 1995
|