Discriminative Scoring of Bayesian Network Classifiers: a Comparative Study

Discriminative Scoring of Bayesian Network Classifiers: a Comparative Study

Cached

Download Links

[www.utia.cas.cz]

by Ad Feelders , Jevgenijs Ivanovs

BibTeX

@MISC{Feelders_discriminativescoring,
    author = {Ad Feelders and Jevgenijs Ivanovs},
    title = {Discriminative Scoring of Bayesian Network Classifiers: a Comparative Study},
    year = {}
}

Bookmark

OpenURL

Abstract

We consider the problem of scoring Bayesian Network Classifiers (BNCs) on the basis of the conditional loglikelihood (CLL). Currently, optimization is usually performed in BN parameter space, but for perfect graphs (such as Naive Bayes, TANs and FANs) a mapping to an equivalent Logistic Regression (LR) model is possible, and optimization can be performed in LR parameter space. We perform an empirical comparison of the efficiency of scoring in BN parameter space, and in LR parameter space using two different mappings. For each parameterization, we study two popular optimization methods: conjugate gradient, and BFGS. Efficiency of scoring is compared on simulated data and data sets from the UCI Machine Learning repository. 1

Citations

2529	C.J.E.: Uci repository of machine learning databases, http://www.ics.uci.edu/ ∼ mlearn/MLRepository.html - Blake, Keogh
1466	Numerical Recipes in C. The Art of Scientific Computing - PRESS, FLANNERY, et al. - 1988
126	An introduction to conditional random fields for relational learning - McCallum, Sutton - 2006
38	Multi-interval discretization of continuous valued attributes for classification learning - Fayyad, Irani - 1993
36	Structural extension to logistic regression: Discriminative parameter learning of belief net classifiers - Greiner, Su, et al.
21	Logistic discrimination - Anderson - 1982
17	Compact numerical methods for computers – linear algebra and function minimization - Nash - 1990
15	Bilmes. Discriminative versus generative parameter and structure learning of Bayesian network classifiers - Pernkopf, A - 2005
11	On discriminative Bayesian network classifiers and logistic regression - Roos, Wettig, et al. - 2005
2	2005. Discriminative learning of Bayesian network classifiers via the TM algorithm - Santafé, Lozano, et al.