## Order-based Discriminative Structure Learning for Bayesian Network Classifiers

Citations: | 1 - 1 self |

### BibTeX

@MISC{Pernkopf_order-baseddiscriminative,

author = {Franz Pernkopf and Jeff Bilmes},

title = {Order-based Discriminative Structure Learning for Bayesian Network Classifiers},

year = {}

}

### OpenURL

### Abstract

We introduce a simple empirical order-based greedy heuristic for learning discriminative Bayesian network structures. We propose two metrics for establishing the ordering of N features. They are based on the conditional mutual information. Given an ordering, we can find the discriminative classifier structure with O (N q) score evaluations (where constant q is the maximum number of parents per node). We present classification results on the UCI repository (Merz, Murphy, & Aha 1997), for a phonetic classification task using the TIMIT database (Lamel, Kassel, & Seneff 1986), and for the MNIST handwritten digit recognition task (Le-Cun et al. 1998). The discriminative structure found by our new procedures significantly outperforms generatively produced structures, and achieves a classification accuracy on par with the best discriminative (naive greedy) Bayesian network learning approach, but does so with a factor of ∼10 speedup. We also show that the advantages of generative discriminatively structured Bayesian network classifiers still hold in the case of missing features. 1