• Documents
  • Authors
  • Tables
  • Other Seers ▼
    RefSeer AckSeer CollabSeer SeerSeer
  • Log in
  • Sign up
  • MetaCart

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations | Disambiguate

A Variational Bayesian Committee of Neural Networks (1999)

by Neil D. Lawrence, Mehdi Azzouzi
Add To MetaCart

Tools

Sorted by:
Results 1 - 3 of 3

A Comparison of State-of-the-Art Classification Techniques with Application to Cytogenetics

by Boaz Lerner, Neil D. Lawrence - Neural Comput. Appl , 2001
"... Several state-of-the-art techniques: a neural network, Bayesian neural network, support vector machine and naive Bayesian classifier are experimentally evaluated in discriminating fluorescence in-situ hybridization (FISH) signals. Highly-accurate classification of signals from real data and arti ..."
Abstract - Cited by 10 (6 self) - Add to MetaCart
Several state-of-the-art techniques: a neural network, Bayesian neural network, support vector machine and naive Bayesian classifier are experimentally evaluated in discriminating fluorescence in-situ hybridization (FISH) signals. Highly-accurate classification of signals from real data and artifacts of two cytogenetic probes (colours) is required for detecting abnormalities in the data. More than 3,100 FISH signals are classified by the techniques into colour and as real or artifact with accuracies of around 98% and 88%, respectively. The results of the comparison also show a trade-off between simplicity represented by the naive Bayesian classifier and high classification performance represented by the other techniques. Keywords: Bayesian neural network; Fluorescence in situ hybridization (FISH); Multilayer perceptron; Naive Bayesian classifier; Signal classification; Support vector machine; 1 Introduction In recent years, fluorescence in-situ hybridization (FISH) has eme...

Variational Bayesian Independent Component Analysis

by Neil D. Lawrence, Christopher M. Bishop , 1999
"... Blind separation of signals through the info-max algorithm may be viewed as maximum likelihood learning in a latent variable model. In this paper we present an alternative approach to maximum likelihood learning in these models, namely Bayesian inference. It has already been shown how Bayesian infer ..."
Abstract - Cited by 7 (0 self) - Add to MetaCart
Blind separation of signals through the info-max algorithm may be viewed as maximum likelihood learning in a latent variable model. In this paper we present an alternative approach to maximum likelihood learning in these models, namely Bayesian inference. It has already been shown how Bayesian inference can be applied to determine latent dimensionality in principal component analysis models (Bishop, 1999a). In this paper we derive a similar approach for removing unecessary source dimensions in an independent component analysis model. We present esults on a toy data-set and on some artificially mixed images.

Multimodal nonlinear filtering using Gauss-Hermite Quadrature

by Hannes P. Saal, Nicolas M. O. Heess, Sethu Vijayakumar
"... Abstract. In many filtering problems the exact posterior state distribution is not tractable and is therefore approximated using simpler parametric forms, such as single Gaussian distributions. In nonlinear filtering problems the posterior state distribution can, however, take complex shapes and eve ..."
Abstract - Add to MetaCart
Abstract. In many filtering problems the exact posterior state distribution is not tractable and is therefore approximated using simpler parametric forms, such as single Gaussian distributions. In nonlinear filtering problems the posterior state distribution can, however, take complex shapes and even become multimodal so that single Gaussians are no longer sufficient. A standard solution to this problem is to use a bank of independent filters that individually represent the posterior with a single Gaussian and jointly form a mixture of Gaussians representation. Unfortunately, since the filters are optimized separately and interactions between the components consequently not taken into account, the resulting representation is typically poor. As an alternative we therefore propose to directly optimize the full approximating mixture distribution by minimizing the KL divergence to the true state posterior. For this purpose we describe a deterministic sampling approach that allows us to perform the intractable minimization approximately and at reasonable computational cost. We find that the proposed method models multimodal posterior distributions noticeably better than banks of independent filters even when the latter are allowed many more mixture components. We demonstrate the importance of accurately representing the posterior with a tractable number of components in an active learning scenario where we report faster convergence, both in terms of number of observations processed and in terms of computation time, and more reliable convergence on up to ten-dimensional problems. 1
The National Science Foundation
  • About CiteSeerX
  • Submit Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2010 The Pennsylvania State University