• Documents
  • Authors
  • Tables
  • Other Seers ▼
    RefSeer AckSeer CollabSeer SeerSeer
  • Log in
  • Sign up
  • MetaCart

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations | Disambiguate

Multivariate information bottleneck (2001)

Cached

  • Download as a PDF

Download Links

  • [www.princeton.edu]
  • [www.cs.huji.ac.il]
  • [www.csail.mit.edu]
  • [www.cs.huji.ac.il]
  • [www.cs.huji.ac.il]
  • [www.cs.huji.ac.il]
  • [www.cs.huji.ac.il]
  • [robotics.stanford.edu]
  • [www.cs.huji.ac.il]
  • [www.cs.huji.ac.il]
  • [robotics.stanford.edu]
  • [robotics.stanford.edu]
  • [www.cs.huji.ac.il]

  • Other Repositories/Bibliography

  • DBLP
  • Save to List
  • Add to Collection
  • Correct Errors
  • Monitor Changes
by Nir Friedman , Ori Mosenzon , Noam Slonim , Naftali Tishby
Citations:76 - 14 self
  • Summary
  • Active Bibliography
  • Co-citation
  • Clustered Documents
  • Version History

BibTeX

@INPROCEEDINGS{Friedman01multivariateinformation,
    author = {Nir Friedman and Ori Mosenzon and Noam Slonim and Naftali Tishby},
    title = {Multivariate information bottleneck},
    booktitle = {},
    year = {2001},
    pages = {152--161},
    publisher = {Morgan Kaufmann Publishers}
}

Years of Citing Articles

Bookmark

citeulike Connotea Bibsonomy Del.icio.us Digg Reddit

OpenURL

 

Abstract

The Information bottleneck method is an unsupervised non-parametric data organization technique. Given a joint distribution¢¤£¦¥¨§�©� � , this method constructs a new variable � that extracts partitions, or clusters, over the values of ¥ that are informative about ©. The information bottleneck has already been applied to document classification, gene expression, neural code, and spectral analysis. In this paper, we introduce a general principled framework for multivariate extensions of the information bottleneck method. This allows us to consider multiple systems of data partitions that are inter-related. Our approach utilizes Bayesian networks for specifying the systems of clusters and what information each captures. We show that this construction provides insight about bottleneck variations and enables us to characterize solutions of these variations. We also present a general framework for iterative algorithms for constructing solutions, and apply it to several examples. 1

Citations

6517 Elements of Information Theory - Cover, Thomas - 1991
5662 Probabilistic reasoning in intelligent systems: networks of plausible inference - Pearl - 1988
832 An information-maximization approach to blind separation and blind deconvolution - Bell, Sejnowski - 1995
545 Probabilistic Latent Semantic Indexing - Hofmann - 1999
477 Distributional clustering of English words - Pereira, Tishby, et al. - 1993
353 Newsweeder: Learning to filter netnews - Lang - 1995
328 The information bottleneck method - Tishby, Pereira, et al. - 1999
298 Divergence measures based on the Shannon entropy - Lin - 1991
197 Distributional clustering of words for text classi - Baker, McCallum - 1998
193 Deterministic annealing for clustering, compression, classification, regression, and related optimization problems - Rose - 1998
122 Document clustering using word clusters via the information bottleneck method - Slonim, Tishby - 2000
117 Agglomerative information bottleneck - Slonim, Tishby - 1999
59 Data clustering by markovian relaxation and the information bottleneck method - Tishby, Slonim - 2000
53 The power of word clusters for text classification - Slonim, Tishby - 2001
21 Newsweeder: Learning to lter netnews - Lang - 1995
10 Molecular classi¯cation of cancer: Class discovery and class prediction by gene expression monitoring, Science 286 - Golub, Slonim, et al. - 1999
6 The power of word clusters for text classi…cation - Slonim, Tishby - 2001
3 Agnostic classi®cation of markovian sequences - El-Yaniv, Fine - 1997
3 Objective spectral classi^cation of galaxies using the information bottleneck method - Slonim, Somerville, et al. - 2001
2 Objective spectral classification of galaxies using the information bottleneck method - Slonim, Somerville, et al. - 2001
The National Science Foundation
  • About CiteSeerX
  • Submit Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2010 The Pennsylvania State University