Mutual Information in Learning Feature Transformations (2000)
| Venue: | In Proceedings of the 17th International Conference on Machine Learning |
| Citations: | 42 - 7 self |
BibTeX
@INPROCEEDINGS{Torkkola00mutualinformation,
author = {Kari Torkkola and William M. Campbell},
title = {Mutual Information in Learning Feature Transformations},
booktitle = {In Proceedings of the 17th International Conference on Machine Learning},
year = {2000},
pages = {1015--1022},
publisher = {Morgan Kaufmann}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We present feature transformations useful for exploratory data analysis or for pattern recognition. Transformations are learned from example data sets by maximizing the mutual information between transformed data and their class labels. We make use of Renyi's quadratic entropy, and we extend the work of Principe et al. to mutual information between continuous multidimensional variables and discrete-valued class labels. 1.
Citations
| 2107 | Introduction to statistical pattern recognition - Fukunaga - 1990 |
| 480 | On estimation of a probability density function and mode - Parzen - 1962 |
| 140 | Using mutual information for selecting features in supervised neural net learning - Battiti - 1994 |
| 99 | Transmission of Information: A Statistical Theory of Communication - Fano - 1961 |
| 55 | LVQ PAK: A program package for the correct application of Learning Vector Quantization algorithms - Kohonen, Kangas, et al. |
| 43 | Selecting Input Variables Using Mutual Information and Nonparametric Density Estimation - Bonnlander, Weigend - 1994 |
| 42 | Measures of Information and Their Applications - Kapur - 1995 |
| 27 | An optimal orthonormal system for discriminant analysis - Okada, Tomita - 1985 |
| 25 | Information theoretic learning - Príncipe, Xu, et al. - 2000 |
| 17 | Assaleh, “Polynomial classifier techniques for speaker verification - Campbell, T - 1999 |
