Kernel design using boosting (2003)
| Venue: | In Advances in Neural Information Processing Systems 15 |
| Citations: | 50 - 0 self |
BibTeX
@INPROCEEDINGS{Crammer03kerneldesign,
author = {Koby Crammer and Joseph Keshet and Yoram Singer},
title = {Kernel design using boosting},
booktitle = {In Advances in Neural Information Processing Systems 15},
year = {2003},
pages = {537--544},
publisher = {MIT Press}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
The focus of the paper is the problem of learning kernel operators from empirical data. We cast the kernel design problem as the construction of an accurate kernel from simple (and less accurate) base kernels. We use the boosting paradigm to perform the kernel construction process. To do so, we modify the booster so as to accommodate kernel operators. We also devise an efficient weak-learner for simple kernels that is based on generalized eigen vector decomposition. We demonstrate the effectiveness of our approach on synthetic data and on the USPS dataset. On the USPS dataset, the performance of the Perceptron algorithm with learned kernels is systematically better than a fixed RBF kernel. 1 Introduction and problem Setting The last decade brought voluminous amount of work on the design, analysis and experimentation of kernel machines. Algorithm based on kernels can be used for various machine learning tasks such as classification, regression, ranking, and principle component
Citations
No citations identified.
