Ridge Regression Learning Algorithm in Dual Variables (1998)
| Venue: | In Proceedings of the 15th International Conference on Machine Learning |
| Citations: | 77 - 6 self |
BibTeX
@INPROCEEDINGS{Saunders98ridgeregression,
author = {C. Saunders and A. Gammerman and V. Vovk},
title = {Ridge Regression Learning Algorithm in Dual Variables},
booktitle = {In Proceedings of the 15th International Conference on Machine Learning},
year = {1998},
pages = {515--521},
publisher = {Morgan Kaufmann}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
In this paper we study a dual version of the Ridge Regression procedure. It allows us to perform non-linear regression by constructing a linear regression function in a high dimensional feature space. The feature space representation can result in a large increase in the number of parameters used by the algorithm. In order to combat this "curse of dimensionality", the algorithm allows the use of kernel functions, as used in Support Vector methods. We also discuss a powerful family of kernel functions which is constructed using the ANOVA decomposition method from the kernel corresponding to splines with an infinite number of nodes. This paper introduces a regression estimation algorithm which is a combination of these two elements: the dual version of Ridge Regression is applied to the ANOVA enhancement of the infinitenode splines. Experimental results are then presented (based on the Boston Housing data set) which indicate the performance of this algorithm relative to other algorithms....
Citations
| 6694 | Statistical Learning Theory - Vapnik - 1998 |
| 1998 | Bagging predictors - Breiman - 1996 |
| 194 | Some results on Tchebycheffian spline functions - Kimeldorf, Wahba - 1971 |
| 122 | Support Vector Machines, Reproducing Kernel Hilbert Spaces and the randomized GACV - Wahba - 1997 |
| 112 | Spline Models for Observational Data, volume 59 - Wahba - 1990 |
| 98 | Support vector regression machines - Drucker, Burges, et al. - 1997 |
| 50 | Learning by transduction - Gammerman, Vapnik, et al. - 1998 |
| 26 | Support vector regression with ANOVA decomposition kernels. Advances in kernel methods: Support vector learning - Stitson, Gammerman, et al. - 1999 |
| 6 | Ridge Regression in dual variables - Saunders, Gammerman, et al. - 1998 |
| 3 | An equivalence between sparce approximations and Support Vector Machines - Girosi - 1997 |
