## An equivalence between sparse approximation and Support Vector Machines (1997)

### Cached

### Download Links

- [dspace.mit.edu]
- [www.ai.mit.edu]
- [publications.ai.mit.edu]
- [alpha-bits.ai.mit.edu]
- DBLP

### Other Repositories/Bibliography

Venue: | A.I. Memo 1606, MIT Arti cial Intelligence Laboratory |

Citations: | 216 - 7 self |

### BibTeX

@ARTICLE{Girosi97anequivalence,

author = {Federico Girosi},

title = {An equivalence between sparse approximation and Support Vector Machines},

journal = {A.I. Memo 1606, MIT Arti cial Intelligence Laboratory},

year = {1997}

}

### Years of Citing Articles

### OpenURL

### Abstract

This publication can be retrieved by anonymous ftp to publications.ai.mit.edu. The pathname for this publication is: ai-publications/1500-1999/AIM-1606.ps.Z This paper shows a relationship between two di erent approximation techniques: the Support Vector Machines (SVM), proposed by V.Vapnik (1995), and a sparse approximation scheme that resembles the Basis Pursuit De-Noising algorithm (Chen, 1995 � Chen, Donoho and Saunders, 1995). SVM is a technique which can be derived from the Structural Risk Minimization Principle (Vapnik, 1982) and can be used to estimate the parameters of several di erent approximation schemes, including Radial Basis Functions, algebraic/trigonometric polynomials, B-splines, and some forms of Multilayer Perceptrons. Basis Pursuit De-Noising is a sparse approximation technique, in which a function is reconstructed by using a small number of basis functions chosen from a large set (the dictionary). We show that, if the data are noiseless, the modi ed version of Basis Pursuit De-Noising proposed in this paper is equivalent to SVM in the following sense: if applied to the same data set the two techniques give the same solution, which is obtained by solving the same quadratic programming problem. In the appendix we also present a derivation of the SVM technique in the framework of regularization theory, rather than statistical learning theory, establishing a connection between SVM, sparse approximation and regularization theory.