Logistic Regression, AdaBoost and Bregman Distances

Logistic Regression, AdaBoost and Bregman Distances (2000)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Michael Collins , Robert E. Schapire , Yoram Singer

Venue:	MACHINE LEARNING
Citations:	171 - 39 self

Versions

Version History

Metadata Version 4

User correction supplied by mph

Datum	Value	Source
TITLE	Logistic Regression, AdaBoost and Bregman Distances	user correction - Legacy Corrections
AUTHOR NAME	Michael Collins	user correction
AUTHOR AFFIL	AT&T Labs -- Research; Shannon Laboratory	user correction
AUTHOR ADDR	180 Park Avenue, Room A253; Florham Park, NJ 07932	user correction
AUTHOR NAME	Robert E. Schapire	user correction
AUTHOR AFFIL	AT&T Labs -- Research; Shannon Laboratory	user correction
AUTHOR ADDR	180 Park Avenue, Room A203; Florham Park, NJ 07932	user correction
AUTHOR NAME	Yoram Singer	user correction
AUTHOR AFFIL	School of Computer Science & Engineering	user correction
AUTHOR ADDR	Hebrew University, Jerusalem 91904, Israel	user correction
ABSTRACT	We give a unified account of boosting and logistic regression in which each learning problem is cast in terms of optimization of Bregman distances. The striking similarity of the two problems in this framework allows us to design and analyze algorithms for both simultaneously, and to easily adapt algorithms designed for one problem to the other. For both problems, we give new algorithms and explain their potential advantages over existing methods. These algorithms can be divided into two types based on whether the parameters are iteratively updated sequentially (one at a time) or in parallel (all at once). We also describe a parameterized family of algorithms which interpolates smoothly between these two extremes. For all of the algorithms, we give convergence proofs using a general formalization of the auxiliary-function proof technique. As one of our sequential-update algorithms is equivalent to AdaBoost, this provides the first general proof of convergence for AdaBoost. We show th...	user correction
YEAR	2000	INFERENCE
VENUE	MACHINE LEARNING	user correction
VENUE TYPE	CONFERENCE	INFERENCE
PAGES	158--169	INFERENCE
VOLUME	48	INFERENCE
CITATIONS	22 found	ParsCit 1.0