Bias Plus Variance Decomposition for Zero-One Loss Functions (1996) [131 citations — 3 self]
Popular Tags
No tags have been applied to this document.
BibTeX | Add To MetaCart
author = {Ron Kohavi and David H. Wolpert},
title = {Bias Plus Variance Decomposition for Zero-One Loss Functions},
year = {1996}
}
Bookmarks
OpenURL
Abstract:
We present a bias-variance decomposition of expected misclassification rate, the most commonly used loss function in supervised classification learning. The bias-variance decomposition for quadratic loss functions is well known and serves as an important tool for analyzing learning algorithms, yet no decomposition was offered for the more commonly used zero-one (misclassification) loss functions until the recent work of Kong & Dietterich (1995) and Breiman (1996). Their decomposition suffers from some major shortcomings though (e.g., potentially negative variance), which our decomposition avoids. We show that, in practice, the naive frequency-based estimation of the decomposition terms is by itself biased and show how to correct for this bias. We illustrate the decomposition on various algorithms and datasets from the UCI repository. 1 Introduction The bias plus variance decomposition (Geman, Bienenstock & Doursat 1992) is a powerful tool from sampling theory statistics for analyzing ...
