DMCA
On the Evaluation of Document Analysis Components by Recall, Precision, and Accuracy (1999)
Cached
Download Links
- [www.dfki.uni-kl.de]
- [www.dfki.uni-kl.de]
- DBLP
Other Repositories/Bibliography
| Venue: | Precision and Accuracy”, International Conference on Document Analysis and Recognition, India |
| Citations: | 30 - 0 self |
BibTeX
@INPROCEEDINGS{Junker99onthe,
author = {Markus Junker and Rainer Hoch and Andreas Dengel},
title = {On the Evaluation of Document Analysis Components by Recall, Precision, and Accuracy},
booktitle = {Precision and Accuracy”, International Conference on Document Analysis and Recognition, India},
year = {1999},
pages = {713--716}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
In document analysis, it is common to prove the usefulness of a component by an experimental evaluation. By applying the respective algorithms to a test sample, some effectiveness measures such as recall, precision, and accuracy are computed. The goal of such an evaluation is two-fold: on the one hand it shows that the absolute effectiveness of the algorithm is acceptable for practical use. On the other hand, the evaluation can prove that the algorithm has a better or worse effectiveness than another algorithm. In this paper we argue that the experimental evaluation on relative small test sets -- as is very common in document analysis -- has to be taken with extreme care from a statistical point of view. In fact, it is surprising how weak statements derived from such evaluations are. 1 Introduction The task of document analysis is to transform printed documents into an equivalent electronic representation. Typical problems of document analysis systems are: image processing, layout se...
Keyphrases
document analysis component document analysis experimental evaluation test sample practical use weak statement statistical point effectiveness measure absolute effectiveness extreme care typical problem equivalent electronic representation respective algorithm printed document relative small test set document analysis system layout se image processing
