Re-evaluating the role of BLEU in machine translation research (2006)
Cached
Download Links
by
Chris Callison-burch
,
Miles Osborne
| Venue: | In EACL |
| Citations: | 53 - 3 self |
BibTeX
@INPROCEEDINGS{Callison-burch06re-evaluatingthe,
author = {Chris Callison-burch and Miles Osborne},
title = {Re-evaluating the role of BLEU in machine translation research},
booktitle = {In EACL},
year = {2006},
pages = {249--256}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We argue that the machine translation community is overly reliant on the Bleu machine translation evaluation metric. We show that an improved Bleu score is neither necessary nor sufficient for achieving an actual improvement in translation quality, and give two significant counterexamples to Bleu’s correlation with human judgments of quality. This offers new potential for research which was previously deemed unpromising by an inability to improve upon Bleu scores. 1
