The Significance of Recall in Automatic Metrics for MT Evaluation (2004)

by Gregor Leusch, Nicola Ueffing, Hermann Ney
Venue:In Proceedings of the 6th Conference of the Association for Machine Translation in the Americas (AMTA-2004
Add To MetaCart
Results 1 - 1 of 1

METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments

by Alon Lavie, Abhaya Agarwal , 2005
"... Meteor is an automatic metric for Machine Translation evaluation which has been demonstrated to have high levels of correlation with human judgments of translation quality, significantly outperforming the more commonly used Bleu metric. It is one of several automatic metrics used in this year’s shar ..."
Abstract - Cited by 88 (5 self) - Add to MetaCart
Meteor is an automatic metric for Machine Translation evaluation which has been demonstrated to have high levels of correlation with human judgments of translation quality, significantly outperforming the more commonly used Bleu metric. It is one of several automatic metrics used in this year’s shared task within the ACL WMT-07 workshop. This paper recaps the technical details underlying the metric and describes recent improvements in the metric. The latest release includes improved metric parameters and extends the metric to support evaluation of MT output in Spanish, French and German, in addition to English. 1