METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments

METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments (2005)

Cached

Download Links

by Alon Lavie , Abhaya Agarwal

Citations:

BibTeX

@INPROCEEDINGS{Lavie05meteor:an,
    author = {Alon Lavie and Abhaya Agarwal},
    title = {METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments},
    booktitle = {},
    year = {2005},
    pages = {65--72}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

Meteor is an automatic metric for Machine Translation evaluation which has been demonstrated to have high levels of correlation with human judgments of translation quality, significantly outperforming the more commonly used Bleu metric. It is one of several automatic metrics used in this year’s shared task within the ACL WMT-07 workshop. This paper recaps the technical details underlying the metric and describes recent improvements in the metric. The latest release includes improved metric parameters and extends the metric to support evaluation of MT output in Spanish, French and German, in addition to English. 1

Citations

204	A Study of Translation Edit Rate with Targeted Human Annotation - Snover, Dorr, et al. - 2006
96	Syntax-based alignment of multiple translations: Extracting paraphrases and generating new sentences - Pang, Knight, et al. - 2003
48	Confidence estimation for machine translation - Blatz, Fitzgerald, et al. - 2004
13	The Porter Stemming Algorithm,” http://www.tartarus.org/~martin/PorterStemmer - Porter
5	Efficient MT Evaluation Using Block Movements - CDER
3	Andrei Popescu-Belis and Eduard Hovy (2003) “FEMTI: creating and using a framework for MT evaluation - King
2	Interface to Snowball Stemmers. http://search.cpan.org - Perl
2	The Significance of Recall in Automatic Metrics for MT Evaluation - Leusch, Ueffing, et al. - 2004
1	Kenji Sagae and Shyamsundar Jayaraman, 2004. The Significance of Recall in Automatic Metrics for MT Evaluation - Lavie - 2004