Abstract

We carried out a study on monolingual translators with no knowledge of the source language, but aided by post-editing and the display of translation options. On Arabic-English and Chinese-English, using standard test data and current statistical machine translation systems, 10 monolingual translators were able to translate 35 % of Arabic and 28 % of Chinese sentences correctly on average, with some of the participants coming close to professional bilingual performance on some of the documents. While machine translation systems have advanced greatly over the last decade, nobody seriously expects human-level performance any time soon, except for very constraint settings. But are todays systems good enough to enable monolingual speakers of the target language without knowledge of the source language to generate correct translations? And what type of assistance from machine translation is most helpful for such translators? We carried out a study that involved monolingual translators who had no knowledge of Chinese and Arabic to translate documents from the NIST 20081 test sets, being assisted by statistical machine translation systems trained on data created under the GALE2 research program. Our study shows that monolingual translators were able to translate 35 % of Arabic and 28 % of Chinese sentences, under a strict standard of correctness that scored professional bilingual translations as 61 % and 66 % correct for Arabic and Chinese, respectively. We found also large variability among the participants and between the documents in the

Citations

434	Moses: Open source toolkit for statistical machine translation - Koehn, Hoang, et al. - 2007
15	Statistical approaches to computer-assisted translation - Barrachina, Bender, et al. - 2009
7	Correcting automatic translations through collaborations between MT and monolingual target-language users - Albrecht, Hwa, et al. - 2009
5	Interactive Assistance to Human Translators using Statistical Machine Translation Methods - Koehn, Haddow - 2009
4	B system description for the 2005 NIST MT evaluation exercise - Callison-Burch - 2005
4	A web-based interactive computer aided translation tool - Koehn - 2009
3	wikiBABEL: Community Creation of Multilingual Data - Kumaran, Saravanan, et al. - 2008
2	Association for Computational Linguistics - Callison-Burch, Koehn, et al. - 2009
2	Translating the world’s information with google translator toolkit - Galvez, Bhansali - 2009
1	Up close and personal with a translator - how translators really work - Desilets - 2009