Online Learning Methods For Discriminative Training of Phrase Based Statistical Machine Translation
| Citations: | 9 - 1 self |
BibTeX
@MISC{Arun_onlinelearning,
author = {Abhishek Arun},
title = {Online Learning Methods For Discriminative Training of Phrase Based Statistical Machine Translation},
year = {}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
This paper investigates the task of training discriminatively a phrase based SMT system with millions of features using the structured perceptron and the Margin Infused Relax Algorithm (MIRA), two popular online learning algorithms. We also compare two different update strategies, one where we update towards an oracle translation candidate extracted from an N-best list vs a more aggressive approach in which we update towards an oracle extracted prior to training using a minloss decoder. We evaluate our different training algorithms on the Czech-English translation task. Our results show that while both learning algorithms achieve similar results, with the perceptron converging more rapidly, the aggressive update strategy performs significantly worse than the more conservative strategy corroborating Liang et al. (2006)’s findings. 1.
Citations
| 805 | A systematic comparison of various statistical alignment models - Och, Ney - 2003 |
| 175 | Ultraconservative online algorithms for multiclass problems - Crammer, Singer - 2003 |
| 114 | Building a Syntactically Annotated Corpus: The Prague Dependency Treebank - Hajič - 1998 |
| 77 | An end-to-end discriminative approach to machine translation - Liang, Bouchard-Côté, et al. - 2006 |
| 63 | R.L.: The mathematics of statistical machine translation: Parameter estimation - Brown, Pietra, et al. - 1993 |
| 5 | System Description for the 2005 IWSLT Speech Translation Evaluation - Edinburgh - 2005 |
| 1 | Statistical phrase-based translation - Axelrod, Callison-Burch, et al. |
