Morphological analysis for statistical machine translation (2004)
| Venue: | In Proceedings of the Human Language Technology, Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL |
| Citations: | 20 - 0 self |
BibTeX
@INPROCEEDINGS{Lee04morphologicalanalysis,
author = {Young-suk Lee},
title = {Morphological analysis for statistical machine translation},
booktitle = {In Proceedings of the Human Language Technology, Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL},
year = {2004},
pages = {57--60}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We present a novel morphological analysis technique which induces a morphological and syntactic symmetry between two languages with highly asymmetrical morphological structures to improve statistical machine translation qualities. The technique pre-supposes fine-grained segmentation of a word in the morphologically rich language into the sequence of prefix(es)-stem-suffix(es) and part-of-speech tagging of the parallel corpus. The algorithm identifies morphemes to be merged or deleted in the morphologically rich language to induce the desired morphological and syntactic symmetry. The technique improves Arabic-to-English translation qualities significantly when applied to IBM Model 1 and Phrase Translation Models trained on the training corpus size ranging from 3,500 to 3.3 million sentence pairs. 1.
Citations
| 992 | BLEU: A Method for Automatic Evaluation of Machine Translation - Papineni, Roukos, et al. - 2002 |
| 892 | Mathematics of Statistical Machine Translation: Parameter Estimation - Brown, Pietra, et al. - 1993 |
| 202 | K.: A syntax-based statistical translation model - Yamada, Knight - 2001 |
| 28 | A projection extension algorithm for statistical machine translation - Tillmann - 2003 |
| 22 | Language model based Arabic word segmentation - Lee, Papineni, et al. - 2003 |
| 22 | Improving SMT Quality with Morpho-syntactic Analysis - Niessen, Ney - 2000 |
| 6 | Discriminative training and maximum entropy models for statistical machine translation - unknown authors - 2002 |
