Automatic identification of document translations in large multilingual document collections (2003)
Cached
Download Links
- [langtech.jrc.it]
- [langtech.jrc.ec.europa.eu]
- DBLP
Other Repositories/Bibliography
| Venue: | In RANLP 2003 – Proceedings of the International Conference on ‘Recent Advances in Natural Language Processing |
| Citations: | 4 - 0 self |
BibTeX
@INPROCEEDINGS{Pouliquen03automaticidentification,
author = {Bruno Pouliquen and Ralf Steinberger and Camelia Ignat},
title = {Automatic identification of document translations in large multilingual document collections},
booktitle = {In RANLP 2003 – Proceedings of the International Conference on ‘Recent Advances in Natural Language Processing},
year = {2003},
pages = {401--408}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
Texts and their translations are a rich linguistic resource that can be used to train and test statistics-based Machine Translation systems and many other applications. In this paper, we present a working system that can identify translations and other very similar documents among a large number of candidates, by representing the document contents with a vector of thesaurus terms from a multilingual thesaurus, and by then measuring the semantic similarity between the vectors. Tests on different text types have shown that the system can detect translations with over 96 % precision in a large search space of 820 documents or more. The system was tuned to ignore languagespecific similarities and to give similar documents in a second language the same similarity score as equivalent documents in the same language. The application can also be used to detect cross-lingual document plagiarism. 1
