Results 1 -
1 of
1
Empirical Machine Translation and its Evaluation by
"... i a la vida, un gran mètode This monographic work is devoted to the application of current Natural Language Processing technology to Empirical Machine Translation and its Evaluation. On the one side, we have studied the problem of automatic MT evaluation. We have analyzed the main deficiencies of cu ..."
Abstract
- Add to MetaCart
i a la vida, un gran mètode This monographic work is devoted to the application of current Natural Language Processing technology to Empirical Machine Translation and its Evaluation. On the one side, we have studied the problem of automatic MT evaluation. We have analyzed the main deficiencies of current evaluation methods, which arise, in our opinion, from the shallow quality principles upon which they are based. Instead of relying on the lexical dimension alone, we suggest a novel path towards heterogeneous evaluations. Our approach is based on the design of a rich set of automatic metrics devoted to capture a wide variety of translation quality aspects at different linguistic levels (lexical, syntactic and semantic). Linguistic metrics have been evaluated over different scenarios. The most notable finding is that metrics based on deeper linguistic information (syntactic/semantic) are able to produce more reliable system rankings than metrics which limit their scope to the lexical dimension, specially when the systems under evaluation are different in nature. However, at the sentence level, some of these metrics suffer a significant decrease,

