Residential College | false |
Status | 已發表Published |
LEPOR: A Robust Evaluation Metric for Machine Translation with Augmented Factors | |
Aaron L. F. HAN; Derek F. WONG; Lidia S. CHAO | |
2012 | |
Conference Name | Proceedings of COLING 2012: Posters |
Source Publication | COLING 2012: Posters |
Pages | 441–450 |
Conference Date | December 2012. |
Conference Place | Mumbai |
Abstract | In the conventional evaluation metrics of machine translation, considering less information about the translations usually makes the result not reasonable and low correlation with human judgments. On the other hand, using many external linguistic resources and tools (e.g. Part-ofspeech tagging, morpheme, stemming, and synonyms) makes the metrics complicated, timeconsuming and not universal due to that different languages have the different linguistic features. This paper proposes a novel evaluation metric employing rich and augmented factors without relying on any additional resource or tool. Experiments show that this novel metric yields the state-of-the-art correlation with human judgments compared with classic metrics BLEU, TER, Meteor-1.3 and two latest metrics (AMBER and MP4IBM1), which proves it a robust one by employing a feature-rich and model-independent approach. |
Keyword | Machine Translation Recall Precision Modified Length Penalty Context-dependent N-gram Alignment Evaluation Metric |
Language | 英語English |
Document Type | Conference paper |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Affiliation | Natural Language Processing & Portuguese-Chinese Machine Translation Laboratory Department of Computer and Information Science University of Macau Macau S.A.R., China |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Aaron L. F. HAN,Derek F. WONG,Lidia S. CHAO. LEPOR: A Robust Evaluation Metric for Machine Translation with Augmented Factors[C], 2012, 441–450. |
APA | Aaron L. F. HAN., Derek F. WONG., & Lidia S. CHAO (2012). LEPOR: A Robust Evaluation Metric for Machine Translation with Augmented Factors. COLING 2012: Posters, 441–450. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment