UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task
Han, Aaron Li-Feng; Derek F. Wong; Lidia S. Chao; Yi Lu; Liangye He; Yiming Wang; Jiaji Zhou
2013
Conference Namethe Eighth Workshop on Statistical Machine Translation
Source PublicationProceedings of the Eighth Workshop on Statistical Machine Translation
Pages414–421
Conference DateAugust 8-9, 2013
Conference PlaceSofia, Bulgaria
Abstract

This paper is to describe our machine translation evaluation systems used for participation in the WMT13 shared Metrics Task. In the Metrics task, we submitted two automatic MT evaluation systems nLEPOR_baseline and LEPOR_v3.1. nLEPOR_baseline is an n-gram based language independent MT evaluation metric employing the factors of modified sentence length penalty, position difference penalty, n-gram precision and n-gram recall. nLEPOR_baseline measures the similarity of the system output translations and the reference translations only on word sequences. LEPOR_v3.1 is a new version of LEPOR metric using the mathematical harmonic mean to group the factors and employing some linguistic features, such as the part-of-speech information. The evaluation results of WMT13 show LEPOR_v3.1 yields the highest averagescore 0.86 with human judgments at systemlevel using Pearson correlation criterion on English-to-other (FR, DE, ES, CS, RU) language pairs.

URLView the original
Language英語English
Document TypeConference paper
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
AffiliationNatural Language Processing & Portuguese-Chinese Machine Translation Laboratory Department of Computer and Information Science University of Macau, Macau S.A.R. China
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Han, Aaron Li-Feng,Derek F. Wong,Lidia S. Chao,et al. A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task[C], 2013, 414–421.
APA Han, Aaron Li-Feng., Derek F. Wong., Lidia S. Chao., Yi Lu., Liangye He., Yiming Wang., & Jiaji Zhou (2013). A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task. Proceedings of the Eighth Workshop on Statistical Machine Translation, 414–421.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Han, Aaron Li-Feng]'s Articles
[Derek F. Wong]'s Articles
[Lidia S. Chao]'s Articles
Baidu academic
Similar articles in Baidu academic
[Han, Aaron Li-Feng]'s Articles
[Derek F. Wong]'s Articles
[Lidia S. Chao]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Han, Aaron Li-Feng]'s Articles
[Derek F. Wong]'s Articles
[Lidia S. Chao]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.