Residential College | false |
Status | 已發表Published |
Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translation | |
Runzhe Zhan; Xuebo Liu; Derek F. Wong; Lidia S. Chao | |
2021-02-02 | |
Conference Name | 35th AAAI Conference on Artificial Intelligence, AAAI 2021 |
Source Publication | The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21) |
Volume | 16 |
Pages | 14310 - 14318 |
Conference Date | 02-09 February 2021 |
Conference Place | Virtual, Online |
Abstract | Meta-learning has been sufficiently validated to be beneficial for low-resource neural machine translation (NMT). How- ever, we find that meta-trained NMT fails to improve the translation performance of the domain unseen at the meta-training stage. In this paper, we aim to alleviate this issue by proposing novel meta-curriculum learning for domain adaptation in NMT. During meta-training, the NMT first learns the similar curricula from each domain to avoid falling into a bad local optimum early, and finally learns the curricula of individualities to improve the model robustness for learning domain-specific knowledge. Experimental results on 10 different low-resource domains show that meta-curriculum learning can improve the translation performance of both familiar and unfamiliar domains. All the codes and data are freely available at https://github.com/NLP2CT/ Meta-Curriculum. |
Keyword | Meta-curriculum Learning Machine Translation Domain Adaptation |
URL | View the original |
Indexed By | CPCI-S |
Language | 英語English |
WOS Research Area | Computer Science ; Education & Educational Research |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Interdisciplinary Applications ; Education, Scientific Disciplines |
WOS ID | WOS:000681269805111 |
The Source to Article | PB_Publication |
Scopus ID | 2-s2.0-85130093378 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Derek F. Wong |
Affiliation | NLP2CT Lab, Department of Computer and Information Science, University of Macau |
First Author Affilication | University of Macau |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Runzhe Zhan,Xuebo Liu,Derek F. Wong,et al. Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translation[C], 2021, 14310 - 14318. |
APA | Runzhe Zhan., Xuebo Liu., Derek F. Wong., & Lidia S. Chao (2021). Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translation. The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21), 16, 14310 - 14318. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment