Residential College | false |
Status | 已發表Published |
SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering | |
Zhu, Xian1,2; Chen, Yuanyuan3; Gu, Yueming4; Xiao, Zhifeng5 | |
2022-03-10 | |
Source Publication | Frontiers in Neurorobotics |
ISSN | 1662-5218 |
Volume | 16Pages:773329 |
Abstract | Recent advances have witnessed a trending application of transfer learning in a broad spectrum of natural language processing (NLP) tasks, including question answering (QA). Transfer learning allows a model to inherit domain knowledge obtained from an existing model that has been sufficiently pre-trained. In the biomedical field, most QA datasets are limited by insufficient training examples and the presence of factoid questions. This study proposes a transfer learning-based sentiment-aware model, named SentiMedQAer, for biomedical QA. The proposed method consists of a learning pipeline that utilizes BioBERT to encode text tokens with contextual and domain-specific embeddings, fine-tunes Text-to-Text Transfer Transformer (T5), and RoBERTa models to integrate sentiment information into the model, and trains an XGBoost classifier to output a confidence score to determine the final answer to the question. We validate SentiMedQAer on PubMedQA, a biomedical QA dataset with reasoning-required yes/no questions. Results show that our method outperforms the SOTA by 15.83% and a single human annotator by 5.91%. |
Keyword | Biomedical Question Answering Roberta Sentiment Analysis T5 Transfer Learning Xgboost |
DOI | 10.3389/fnbot.2022.773329 |
URL | View the original |
Indexed By | SCIE ; SSCI |
Language | 英語English |
WOS Research Area | Computer Science ; Robotics ; Neurosciences & Neurology |
WOS Subject | Computer Science, Artificial Intelligence ; Robotics ; Neurosciences |
WOS ID | WOS:000778370800001 |
Publisher | FRONTIERS MEDIA SA, AVENUE DU TRIBUNAL FEDERAL 34, LAUSANNE CH-1015, SWITZERLAND |
Scopus ID | 2-s2.0-85127602109 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | INSTITUTE OF COLLABORATIVE INNOVATION |
Corresponding Author | Xiao, Zhifeng |
Affiliation | 1.School of Information Management, Nanjing University, Nanjing, China 2.School of Health Economics and Management, Nanjing University of Chinese Medicine, Nanjing, China 3.Centre for Data Science, Institute of Collaborative Innovation, University of Macau, Macao 4.School of Computing and Information Systems, Faculty of Engineering and Information Technology, University of Melbourne, Parkville, Australia 5.School of Engineering, Penn State Erie, The Behrend College, Erie, United States |
Recommended Citation GB/T 7714 | Zhu, Xian,Chen, Yuanyuan,Gu, Yueming,et al. SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering[J]. Frontiers in Neurorobotics, 2022, 16, 773329. |
APA | Zhu, Xian., Chen, Yuanyuan., Gu, Yueming., & Xiao, Zhifeng (2022). SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering. Frontiers in Neurorobotics, 16, 773329. |
MLA | Zhu, Xian,et al."SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering".Frontiers in Neurorobotics 16(2022):773329. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment