UM  > INSTITUTE OF COLLABORATIVE INNOVATION
Residential Collegefalse
Status已發表Published
SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering
Zhu, Xian1,2; Chen, Yuanyuan3; Gu, Yueming4; Xiao, Zhifeng5
2022-03-10
Source PublicationFrontiers in Neurorobotics
ISSN1662-5218
Volume16Pages:773329
Abstract

Recent advances have witnessed a trending application of transfer learning in a broad spectrum of natural language processing (NLP) tasks, including question answering (QA). Transfer learning allows a model to inherit domain knowledge obtained from an existing model that has been sufficiently pre-trained. In the biomedical field, most QA datasets are limited by insufficient training examples and the presence of factoid questions. This study proposes a transfer learning-based sentiment-aware model, named SentiMedQAer, for biomedical QA. The proposed method consists of a learning pipeline that utilizes BioBERT to encode text tokens with contextual and domain-specific embeddings, fine-tunes Text-to-Text Transfer Transformer (T5), and RoBERTa models to integrate sentiment information into the model, and trains an XGBoost classifier to output a confidence score to determine the final answer to the question. We validate SentiMedQAer on PubMedQA, a biomedical QA dataset with reasoning-required yes/no questions. Results show that our method outperforms the SOTA by 15.83% and a single human annotator by 5.91%.

KeywordBiomedical Question Answering Roberta Sentiment Analysis T5 Transfer Learning Xgboost
DOI10.3389/fnbot.2022.773329
URLView the original
Indexed BySCIE ; SSCI
Language英語English
WOS Research AreaComputer Science ; Robotics ; Neurosciences & Neurology
WOS SubjectComputer Science, Artificial Intelligence ; Robotics ; Neurosciences
WOS IDWOS:000778370800001
PublisherFRONTIERS MEDIA SA, AVENUE DU TRIBUNAL FEDERAL 34, LAUSANNE CH-1015, SWITZERLAND
Scopus ID2-s2.0-85127602109
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionINSTITUTE OF COLLABORATIVE INNOVATION
Corresponding AuthorXiao, Zhifeng
Affiliation1.School of Information Management, Nanjing University, Nanjing, China
2.School of Health Economics and Management, Nanjing University of Chinese Medicine, Nanjing, China
3.Centre for Data Science, Institute of Collaborative Innovation, University of Macau, Macao
4.School of Computing and Information Systems, Faculty of Engineering and Information Technology, University of Melbourne, Parkville, Australia
5.School of Engineering, Penn State Erie, The Behrend College, Erie, United States
Recommended Citation
GB/T 7714
Zhu, Xian,Chen, Yuanyuan,Gu, Yueming,et al. SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering[J]. Frontiers in Neurorobotics, 2022, 16, 773329.
APA Zhu, Xian., Chen, Yuanyuan., Gu, Yueming., & Xiao, Zhifeng (2022). SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering. Frontiers in Neurorobotics, 16, 773329.
MLA Zhu, Xian,et al."SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering".Frontiers in Neurorobotics 16(2022):773329.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhu, Xian]'s Articles
[Chen, Yuanyuan]'s Articles
[Gu, Yueming]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhu, Xian]'s Articles
[Chen, Yuanyuan]'s Articles
[Gu, Yueming]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhu, Xian]'s Articles
[Chen, Yuanyuan]'s Articles
[Gu, Yueming]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.