UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Billion-scale pre-trained knowledge graph model for conversational chatbot
Wong, Chi Man1,2; Feng, Fan1; Zhang, Wen3; Chen, Huajun3; Vong, Chi Man2; Chen, Chuangquan4
2024-11-14
Source PublicationNeurocomputing
ISSN0925-2312
Volume606Pages:128353
Abstract

Conversational Chatbot is a critical technology for managing customer service on E-commerce platforms. However, most Chatbots struggle with data scarcity and sparsity. To tackle these issues, a novel two-step (pretrain and fine-tune) click-through-rate prediction model called knowledge-enhanced deep cross network (K-DCN) is proposed. First, a billion-scale conversation knowledge graph is constructed, inspired by real-world application scenarios. Then, the conversation knowledge graph is pretrained to capture the semantic and structure information respectively. Our K-DCN leverages novel user-state and dialogue-interaction representations from the pre-trained conversation knowledge graph, integrating them with the conventional dense and sparse feature representations within the Deep Cross Network framework. This integration is designed to perform item ranking in recommendation. From the experiments, our proposed K-DCN significantly outperforms the baseline models, and the model has been deployed in real world application.

KeywordClick-through-rate Conversational Chatbot Entity Representation Knowledge Graph
DOI10.1016/j.neucom.2024.128353
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Artificial Intelligence
WOS IDWOS:001299634000001
PublisherELSEVIER, RADARWEG 29, 1043 NX AMSTERDAM, NETHERLANDS
Scopus ID2-s2.0-85201486196
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorZhang, Wen
Affiliation1.Alibaba Group, China
2.University of Macau, China
3.Zhejiang University, China
4.Wuyi University, China
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Wong, Chi Man,Feng, Fan,Zhang, Wen,et al. Billion-scale pre-trained knowledge graph model for conversational chatbot[J]. Neurocomputing, 2024, 606, 128353.
APA Wong, Chi Man., Feng, Fan., Zhang, Wen., Chen, Huajun., Vong, Chi Man., & Chen, Chuangquan (2024). Billion-scale pre-trained knowledge graph model for conversational chatbot. Neurocomputing, 606, 128353.
MLA Wong, Chi Man,et al."Billion-scale pre-trained knowledge graph model for conversational chatbot".Neurocomputing 606(2024):128353.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wong, Chi Man]'s Articles
[Feng, Fan]'s Articles
[Zhang, Wen]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wong, Chi Man]'s Articles
[Feng, Fan]'s Articles
[Zhang, Wen]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wong, Chi Man]'s Articles
[Feng, Fan]'s Articles
[Zhang, Wen]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.