Residential College | false |
Status | 已發表Published |
Billion-scale pre-trained knowledge graph model for conversational chatbot | |
Wong, Chi Man1,2; Feng, Fan1; Zhang, Wen3; Chen, Huajun3; Vong, Chi Man2; Chen, Chuangquan4 | |
2024-11-14 | |
Source Publication | Neurocomputing |
ISSN | 0925-2312 |
Volume | 606Pages:128353 |
Abstract | Conversational Chatbot is a critical technology for managing customer service on E-commerce platforms. However, most Chatbots struggle with data scarcity and sparsity. To tackle these issues, a novel two-step (pretrain and fine-tune) click-through-rate prediction model called knowledge-enhanced deep cross network (K-DCN) is proposed. First, a billion-scale conversation knowledge graph is constructed, inspired by real-world application scenarios. Then, the conversation knowledge graph is pretrained to capture the semantic and structure information respectively. Our K-DCN leverages novel user-state and dialogue-interaction representations from the pre-trained conversation knowledge graph, integrating them with the conventional dense and sparse feature representations within the Deep Cross Network framework. This integration is designed to perform item ranking in recommendation. From the experiments, our proposed K-DCN significantly outperforms the baseline models, and the model has been deployed in real world application. |
Keyword | Click-through-rate Conversational Chatbot Entity Representation Knowledge Graph |
DOI | 10.1016/j.neucom.2024.128353 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence |
WOS ID | WOS:001299634000001 |
Publisher | ELSEVIER, RADARWEG 29, 1043 NX AMSTERDAM, NETHERLANDS |
Scopus ID | 2-s2.0-85201486196 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Zhang, Wen |
Affiliation | 1.Alibaba Group, China 2.University of Macau, China 3.Zhejiang University, China 4.Wuyi University, China |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Wong, Chi Man,Feng, Fan,Zhang, Wen,et al. Billion-scale pre-trained knowledge graph model for conversational chatbot[J]. Neurocomputing, 2024, 606, 128353. |
APA | Wong, Chi Man., Feng, Fan., Zhang, Wen., Chen, Huajun., Vong, Chi Man., & Chen, Chuangquan (2024). Billion-scale pre-trained knowledge graph model for conversational chatbot. Neurocomputing, 606, 128353. |
MLA | Wong, Chi Man,et al."Billion-scale pre-trained knowledge graph model for conversational chatbot".Neurocomputing 606(2024):128353. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment