Residential College | false |
Status | 已發表Published |
Zero-shot Micro-video Classification with Neural Variational Inference in Graph Prototype Network | |
Chen, Junyang1; Wang, Jialong2; Dai, Zhijiang1; Wu, Huisi1; Wang, Mengzhu1; Zhang, Qin1; Wang, Huan3 | |
2023-10-27 | |
Conference Name | 31st ACM International Conference on Multimedia, MM 2023 |
Source Publication | MM 2023 - Proceedings of the 31st ACM International Conference on Multimedia |
Pages | 966-974 |
Conference Date | 2023/10/29-2023/11/03 |
Conference Place | Ottawa |
Publisher | Association for Computing Machinery, Inc |
Abstract | Micro-video classification plays a central role in online content recommendation platforms, such as Kwai and Tik-Tok. Existing works on video classification largely exploit the interactions between users and items as well as the item labels to provide quality recommendation services. However, scarce or even no labeled data of emerging videos is a great challenge for existing classification methods. In this paper, we propose a zero-shot micro-video classification model (NVIGPN) by exploiting the hidden topics behind items to guide the representation learning in user-item interactions. Specifically, we study this zero-shot classification in two stages: (1) exploiting a generalized semantic hidden topic descriptions for transferable knowledge learning, and (2) designing a graph-based learning model for guiding the minor seen class information to the unseen ones. Through mining the transferable knowledge between the hidden topics and the small number of the seen classes, NVIGPN can achieves state-of-the-art performances in predicting the unseen classes of micro-videos. We conduct extensive experiments to demonstrate the effectiveness of our method. |
Keyword | Neural Variational Inference Transferable Representation Learning Zero-shot Micro-video Classification |
DOI | 10.1145/3581783.3611740 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85179558787 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Co-First Author | Chen, Junyang |
Corresponding Author | Wang, Huan |
Affiliation | 1.College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China 2.Department of Computer Information Science, University of Macau, Macao 3.College of Informatics, Huazhong Agricultural University, Wuhan, China |
Recommended Citation GB/T 7714 | Chen, Junyang,Wang, Jialong,Dai, Zhijiang,et al. Zero-shot Micro-video Classification with Neural Variational Inference in Graph Prototype Network[C]:Association for Computing Machinery, Inc, 2023, 966-974. |
APA | Chen, Junyang., Wang, Jialong., Dai, Zhijiang., Wu, Huisi., Wang, Mengzhu., Zhang, Qin., & Wang, Huan (2023). Zero-shot Micro-video Classification with Neural Variational Inference in Graph Prototype Network. MM 2023 - Proceedings of the 31st ACM International Conference on Multimedia, 966-974. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment