UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks
Duan, Wenying1; Fang, Tianxiang2; Rao, Hong; He, Xiaoxi
2024-08-24
Conference NameKDD '24: The 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
Source PublicationKDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
Pages701-712
Conference DateAugust 25-29, 2024
Conference PlaceBarcelona, Spain
CountrySpain
Publication PlaceNew York, NY, USA
PublisherAssociation for Computing Machinery
Abstract

In this paper, we present a novel method to significantly enhance the computational efficiency of Adaptive Spatial-Temporal Graph Neural Networks (ASTGNNs) by introducing the concept of the Graph Winning Ticket (GWT), derived from the Lottery Ticket Hypothesis (LTH). By adopting a pre-determined star topology as a GWT prior to training, we balance edge reduction with efficient information propagation, reducing computational demands while maintaining high model performance. Both the time and memory computational complexity of generating adaptive spatial-temporal graphs is significantly reduced from O(N2) to O(N). Our approach streamlines the ASTGNN deployment by eliminating the need for exhaustive training, pruning, and retraining cycles, and demonstrates empirically across various datasets that it is possible to achieve comparable performance to full models with substantially lower computational costs. Specifically, our approach enables training ASTGNNs on the largest scale spatial-temporal dataset using a single A6000 equipped with 48 GB of memory, overcoming the out-of-memory issue encountered during original training and even achieving state-of-the-art performance. Furthermore, we delve into the effectiveness of the GWT from the perspective of spectral graph theory, providing substantial theoretical support. This advancement not only proves the existence of efficient sub-networks within ASTGNNs but also broadens the applicability of the LTH in resource-constrained settings, marking a significant step forward in the field of graph neural networks. Code is available at https://anonymous.4open.science/r/paper-1430. 

KeywordLottery Ticket Hypothesis Spatial-temporal Data Mining Spatial-temporal Graph Neural Network
DOI10.1145/3637528.3671912
URLView the original
Language英語English
Scopus ID2-s2.0-85203698560
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionFaculty of Science and Technology
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Corresponding AuthorHe, Xiaoxi
Affiliation1.Jiangxi Provincial Key Laboratory of Intelligent Systems, and Human-Machine Interaction, Nanchang University Nanchang, China
2.Nanchang University, Nanchang, China
3.School of Software, Nanchang University Nanchang, China
4.Faculty of Science and Technology, University of Macau, Macau, China
Recommended Citation
GB/T 7714
Duan, Wenying,Fang, Tianxiang,Rao, Hong,et al. Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks[C], New York, NY, USA:Association for Computing Machinery, 2024, 701-712.
APA Duan, Wenying., Fang, Tianxiang., Rao, Hong., & He, Xiaoxi (2024). Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks. KDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 701-712.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Duan, Wenying]'s Articles
[Fang, Tianxiang]'s Articles
[Rao, Hong]'s Articles
Baidu academic
Similar articles in Baidu academic
[Duan, Wenying]'s Articles
[Fang, Tianxiang]'s Articles
[Rao, Hong]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Duan, Wenying]'s Articles
[Fang, Tianxiang]'s Articles
[Rao, Hong]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.