Residential College | false |
Status | 已發表Published |
Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks | |
Duan, Wenying1; Fang, Tianxiang2; Rao, Hong; He, Xiaoxi | |
2024-08-24 | |
Conference Name | KDD '24: The 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining |
Source Publication | KDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining |
Pages | 701-712 |
Conference Date | August 25-29, 2024 |
Conference Place | Barcelona, Spain |
Country | Spain |
Publication Place | New York, NY, USA |
Publisher | Association for Computing Machinery |
Abstract | In this paper, we present a novel method to significantly enhance the computational efficiency of Adaptive Spatial-Temporal Graph Neural Networks (ASTGNNs) by introducing the concept of the Graph Winning Ticket (GWT), derived from the Lottery Ticket Hypothesis (LTH). By adopting a pre-determined star topology as a GWT prior to training, we balance edge reduction with efficient information propagation, reducing computational demands while maintaining high model performance. Both the time and memory computational complexity of generating adaptive spatial-temporal graphs is significantly reduced from O(N2) to O(N). Our approach streamlines the ASTGNN deployment by eliminating the need for exhaustive training, pruning, and retraining cycles, and demonstrates empirically across various datasets that it is possible to achieve comparable performance to full models with substantially lower computational costs. Specifically, our approach enables training ASTGNNs on the largest scale spatial-temporal dataset using a single A6000 equipped with 48 GB of memory, overcoming the out-of-memory issue encountered during original training and even achieving state-of-the-art performance. Furthermore, we delve into the effectiveness of the GWT from the perspective of spectral graph theory, providing substantial theoretical support. This advancement not only proves the existence of efficient sub-networks within ASTGNNs but also broadens the applicability of the LTH in resource-constrained settings, marking a significant step forward in the field of graph neural networks. Code is available at https://anonymous.4open.science/r/paper-1430. |
Keyword | Lottery Ticket Hypothesis Spatial-temporal Data Mining Spatial-temporal Graph Neural Network |
DOI | 10.1145/3637528.3671912 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85203698560 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING |
Corresponding Author | He, Xiaoxi |
Affiliation | 1.Jiangxi Provincial Key Laboratory of Intelligent Systems, and Human-Machine Interaction, Nanchang University Nanchang, China 2.Nanchang University, Nanchang, China 3.School of Software, Nanchang University Nanchang, China 4.Faculty of Science and Technology, University of Macau, Macau, China |
Recommended Citation GB/T 7714 | Duan, Wenying,Fang, Tianxiang,Rao, Hong,et al. Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks[C], New York, NY, USA:Association for Computing Machinery, 2024, 701-712. |
APA | Duan, Wenying., Fang, Tianxiang., Rao, Hong., & He, Xiaoxi (2024). Pre-Training Identification of Graph Winning Tickets in Adaptive Spatial-Temporal Graph Neural Networks. KDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 701-712. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment