Residential College | false |
Status | 已發表Published |
Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices | |
Li Peichun1; Zhang Hanwen1; Wu Yuan2![]() | |
2024 | |
Source Publication | IEEE Transactions on Mobile Computing
![]() |
ISSN | 1536-1233 |
Volume | 23Issue:10Pages:10001 - 10015 |
Abstract | Distributed Artificial Intelligence (AI) model training over mobile edge networks encounters significant challenges due to the data and resource heterogeneity of edge devices. The former hampers the convergence rate of the global model, while the latter diminishes the devices' resource utilization efficiency. In this paper, we propose a generative AI-empowered federated learning to address these challenges by leveraging the idea of FIlling the MIssing (FIMI) portion of local data. Specifically, FIMI can be considered as a resource-aware data augmentation method that effectively mitigates the data heterogeneity while ensuring efficient FL training. We first quantify the relationship between the training data amount and the learning performance. We then study the FIMI optimization problem with the objective of minimizing the device-side overall energy consumption subject to required learning performance constraints. The decomposition-based analysis and the cross-entropy searching method are leveraged to derive the solution, where each device is assigned suitable AI-synthetic data and resource utilization policy. Experiment results demonstrate that FIMI can save up to 50% of the device-side energy to achieve the target global test accuracy in comparison with the existing methods. Meanwhile, FIMI can significantly enhance the converged global accuracy under the non-independently-and-identically distribution (non-IID) data. |
Keyword | Convergence Data Compensation Data Models Energy Consumption Federated Learning Generative Ai Generative Ai Optimization Performance Evaluation Resource Management Training |
DOI | 10.1109/TMC.2024.3371772 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Telecommunications |
WOS Subject | Computer Science, Information Systems ; Telecommunications |
WOS ID | WOS:001306818600067 |
Publisher | IEEE COMPUTER SOC10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314 |
Scopus ID | 2-s2.0-85187012754 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) |
Corresponding Author | Wu Yuan |
Affiliation | 1.State Key Laboratory of Internet of Things for Smart City, University of Macau, Macao, China 2.State Key Laboratory of Internet of Things for Smart City and the Department of Computer and Information Science, University of Macau, Macau, China 3.College of Information Engineering, Zhejiang University of Technology, Hangzhou, China 4.School of Automation, Guangdong University of Technology, Guangzhou, China 5.College of Computing & Data Science (CCDS), Nanyang Technological University Singapore Block N4-02a-32, Nanyang Avenue, Singapore 6.Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada |
First Author Affilication | University of Macau |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Li Peichun,Zhang Hanwen,Wu Yuan,et al. Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices[J]. IEEE Transactions on Mobile Computing, 2024, 23(10), 10001 - 10015. |
APA | Li Peichun., Zhang Hanwen., Wu Yuan., Qian Liping., Yu Rong., Niyato Dusit., & Shen Xuemin (2024). Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices. IEEE Transactions on Mobile Computing, 23(10), 10001 - 10015. |
MLA | Li Peichun,et al."Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices".IEEE Transactions on Mobile Computing 23.10(2024):10001 - 10015. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment