Residential Collegefalse
Status已發表Published
Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices
Li Peichun1; Zhang Hanwen1; Wu Yuan2; Qian Liping3; Yu Rong4; Niyato Dusit5; Shen Xuemin6
2024
Source PublicationIEEE Transactions on Mobile Computing
ISSN1536-1233
Volume23Issue:10Pages:10001 - 10015
Abstract

Distributed Artificial Intelligence (AI) model training over mobile edge networks encounters significant challenges due to the data and resource heterogeneity of edge devices. The former hampers the convergence rate of the global model, while the latter diminishes the devices' resource utilization efficiency. In this paper, we propose a generative AI-empowered federated learning to address these challenges by leveraging the idea of FIlling the MIssing (FIMI) portion of local data. Specifically, FIMI can be considered as a resource-aware data augmentation method that effectively mitigates the data heterogeneity while ensuring efficient FL training. We first quantify the relationship between the training data amount and the learning performance. We then study the FIMI optimization problem with the objective of minimizing the device-side overall energy consumption subject to required learning performance constraints. The decomposition-based analysis and the cross-entropy searching method are leveraged to derive the solution, where each device is assigned suitable AI-synthetic data and resource utilization policy. Experiment results demonstrate that FIMI can save up to 50% of the device-side energy to achieve the target global test accuracy in comparison with the existing methods. Meanwhile, FIMI can significantly enhance the converged global accuracy under the non-independently-and-identically distribution (non-IID) data.

KeywordConvergence Data Compensation Data Models Energy Consumption Federated Learning Generative Ai Generative Ai Optimization Performance Evaluation Resource Management Training
DOI10.1109/TMC.2024.3371772
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Telecommunications
WOS SubjectComputer Science, Information Systems ; Telecommunications
WOS IDWOS:001306818600067
PublisherIEEE COMPUTER SOC10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314
Scopus ID2-s2.0-85187012754
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Corresponding AuthorWu Yuan
Affiliation1.State Key Laboratory of Internet of Things for Smart City, University of Macau, Macao, China
2.State Key Laboratory of Internet of Things for Smart City and the Department of Computer and Information Science, University of Macau, Macau, China
3.College of Information Engineering, Zhejiang University of Technology, Hangzhou, China
4.School of Automation, Guangdong University of Technology, Guangzhou, China
5.College of Computing & Data Science (CCDS), Nanyang Technological University Singapore Block N4-02a-32, Nanyang Avenue, Singapore
6.Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Li Peichun,Zhang Hanwen,Wu Yuan,et al. Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices[J]. IEEE Transactions on Mobile Computing, 2024, 23(10), 10001 - 10015.
APA Li Peichun., Zhang Hanwen., Wu Yuan., Qian Liping., Yu Rong., Niyato Dusit., & Shen Xuemin (2024). Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices. IEEE Transactions on Mobile Computing, 23(10), 10001 - 10015.
MLA Li Peichun,et al."Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices".IEEE Transactions on Mobile Computing 23.10(2024):10001 - 10015.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li Peichun]'s Articles
[Zhang Hanwen]'s Articles
[Wu Yuan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li Peichun]'s Articles
[Zhang Hanwen]'s Articles
[Wu Yuan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li Peichun]'s Articles
[Zhang Hanwen]'s Articles
[Wu Yuan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.