UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing
Cai, Xinquan1; Sang, Qianlong1; Hu, Chuang1; Gong, Yili1; Suo, Kun2; Zhou, Xiaobo3; Cheng, Dazhao1
2024
Source PublicationIEEE Transactions on Computers
ISSN0018-9340
Volume73Issue:7Pages:1780-1794
Abstract

In serverless computing, cold start results in long response latency. Existing approaches strive to alleviate the issue by reducing the number of cold starts. However, our measurement based on real-world production traces shows that the minimum number of cold starts does not equate to the minimum response latency, and solely focusing on optimizing the number of cold starts will lead to sub-optimal performance. The root cause is that functions have different priorities in terms of latency benefits by transferring a cold start to a warm start. In this paper, we propose Incendio, a serverless computing framework exploiting priority-based scheduling to minimize the overall response latency from the perspective of cloud providers. We reveal the priority of a function is correlated to multiple factors and design a priority model based on Spearman’s rank correlation coefficient. We integrate a hybrid Prophet-LightGBM prediction model to dynamically manage runtime pools, which enables the system to prewarm containers in advance and terminate containers at the appropriate time. Furthermore, to satisfy the low-cost and high-accuracy requirements in serverless computing, we propose a Clustered Reinforcement Learning-based function scheduling strategy. The evaluations show that Incendio speeds up the native system by 1.4×, and achieves 23% and 14.8% latency reductions compared to two state-of-the-art approaches.

KeywordServerless Computing Cold Start Priority Prediction Scheduling In-memory Computing Distributed Systems
DOI10.1109/TC.2024.3386063
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Hardware & Architecture ; Engineering, Electrical & Electronic
WOS IDWOS:001246169700012
PublisherIEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314
Scopus ID2-s2.0-85190173898
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorHu, Chuang; Cheng, Dazhao
Affiliation1.School of Computer Science, Wuhan University, Hubei, China
2.Department of Computer Science, Kennesaw State University, GA, USA
3.Laboratory of Internet of Things for Smart City & the Department of Computer and Information Science, University of Macau, Macau S.A.R
Recommended Citation
GB/T 7714
Cai, Xinquan,Sang, Qianlong,Hu, Chuang,et al. Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing[J]. IEEE Transactions on Computers, 2024, 73(7), 1780-1794.
APA Cai, Xinquan., Sang, Qianlong., Hu, Chuang., Gong, Yili., Suo, Kun., Zhou, Xiaobo., & Cheng, Dazhao (2024). Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing. IEEE Transactions on Computers, 73(7), 1780-1794.
MLA Cai, Xinquan,et al."Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing".IEEE Transactions on Computers 73.7(2024):1780-1794.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Cai, Xinquan]'s Articles
[Sang, Qianlong]'s Articles
[Hu, Chuang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Cai, Xinquan]'s Articles
[Sang, Qianlong]'s Articles
[Hu, Chuang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Cai, Xinquan]'s Articles
[Sang, Qianlong]'s Articles
[Hu, Chuang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.