UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Practice of Alibaba cloud on elastic resource provisioning for large-scale microservices cluster
Xu, Minxian1; Yang, Lei1; Wang, Yang1; Gao, Chengxi1; Wen, Linfeng1; Xu, Guoyao2; Zhang, Liping2; Ye, Kejiang1; Xu, Chengzhong3
2024
Source PublicationSoftware - Practice and Experience
ISSN0038-0644
Volume54Issue:1Pages:39-57
Abstract

Cloud-native architecture is becoming increasingly crucial for today's cloud computing environments due to the need for speed and flexibility in developing applications. It utilizes microservice technology to break down traditional monolithic applications into light-weight and self-contained microservice components. However, as microservices grow in scale and have dynamic inter-dependencies, they also pose new challenges in resource provisioning that cannot be fully addressed by traditional resource scheduling approaches. The various microservices with different resource demands and latency requirements can create complex calling chains, making it difficult to provide fine-grained and accurate resource allocation to each component while maintaining the overall quality of service in the chain. Alibaba Cloud has fully embraced cloud-native and microservice technologies to drive its key business and scenarios, including Double 11 Shopping Festival. In this work, we aim to address the research problem on how to efficiently provision resources for the growing scale of microservice platform and ensure the performance of latency-critical microservices. To address the problem, we present in-depth analyses of Alibaba's microservice cluster and propose optimized resource provisioning algorithms to enhance resource utilization while ensuring the latency requirement. First, we analyze the distinct features of microservices in Alibaba's cluster compared to traditional applications. Then we present Alibaba's resource capacity provisioning workflow and framework to address challenges in resource provisioning for large-scale and latency-critical microservice clusters. Finally, we propose enhanced resource provisioning algorithms over Alibaba's current practice by making both proactive and reactive scheduling decisions based on different workloads patterns, which can improve resource usage by 10%–15% in Alibaba's clusters, while maintaining the necessary latency for microservices.

KeywordAlibaba Cloud-native Latency Microservice Resource Provisioning
DOI10.1002/spe.3271
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Software Engineering
WOS IDWOS:001066008200001
Scopus ID2-s2.0-85171253166
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorYe, Kejiang
Affiliation1.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
2.Alibaba Group, Hangzhou, China
3.State Key Lab of IOTSC, Department of Computer Science, University of Macau, Macao
Recommended Citation
GB/T 7714
Xu, Minxian,Yang, Lei,Wang, Yang,et al. Practice of Alibaba cloud on elastic resource provisioning for large-scale microservices cluster[J]. Software - Practice and Experience, 2024, 54(1), 39-57.
APA Xu, Minxian., Yang, Lei., Wang, Yang., Gao, Chengxi., Wen, Linfeng., Xu, Guoyao., Zhang, Liping., Ye, Kejiang., & Xu, Chengzhong (2024). Practice of Alibaba cloud on elastic resource provisioning for large-scale microservices cluster. Software - Practice and Experience, 54(1), 39-57.
MLA Xu, Minxian,et al."Practice of Alibaba cloud on elastic resource provisioning for large-scale microservices cluster".Software - Practice and Experience 54.1(2024):39-57.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Xu, Minxian]'s Articles
[Yang, Lei]'s Articles
[Wang, Yang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Xu, Minxian]'s Articles
[Yang, Lei]'s Articles
[Wang, Yang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Xu, Minxian]'s Articles
[Yang, Lei]'s Articles
[Wang, Yang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.