Residential College | false |
Status | 已發表Published |
ChainsFormer: A Chain Latency-Aware Resource Provisioning Approach for Microservices Cluster | |
Song, Chenghao1; Xu, Minxian1; Ye, Kejiang1; Wu, Huaming2; Gill, Sukhpal Singh3; Buyya, Rajkumar4; Xu, Chengzhong5 | |
2023-11 | |
Conference Name | 21st International Conference on Service-Oriented Computing (ICSOC) |
Source Publication | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
Volume | 14419 LNCS |
Pages | 197-211 |
Conference Date | NOV 28-DEC 01, 2023 |
Conference Place | Rome, Italy |
Country | Italy |
Abstract | The trend towards transitioning from monolithic applications to microservices has been widely embraced in modern distributed systems and applications. This shift has resulted in the creation of lightweight, fine-grained, and self-contained microservices. Multiple microservices can be linked together via calls and inter-dependencies to form complex functions. One of the challenges in managing microservices is provisioning the optimal amount of resources for microservices in the chain to ensure application performance while improving resource usage efficiency. This paper presents ChainsFormer, a framework that analyzes microservice inter-dependencies to identify critical chains and nodes, and provision resources based on reinforcement learning. To analyze chains, ChainsFormer utilizes light-weight machine learning techniques to address the dynamic nature of microservice chains and workloads. For resource provisioning, a reinforcement learning approach is used that combines vertical and horizontal scaling to determine the amount of allocated resources and the number of replicates. We evaluate the effectiveness of ChainsFormer using realistic applications and traces on a real testbed based on Kubernetes. Our experimental results demonstrate that ChainsFormer can reduce response time by up to 26% and improve processed requests per second by 8% compared with state-of-the-art techniques. |
Keyword | Chain Kubernetes Microservice Reinforcement Learning Scaling |
DOI | 10.1007/978-3-031-48421-6_14 |
URL | View the original |
Indexed By | CPCI-S |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Software Engineering ; Computer Science, Theory & Methods |
WOS ID | WOS:001159757300014 |
Scopus ID | 2-s2.0-85178189083 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Xu, Minxian |
Affiliation | 1.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China 2.Tianjin University, Tianjin, China 3.Queen Mary University of London, London, United Kingdom 4.Cloud Computing and Distributed Systems (CLOUDS) Lab, School of Computing and Information Systems, The University of Melbourne, Melbourne, Australia 5.State Key Lab of IoTSC, University of Macau, Macao |
Recommended Citation GB/T 7714 | Song, Chenghao,Xu, Minxian,Ye, Kejiang,et al. ChainsFormer: A Chain Latency-Aware Resource Provisioning Approach for Microservices Cluster[C], 2023, 197-211. |
APA | Song, Chenghao., Xu, Minxian., Ye, Kejiang., Wu, Huaming., Gill, Sukhpal Singh., Buyya, Rajkumar., & Xu, Chengzhong (2023). ChainsFormer: A Chain Latency-Aware Resource Provisioning Approach for Microservices Cluster. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14419 LNCS, 197-211. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment