Residential Collegefalse
Status已發表Published
Derm: SLA-aware Resource Management for Highly Dynamic Microservices
Chen Liao1; Shutian Luo2; Chenyu Lin1; Zizhao Mo1; XU HUANLE1; Kejiang Ye3; Chengzhong Xu1
2024-07
Conference NameThe International Symposium on Computer Architecture (ISCA)
Source PublicationProceedings of ACM/IEEE 51st Annual International Symposium on Computer Architecture
Conference Date2024.07
Conference PlaceBuenos Aires
CountryArgentina
PublisherInstitute of Electrical and Electronics Engineers Inc.
Contribution Rank1
Abstract

Ensuring efficient resource allocation while providing service level agreement (SLA) guarantees for end-to-end (E2E) latency is crucial for microservice applications. Although existing studies have made significant contributions towards achieving this objective, they primarily concentrate on static graphs. However, microservice graphs are inherently dynamic during runtime in production environments, necessitating more effective and scalable resource management solutions.In this paper, we present Derm, a new resource management system designed for microservice applications with highly dynamic graphs. Our principal finding is that prioritizing different microservice graphs can lead to a substantial reduction in resource allocation. To take advantage of this opportunity, we develop three main components. The first is a performance model that describes uncertainties of microservice latency through a conditional exponential distribution. The second is a probabilistic quantification of the dynamics of microservice graphs. The third is an optimization method for adjusting the resource allocation of microservices to minimize resource usage. We evaluate Derm in our cluster using real microservice benchmarks and production traces. The results highlight that Derm reduces the resource usage by 68.4 % and lowers SLA violation probability by 6.7 ×, compared to existing approaches.

KeywordDynamic Microservice Graph Resource Scaling Uncertainty
DOI10.1109/ISCA59077.2024.00039
URLView the original
Language英語English
Scopus ID2-s2.0-85201154811
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorXU HUANLE; Chengzhong Xu
Affiliation1.University of Macau, Macao
2.Yale University, United States
3.Shenzhen Institute of Advanced Technology, China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Chen Liao,Shutian Luo,Chenyu Lin,et al. Derm: SLA-aware Resource Management for Highly Dynamic Microservices[C]:Institute of Electrical and Electronics Engineers Inc., 2024.
APA Chen Liao., Shutian Luo., Chenyu Lin., Zizhao Mo., XU HUANLE., Kejiang Ye., & Chengzhong Xu (2024). Derm: SLA-aware Resource Management for Highly Dynamic Microservices. Proceedings of ACM/IEEE 51st Annual International Symposium on Computer Architecture.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Chen Liao]'s Articles
[Shutian Luo]'s Articles
[Chenyu Lin]'s Articles
Baidu academic
Similar articles in Baidu academic
[Chen Liao]'s Articles
[Shutian Luo]'s Articles
[Chenyu Lin]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Chen Liao]'s Articles
[Shutian Luo]'s Articles
[Chenyu Lin]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.