Residential College | false |
Status | 已發表Published |
Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing | |
Cai, Xinquan1; Sang, Qianlong1; Hu, Chuang1; Gong, Yili1; Suo, Kun2; Zhou, Xiaobo3; Cheng, Dazhao1 | |
2024 | |
Source Publication | IEEE Transactions on Computers |
ISSN | 0018-9340 |
Volume | 73Issue:7Pages:1780-1794 |
Abstract | In serverless computing, cold start results in long response latency. Existing approaches strive to alleviate the issue by reducing the number of cold starts. However, our measurement based on real-world production traces shows that the minimum number of cold starts does not equate to the minimum response latency, and solely focusing on optimizing the number of cold starts will lead to sub-optimal performance. The root cause is that functions have different priorities in terms of latency benefits by transferring a cold start to a warm start. In this paper, we propose Incendio, a serverless computing framework exploiting priority-based scheduling to minimize the overall response latency from the perspective of cloud providers. We reveal the priority of a function is correlated to multiple factors and design a priority model based on Spearman’s rank correlation coefficient. We integrate a hybrid Prophet-LightGBM prediction model to dynamically manage runtime pools, which enables the system to prewarm containers in advance and terminate containers at the appropriate time. Furthermore, to satisfy the low-cost and high-accuracy requirements in serverless computing, we propose a Clustered Reinforcement Learning-based function scheduling strategy. The evaluations show that Incendio speeds up the native system by 1.4×, and achieves 23% and 14.8% latency reductions compared to two state-of-the-art approaches. |
Keyword | Serverless Computing Cold Start Priority Prediction Scheduling In-memory Computing Distributed Systems |
DOI | 10.1109/TC.2024.3386063 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Hardware & Architecture ; Engineering, Electrical & Electronic |
WOS ID | WOS:001246169700012 |
Publisher | IEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314 |
Scopus ID | 2-s2.0-85190173898 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Hu, Chuang; Cheng, Dazhao |
Affiliation | 1.School of Computer Science, Wuhan University, Hubei, China 2.Department of Computer Science, Kennesaw State University, GA, USA 3.Laboratory of Internet of Things for Smart City & the Department of Computer and Information Science, University of Macau, Macau S.A.R |
Recommended Citation GB/T 7714 | Cai, Xinquan,Sang, Qianlong,Hu, Chuang,et al. Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing[J]. IEEE Transactions on Computers, 2024, 73(7), 1780-1794. |
APA | Cai, Xinquan., Sang, Qianlong., Hu, Chuang., Gong, Yili., Suo, Kun., Zhou, Xiaobo., & Cheng, Dazhao (2024). Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing. IEEE Transactions on Computers, 73(7), 1780-1794. |
MLA | Cai, Xinquan,et al."Incendio: Priority-based Scheduling for Alleviating Cold Start in Serverless Computing".IEEE Transactions on Computers 73.7(2024):1780-1794. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment