Residential College | false |
Status | 已發表Published |
Towards Elastic Data Warehousing by Decoupling Data Management and Computation | |
Liu,Zhi1; Wu,Haowen1; Bai,Tongxin2; Wang,Yang2; Xu,Chengzhong3 | |
2020-08-26 | |
Conference Name | The 2020 4th International Conference on Cloud and Big Data Computing |
Source Publication | ACM International Conference Proceeding Series |
Pages | 52-57 |
Conference Date | August 26 - 28, 2020 |
Conference Place | Virtual United Kingdom |
Abstract | Moving data warehouses to the cloud is what today's companies consider a trend towards cost-effective data management. To fully achieve the economic goal, the cloud data warehouse system is supposed to be able to adjust its resource provisioning to adapt to changing workload requirements. However, traditional data warehousing architecture is not flexible enough to allow on demand resource control, which severely restrains the cloud provider as well as the users to optimize total cost and maintain desired quality of service. To build the data warehouses for the cloud, new architectures should be studied. In this paper we explore such an architecture that decouples data management and data computation to facilitate the on demand resource control. By separating the two parts, the resulting system gains more elasticity and more adaptivity. For the poof of concept, we build a prototype system, called DuoSQL, based on PostgreSQL and Spark. We validate the system using the TPC-H benchmark. The experiment results show the decoupling approach is not only flexible but also has great performance potentials. |
Keyword | Elastic Data Warehouse Postgresql Spark |
DOI | 10.1145/3416921.3416935 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85092690665 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) Faculty of Science and Technology |
Affiliation | 1.Shenzhen Institutes of Advanced Technology,University of Chinese Academy of Sciences,China 2.Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,China 3.State Key Lab of IoTSC,University of Macau,Macao |
Recommended Citation GB/T 7714 | Liu,Zhi,Wu,Haowen,Bai,Tongxin,et al. Towards Elastic Data Warehousing by Decoupling Data Management and Computation[C], 2020, 52-57. |
APA | Liu,Zhi., Wu,Haowen., Bai,Tongxin., Wang,Yang., & Xu,Chengzhong (2020). Towards Elastic Data Warehousing by Decoupling Data Management and Computation. ACM International Conference Proceeding Series, 52-57. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment