Residential Collegefalse
Status已發表Published
Towards Elastic Data Warehousing by Decoupling Data Management and Computation
Liu,Zhi1; Wu,Haowen1; Bai,Tongxin2; Wang,Yang2; Xu,Chengzhong3
2020-08-26
Conference NameThe 2020 4th International Conference on Cloud and Big Data Computing
Source PublicationACM International Conference Proceeding Series
Pages52-57
Conference DateAugust 26 - 28, 2020
Conference PlaceVirtual United Kingdom
Abstract

Moving data warehouses to the cloud is what today's companies consider a trend towards cost-effective data management. To fully achieve the economic goal, the cloud data warehouse system is supposed to be able to adjust its resource provisioning to adapt to changing workload requirements. However, traditional data warehousing architecture is not flexible enough to allow on demand resource control, which severely restrains the cloud provider as well as the users to optimize total cost and maintain desired quality of service. To build the data warehouses for the cloud, new architectures should be studied. In this paper we explore such an architecture that decouples data management and data computation to facilitate the on demand resource control. By separating the two parts, the resulting system gains more elasticity and more adaptivity. For the poof of concept, we build a prototype system, called DuoSQL, based on PostgreSQL and Spark. We validate the system using the TPC-H benchmark. The experiment results show the decoupling approach is not only flexible but also has great performance potentials.

KeywordElastic Data Warehouse Postgresql Spark
DOI10.1145/3416921.3416935
URLView the original
Language英語English
Scopus ID2-s2.0-85092690665
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionTHE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Faculty of Science and Technology
Affiliation1.Shenzhen Institutes of Advanced Technology,University of Chinese Academy of Sciences,China
2.Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,China
3.State Key Lab of IoTSC,University of Macau,Macao
Recommended Citation
GB/T 7714
Liu,Zhi,Wu,Haowen,Bai,Tongxin,et al. Towards Elastic Data Warehousing by Decoupling Data Management and Computation[C], 2020, 52-57.
APA Liu,Zhi., Wu,Haowen., Bai,Tongxin., Wang,Yang., & Xu,Chengzhong (2020). Towards Elastic Data Warehousing by Decoupling Data Management and Computation. ACM International Conference Proceeding Series, 52-57.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liu,Zhi]'s Articles
[Wu,Haowen]'s Articles
[Bai,Tongxin]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liu,Zhi]'s Articles
[Wu,Haowen]'s Articles
[Bai,Tongxin]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liu,Zhi]'s Articles
[Wu,Haowen]'s Articles
[Bai,Tongxin]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.