CirroData: Yet Another SQL-on-Hadoop Data Analytics Engine with High Performance

doi:10.1007/s11390-020-9536-z

	CirroData: Yet Another SQL-on-Hadoop Data Analytics Engine with High Performance
	Jin, Zheng-Hao 1; Shi, Haiyang 2; Hu, Ying-Xin 1; Zha, Li 3,4; Lu, Xiaoyi 2
	2020
发表期刊	JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
ISSN	1000-9000
卷号	35 期号:1 页码:194-208
摘要	This paper presents CirroData, a high-performance SQL-on-Hadoop system designed for Big Data analytics workloads. As a home-grown enterprise-level online analytical processing (OLAP) system with more than seven-year research and development (R&D) experiences, we share our design details to the community about how to achieve high performance in CirroData. Multiple optimization techniques have been discussed in the paper. The effectiveness and the efficiency of all these techniques have been proved by our customers' daily usage. Benchmark-level studies, as well as several real application case studies of CirroData, have been presented in this paper. Our evaluations show that CirroData can outperform various types of counterpart database systems in the community, such as "Spark+Hive", "Spark+HBase", Impala, DB-X/Y, Greenplum, HAWQ, and others. CirroData can achieve up to 4.99x speedup compared with Greenplum, HAWQ, and Spark in the standard TPC-H queries. Application-level evaluations demonstrate that CirroData outperforms "Spark+Hive" and "Spark+HBase" by up to 8.4x and 38.8x, respectively. In the meantime, CirroData achieves the performance speedups for some application workloads by up to 20x, 100x, 182.5x, 92.6x, and 55.5x as compared with Greenplum, DB-X, Impala, DB-Y, and HAWQ, respectively.
关键词	CirroData high performance SQL-on-Hadoop online analytical processing (OLAP) Big Data
DOI	10.1007/s11390-020-9536-z
收录类别	SCI
语种	英语
资助项目	Strategic Priority Research Program of the Chinese Academy of Sciences of China[XDA19020400]
WOS研究方向	Computer Science
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Software Engineering
WOS记录号	WOS:000512098800012
出版者	SCIENCE PRESS
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/14764
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Jin, Zheng-Hao
作者单位	1.Business Intelligence Oriental Nat Corp Ltd, Beijing 100102, Peoples R China 2.Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA 3.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 4.Univ Chinese Acad Sci, Beijing 101408, Peoples R China
推荐引用方式 GB/T 7714	Jin, Zheng-Hao,Shi, Haiyang,Hu, Ying-Xin,et al. CirroData: Yet Another SQL-on-Hadoop Data Analytics Engine with High Performance[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2020,35(1):194-208.
APA	Jin, Zheng-Hao,Shi, Haiyang,Hu, Ying-Xin,Zha, Li,&Lu, Xiaoyi.(2020).CirroData: Yet Another SQL-on-Hadoop Data Analytics Engine with High Performance.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,35(1),194-208.
MLA	Jin, Zheng-Hao,et al."CirroData: Yet Another SQL-on-Hadoop Data Analytics Engine with High Performance".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 35.1(2020):194-208.