Benchmarking Big Data Systems: A Review

doi:10.1109/TSC.2017.2730882

	Benchmarking Big Data Systems: A Review
	Han, Rui 1; John, Lizy Kurian 2; Zhan, Jianfeng 1
	2018-05-01
发表期刊	IEEE TRANSACTIONS ON SERVICES COMPUTING
ISSN	1939-1374
卷号	11 期号:3 页码:580-597
摘要	With the fast development of big data systems in recent years, a variety of open-source benchmarks have been built to evaluate and compare the workloads on these systems, and to promote their technology improvement. However, to date no comprehensive survey has been written on this topic. This paper attempts to fill the void by presenting a review of the state-of-the-art big data benchmarking efforts. The paper first gives an overview of popular open-source benchmarks from the point of view of big data systems. It then reviews the three important aspects of benchmarking - workload generation techniques, workload input data generation techniques, and metrics used to assess systems. For each aspect, the paper divides the surveyed benchmarks into different categories and describes some representative benchmarks, rather than all benchmarks listed, in each category, following the discussion of potential research directions to motivate future work in this area.
关键词	Big data systems benchmarks input data workloads metrics
DOI	10.1109/TSC.2017.2730882
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61502451] ; National Key Research and Development Plan of China[2016YFB1000601] ; National Key Research and Development Plan of China[2016YFB1000200]
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering
WOS记录号	WOS:000440871000009
出版者	IEEE COMPUTER SOC
引用统计	被引频次：38[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/5067
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Han, Rui
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100864, Peoples R China 2.Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
推荐引用方式 GB/T 7714	Han, Rui,John, Lizy Kurian,Zhan, Jianfeng. Benchmarking Big Data Systems: A Review[J]. IEEE TRANSACTIONS ON SERVICES COMPUTING,2018,11(3):580-597.
APA	Han, Rui,John, Lizy Kurian,&Zhan, Jianfeng.(2018).Benchmarking Big Data Systems: A Review.IEEE TRANSACTIONS ON SERVICES COMPUTING,11(3),580-597.
MLA	Han, Rui,et al."Benchmarking Big Data Systems: A Review".IEEE TRANSACTIONS ON SERVICES COMPUTING 11.3(2018):580-597.