Evaluating Iterative Optimization Across 1000 Data Sets

	Evaluating Iterative Optimization Across 1000 Data Sets
	Chen, Yang 1,2; Huang, Yuanjie 1,2; Eeckhout, Lieven 4; Fursin, Grigori 3; Peng, Liang 1,2; Temam, Olivier 3; Wu, Chengyong 1
	2010-06-01
发表期刊	ACM SIGPLAN NOTICES
ISSN	0362-1340
卷号	45 期号:6 页码:448-459
摘要	While iterative optimization has become a popular compiler optimization approach, it is based on a premise which has never been truly evaluated: that it is possible to learn the best compiler optimizations across data sets. Up to now, most iterative optimization studies find the best optimizations through repeated runs on the same data set. Only a handful of studies have attempted to exercise iterative optimization on a few tens of data sets. In this paper, we truly put iterative compilation to the test for the first time by evaluating its effectiveness across a large number of data sets. We therefore compose KDataSets, a data set suite with 1000 data sets for 32 programs, which we release to the public. We characterize the diversity of KDataSets, and subsequently use it to evaluate iterative optimization. We demonstrate that it is possible to derive a robust iterative optimization strategy across data sets: for all 32 programs, we find that there exists at least one combination of compiler optimizations that achieves 86% or more of the best possible speedup across all data sets using Intel's ICC (83% for GNU's GCC). This optimal combination is program-specific and yields speedups up to 1.71 on ICC and 2.23 on GCC over the highest optimization level (-fast and -03, respectively). This finding makes the task of optimizing programs across data sets much easier than previously anticipated, and it paves the way for the practical and reliable usage of iterative optimization. Finally, we derive pre-shipping and post-shipping optimization strategies for software vendors.
关键词	Design Experimentation Measurement Performance
收录类别	SCI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:000279357500038
出版者	ASSOC COMPUTING MACHINERY
引用统计	被引频次：10[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/12116
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Chen, Yang
作者单位	1.CAS, ICT, LCSA, Key Lab Comp Syst & Architecture, Beijing, Peoples R China 2.CAS, Grad Sch, Beijing, Peoples R China 3.INRIA, Saclay, France 4.Univ Ghent, Ghent, Belgium
推荐引用方式 GB/T 7714	Chen, Yang,Huang, Yuanjie,Eeckhout, Lieven,et al. Evaluating Iterative Optimization Across 1000 Data Sets[J]. ACM SIGPLAN NOTICES,2010,45(6):448-459.
APA	Chen, Yang.,Huang, Yuanjie.,Eeckhout, Lieven.,Fursin, Grigori.,Peng, Liang.,...&Wu, Chengyong.(2010).Evaluating Iterative Optimization Across 1000 Data Sets.ACM SIGPLAN NOTICES,45(6),448-459.
MLA	Chen, Yang,et al."Evaluating Iterative Optimization Across 1000 Data Sets".ACM SIGPLAN NOTICES 45.6(2010):448-459.