Using confidence interval to summarize the evaluating results of DSM systems

	Using confidence interval to summarize the evaluating results of DSM systems
	Shi, WS ; Tang, ZM ; Shi, JS
	2000
发表期刊	JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
ISSN	1000-9000
卷号	15 期号:1 页码:73-83
摘要	Distributed Shared Memory (DSM) systems have gained popular acceptance by combining the scalability and low cost of distributed system with the ease of use of single address space. Many new hardware DSM and software DSM systems have been proposed in recent years. In general, benchmarking is widely used to demonstrate the performance advantages of new systems. However, the common method used to summarize the measured results is the arithmetic mean of ratios, which is incorrect in some cases. Furthermore, many published papers list a lot of data only, and do not summarize them effectively, which confuse users greatly. In fact, many users want to get a single number as conclusion, which is not provided in old summarizing techniques. Therefore, a new data-summarizing technique based on confidence interval is proposed in this paper. The new technique includes two data-summarizing methods: (1) paired confidence interval method; (2) unpaired confidence interval method. With this new technique, it is concluded that at some confidence one system is better than others. Four examples are shown to demonstrate the advantages of this new technique. Furthermore, with the help of confidence level, it is proposed to standardize the benchmarks used for evaluating DSM systems so that a convincing result can be got. In addition, the new summarizing technique fits not only for evaluating DSM systems, but also for evaluating other systems, such as memory system and communication systems.
关键词	data-summarizing technique performance evaluation DSM system confidence interval benchmarking
收录类别	SCI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Software Engineering
WOS记录号	WOS:000089936500008
出版者	SCIENCE PRESS
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/13322
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Shi, WS
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China 2.E China Univ Sci & Technol, Dept Appl Math, Shanghai 200237, Peoples R China
推荐引用方式 GB/T 7714	Shi, WS,Tang, ZM,Shi, JS. Using confidence interval to summarize the evaluating results of DSM systems[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2000,15(1):73-83.
APA	Shi, WS,Tang, ZM,&Shi, JS.(2000).Using confidence interval to summarize the evaluating results of DSM systems.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,15(1),73-83.
MLA	Shi, WS,et al."Using confidence interval to summarize the evaluating results of DSM systems".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 15.1(2000):73-83.