Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System

doi:10.1109/TC.2009.80

	Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System
	Lee, Rubao; Xu, Zhiwei
	2009-10-01
发表期刊	IEEE TRANSACTIONS ON COMPUTERS
ISSN	0018-9340
卷号	58 期号:10 页码:1356-1368
摘要	This paper focuses on the problem of improving throughput of distributed query processing in an RDBMS-based data integration system. Although a buffer pool can be used in an RDBMS to cache disk pages in memory to reduce disk accesses, it cannot be used for data integration queries since its foundation, the memory-disk hierarchy, does not exist. The lack of a data sharing mechanism limits system throughput because unnecessary data requests increase burden on data sources and redundant resultant data transfers waste network bandwidth. To address the problem, we present a new technique called request window, which can detect and exploit data sharing opportunities among concurrent queries. Request window exploits a new stream request locality which reflects common query interests among independent users in a short time period. The existence of such a locality makes it possible to collect a group of related data requests and process them as a batch by request window. Evaluation on a PostgreSQL-based data integration system shows that request window can significantly increase system throughput when running a distributed TPC-H workload.
关键词	Buffer management distributed databases locality query processing
DOI	10.1109/TC.2009.80
收录类别	SCI
语种	英语
资助项目	National Science Foundation of China[90412010] ; Hi-Tech Research and Development (863) Program of China[2006AA01A106] ; National Basic Research (973) Program of China[2005CB321807]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Hardware & Architecture ; Engineering, Electrical & Electronic
WOS记录号	WOS:000269131900006
出版者	IEEE COMPUTER SOC
引用统计	被引频次：5[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/11838
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Lee, Rubao
作者单位	Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
推荐引用方式 GB/T 7714	Lee, Rubao,Xu, Zhiwei. Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System[J]. IEEE TRANSACTIONS ON COMPUTERS,2009,58(10):1356-1368.
APA	Lee, Rubao,&Xu, Zhiwei.(2009).Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System.IEEE TRANSACTIONS ON COMPUTERS,58(10),1356-1368.
MLA	Lee, Rubao,et al."Exploiting Stream Request Locality to Improve Query Throughput of a Data Integration System".IEEE TRANSACTIONS ON COMPUTERS 58.10(2009):1356-1368.