Cacheap: Portable and Collaborative I/O Optimization for Graph Processing

doi:10.1007/s11390-019-1936-6

	Cacheap: Portable and Collaborative I/O Optimization for Graph Processing
	Zhao, Peng 1,2; Ding, Chen 3; Liu, Lei 1; Yu, Jiping 4; Han, Wentao 4; Feng, Xiao-Bing 1,2
	2019-05-01
发表期刊	JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
ISSN	1000-9000
卷号	34 期号:3 页码:690-706
摘要	Increasingly there is a need to process graphs that are larger than the available memory on today's machines. Many systems have been developed with graph representations that are efficient and compact for out-of-core processing. A necessary task in these systems is memory management. This paper presents a system called Cacheap which automatically and efficiently manages the available memory to maximize the speed of graph processing, minimize the amount of disk access, and maximize the utilization of memory for graph data. It has a simple interface that can be easily adopted by existing graph engines. The paper describes the new system, uses it in recent graph engines, and demonstrates its integer factor improvements in the speed of large-scale graph processing.
关键词	out-of-core graph processing system I/O optimization memory cache graph analytics locality
DOI	10.1007/s11390-019-1936-6
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Program of China[2017YFB1003103] ; National Natural Science Foundation of China[61432018] ; National Natural Science Foundation of China[61432016] ; National Natural Science Foundation of China[61332009] ; National Natural Science Foundation of China[61521092] ; National Science Foundation of USA[CCF-1717877] ; National Science Foundation of USA[CCF-1629376] ; IBM CAS Faculty Fellowship
WOS研究方向	Computer Science
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Software Engineering
WOS记录号	WOS:000468036000015
出版者	SCIENCE PRESS
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/4224
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Liu, Lei
作者单位	1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Univ Rochester, Dept Comp Sci, Rochester, NY 14623 USA 4.Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
推荐引用方式 GB/T 7714	Zhao, Peng,Ding, Chen,Liu, Lei,et al. Cacheap: Portable and Collaborative I/O Optimization for Graph Processing[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2019,34(3):690-706.
APA	Zhao, Peng,Ding, Chen,Liu, Lei,Yu, Jiping,Han, Wentao,&Feng, Xiao-Bing.(2019).Cacheap: Portable and Collaborative I/O Optimization for Graph Processing.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,34(3),690-706.
MLA	Zhao, Peng,et al."Cacheap: Portable and Collaborative I/O Optimization for Graph Processing".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 34.3(2019):690-706.