Toward Network-Aware Query Execution Systems in Large Datacenters

doi:10.1109/TNSM.2023.3273166

	Toward Network-Aware Query Execution Systems in Large Datacenters
	Cheng, Long 1; Wang, Ying 2; Jhaveri, Rutvij H.3; Wang, Qingle 1; Mao, Ying 4
	2023-12-01
发表期刊	IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT
ISSN	1932-4537
卷号	20 期号:4 页码:4494-4504
摘要	How to efficiently process concurrent data tasks such as online analytical queries in datacenter environments is still a big challenge for current computing techniques. One of the fundamental reasons is that their task execution normally involves large numbers of distributed data operators, which are always expensive in terms of communication time. To improve the general performance, various advanced approaches on the execution optimization of data operators have been proposed in the past years. However, most of them focus on application-level optimization, such as using data locality scheduling to reduce network traffic. Moreover, few of them has considered the optimization opportunities for concurrent execution of multiple data operators. In this paper, we propose a novel coflow-based scheduling system called CoFlop, which aims to improve network communication time for multiple distributed operators at a query level, and on that basis to lay a solid foundation for the development of a network-aware query execution system in datacenter networks. We introduce the detailed system design of CoFlop and conduct a simulation-based evaluation with large concurrent distributed join operations. Compared to existing methods, the experimental results show that CoFlop can perform better in the presence of different large workloads.
关键词	Query data operator coflow scheduling network communication performance optimizations datacenters
DOI	10.1109/TNSM.2023.3273166
收录类别	SCI
语种	英语
资助项目	Fundamental Research Funds for the Central Universities
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems
WOS记录号	WOS:001128152200070
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/38440
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Jhaveri, Rutvij H.
作者单位	1.North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China 3.Pandit Deendayal Energy Univ, Sch Technol, Dept Comp Sci & Engn, Gandhinagar 382009, India 4.Fordham Univ, Dept Comp & Informat Sci, New York, NY 10458 USA
推荐引用方式 GB/T 7714	Cheng, Long,Wang, Ying,Jhaveri, Rutvij H.,et al. Toward Network-Aware Query Execution Systems in Large Datacenters[J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT,2023,20(4):4494-4504.
APA	Cheng, Long,Wang, Ying,Jhaveri, Rutvij H.,Wang, Qingle,&Mao, Ying.(2023).Toward Network-Aware Query Execution Systems in Large Datacenters.IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT,20(4),4494-4504.
MLA	Cheng, Long,et al."Toward Network-Aware Query Execution Systems in Large Datacenters".IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT 20.4(2023):4494-4504.