HCMonitor: An accurate measurement system for high concurrent network services

doi:10.1002/cpe.6081

	HCMonitor: An accurate measurement system for high concurrent network services
	Song, Hui 1; Zhang, Wenli 1; Liu, Ke 1; Shen, Yifan 1,2; Chen, Mingyu 1,2,3
	2021-04-27
发表期刊	CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
ISSN	1532-0626
页码	16
摘要	This article aims to enhance the monitoring accuracy of high concurrent network services. As modern network services grow rapidly in data centers, tail latency has become one of the most crucial deciding factors on user experience. Latency measurement and anomaly detection are essential in evaluating service performance. Existing monitoring tools can be divided into two categories according to estimation methods. First, approaches based on sample traffic sample network packets to unburden the measurement. Second, approaches based on full traffic like wrk, analyze all of the packets from the kernel network stack and load the client-side overhead into response delay. Therefore, we propose a high-performance monitor system named HCMonitor, which computes the server-side response latency and the round-trip time of per-request. It can afford full traffic monitoring on the basis of userspace, "zero copy" and pipeline. By switch mirroring, the measured latency eliminates the kernel network stack overhead and the queuing delay of the client-side. Such measurement results in improved accuracy, online analysis, anomaly detection, real-time display and transparent to network services. Our evaluations show HCMonitor obtains a higher throughput compared with tcpdump by over 200 times. Compared with wrk, the tail latency accuracy shows an increase by up to 72%-76% in high concurrent networks.
关键词	accurate measurement full traffic high concurrency monitor server‐ side latency
DOI	10.1002/cpe.6081
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Plan of China[2017YFB1001602] ; National-Natural Science Foundation of China[62072439]
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering ; Computer Science, Theory & Methods
WOS记录号	WOS:000644709200001
出版者	WILEY
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/17833
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhang, Wenli
作者单位	1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Kexueyuan Rd South 6, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing, Peoples R China 3.Peng Cheng Lab, Frontier Res Ctr, Shenzhen, Peoples R China
推荐引用方式 GB/T 7714	Song, Hui,Zhang, Wenli,Liu, Ke,et al. HCMonitor: An accurate measurement system for high concurrent network services[J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE,2021:16.
APA	Song, Hui,Zhang, Wenli,Liu, Ke,Shen, Yifan,&Chen, Mingyu.(2021).HCMonitor: An accurate measurement system for high concurrent network services.CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE,16.
MLA	Song, Hui,et al."HCMonitor: An accurate measurement system for high concurrent network services".CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE (2021):16.