Labeled Network Stack: A High-Concurrency and Low-Tail Latency Cloud Server Framework for Massive IoT Devices

doi:10.1007/s11390-020-9651-x

	Labeled Network Stack: A High-Concurrency and Low-Tail Latency Cloud Server Framework for Massive IoT Devices
	Zhang, Wen-Li 1; Liu, Ke 1; Shen, Yi-Fan 1,2; Lan, Ya-Zhu 1; Song, Hui 1; Chen, Ming-Yu 1,2,3; Chen, Yuan-Fei 1,4
	2020
发表期刊	JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
ISSN	1000-9000
卷号	35 期号:1 页码:179-193
摘要	Internet of Things (IoT) applications have massive client connections to cloud servers, and the number of networked IoT devices is remarkably increasing. IoT services require both low-tail latency and high concurrency in datacenters. This study aims to determine whether an order of magnitude improvement is possible in tail latency and concurrency in mainstream systems by proposing a hardware-software codesigned labeled network stack (LNS) for future datacenters. The key innovation is a cross-layered payload labeling mechanism that distinguishes different requests by payload across the full network stack, including application, TCP/IP, and Ethernet layers. This type of design enables prioritized data packet processing and forwarding along the full datapath, such that latency-insensitive requests cannot significantly interfere with high-priority requests. We build a prototype datacenter server to evaluate the LNS design against a commercial X86 server and the mTCP research, using a cloud-supported IoT application scenario. Experimental results show that the LNS design can provide an order of magnitude improvement in tail latency and concurrency. A single datacenter server node can support over 2 million concurrent long-living connections for IoT devices as a 99-percentile tail latency of 50 ms is maintained. In addition, the hardware-software codesign approach remarkably reduces the labeling and prioritization overhead and constrains the interference of high-priority requests to low-priority requests.
关键词	tail latency high concurrency network stack cloud server Internet of Things (IoT) service
DOI	10.1007/s11390-020-9651-x
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Plan of China[2016YFB1000203]
WOS研究方向	Computer Science
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Software Engineering
WOS记录号	WOS:000512098800011
出版者	SCIENCE PRESS
引用统计	被引频次：2[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/14754
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhang, Wen-Li
作者单位	1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Peng Cheng Lab, Shenzhen 518000, Peoples R China 4.Zhongke Zhicheng Elect Technol Co Ltd, Jining 272000, Peoples R China
推荐引用方式 GB/T 7714	Zhang, Wen-Li,Liu, Ke,Shen, Yi-Fan,et al. Labeled Network Stack: A High-Concurrency and Low-Tail Latency Cloud Server Framework for Massive IoT Devices[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2020,35(1):179-193.
APA	Zhang, Wen-Li.,Liu, Ke.,Shen, Yi-Fan.,Lan, Ya-Zhu.,Song, Hui.,...&Chen, Yuan-Fei.(2020).Labeled Network Stack: A High-Concurrency and Low-Tail Latency Cloud Server Framework for Massive IoT Devices.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,35(1),179-193.
MLA	Zhang, Wen-Li,et al."Labeled Network Stack: A High-Concurrency and Low-Tail Latency Cloud Server Framework for Massive IoT Devices".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 35.1(2020):179-193.