Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks

doi:10.1016/j.micpro.2020.103217

	Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks
	Sun, Hui 1,2; Dai, Shangshang 1; Huang, Jianzhong 3
	2020-10-01
发表期刊	MICROPROCESSORS AND MICROSYSTEMS
ISSN	0141-9331
卷号	78 页码:16
摘要	Log-structured merge tree (i.e., LSM-tree)-based key-value stores (i.e., KV stores) are widely used in big-data applications and provide high performance. NAND Flash-based Solid-state disks (i.e., SSDs) have become a popular storage device alternative to hard disk drives (i.e., HDDs) because of their high performance and low power consumption. LSM-tree KV stores with SSDs are deployed in large-scale storage systems, which aims to achieve high performance in the cloud. Write amplification in LSM-tree KV stores and NAND Flash memory in SSDs are defined as WA1 and WA2 in this paper. The former, which is attributed to compaction operations in LSM-tree-based KV stores, is a burden on I/O bandwidth between the host and the device. The latter, which results from out-place updates in NAND Flash memory, blocks user I/O requests between the host and NAND Flash memory, thereby degrading the SSD performance. Write amplification impairs the overall system performance. In this study, we explored the two-level cascaded write amplification in LSM-tree KV stores with SSDs. The cascaded write amplification is represented as WA. Our primary goal is to comprehensively study two-level cascaded write amplification on the host-side LSM-tree KV stores and the device-side SSDs. We quantitatively analyze the impact of two-level write amplification on overall performance. The cascaded write amplification is 16.44 (WA1 is 16.55; WA2 is 0.99) and 35.51 (WA1 is 16.6; WA2 is 2.14) for SSD-I and SSD-S with LevelDB's default setting under DB_bench. The larger cascaded write amplification of KV stores has a bad impact on SSD performance and lifetime. The throughput of SSD-S and SSD-I under an 80%-write workload is approximately 0.28x and 0.31x of that under a 100%-write workload. Therefore, it is important to design a novel approach to balance the cost of an SSD lifetime caused by cascaded write amplification and its high performance under the read-write-mixed workloads. We attempt to reveal details of cascaded write amplification and hope that this study is useful for developers of LSM-tree-based KV stores and SSD software stacks.
关键词	Log-structured merge tree Write amplification Solid state disks Key-value stores
DOI	10.1016/j.micpro.2020.103217
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61702004] ; National Natural Science Foundation of China[61572209] ; State Key Laboratory of Computer Architecture (ICT, CAS), China[CARCH201915]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS记录号	WOS:000579525100007
出版者	ELSEVIER
引用统计	被引频次：2[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/15685
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Huang, Jianzhong
作者单位	1.Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing, Peoples R China 3.Huazhong Univ Sci & Technol, Wuhan Natl Lab Optoelect, Wuhan, Peoples R China
推荐引用方式 GB/T 7714	Sun, Hui,Dai, Shangshang,Huang, Jianzhong. Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks[J]. MICROPROCESSORS AND MICROSYSTEMS,2020,78:16.
APA	Sun, Hui,Dai, Shangshang,&Huang, Jianzhong.(2020).Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks.MICROPROCESSORS AND MICROSYSTEMS,78,16.
MLA	Sun, Hui,et al."Cascaded Write Amplification of LSM-tree-based Key-Value Stores underlying Solid-State Disks".MICROPROCESSORS AND MICROSYSTEMS 78(2020):16.