HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization

doi:10.1109/ACCESS.2024.3382987

CSpace

	HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization
	Song, Ying 1,2,3; Zhao, Wenxuan 1,2; Tian, Yingai 1; Wang, Bo 4
	2024
发表期刊	IEEE ACCESS
ISSN	2169-3536
卷号	12 页码:48630-48639
摘要	In distributed systems, the method for data storage is crucial. Previous data storage work use the replication or Erasure Coding method to store data. Such single storage method leads to the excessive storage overheads for cold data with low access frequency or the low reading performance for hot data with high access frequency. Nowadays, the research on the hybrid storage has become a hot topic of concern for many scholars. Existing hybrid storage works take into account data reading performance and the storage overheads, and use the replication and Erasure Coding methods to store the hot data and cold data respectively. However, in the scenarios of sufficient disk space or low disk space, these fixed data storage methods will lead to the relatively low system data reading performance or the excessively low disk space of the system. In this paper, we propose HSM, a hybrid storage method based on the heat of data and global disk space utilization. HSM fully considers the system's requirements for the data reading performance and storage overheads under different global disk space utilization scenarios, and adaptively selects appropriate storage methods for data whose heat is different through data deletion, data reconstruction, and data archiving. The experiment results show that when system disk space is sufficient, HSM reduces data reading time by up to 18%; when system disk space is low, although increasing storage overhead by up to 7%, HSM reduces cross-rack data transfer traffic by up to 20% and cross-rack data transfer time by up to 15% compared with ERP in the process of changing the storage methods.
关键词	Distributed storage system hybrid storage erasure coding replication
DOI	10.1109/ACCESS.2024.3382987
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China
WOS研究方向	Computer Science ; Engineering ; Telecommunications
WOS类目	Computer Science, Information Systems ; Engineering, Electrical & Electronic ; Telecommunications
WOS记录号	WOS:001197750100001
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/38733
专题	中国科学院计算技术研究所
通讯作者	Song, Ying
作者单位	1.Beijing Informat Sci & Technol Univ, Beijing 100101, Peoples R China 2.Beijing Informat Sci & Technol Univ, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing 100101, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100086, Peoples R China 4.Zhengzhou Univ Light Ind, Software Engn Coll, Zhengzhou 450002, Peoples R China
推荐引用方式 GB/T 7714	Song, Ying,Zhao, Wenxuan,Tian, Yingai,et al. HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization[J]. IEEE ACCESS,2024,12:48630-48639.
APA	Song, Ying,Zhao, Wenxuan,Tian, Yingai,&Wang, Bo.(2024).HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization.IEEE ACCESS,12,48630-48639.
MLA	Song, Ying,et al."HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization".IEEE ACCESS 12(2024):48630-48639.