BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems

doi:10.1109/ACCESS.2023.3257404

	BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems
	Song, Ying 1,2,3; Zhao, Wenxuan 1,2; Wang, Bo 4
	2023
发表期刊	IEEE ACCESS
ISSN	2169-3536
卷号	11 页码:44509-44518
摘要	Today, Erasure Coding is one of the most significant techniques widely used in distributed systems because it can improve reliability for large amounts of data with low storage overhead. However, when the distributed system encounters a large number of data loss in stripes and requires batch-stripes data recovery, current data recovery methods either repeat the single-stripe recovery method or only optimize partial stripe recovery when recovering large-scale stripes, which incurs heavy upload and download repair traffics and imbalanced load, affecting the efficiency of fault recovery and wasting additional resources. In this paper, we propose BPR, an Erasure Coding batch parallel repair approach for distributed storage systems. BPR reduces cross-rack network transfer time and increases recovery throughput by classifying the stripes and recovering the data of stripes in batches through the forward and reverse parallel data recovery. The experiment results show that for large-scale stripes recovery, BPR reduces the cross-rack network transfer time by up to 10% and increases the recovery throughput by up to 8% compared with the rPDL in some scenarios.
关键词	Distributed processing Business process re-engineering Traffic congestion Encoding Full-duplex system Decoding Bandwidth Storage management Distributed storage system erasure coding data recovery
DOI	10.1109/ACCESS.2023.3257404
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61872043] ; State Key Laboratory of Computer Architecture, Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS)[CARCHA202103]
WOS研究方向	Computer Science ; Engineering ; Telecommunications
WOS类目	Computer Science, Information Systems ; Engineering, Electrical & Electronic ; Telecommunications
WOS记录号	WOS:000988464100001
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：2[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21456
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Song, Ying
作者单位	1.Beijing Informat Sci & Technol Univ, Beijing Key Lab Internet Culture & Digital Dissemi, Beijing 100101, Peoples R China 2.Beijing Informat Sci & Technol Univ, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing 100101, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100086, Peoples R China 4.Zhengzhou Univ Light Ind, Software Engn Coll, Zhengzhou 450002, Peoples R China
推荐引用方式 GB/T 7714	Song, Ying,Zhao, Wenxuan,Wang, Bo. BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems[J]. IEEE ACCESS,2023,11:44509-44518.
APA	Song, Ying,Zhao, Wenxuan,&Wang, Bo.(2023).BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems.IEEE ACCESS,11,44509-44518.
MLA	Song, Ying,et al."BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems".IEEE ACCESS 11(2023):44509-44518.