LEC-PR: Proactive Recovery Method in Erasure-Coded Storage

Song, Ying; Yang, Mingjie; Wang, Bo

doi:10.1109/ipdrm56689.2022.00007

Cited by 1 publication

(1 citation statement)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…If the damaged data is accessed, degraded data reading may occur, resulting in the increased response time. The predictive repair is to process the possible damaged or lost data blocks in advance before the actual failure based on the prediction of the soon-to-fail (STF) node through machine learning or other methods [11], [12], [13], [14], [15], so as to shorten the unavailable time of data blocks and improve data reliability [16], [17], [18], [19], [20], [21]. However, the above researches focus on how to optimize the repair process and ignore whether it is necessary to immediately repair faults.…”

Section: Introductionmentioning

confidence: 99%

ACPR: Adaptive Classification Predictive Repair Method for Different Fault Scenarios

Song,

Zheng,

Tian

et al. 2024

IEEE Access

Self Cite

View full text Add to dashboard Cite

Erasure codes are widely used in large-scale distributed storage systems due to their high efficiency and reliability, but they also face extremely high repair penalties when data corruption occurs. At present, machine learning methods can accurately predict the next failure time and type of machine nodes. Based on this, in order to solve the problem of unnecessary repair traffic caused by temporary failures, as well as the more degraded reads of high-frequency accessed data due to longer failure time of such data in existing repair methods, we propose an Adaptive Classification Predictive Repair method (ACPR) for different fault scenarios. By categorizing the failed blocks into high-risk and low-risk based on the failure type of the soon-to-fail (STF) node and the access heat of STF blocks, ACPR can perform adaptive predictive repair. By quickly repair high-risk blocks to ensure data availability while delaying the repair of low-risk blocks, a large amount of unnecessary repair traffic caused by temporary node failures in the cluster is avoided. Alibaba Cloud Elastic Compute Service (ECS) experiments results show that compared with FastPR and ECPipe, ACPR can shorten the repair time per data block by up to 15.2% and 33.5%, respectively. Moreover, ACPR can reduce repair traffic by up to 74.1% and 84.4%, respectively.INDEX TERMS Distributed storage system, data recovery, erasure coding.

show abstract