Substituting Disk Failure Avoidance for Redundancy in Wide Area Fault Tolerant Storage Systems

Abstract

The primary mechanism for overcoming faults in modern storage systems is to introduce redundancy in the form of replication and/or error correcting codes. The costs of such redundancy in hardware, system availability and overall complexity can be substantial, depending on the number and pattern of faults that are handled. In this paper, we describe a system that seeks to use disk failure avoidance to reduce the need for costly redundancy by using adaptive heuristics that predict such failures. While a number of predictive factors such as hard drive utilization rate, age, SMART errors, and model can be used, the initial work we present here focuses on SMART errors. Our approach can predict where near term disk failures are more likely to occur, enabling proactive movement/replication of atrisk data, thus maintaining data integrity and availability. Our strategy can reduce costs due to redundant storage without compromising these important requirements.