The Reliability of Modern File Systems in the face of SSD Errors

Abstract

As solid state drives (SSDs) are increasingly replacing hard disk drives, the reliability of storage systems depends on the failure modes of SSDs and the ability of the file system layered on top to handle these failure modes. While the classical paper on IRON File Systems provides a thorough study of the failure policies of three file systems common at the time, we argue that 13 years later it is time to revisit file system reliability with SSDs and their reliability characteristics in mind, based on modern file systems that incorporate journaling, copy-on-write, and log-structured approaches and are optimized for flash. This article presents a detailed study, spanning ext4, Btrfs, and F2FS, and covering a number of different SSD error modes. We develop our own fault injection framework and explore over 1,000 error cases. Our results indicate that 16% of these cases result in a file system that cannot be mounted or even repaired by its system checker. We also identify the key file system metadata structures that can cause such failures, and, finally, we recommend some design guidelines for file systems that are deployed on top of SSDs.

Data recovery methods for DNA storage based on fountain codes

“…Traditional digital data storage systems offer various solutions for data recovery in the event of medium failure. For hard disk drives, this typically involves the use of software tools for error prediction [13] and (file system ) recovery [14,15] as well as near-hardware procedures to retrieve otherwise inaccessible user data [16]. While recovering data from a failed hard disk drive is generally possible, any error exceeding the chosen maximum redundancy for a DNA storage system leads to irreversible data loss.…”

Data recovery methods for DNA storage based on fountain codes

“…Conventional digital data storage systems offer various solutions to recover data if a failure of the medium occurs. For hard disk drives, this typically includes the use of software tools to predict [33] and recover (file system) errors [18,10] as well as near-hardware procedures to retrieve otherwise inaccessible user data [29]. While it is in principle possible to recover data from a failed hard disk drive, any error beyond the maximum redundancy chosen for a DNA storage system would result in irreversible data loss.…”