A Two-Level Fault-Tolerance Technique for High Performance Computing Applications

Abstract

Reliability is the biggest concern facing future extreme-scale, high performance computing (HPC) systems. Within the current generation of HPC systems, projections suggest that errors will occur with very high rates in future systems. Thus, it is fundamental that we detect errors that can cause the failure of important applications, such as scientific ones. In this paper, we have presented a two-level fault-tolerance approach for the detection and classification of errors for Compute United Device Architecture (CUDA)-based Graphics Processing Units (GPUs). In the first level, it detects the existence of errors by using software redundancy that applies design diversity. In the second level, it investigates the problematic software version and re-executes it on a different hardware component to classify whether the error is a permanent hardware error or a software error. We implemented our approach to run on GPUs and conducted proof of concept experiments by running three versions of matrix multiplications with different error scenarios and results show the feasibility of the proposed approach.

Efficient failure detection and consensus at extreme-scale systems

“…A state-of-the-art failure detection, prediction, and recovery techniques in exascale systems has introduced [15]. In research [16], [17], a fault tolerant framework is designed and implemented for heterogeneous applications to increase scalability. A various gossip-based algorithms were implemented for failure detection and consensus [18]- [20].…”