Efficient detection of silent data corruption in HPC applications with synchronization-free message verification

Zhang, Guozhen; Liu, Yi; Yang, Hailong; Qian, Depei

doi:10.1007/s11227-021-03892-4

Cited by 5 publications

(1 citation statement)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Fault tolerant techniques for message passing interface (MPI) applications have been proposed to detect and recover failures [7]- [11]. Failure detection using machine learning frameworks in high performance computing systems that automatically detect and diagnose failures [12]- [14]. A state-of-the-art failure detection, prediction, and recovery techniques in exascale systems has introduced [15].…”

Section: Introductionmentioning

confidence: 99%

Efficient failure detection and consensus at extreme-scale systems

Kolisetty¹,

Rao²

2022

IJECE

View full text Add to dashboard Cite

<span>Distributed systems and extreme-scale systems are ubiquitous in recent years and have seen throughout academia organizations, business, home, and government sectors. Peer-to-peer (P2P) technology is a typical distributed system model that is gaining popularity for delivering computing resources and services. Distributed systems try to increase its availability in the event of frequent component failures and functioning the system in such scenario is notoriously difficult. In order to identify component failures in the system and achieve global agreement (consensus) among failed components, this paper implemented an efficient failure detection and consensus algorithm based on fail-stop type process failures. The proposed algorithm is fault-tolerant to process failures occurring before and during the execution of the algorithm. The proposed algorithm works with the epidemic gossip protocol, which is a randomly generated paradigm of computation and communication that is both fault-tolerant and scalable. A simulation of an extreme-scale information dissemination process shows that global agreement can be achieved. A P2P simulator, PeerSim, is used in the paper to implement and test the proposed algorithm. The proposed algorithm results exhibited high scalability and at the same time detected all the process failures. The status of all the processes is maintained in a Boolean matrix.</span>

show abstract