MMPI: A Scalable Fault Tolerance Mechanism for MPI Large Scale Parallel Computing

Wang, Zhiyuan; Yang, Xuejun; Zhou, Yun

doi:10.1109/cit.2010.226

Cited by 4 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The recently proposed MMPI [18] offers a set of protocols for redundant execution of MPI applications with different replica partitioning and comparison schemes. It relies entirely on cumbersome source code modifications for implementing the redundancy protocols.…”

Section: Redundant Execution With Mmpimentioning

confidence: 99%

Redundant Execution of HPC Applications with MR-MPI

Engelmann

Boehm²

2011

Parallel and Distributed Computing and Networks / 720: Software Engineering

View full text Add to dashboard Cite

This paper presents a modular-redundant Message Passing Interface (MPI) solution, MR-MPI, for transparently executing high-performance computing (HPC) applications in a redundant fashion. The presented work addresses the deficiencies of recovery-oriented HPC, i.e., checkpoint/restart to/from a parallel file system, at extreme scale by adding the redundancy approach to the HPC resilience portfolio. It utilizes the MPI performance tool interface, PMPI, to transparently intercept MPI calls from an application and to hide all redundancy-related mechanisms. A redundantly executed application runs with r * m native MPI processes, where r is the number of MPI ranks visible to the application and m is the replication degree. Messages between redundant nodes are replicated. Partial replication for tunable resilience is supported. The performance results clearly show the negative impact of the O(m 2) messages between replicas. For low-level, point-to-point benchmarks, the impact can be as high as the replication degree. For applications, performance highly depends on the actual communication types and counts. On single-core systems, the overhead can be 0% for embarrassingly parallel applications independent of the employed redundancy configuration or up to 70-90% for communication-intensive applications in a dual-redundant configuration. On multi-core systems, the overhead can be significantly higher due to the additional communication contention.

show abstract

Section: Redundant Execution With Mmpimentioning

confidence: 99%