The MIG Framework

Abstract

This paper introduces the mig framework: an Open MPI extension to transparently support the migration of application processes, over different nodes of a distributed High-Performance Computing (HPC) system. The framework provides mechanism on top of which suitable resource managers can implement policies to react to hardware faults, address performance variability, improve resource utilization, perform a fine-grained load balancing and power thermal management.Compared to other state-of-the-art approaches, the mig framework does not require changes in the application code. Moreover, it is highly maintainable, since it is mainly a selfcontained solution that has required a very few changes in other already existing Open MPI frameworks. Experimental results have shown that the proposed extension does not introduce significant overhead in the application execution, while the penalty due to performing a migration can be properly taken into account by a resource manager. CCS Concepts•Software and its engineering → Checkpoint / restart; Multiprocessing / multiprogramming / multitasking; •Computing methodologies → Parallel computing methodologies; •Computer systems organization → Distributed architectures;

Predictive Reliability and Fault Management in Exascale Systems

“…If the application has been implemented by using the Message Passing Interface (MPI) programming model, then this may typically require the movement of MPI processes ( Process migration ) among nodes. Some authors proposed an extension of the OpenMPI runtime to perform this in a transparent manner [ 144 ].…”