Efficient data redistribution for malleable applications

Martín Álvarez, Iker; Aliaga, José I.; Castillo, Maribel; Iserte, Sergio

doi:10.1145/3624062.3624110

Cited by 2 publications

(1 citation statement)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Again, one method should always be selected, while none, one, or both strategies can be enabled. These techniques are explained in more detail in [48].…”

Section: Malleability Modulementioning

confidence: 99%

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Martín-Álvarez,

Aliaga,

Castillo

et al. 2024

Preprint

View full text Add to dashboard Cite

Applying malleability to HPC systems can increase their productivity without degrading or even improving the performance of running applications.This paper presents Proteo, a configurable framework that allows to design benchmarks to study the effect of malleability on a system, and also incorporates malleability into a real application. Proteo consists of two modules: SAM allows to emulate the computational behavior of iterative scientific MPI applications; and MaM is able to reconfigure a job during execution, adjusting the number of processes, redistributing data and resuming execution. An in-depth study of all the possibilities shows that Proteo is able to behave like a real malleable or non-malleable application in the range [0.85, 1.15]. Furthermore, the different methods defined in MaM for process management and data redistribution are analyzed, concluding that asynchronous malleability, where reconfiguration and application execution overlap, results in a 1.15x speedup.

show abstract

“…Again, one method should always be selected, while none, one, or both strategies can be enabled. These techniques are explained in more detail in [48].…”

Section: Malleability Modulementioning

confidence: 99%

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Martín-Álvarez,

Aliaga,

Castillo

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

Proteo: a framework for the generation and evaluation of malleable MPI applications

Martín-Álvarez,

Aliaga,

Castillo

et al. 2024

J Supercomput

View full text Add to dashboard Cite

Applying malleability to HPC systems can increase their productivity without degrading or even improving the performance of running applications. This paper presents Proteo, a configurable framework that allows to design benchmarks to study the effect of malleability on a system, and also incorporates malleability into a real application. Proteo consists of two modules: SAM allows to emulate the computational behavior of iterative scientific MPI applications, and MaM is able to reconfigure a job during execution, adjusting the number of processes, redistributing data, and resuming execution. An in-depth study of all the possibilities shows that Proteo is able to behave like a real malleable or non-malleable application in the range [0.85, 1.15]. Furthermore, the different methods defined in MaM for process management and data redistribution are analyzed, concluding that asynchronous malleability, where reconfiguration and application execution overlap, results in a 1.15$$\times$$ × speedup.

show abstract

Efficient data redistribution for malleable applications

Cited by 2 publications

References 18 publications

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Proteo: a framework for the generation and evaluation of malleable MPI applications

Contact Info

Product

Resources

About