Malleability Techniques for HPC Systems

Carretero, Jesús; Singh, David E.; Cascajo, Alberto; Montella, Raffaele

doi:10.1007/978-3-031-30445-3_7

Cited by 2 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[24][25][26]; and scientific applications such as LAMMPS, HPG-aligner, LeanMD 3 , etc. [9,[27][28][29][30][31][32][33].…”

Section: Motivation and Backgroundmentioning

confidence: 99%

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Martín-Álvarez,

Aliaga,

Castillo

et al. 2024

Preprint

View full text Add to dashboard Cite

Applying malleability to HPC systems can increase their productivity without degrading or even improving the performance of running applications.This paper presents Proteo, a configurable framework that allows to design benchmarks to study the effect of malleability on a system, and also incorporates malleability into a real application. Proteo consists of two modules: SAM allows to emulate the computational behavior of iterative scientific MPI applications; and MaM is able to reconfigure a job during execution, adjusting the number of processes, redistributing data and resuming execution. An in-depth study of all the possibilities shows that Proteo is able to behave like a real malleable or non-malleable application in the range [0.85, 1.15]. Furthermore, the different methods defined in MaM for process management and data redistribution are analyzed, concluding that asynchronous malleability, where reconfiguration and application execution overlap, results in a 1.15x speedup.

show abstract

“…[24][25][26]; and scientific applications such as LAMMPS, HPG-aligner, LeanMD 3 , etc. [9,[27][28][29][30][31][32][33].…”

Section: Motivation and Backgroundmentioning

confidence: 99%

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Martín-Álvarez,

Aliaga,

Castillo

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

Proteo: a framework for the generation and evaluation of malleable MPI applications

Martín-Álvarez,

Aliaga,

Castillo

et al. 2024

J Supercomput

View full text Add to dashboard Cite

Applying malleability to HPC systems can increase their productivity without degrading or even improving the performance of running applications. This paper presents Proteo, a configurable framework that allows to design benchmarks to study the effect of malleability on a system, and also incorporates malleability into a real application. Proteo consists of two modules: SAM allows to emulate the computational behavior of iterative scientific MPI applications, and MaM is able to reconfigure a job during execution, adjusting the number of processes, redistributing data, and resuming execution. An in-depth study of all the possibilities shows that Proteo is able to behave like a real malleable or non-malleable application in the range [0.85, 1.15]. Furthermore, the different methods defined in MaM for process management and data redistribution are analyzed, concluding that asynchronous malleability, where reconfiguration and application execution overlap, results in a 1.15$$\times$$ × speedup.

show abstract

Malleability Techniques for HPC Systems

Cited by 2 publications

References 16 publications

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

Proteo: a framework for the generation and evaluation of malleable MPI applications

Contact Info

Product

Resources

About