Enabling Continuous Testing of HPC Systems Using ReFrame

Karakasis, Vasileios; Manitaras, Theofilos; Rusu, Victor H.; Sarmiento-Pérez, Rafael; Bignamini, C.; Kraushaar, Matthias; Jocksch, A.; Omlin, Samuel; Peretti-Pezzi, Guilherme; Augusto, João P. S. C.; Friesen, Brian; He, Yun; Gerhardt, L.; Cook, Brandon; You, Zhi-Qiang; Khuvis, Samuel; Tomko, Karen

doi:10.1007/978-3-030-44728-1_3

Cited by 3 publications

(3 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Unlike PCVS, it is not intended for end users but rather for programmatic use in automating the deployment of reproducible applications for validating production developments. Finally, ReFrame [12] is a python-based test framework for writing regression tests or benchmarks, targeting HPC systems by adding abstraction layers between test definition and hardware, through a powerful support for batch managers.…”

Section: Related-workmentioning

confidence: 99%

Generating and Scaling a Multi-Language Test-Suite for MPI

Adam,

Besnard,

Canat

et al. 2023

Proceedings of the 30th European MPI Users' Group Meeting

View full text Add to dashboard Cite

High-Performance Computing (HPC) is currently facing significant challenges. The hardware pressure has become increasingly difficult to manage due to the lack of parallel abstractions in applications. As a result, parallel programs must undergo drastic evolution to effectively exploit underlying hardware parallelism. Failure to do so results in inefficient code. In this constrained environment, parallel runtimes play a critical role, and their testing becomes crucial. This paper focuses on the MPI interface and leverages the MPI binding tools to develop a multi-language test suite for MPI. By doing so and building on previous work from the Forum document editors, we implement a systematic testing of MPI symbols in the context of the Parallel Computing Validation System (PCVS), which is an HPC validation platform dedicated to running and managing test suites at scale. We first describe PCVS, then outline the process of generating the MPI API test suite, and finally, run these tests at scale. All data sets, code generators, and implementations are made available in open-source to the community. We also set up a dedicated website showcasing the results, which self-updates thanks to the Spack package manager.

show abstract

Section: Related-workmentioning

confidence: 99%

Generating and Scaling a Multi-Language Test-Suite for MPI

Adam,

Besnard,

Canat

et al. 2023

Proceedings of the 30th European MPI Users' Group Meeting

View full text Add to dashboard Cite

show abstract

“…As such, it can interact with various batch schedulers to launch (and test) multi-node parallel applications. 49,71 • Terraform: An open-source tool designed to provision computing infrastructure. 46…”

Section: Author Contributionsmentioning

confidence: 99%

“…This makes it quite different from regular software testing. The ReFrame framework 49 is designed specifically for testing HPC software and has a number of key features to support the above requirements. While any framework would suffice for the filesystem and compatibility layer tests, we aim to use ReFrame for testing all three layers in order to maintain testing consistency across the different layers and facilitate contributions to the test suite.…”

Section: Project Overviewmentioning

confidence: 99%

EESSI: A cross‐platform ready‐to‐use optimised scientific software stack

et al. 2022

View full text Add to dashboard Cite

Getting scientific software installed correctly and ensuring it performs well has been a ubiquitous problem for several decades now, which is compounded currently by the changing landscape of computational science with the (re‐)emergence of different microprocessor families, and the expansion to additional scientific domains like artificial intelligence and next‐generation sequencing. The European Environment for Scientific Software Installations (EESSI) project aims to provide a ready‐to‐use stack of scientific software installations that can be leveraged easily on a variety of platforms, ranging from personal workstations to cloud environments and supercomputer infrastructure, without making compromises with respect to performance. In this article, we provide a detailed overview of the project, highlight potential use cases, and demonstrate that the performance of the provided scientific software installations can be competitive with system‐specific installations.

show abstract