An Analysis of Long-Tailed Network Latency Distribution and Background Traffic on Dragonfly+

Beni, Majid Salimi; Cosenza, Biagio

doi:10.1007/978-3-031-31180-2_8

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Book1

Article1

Other1

Relationship

Self Cite0

Independent3

Authors

Journals

Cited by 3 publications

References 59 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Algorithm Selection of MPI Collectives Considering System Utilization

Salimi Beni,

Hunold,

Cosenza

2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Algorithm Selection of MPI Collectives Considering System Utilization

Salimi Beni,

Hunold,

Cosenza

2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Analysis and prediction of performance variability in large-scale computing systems

Salimi Beni,

Hunold,

Cosenza

2024

J Supercomput

View full text Add to dashboard Cite

The development of new exascale supercomputers has dramatically increased the need for fast, high-performance networking technology. Efficient network topologies, such as Dragonfly+, have been introduced to meet the demands of data-intensive applications and to match the massive computing power of GPUs and accelerators. However, these supercomputers still face performance variability mainly caused by the network that affects system and application performance. This study comprehensively analyzes performance variability on a large-scale HPC system with Dragonfly+ network topology, focusing on factors such as communication patterns, message size, job placement locality, MPI collective algorithms, and overall system workload. The study also proposes an easy-to-measure metric for estimating network background traffic generated by other users, which can be used to estimate the performance of our job accurately. The insights gained from this study contribute to improving performance predictability, enhancing job placement policies and MPI algorithm selection, and optimizing resource management strategies in supercomputers.

show abstract