Unveiling the Interplay Between Global Link Arrangements and Network Management Algorithms on Dragonfly Networks

Kaplan, Fulya; Tuncer, Ozan; Leung, Vitus J.; Hemmert, Scott; Coskun, Ayse K.

doi:10.1109/ccgrid.2017.93

Cited by 9 publications

(1 citation statement)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Indeed, all these design aspects should be taken into consideration together, i.e., with a holistic perspective that analyses the impact of new designs on each other aspect. For instance, the design of the network topology influences the routing algorithm, or the offered network bisection bandwidth [7]. Therefore, efficient routing algorithms will need to leverage the network topology properties (e.g., path diversity, bisection bandwidth, etc.…”

Section: Introductionmentioning

confidence: 99%

Building and Evaluating an Ethernet-based Interconnection Network Prototype using Open-Hardware Designs and FPGAs

Moran-Munoz,

Escudero-Sahuquillo,

Garcia

et al. 2023

Preprint

View full text Add to dashboard Cite

The interconnection network is a subsystem evermore important in current Datacenters and supercomputers where data- and computing-hungry applications, used in high-performance computing (HPC), artificial intelligence (AI), or Cloud fields, demand a growing number of communication operations among the server hosts. These demands require that the network subsystem guarantees high communication bandwidth and low latency, otherwise becoming the bottleneck of the entire system. There are numerous interconnection network technologies that are evolving their architectures to accomplish these demands, such as InfiniBand or Ethernet-based networks. In particular, Ethernet-based interconnection networks have improved in the last few years their performance, in terms of latency and throughput, so they have become a competitive and popular choice for Datacenters and Supercomputers.Indeed, there are several open hardware projects, such as Corundum and NetFPGA, which provide interconnection network models that can be implemented in commodity FPGAs. Thanks to these projects the community is contributing to developing novel and efficient network functionalities. In this paper, we describe the process of building an FPGA-based prototype for an Ethernet-based interconnection network.Specifically, we use development boards from the NetFPGA platform, composed of a Xilinx Virtex-7 690T FPGA, internal flash memory, 10GbE transceivers, etc.In these FPGAs, we have implemented open-source designs (NICs and switches) from NetFPGA and Corundum projects. The cabling of the prototype is flexible so it allows measuring the performance of NIC-to-NIC and NIC-to-switch communication. We have also evaluated several transport protocols (i.e., TCP and UDP) using commonly used benchmarks and tools, and analyzed the different configurations of the software stack to reduce the packet dropping in the communication.

show abstract

Section: Introductionmentioning

confidence: 99%

Building and Evaluating an Ethernet-based Interconnection Network Prototype using Open-Hardware Designs and FPGAs

Moran-Munoz,

Escudero-Sahuquillo,

Garcia

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

An Analysis of Long-Tailed Network Latency Distribution and Background Traffic on Dragonfly+

Beni

Cosenza

2023

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Analysis and prediction of performance variability in large-scale computing systems

Salimi Beni,

Hunold,

Cosenza

2024

J Supercomput

View full text Add to dashboard Cite

The development of new exascale supercomputers has dramatically increased the need for fast, high-performance networking technology. Efficient network topologies, such as Dragonfly+, have been introduced to meet the demands of data-intensive applications and to match the massive computing power of GPUs and accelerators. However, these supercomputers still face performance variability mainly caused by the network that affects system and application performance. This study comprehensively analyzes performance variability on a large-scale HPC system with Dragonfly+ network topology, focusing on factors such as communication patterns, message size, job placement locality, MPI collective algorithms, and overall system workload. The study also proposes an easy-to-measure metric for estimating network background traffic generated by other users, which can be used to estimate the performance of our job accurately. The insights gained from this study contribute to improving performance predictability, enhancing job placement policies and MPI algorithm selection, and optimizing resource management strategies in supercomputers.

show abstract

Unveiling the Interplay Between Global Link Arrangements and Network Management Algorithms on Dragonfly Networks

Cited by 9 publications

References 31 publications

Building and Evaluating an Ethernet-based Interconnection Network Prototype using Open-Hardware Designs and FPGAs

Building and Evaluating an Ethernet-based Interconnection Network Prototype using Open-Hardware Designs and FPGAs

An Analysis of Long-Tailed Network Latency Distribution and Background Traffic on Dragonfly+

Analysis and prediction of performance variability in large-scale computing systems

Contact Info

Product

Resources

About