Boosting HPC Applications in the Cloud Through JIT Traffic-Aware Path Provisioning

Pretto, Guilherme R.; Dalmazo, Bruno L.; Marques, Jonatas Adilson; Wu, Zhongke; Wang, Xingce; Korkhov, Vladimir; Navaux, Philippe O. A.; Gaspary, Luciano Paschoal

doi:10.1007/978-3-030-24305-0_52

Cited by 5 publications

(1 citation statement)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such performance improvements can be made with both software and hardware optimization. On the hardware side, the network interconnection is pointed out by several studies as one of the main bottlenecks [ 11 , 13 , 14 ], because it is the central point of interconnection between servers, and thus also be shared between the processing of several flows originated from different cloud instances. In addition, another alternative is to allocate a faster cloud instance, which can increase overall performance, but theoretically also increases the cost.…”

Section: Introductionmentioning

confidence: 99%

Performance Impact of IEEE 802.3ad in Container-Based Clouds for HPC Applications

Maliszewski

Roloff

Griebler

et al. 2020

Computational Science and Its Applications – ICCSA 2020

Self Cite

View full text Add to dashboard Cite

Historically, large computational clusters have supported hardware requirements for executing High-Performance Computing (HPC) applications. This model has become out of date due to the high costs of maintaining and updating these infrastructures. Currently, computing resources are delivered as a service because of the cloud computing paradigm. In this way, we witnessed consistent efforts to migrate HPC applications to the cloud. However, if on the one hand cloud computing offers an attractive environment for HPC, benefiting from the pay-per-use model and on-demand resource allocation, on the other, there are still significant performance challenges to be addressed, such as the known network bottleneck. In this article, we evaluate the use of a Network Interface Cards (NIC) aggregation approach, using the IEEE 802.3ad standard to improve the performance of representative HPC applications executed in LXD container based-cloud. We assessed the aggregation impact using two and four NICs with three distinct transmission hash policies. Our results demonstrated that if the correct hash policy is selected, the NIC aggregation can significantly improve the performance of network-intensive HPC applications by up to 40%.

show abstract

Section: Introductionmentioning

confidence: 99%