Efficient and Contention-Free Virtualisation of Fat-Trees

Sem-Jacobsen, Frank Olaf; Solheim, Åshild Grønstad; Lysne, Olav; Skeie, Tor; Sødring, Thomas

doi:10.1109/ipdps.2011.218

Cited by 3 publications

(2 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several proposals have been presented to improve system utilization by intelligent job allocation and scheduling in fat-tree topologies. In [50], the authors have presented an allocation algorithm for achieving high network utilization and application isolation in fat-trees. The algorithm assumes centralized knowledge of the complete data center wide workload, and allocates processing nodes on a per job basis.…”

Section: Related Workmentioning

confidence: 99%

Efficient network isolation and load balancing in multi-tenant HPC clusters

Zahid

Gran

Bogdański³

et al. 2017

Future Generation Computer Systems

View full text Add to dashboard Cite

Section: Related Workmentioning

confidence: 99%

Efficient network isolation and load balancing in multi-tenant HPC clusters

Zahid

Gran

Bogdański³

et al. 2017

Future Generation Computer Systems

View full text Add to dashboard Cite

“…Such a claim is not considered true any more. Even for fat tree networks, where the assumption has been that, due to its high bisection bandwidth, the allocation (fragmented or not) should have a minimal impact, it has been demonstrated 55,44,60 that the allocation strategy plays an important role in application performance: in reducing communication latency between communicating tasks 60 and in reducing interference from other applications 30 . For other topologies, such as meshes or tori, the problem of interference is even worse 63,8,46,56 .…”

mentioning

confidence: 99%

Resource management techniques aware of interference among high-performance computing applications

Jokanović

View full text Add to dashboard Cite

Network interference of nearby jobs has been recently identified as the dominant reason for the high performance variability of parallel applications running on High Performance Computing (HPC) systems. Typically, HPC systems are dynamic with multiple jobs coming and leaving in an unpredictable fashion, sharing simultaneously the system interconnection network. In such environment contention for network resources is causing random stalls in the progress of application execution degrading application's performance. Eliminating interactions between jobs is the key for guaranteeing both high performance and performance predictability of applications. These interactions are determined by the job location in the system. Upon arriving to the system, the job is allocated the computing and network resources by resource managers. Based on the job size requirements, the job scheduler finds a set of available computing nodes. In addition, the subnet manager determines the allocation of the network resources such as paths between nodes, virtual lanes, link bandwidth. Typically, resource managers are mainly focused on increasing utilization of the resources while neglecting job interactions. In this thesis, we propose techniques for both, job scheduler and subnet manager, able to mitigate job interactions: 1) a job scheduling policy that reduces the node fragmentation in the system, and 2) a quality-of-service (QoS) policy based on a characterization of job's network load; this policy is relaying on the virtual lanes mechanism provided by modern interconnection network (e.g. InfiniBand). In order to evaluate our job scheduling policy we use a simulator developed for this thesis that takes as an input the job scheduler log from a production HPC system. This simulator performs the node allocation for the jobs from the log. The proposed QoS policy is evaluated using a flit-level network simulator that is able to replay multiple traces from real executions of MPI applications. Experimental results show that the proposed job scheduling policy leads to few jobs sharing network resources and thus having fewer job's interactions while the QoS policy is able to effectively reduce the degradation from the remaining job's interactions. These two software techniques are complementary and could be used together without additional hardware.

show abstract