Batsim: A Realistic Language-Independent Resources and Jobs Management Systems Simulator

Dutot, Pierre-François; Mercier, Michael; Poquet, Millian; Richard, Olivier

doi:10.1007/978-3-319-61756-5_10

Cited by 59 publications

(44 citation statements)

References 21 publications

(12 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Batsim [12] is one of the most recent SimGrid-based simulators. It is based on the separation of concerns between system simulation and scheduling algorithms using two main components: batsim main and batsim decision.…”

Section: Related Workmentioning

confidence: 99%

Exploring the Relation between Two Levels of Scheduling Using a Novel Simulation Approach

Eleliemy

Mohammed

Ciorba

2017

2017 16th International Symposium on Parallel and Distributed Computing (ISPDC)

View full text Add to dashboard Cite

Abstract-Modern high performance computing (HPC) systems exhibit a rapid growth in size, both "horizontally" in the number of nodes, as well as "vertically" in the number of cores per node. As such, they offer additional levels of hardware parallelism. Each level requires and employs algorithms for appropriately scheduling the computational work at the respective level. The present work explores the relation between two scheduling levels: batch and application. To understand and explore this relation, a novel simulation approach is presented that bridges two existing simulators from the two scheduling levels. A novel two-level simulator that implements the proposed approach is introduced. The two-level simulator is used to simulate all combinations of three batch scheduling and four application scheduling algorithms from the literature. These combinations are considered for allocating resources and executing the parallel jobs from a workload of a production HPC system. The results of the scheduling experiments reveal the strong relation between decisions taken at the two scheduling levels and their mutual influence. Complementing the simulations, the two-level simulator produces abstract parallel execution traces, which can visually be examined and illustrate the execution of different jobs and, for each job, the execution of its tasks at node and core levels, respectively.

show abstract

Section: Related Workmentioning

confidence: 99%

Exploring the Relation between Two Levels of Scheduling Using a Novel Simulation Approach

Eleliemy

Mohammed

Ciorba

2017

2017 16th International Symposium on Parallel and Distributed Computing (ISPDC)

View full text Add to dashboard Cite

show abstract

“…This group is represented, e.g., by the recent Batsim, Simbatch or GSSIM [3]. Batsim is built on top of SimGrid [4]. It is made such that any event-based scheduling algorithm can be plugged to it and tested.…”

Section: Related Workmentioning

confidence: 99%

Alea – Complex Job Scheduling Simulator

Klusáček¹,

Soysal²,

Suter³

2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Using large computer systems such as HPC clusters up to their full potential can be hard. Many problems and inefficiencies relate to the interactions of user workloads and system-level policies. These policies enable various setup choices of the resource management system (RMS) as well as the applied scheduling policy. While expert's assessment and well known best practices do their job when tuning the performance, there is usually plenty of room for further improvements, e.g., by considering more efficient system setups or even radically new scheduling policies. For such potentially damaging modifications it is very suitable to use some form of a simulator first, which allows for repeated evaluations of various setups in a fully controlled manner. This paper presents the latest improvements and advanced simulation capabilities of the Alea job scheduling simulator that has been actively developed for over 10 years now. We present both recently added advanced simulation capabilities as well as a set of real-life based case studies where Alea has been used to evaluate major modifications of real HPC and HTC systems.

show abstract

“…A new allocation which takes the current allocation of J r into account is determined for all the jobs in L 1 (lines 6-8). Then, while there is a job J i in L 1 that does not respect its deadline, we move it from L 1 to L tmp (lines 10-11) and recompute the allocations of both L tmp (lines [15][16][17] and L 1 (lines [18][19][20]. Note that the allocations for the jobs in L tmp are determined by considering the jobs in an increasing order of submission time.…”

Section: A Deadline-based Backlling Algorithmmentioning

confidence: 99%

“…In this work we decided to rely on another recent and promising SimGridbased tool. Batsim 5 [16] is developed by the team that develops and maintains the OAR RJMS [1]. It decouples the simulation of the resources and the execution of a schedule from the decisions that led to this schedule.…”

Section: Simulation Environmentmentioning

confidence: 99%

Don’t Hurry Be Happy: A Deadline-Based Backfilling Approach

N'Takpé

Suter

2018

Job Scheduling Strategies for Parallel Processing

View full text Add to dashboard Cite

Abstract. Computing resources in data centers are usually managed by a Resource and Job Management System whose main objective is to complete submitted jobs as soon as possible while maximizing resource usage and ensuring fairness among users. However, some users might not be as hurried as the job scheduler but only interested in their jobs to complete before a given deadline. In this paper, we derive from this initial hypothesis a low-complexity scheduling algorithm, called Deadline-Based Backlling (DBF), that distinguishes regular jobs that have to complete as early as possible from deadline-driven jobs that come with a deadline before when they have to nish. We also investigate a scenario in which deadline-driven jobs are submitted and evaluate the impact of the proposed algorithm on classical performance metrics with regard to state-of-the-art scheduling algorithms. Experiments conducted on four dierent workloads show that the proposed algorithm signicantly reduces the average wait time and average stretch when compared to Conservative Backlling.

show abstract

Batsim: A Realistic Language-Independent Resources and Jobs Management Systems Simulator

Cited by 59 publications

References 21 publications

Exploring the Relation between Two Levels of Scheduling Using a Novel Simulation Approach

Exploring the Relation between Two Levels of Scheduling Using a Novel Simulation Approach

Alea – Complex Job Scheduling Simulator

Don’t Hurry Be Happy: A Deadline-Based Backfilling Approach

Contact Info

Product

Resources

About