A Grid simulation framework to study advance scheduling strategies for complex workflow applications

Hirales-Carbajal, Adán; Tchernykh, Andrei; Röblitz, Thomas; Yahyapour, Ramin

doi:10.1109/ipdpsw.2010.5470918

Cited by 25 publications

(15 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…They observe that many of these simulators do not capture the details of underlying infrastructures and/or use naive simulation models. This is the case with custom simulators such as that in [36], [37], [40]. But it is also the case with workflow simulators built on top of generic simulation frameworks that provide convenient userlevel abstractions but fail to model the details of the underlying infrastructure, e.g., the simulators in [11], [35], [38], which build on the CloudSim [25] or GroudSim [24] frameworks.…”

Section: Related Workmentioning

confidence: 99%

WRENCH: A Framework for Simulating Workflow Management Systems

Casanova

Pandey

Oeth

et al. 2018

2018 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS)

View full text Add to dashboard Cite

Scientific workflows are used routinely in numerous scientific domains, and Workflow Management Systems (WMSs) have been developed to orchestrate and optimize workflow executions on distributed platforms. WMSs are complex software systems that interact with complex software infrastructures. Most WMS research and development activities rely on empirical experiments conducted with full-fledged software stacks on actual hardware platforms. Such experiments, however, are limited to hardware and software infrastructures at hand and can be labor-and/or time-intensive. As a result, relying solely on realworld experiments impedes WMS research and development. An alternative is to conduct experiments in simulation. In this work we present WRENCH, a WMS simulation framework, whose objectives are (i) accurate and scalable simulations; and (ii) easy simulation software development. WRENCH achieves its first objective by building on the SimGrid framework. While SimGrid is recognized for the accuracy and scalability of its simulation models, it only provides low-level simulation abstractions and thus large software development efforts are required when implementing simulators of complex systems. WRENCH thus achieves its second objective by providing highlevel and directly re-usable simulation abstractions on top of SimGrid. After describing and giving rationales for WRENCH's software architecture and APIs, we present a case study in which we apply WRENCH to simulate the Pegasus production WMS. We report on ease of implementation, simulation accuracy, and simulation scalability so as to determine to which extent WRENCH achieves its two above objectives. We also draw both qualitative and quantitative comparisons with a previously proposed workflow simulator.

show abstract

Section: Related Workmentioning

confidence: 99%

WRENCH: A Framework for Simulating Workflow Management Systems

Casanova

Pandey

Oeth

et al. 2018

2018 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS)

View full text Add to dashboard Cite

show abstract

“…Merdan et al [39] and Hirales-Carbajal et al [40] developed simulation environments specifically for comparing different approaches to workflow scheduling on computational grids. They also provide examples of possible experimental setups, yet omit the execution of these experiments.…”

Section: Related Workmentioning

confidence: 99%

DynamicCloudSim: Simulating heterogeneity in computational clouds

Bux

Leser

2015

Future Generation Computer Systems

View full text Add to dashboard Cite

Simulation has become a commonly employed first step in evaluating novel approaches towards resource allocation and task scheduling on distributed architectures. However, existing simulators fall short in their modeling of the instability common to shared computational infrastructure, such as public clouds. In this work, we present DynamicCloudSim which extends the popular simulation toolkit CloudSim with several factors of instability, including inhomogeneity and dynamic changes of performance at runtime as well as failures during task execution. As a use case and validation of the introduced functionality, we simulate the impact of instability on scientific workflow scheduling by assessing and comparing the performance of four schedulers in the course of several experiments. Results indicate that our model seems to adequately capture the most important aspects of cloud performance instability, though a validation on real hardware is still pending. The source code of DynamicCloudSim and the examined schedulers is available at https://code.google.com/p/dynamiccloudsim/.

show abstract

“…We have extended Teikoku to include Grid workflow job scheduling capabilities. Design details of the simulator are described in [32]. Two workloads types are used in experiments for comprehensive analysis: workload A (306 workflows) and workload B (508 workflows).…”

Section: Methodsmentioning

confidence: 99%

Multiple Workflow Scheduling Strategies with User Run Time Estimates on a Grid

et al. 2012

Self Cite

View full text Add to dashboard Cite

In this paper, we present an experimental study of deterministic non-preemptive multiple workflow scheduling strategies on a Grid. We distinguish twenty five strategies depending on the type and amount of information they require. We analyze scheduling strategies that consist of two and four stages: labeling, adaptive allocation, prioritization, and parallel machine scheduling. We apply these strategies in the context of executing the Cybershake, Epigenomics, Genome, Inspiral, LIGO, Montage, and SIPHT workflows applications. In order to provide performance comparison, we performed a joint analysis considering three metrics. A case study is given and corresponding results indicate that well known DAG scheduling algorithms designed for single DAG and single machine settings are not well suited for Grid scheduling scenarios, where user run time estimates are available. We show that the proposed new strategies outperform other strategies in terms of approximation factor, mean critical path waiting time, and critical path slowdown. The robustness of these strategies is also discussed.

show abstract

A Grid simulation framework to study advance scheduling strategies for complex workflow applications

Cited by 25 publications

References 17 publications

WRENCH: A Framework for Simulating Workflow Management Systems

WRENCH: A Framework for Simulating Workflow Management Systems

DynamicCloudSim: Simulating heterogeneity in computational clouds

Multiple Workflow Scheduling Strategies with User Run Time Estimates on a Grid

Contact Info

Product

Resources

About