On the Scheduling of Checkpoints in Desktop Grids

Bouguerra, Mohamed Slim; Kondo, Derrick; Trystram, Denis

doi:10.1109/ccgrid.2011.63

Cited by 24 publications

(13 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The work in [26] simulates bag-of-task applications to study their scalability. In [27], the authors use simulation to study the checkpointing of sequential applications to improve fault-tolerance.…”

Section: Related Workmentioning

confidence: 99%

Simulating Application Workflows and Services Deployed on the European Grid Infrastructure

Camarasu-Pop

Glatard²,

Benoit-Cattin³

2013

2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

View full text Add to dashboard Cite

International audienceThis paper presents an end-to-end SimGrid-based simulation of a Monte-Carlo computation deployed on the European Grid Infrastructure. We describe a simulation framework allowing to replay executions from real traces. Middleware services, namely the file catalog, storage elements, the DIRAC pilot-job system, and the MOTEUR workflow engine are simulated by SimGrid processes. The deployment of pilot jobs, performed on EGI by the gLite WMS and batch queues, is simulated by a random selection of platform hosts, and a matching of their latencies and failure times with real traces. The Monte-Carlo application workflow is calibrated to address performance discrepancies between the real and simulated network and CPUs. The simulation is evaluated against real executions of the GATE Monte-Carlo application. Results show that SimGrid can be used to study the performance of applications running on EGI. Simulated and real make spans are consistent, and conclusions drawn in production about the influence of application parameters such as the check pointing frequency and the number of mergers are also made in simulation. This opens the door to better and faster experimentation on production grids

show abstract

Section: Related Workmentioning

confidence: 99%

Simulating Application Workflows and Services Deployed on the European Grid Infrastructure

Camarasu-Pop

Glatard²,

Benoit-Cattin³

2013

2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

View full text Add to dashboard Cite

show abstract

“…The application of checkpointing in High-Throughput Computing environments and Fine-Grained Cycle Sharing (FGCS) systems is explored extensively in [34,7], though without consideration for its implications for energy consumption.…”

Section: Checkpointing In Htc Systemsmentioning

confidence: 99%

Energy-efficient Checkpointing in High-throughput Cycle-stealing Distributed Systems

Forshaw

McGough

Thomas

2015

Electronic Notes in Theoretical Computer Science

View full text Add to dashboard Cite

(2015) 'Energy-ecient checkpointing in high-throughput cycle-stealing distributed systems.', Electronic notes in theoretical computer science., 310. pp. 65-90. Further information on publisher's website: http://dx. The full-text may be used and/or reproduced, and given to third parties in any format or medium, without prior permission or charge, for personal research or study, educational, or not-for-prot purposes provided that: • a full bibliographic reference is made to the original source • a link is made to the metadata record in DRO • the full-text is not changed in any way The full-text must not be sold in any format or medium without the formal permission of the copyright holders. Please consult the full DRO policy for further details. Abstract Checkpointing is a fault-tolerance mechanism commonly used in High Throughput Computing (HTC) environments to allow the execution of long-running computational tasks on compute resources subject to hardware or software failures as well as interruptions from resource owners and more important tasks. Until recently many researchers have focused on the performance gains achieved through checkpointing, but now with growing scrutiny of the energy consumption of IT infrastructures it is increasingly important to understand the energy impact of checkpointing within an HTC environment. In this paper we demonstrate through trace-driven simulation of real-world datasets that existing checkpointing strategies are inadequate at maintaining an acceptable level of energy consumption whilst maintaing the performance gains expected with checkpointing. Furthermore, we identify factors important in deciding whether to exploit checkpointing within an HTC environment, and propose novel strategies to curtail the energy consumption of checkpointing approaches whist maintaining the performance benefits.

show abstract

“…Both Bouguerra et al [4] and Forshaw et al [6] propose strategies for when to take checkpoints within HTC systems. We see this as an appropriate solution given that a user cannot be re-routed to a different computer.…”

Section: Related Workmentioning

confidence: 99%

Flipping the priority: effects of prioritising HTC jobs on energy consumption in a multi-use cluster

Forshaw¹,

McGough²

2015

Proceedings of the Eighth EAI International Conference on Simulation Tools and Techniques

View full text Add to dashboard Cite

Further information on publisher's website:http://dx.doi.org/10.4108/eai. 24-8-2015.2261101 Publisher's copyright statement:Additional information: Use policyThe full-text may be used and/or reproduced, and given to third parties in any format or medium, without prior permission or charge, for personal research or study, educational, or not-for-prot purposes provided that:• a full bibliographic reference is made to the original source • a link is made to the metadata record in DRO • the full-text is not changed in any way The full-text must not be sold in any format or medium without the formal permission of the copyright holders.Please consult the full DRO policy for further details. ABSTRACTHigh Throughput Computing (HTC) through the use of volunteer computing provides a compelling opportunity to perform large volumes of computation without the need to invest in computational resources. This relies on the good will of computer owners who volunteer their computer idle time. In scenarios when there is contention the HTC system will relinquish the computer -normally achieved through termination or suspension. This often leads to longer turn-around times for the HTC jobs and an increase in energy consumption when the work is restarted elsewhere. However, within large organisations this clear distinction of who is the owner of a computer and who should take priority is not always clear. If a user enters a large cluster room (of identical computers) should they be allowed to use a computer which is servicing HTC jobs when other computers are idle? Should HTC jobs be able to delay the rebooting of computers thus allowing the jobs to complete? In this work we relax some of the common policies used in management of computers in large organisations in order to evaluate if alternative policies which may have impact on the primary users of the computers could save enough energy to make this impact tolerable. We evaluate our approach through the use of the HTC-Sim simulation framework. We demonstrate a potential energy saving of 12.4%, along with overhead reductions of 20-74%, and up to 48% reduction in job terminations by re-directing only 13% of users away from computers servicing HTC jobs.

show abstract

On the Scheduling of Checkpoints in Desktop Grids

Cited by 24 publications

References 12 publications

Simulating Application Workflows and Services Deployed on the European Grid Infrastructure

Simulating Application Workflows and Services Deployed on the European Grid Infrastructure

Energy-efficient Checkpointing in High-throughput Cycle-stealing Distributed Systems

Flipping the priority: effects of prioritising HTC jobs on energy consumption in a multi-use cluster

Contact Info

Product

Resources

About