Improving Fault Tolerance in Desktop Grids Based On Incremental Checkpointing

Abstract

Fault tolerance is an important issue to guarantee reliable execution of tasks in computational desktop grid environment where execution failures are frequently expected. Periodic checkpointing of running tasks is one of the common strategies for achieving acceptable fault tolerance. A problem usually arises, that is, temporary stored data in a checkpoint file for some long running tasks might be too large in size to be reliably transmitted between nodes without consuming network bandwidth. Data loss may also occur when transmitting such large amount of data in a non-reliable communication environment (e.g. Desktop Grid). In this paper, a modified application level incremental checkpointing approach is proposed in which the size of transmitted checkpoint data can be reduced to about 3% of its original size with little overhead on computation time. The proposed approach also investigates a new mechanism for safely storing a checkpoint file with reliance on the availability of the submitting node only. A simulator have been built using the .Net Framework 1.1 to test the validity of the proposed approach using an application code built on variable dimensions' matrix multiplication. Experimental results show that the proposed approach improved fault tolerance with minimizing computational overhead.

Application checkpointing in grid environment with improved checkpoint reliability through replication

“…Checkpointing overhead is measured in terms of time and resources consumed for generating checkpoint and then transferring it to another node or central node for storage [9]. So this overhead is related to the checkpoint frequency and checkpoint size.…”

Peer-to-Peer Desktop Grids Based on an Adaptive Decentralized Scheduling Mechanism

“…Users submit tasks that should be efficiently processed using resources available on the Grid (Nabrzyski, Schopf, & Weglarz, 2003). A Desktop Grid is usually built on the Internet platform in which resources are unreliable and frequently turned off or disconnected (El-Desoky, Hisham, & Abdulrahman, 2006). The idea of desktop grid is to harvest the idle time of Internet connected computers, to run very large and distributed applications (Fedak, Germain, Vincent, & Franck, 2001).…”