Reliability-aware resource management for computational grid/cluster environments

Abstract

The collective resource utilization achieved through grid computing is critical to the overall computing capacity of the collaborative community and should be guaranteed. Especially, in an existing environment where job sites are Beowulf cluster systems, a service node failure may render the whole system outage. Current grid fault tolerance techniques only address these issues in an opportunistic fashion. Thus, there is a need for complementing these approaches by proactively handling failures at a job-site level, ensuring the system high availability with no loss of user submitted jobs. Our grid-aware cluster resource management effort was motivated by the fact that a cluster turns into a popular job site in the computational rid environment. We propose a solution dealing with fault tolerance at the service level complementing the task-based solutions as being done in some recent studies. We discuss various service availability issues related to the grid, and preliminary results obtained while implementing the smart failover and transparent job-queue replication mechanism and the automated grid installation package. Our report entails the benefits outweighing acceptable overhead after implementing our proof-of-concept framework.

Fault tolerant and prioritized scheduling in OGSA‐based mobile Grids

“…SOAP request with small number of parameters or data), and not tasks that would involve time-intensive replication (such as duplication of large data sets) and whose handling would influence the overall performance of the proposed scheme. Other research works that are based on the same approach of a negligible replication overhead are presented in [27][28][29].…”

“…SOAP request with small number of parameters or data), and not tasks that would involve time-intensive replication (such as duplication of large data sets) and whose handling would influence the overall performance of the proposed scheme. Other research works that are based on the same approach of a negligible replication overhead are presented in [27][28][29]. Furthermore, by producing task replicas, the failure probability of each task can be significantly lowered; however, the number of tasks that are finally assigned to the mobile Grid increases, increasing, respectively, the total workload that is assigned to the Grid for execution.…”

Representativeness models of systems: smart grid example

“…Single points of failure can be avoided through implementation of redundancy, such as the backup generator in Fig. 1 [26]. • State control: Each smart grid operator object (e.g., voltage stabilizer in Fig.…”

Improving reliability of a heterogeneous grid-based intrusion detection platform using levels of redundancies

“…Clusters [9][10][11] are deployed to improve reliability and availability in safety-critical systems, such as Google Linux Cluster. A cluster system consists of a group of independent computers running an independent operating system and working together as a single system to provide a powerful computing environment and high availability of services, particularly for computation intensive tasks.…”