CGSP: An Extensible and Reconfigurable Grid Framework

Wu, Yongwei; Wu, Song; Yu, Huashan; Hu, Chunming

doi:10.1007/11573937_32

Cited by 32 publications

(16 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Experiments have been carried out on a real Bioinformatics Grid (BioGrid) constructed with the middleware ChinaGrid Support Platform (CGSP) [21]. BioGrid has 7 nodes distributed in 6 distant cities of China (Beijing, Shanghai, Wuhan, Ji'nan, Lanzhou, Xi'an), and each of them has a cluster with processor number differing from 64 to 256.…”

Section: Methodsmentioning

confidence: 99%

An adaptive task-level fault-tolerant approach to Grid

Yuan

Yang

et al. 2009

J Supercomput

Self Cite

View full text Add to dashboard Cite

A strong failure recovery mechanism handling diverse failures in heterogeneous and dynamic Grid is so important to ensure the complete execution of longrunning applications. Although there have been various efforts made to address this issue, existing solutions either focus on employing only one single fault-tolerant technique without considering the diversity of failures, or propose some frameworks which cannot deal with various kinds of failures adaptively in Grid. In this paper, an adaptive task-level, fault-tolerant approach to Grid is proposed. This approach aims at handling quite a complete set of failures arising in Grid environment by integrating basic fault-tolerant approaches. Moreover, this paper puts forward that resource consumption (not received enough attention) is also an important evaluation metric for any fault-tolerant approach. The corresponding evaluation models based on mean execution time and resource consumption are constructed to evaluate any faulttolerant approach. Based on the models, we also demonstrate the effectiveness of our approach and illustrate the performance gains achieved via simulations. The experiments based on a real Grid have been made and the results show that our approach can achieve better performance and consume less resource.

show abstract

Section: Methodsmentioning

confidence: 99%

An adaptive task-level fault-tolerant approach to Grid

Yuan

Yang

et al. 2009

J Supercomput

Self Cite

View full text Add to dashboard Cite

show abstract

“…Furthermore, these Grid entities are independent and autonomous in their internal working, having their own scheduling, and security infrastructure. Absence of centralized control and management is the key feature of our framework as compared to [6,7]. Being totally distributed and reconfigurable, it provides the required features of dynamic joining and resigning of Grid systems and scalability.…”

Section: System Overviewmentioning

confidence: 97%

“…Additionally, the Grid Interoperability Now-Community Group (GIN-CG) [4] has been working on providing interoperability between Grids by developing components and adapters that enable secure job submission, data transfers, and information queries. Besides that, federated collaboration for resource sharing among distributed clusters has been also proposed [5][6][7].…”

Section: Introductionmentioning

confidence: 99%

A probabilistic and adaptive scheduling algorithm using system-generated predictions for inter-grid resource sharing

Rao

Huh

2008

J Supercomput

View full text Add to dashboard Cite

Rapid advancement and more readily availability of Grid technologies have encouraged many businesses and researchers to establish Virtual Organizations (VO) and make use of their available desktop resources to solve computing intensive problems. These VOs, however, work as disjointed and independent communities with no resource sharing between them. We, in previous work, have proposed a fully decentralized and reconfigurable Inter-Grid framework for resource sharing among such distributed and autonomous Grid systems (Rao et al. in ICCSA, 2006). The specific problem that underlies in such a collaborating Grids system is scheduling of resources as there is very little knowledge about availability of the resources due to the distributed and autonomous nature of the underlying Grid entities. In this paper, we propose a probabilistic and adaptive scheduling algorithm using systemgenerated predictions for Inter-Grid resource sharing keeping collaborating Grid systems autonomous and independent. We first use system-generated job runtime estimates without actually submitting jobs to the target Grid system. Then this job execution estimate is used to predict the job scheduling feasibility on the target system. Furthermore, our proposed algorithm adapted itself to the actual resource behavior and performance. Simulation results are presented to discuss the correctness and accuracy of our proposed algorithm.

show abstract

“…Most existing Grids (e.g., OSG [18], TeraGrid [19], and ChinaGrid [20,22]) rely on clusters to perform actual computations; a Grid system integrates its clusters into its infrastructure and makes the infrastructure available for users, in which case, a resource management mechanism is usually required. In this section, we describe three different models/mechanisms for resource (cluster) management, one of which is our TopCluster, and the other two (PCluster and VCluster) are also introduced for comparison purpose.…”

Section: Architecture Of Topclustermentioning

confidence: 99%

TopCluster: A hybrid cluster model to support dynamic deployment in Grid

Chen

et al. 2013

Journal of Computer and System Sciences

Self Cite

View full text Add to dashboard Cite

Cluster virtualization is a promising approach to construct customized execution environments for Grid users. However, Virtual-Machine Cluster (VCluster) comes with the cost of the overhead caused by virtual machines, which therefore degrades system performance. In this paper, we propose a novel hybrid cluster model, namely TopCluster. By exploiting a Hybrid Batch System (HyBS) mechanism, TopCluster can flexibly allocate both physical or virtualized resources via a unified front-end. To reduce the overhead caused by the dynamic deployment of virtual machines and applications, we also propose a valuebased deployment strategy along with TopCluster. An XML-based Application Deployment Description Language (ADDL) is also newly proposed to describe properties, installation procedure, and configuration operations of applications. A prototype system has been implemented and a series of experiments was conducted to evaluate TopCluster by replaying a real world trace. Results show that TopCluster can averagely generate 24.6% and 46.8% higher system throughput, 26.3% and 110.6% higher resource utility, and 35.1% and 56.1% lower waiting time of jobs than two commonly applied cluster models in Grid: Traditional Physical Cluster (PCluster) and VCluster.

show abstract

CGSP: An Extensible and Reconfigurable Grid Framework

Cited by 32 publications

References 7 publications

An adaptive task-level fault-tolerant approach to Grid

An adaptive task-level fault-tolerant approach to Grid

A probabilistic and adaptive scheduling algorithm using system-generated predictions for inter-grid resource sharing

TopCluster: A hybrid cluster model to support dynamic deployment in Grid

Contact Info

Product

Resources

About