A Workflow-based Computational Resource Broker with Information Monitoring in Grids

In this paper, we propose a resource broker, which providing a friendly interface for accessing available and appropriate resources via user credentials, is developed on a platform constructed by employing the Globus toolkit. This broker not only deploys a domainbased network information model and its dynamic version to measure network status by invoking Network Weather Service (NWS) on grid computing environments, but also uses the Ganglia and NWS tools to monitor resource status and network-related information. Based on the actual value of network bandwidth and preserving the advantages of our previous model, a network bandwidth-award job scheduling algorithm for grid resource brokerage is then developed for communication-intensive job execution. Furthermore, the network information and resource status collected are all up-to-date so that the resource broker can effectively match appropriate grid resources and users' requests to improve execution.

show abstract

“…At last, we give a performance value to each type of CPU and memory size in our environment based on results of those performance tests. [16] (3)…”

Section: Our Scheduling Systemmentioning

confidence: 99%

A Network Bandwidth-Aware Job Scheduling with Dynamic Information Model for Grid Resource Brokers

Yang

Leu

2008

2008 IEEE Asia-Pacific Services Computing Conference

Self Cite

View full text Add to dashboard Cite

show abstract

“…The MSRA_1, an evolved version of the MSRA presented in [9,43], is used in this study. The difference between them is that the MSRA can allocate at most two sites to a job since we considered the jobs that during their execution need heavy inter-component communication, particularly through WANs, and the MSRA_1 can allocate q sites to a job, q 1.…”

Section: Msra Strategymentioning

confidence: 99%

“…In [9], we introduced a workflow-based resource broker that handles workflows and allocates resources to jobs 1. JavaCoG (Commodity of Grid) Kit [28] integrates Java technology with Grid Computing to develop advanced Grid services that increase accessibility to basic Globus resources, and provides a framework which enables users to access Grid services provided by the Java higher level framework.…”

Section: Introductionmentioning

confidence: 99%

Resource brokering using a multi‐site resource allocation strategy for computational grids

Yang

Leu

Chen

2010

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

SUMMARYGrid computing employs heterogeneous resources which may be installed on different platforms, hardware/software, computer architectures, and perhaps using different computer languages to solve large-scale computational problems. As many more Grids are being developed worldwide, the number of multi-institutional collaborations is growing rapidly. However, to realize Grid computing's full potential, it is expected that Grid participants must be able to share one another's resources. This paper presents a resource broker that employs the multi-site resource allocation (MSRA) strategy and the dynamic domain-based network information model that we propose to allocate Grid resources to submitted jobs, where the Grid resources may be dispersed at different sites, and owned and governed by different organizations or institutes. The jobs and resources may also belong to different clusters/sites. Resource statuses collected by the Ganglia, and network bandwidths gathered by the Network Weather Service, are both considered in the proposed scheduling approach. A dynamic domain-based model for network information measurement is also proposed to choose the most appropriate resources that meet the jobs' execution requirements. Experimental results show that MSRA outperformed the other tested strategies.

show abstract

“…After evaluating, we conduct an HPL performance test on one of the sites under consideration and switch network bandwidth from gigabit to 10/100 Mb to determine the effect of network speed on system performance. There are two α NE weights, one for gigabit, which is α NE (giga) = Cov(gigabit, HPL) Cov(gigabit, HPL) + Cov (10/100, HPL) , [31] …”

Section: Performance Evaluation Mechanismmentioning

confidence: 99%

Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers

2008

Self Cite

View full text Add to dashboard Cite

A resource broker with a user-friendly interface for job submission developed on a platform constructed using the Globus toolkit is proposed. The broker employs a domain-based network information model and dynamic version to measure network statuses, and also monitors and collects resource statuses and networkrelated information as the basis of its brokerage. A network bandwidth-aware job scheduling algorithm for brokering suitable Grid resources to communicationintensive jobs based on improving and preserving the advantages of our previously developed network information model is also proposed. Using timely information, the resource broker effectively matches Grid resources and user requests, thus improving job execution efficiency.

show abstract

A Workflow-based Computational Resource Broker with Information Monitoring in Grids

Cited by 19 publications

References 11 publications

A Network Bandwidth-Aware Job Scheduling with Dynamic Information Model for Grid Resource Brokers

A Network Bandwidth-Aware Job Scheduling with Dynamic Information Model for Grid Resource Brokers

Resource brokering using a multi‐site resource allocation strategy for computational grids

Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers

Contact Info

Product

Resources

About