Inter-Operating Grids Through Delegated MatchMaking

Abstract

Abstract. The grid vision of a single computing utility has yet to materialize: while many grids with thousands of processors each exist, most work in isolation. An important obstacle for the effective and efficient inter-operation of grids is the problem of resource selection. In this paper we propose a solution to this problem that combines the hierarchical and decentralized approaches for interconnecting grids. In our solution, a hierarchy of grid sites is augmented with peer-to-peer connections between sites under the same administrative control. To operate this architecture, we employ the key concept of delegated matchmaking, which temporarily binds resources from remote sites to the local environment. With trace-based simulations we evaluate our solution under various infrastructural and load conditions, and we show that it outperforms other approaches to inter-operating grids. Specifically, we show that delegated matchmaking achieves up to 60% more goodput and completes 26% more jobs than its best alternative.

The Grid Workloads Archive

“…In another work, we have investigated the existence of batches of jobs in grids, and found that in several real grids batches are responsible for 85%-95% of the jobs, and for 30%-96% of the total consumed CPU [30]. The imbalance of job arrivals in multi-cluster grids has been assessed using traces from the GWA in another study [31].…”

“…The contents of the GWA have also been used to evaluate the performance of various scheduling policies, both in real [5] and simulated [35,31]environments. Finally, the tools in the GWA have been used to provide an analysis back-end to a grid simulation environment [31].…”

Infrastructure Federation Through Virtualized Delegation of Resources and Services

“…Iosup et al have introduced the concept of delegated matchmaking, where resources from remote Condor pools can be bound temporarily to the local environment [22]. The solution augments a hierarchy of Grid sites with peer-to-peer connections between sites on the same hierarchy level.…”

A cost-benefit analysis of using cloud computing to extend the capacity of clusters

“…Iosup et al [18] proposed a matchmaking mechanism for enabling resource sharing across computational Grids. Wang and Morris [37] investigated different strategies for load sharing across computers in a local area network.…”