From Sandbox to Playground: Dynamic Virtual Environments in the Grid

Abstract

Much experience has been gained with the protocols and mechanisms needed for discovery and allocation of remote computational resources. However, the preparation of a remote computer for use by a distributed application also requires the creation of an appropriate execution environment, which remains an ad hoc and often clumsy process. We propose here a codification of the interactions required to negotiate the creation of new execution environments. In brief, we model dynamic virtual environments (DVEs) as first-class entities in a distributed environment, with Grid service interfaces defined to negotiate creation, monitor properties, and manage lifetime. We also show how such DVEs can be implemented in a variety of technologiessandboxes, virtual machines, or simply Unix accounts-and evaluate costs associated with these different approaches. DVEs provide a basis for both customization of a remote computer to meet user needs and also enforcement of resource usage and security policies. They can also simplify the administration of virtual organizations (VOs), by allowing new environments to be created automatically, subject to local and VO policy. Thus, DVEs have the potential to relieve much of the current administrative burden involved in providing and using Grid resources.

On the Use of Cloud Computing for Scientific Workflows

“…Further, guaranteeing a desired resource allocation to a Grid user is difficult today as most of the available tools support only unstructured sharing which further limits the impact of Grid computing on science. Using virtualization in conjunction with Grid computing, known as "cloud computing" or Infrastructure-as-a-Service (IaaS), has been recognized as a potential solution to these problems [8,9]. This paper looks at the differences between running scientific workflows on the cloud and running them on the Grid, using the Montage [10] application and Pegasus-WMS, a scientific workflow software [11,12].…”

Distributed application configuration, management, and visualization with plush

“…In addition to Shirako [Irwin et al 2006] and Usher [McNett et al 2007], which are described in Section 4, other similar projects related to virtual machine creation and management include Sandpiper [Wood et al 2007], In-VIGO [Adabala et al 2005], VMPlants [Krsul et al 2004], The Collective [Chandra et al 2005], Virtual Workspaces [Keahey et al 2004], and Virtuoso [Shoykhet et al 2004].…”

A tool for environment deployment in clusters and light grids

“…On the other hand, alternative design approaches for large scale configuration based on virtualization and similar techniques are proposed by technologies like VMPlants [19], XenoServer [18], Dynamic Virtual Environments [17] and Condor GliedIn mechanism [15].…”