An End-to-end Workflow Pipeline for Large-scale Grid Computing

McGough, Andrew Stephen; Cohen, Joel A.; Darlington, John; Katsiri, Eleftheria; Lee, William; Panagiotidi, Sofia; Patel, Yash

doi:10.1007/s10723-005-9014-4

Cited by 11 publications

(17 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We are now investigating techniques to manipulate the workflows that are submitted in order to better meet the QoS requirements of the system. We are looking into the techniques proposed in [3]. We are also developing the agreement and reservation capabilities.…”

Section: Discussionmentioning

confidence: 99%

Adding Instruments and Workflow Support to Existing Grid Architectures

Colling

Dickens

Ferrari³

et al. 2006

Computational Science – ICCS 2006

View full text Add to dashboard Cite

Abstract. Many Grid architectures have been developed in recent years. These range from the large community Grids such as LHG and EGEE to single site deployments such as Condor. However, these Grid architectures have tended to focus on the single or batch submission of executable jobs. Application scientists are now seeking to manage and use physical instrumentation on the Grid, integrating these with the computational tasks they already perform. This will require the functionality of current Grid systems to be extended to allow the submission of entire workflows. Thus allowing the scientists to perform increasingly larger parts of their experiments within the Grid environment. We propose here a set of high level services which may be used on-top of these existing Grid architectures such that the benefits of these architectures may be exploited along with the new functionality of workflows.

show abstract

Section: Discussionmentioning

confidence: 99%

Adding Instruments and Workflow Support to Existing Grid Architectures

Colling

Dickens

Ferrari³

et al. 2006

Computational Science – ICCS 2006

View full text Add to dashboard Cite

show abstract

“…Minimum execution time and minimum execution cost are two constraints of user requirements, which are implemented within ICENI. In [25], a service based, end-to-end workflow processing in a Grid environment with heterogeneous resources is presented. The PerCo performance control framework migrates distributed scientific coupled models in response to changes in an execution environment [19].…”

Section: Related Workmentioning

confidence: 99%

An Adaptive Execution Scheme for Achieving Guaranteed Performance in Computational Grids

et al. 2009

View full text Add to dashboard Cite

Nature of the resource pool in a Grid environment is heterogeneous and dynamic. Availability, load and status of the resources may change at the time of execution of an application. Therefore, in order to maintain the performance guarantee (as has been agreed upon through service level agreements (SLAs) between the client and the resource providers), an application may need to adapt to its run-time environment on the basis of resource availability and application demands. Often it may be required to migrate the application components to a new set of resources during their execution so that performance guar- A. antee can be maintained. Objective of this paper is to present an adaptive execution scheme for achieving guaranteed performance on the basis of the SLAs. The scheme has been implemented based on the notion of performance properties and by deploying a set of autonomous agents within an integrated performance-based resource management framework.

show abstract

“…In previous work [14,15] we have proposed an entire Grid workflow architecture in which elements of the architecture can be selected in anà-la-carte fashion. We illustrate here a combination of these elements which can be combined to provide a system capable of efficiently executing legacy applications on the Grid.…”

Section: Architecturementioning

confidence: 99%

“…In previous work [14,[27][28][29] we have proposed an architecture for a brokering (scheduling) system for the Grid. We leverage this work for this paper.…”

Section: Grid Brokering Servicementioning

confidence: 99%