Grid middleware services for virtual data discovery, composition, and integration

Abstract

We describe the services, architecture and application of the GriPhyN Virtual Data System, a suite of components and services that allow users to describe virtual data products in declarative terms, discover definitions and assemble workflows based on those definitions, and execute the resulting workflows on Grid resources. We show how these middleware-level services have been applied by specific communities to manage scientific data and workflows. In particular, we highlight and introduce Chiron, a portal facility that enables the interactive use of the virtual data system. Chiron has been used within the QuarkNet education project and as an online "educator" for virtual data applications. We also present applications from functional MRI-based neuroscience research.

A budget constrained scheduling of workflow applications on utility Grids using genetic algorithms

“…11b) is a complex combination of parallel and sequential execution. In our experiments, we used a neuro-science workflow [36] for our parallel application and a protein annotation workflow [4] developed by London e-Science Centre for our hybrid workflow structure application.…”

Economics of Grids, Clouds, Systems, and Services

“…A close inspection of the above factors influencing chargeback success reveals that their impact is realized in two separate ways. The examined forces either affect the effectiveness of the model [3,11,12,25,27], or the acceptability to the stakeholders [11,20,21,25,30]. These two aspects of chargeback success are used in the authors cited above to describe how accuracy, cost of costing, transparency and understandability, and controllability affect success.…”

Energy-Aware Mappings of Series-Parallel Workflows onto Chip Multiprocessors

“…In [41], Qin and Fahringer discuss several scientific grid workflow applications, which are all structured as SPGs: the WIEN2k workflow performs electronic structure calculations of solids using density functional theory [7], the MeteoAG workflow is a meteorology simulation application [43], and the GRASIL workflow calculates the spectral energy distribution of galaxies [44]; this latter application has actually a fork-join graph. A last example is the fMRI workflow [52], which is a cognitive neuroscience application.…”

“…Streaming applications, or workflows, are ubiquitous in many domains, as for instance DSP or image processing applications, astrophysics, meteorology, neuroscience, and so on [16,44,43,52]. Most of these applications have simple and regular task graphs, such as linear chains, trees, fork-join graphs, or general SPGs (see Section 3.1 for a formal definition of SPGs.)…”