Hypermedia Workflow: A New Approach to Data-Driven Scientific Workflows

Abstract

This paper presents a new approach to scientific workflows based on the hypermedia design paradigm, the core of the REST architectural style. A Web resource model for workflow elements: tasks and data, is proposed. A workflow execution protocol based on the hypermedia-as-the-engine-ofapplication-state principle is also introduced. We compare the hypermedia model with one based on a workflow execution engine. Benefits and implications of the hypermedia approach for other important aspects of the workflow lifecycle, including provenance and mapping of tasks to resources, are also discussed. As a proof-of-concept of the hypermedia workflow concept, we implemented a simulator for execution of synthetic workflows based on the Pegasus workflow generator.

Workflow management for edge driven manufacturing systems

“…REST and hypermedia has been proposed for work flow automation. For example in [9], Balis proposes a hypermedia driven workflow for data-driven scientific experiments. In this context a data driven workflow is implemented using an Hypermedia As The Engine Of Application State (HATEOAS) approach.…”

Scheduling Multilevel Deadline-Constrained Scientific Workflows on Clouds Based on Cost Optimization

“…The synthetic workflows were generated using code developed in [30], with task runtimes based on distributions gathered from running real workflows. The experimental data come from execution of Montage workflow on Amazon EC2 using the HyperFlow workflow management system [31].…”

“…Montage workflow tasks are single threaded and therefore in our experiment the number of execution threads running in parallel was equal to the number of virtual cores. We used the HyperFlow workflow engine [31] to drive workflow execution. In the experiment, we used EBS (elastic block storage) volume for data storage instead of S3 (simple storage service); however we measured the transfer times to and from S3 separately.…”