Enabling scientific workflow sharing through coarse-grained interoperability

Terstyánszky, Gábor; Kukla, Tamas; Kiss, Tamás; Kacsuk, Péter; Balaskó, Ákos; Farkas, Zoltán

doi:10.1016/j.future.2014.02.016

Cited by 50 publications

(51 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It was already described in [22] how the workflows taken from the SHIWA Repository are managed and executed as embedded nodes in WS-PGRADE workflows within the SHIWA Simulation Platform (SSP). Here we focus on how to create the required infrastructure in the cloud before the embedded workflow node is actually invoked by the WS-PGRADE workflow enactor.…”

Section: Workflowsmentioning

confidence: 99%

“…This is a fine grained solution and the "white box" approach in this paper corresponds to this option. Graph based approaches try to embed graphs into one another [22][17] representing a coarse grained concept and corresponds to the black box approach presented in the paper. The work presented in this paper is aimed at supporting the latter, graph based (black box) type of interoperability solved by dynamic resource orchestration.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Infrastructure Aware Scientific Workflows and Infrastructure Aware Workflow Managers in Science Gateways

et al. 2016

Self Cite

View full text Add to dashboard Cite

Abstract-The workflow interoperability problem was successfully solved by the SHIWA project if the workflows to be integrated were running in the same grid infrastructure. However, in the more generic case when the workflows were running in different infrastructures the problem has not been solved yet. In the current paper we show a solution for this problem by introducing a new type of workflow called infrastructure-aware workflow. These are scientific workflows extended with new node types that enable the on-the-fly creation and destruction of the required infrastructures in the clouds. The paper shows the semantics of these new types of nodes and workflows and also how they can solve the workflow interoperability problem. The paper also describes how these new type of workflows can be implemented by a new service called Occopus, and how this service can be integrated with the existing SHIWA Simulation Platform services like the WS-PGRADE/gUSE portal to provide the required functionalities of solving the workflow interoperability problem.

show abstract

Section: Workflowsmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Infrastructure Aware Scientific Workflows and Infrastructure Aware Workflow Managers in Science Gateways

et al. 2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…The coarse-grained strategy treats each workflow engine as distributed black boxes, where data being sent to preexisting enactment engines and results are returned. One workflow system is able to invoke another workflow engine through the use of the SHIWA interface, and the Shiwa Portal facilitates the publishing and sharing of reusable workflows [7]. The fine-grained approach [8] deals with language interoperability by defining and Interoperable Workflow Intermediate Representation (IWIR) [9] language for translating workflows (ASKALON, P-Grade, MOTEUR and Triana) from one DCI to another, thus creating a cross-compiler for workflows.…”

Section: Introductionmentioning

confidence: 99%

A novel approach to user-steering in scientific workflows

Kail

Kacsuk

Kozlovszky

2015

2015 IEEE 10th Jubilee International Symposium on Applied Computational Intelligence and Informatics

Self Cite

View full text Add to dashboard Cite

Abstract-From the scientist's perspective the workflow execution is like black boxes [25]. The scientist submits the workflow and at the end, the result or a notification about failed completion is returned. Concerning long running experiments or when workflows are in experimental phase it may not be acceptable. Scientist may need to fine-tune and monitor their experiments. To support the scientist with special user interaction tool we introduced intervention points (iPoints) where the user takes over the control for a while and has the possibility to interfere, namely to change some parameters or data, or to stop, to restart the workflow or even to deviate from the original workflow model during enactment. We plan to implement our solution in IWIR [9] language which was targeted to provide interoperability between four existing well-known SWfMS within the framework of the SHIWA project [1].

show abstract

“…One way to achieve coarse-grain interoperability is presented in (Terstyanszky et al 2014). "Non-native" workflows are wrapped and integrated into a node of the "native" workflows.…”

Section: Workflow Interoperabilitymentioning

confidence: 99%

Interacting with scientific workflows

Nguyen¹

View full text Add to dashboard Cite

Scientific workflow technology has become a de facto standard in e-Science. It provides a powerful unifying platform that allows scientists to build arbitrarily complicated applications by combining predefined components. With a wide range of components, with the functions ranging from acquiring data inputs from sensors, querying databases, performing data-mining, performing execution, through to visualising the results, this paradigm allows scientists to automate, manage and execute various steps in scientific research. Although powerful, scientific workflow systems still require some programming knowledge, which might not be optimal for many scientists.Recently, scientific workflows have been integrated into the Web, creating workflow-based science gateways. These gateways allow scientists to launch large-scale computational experiments without concern for the underlying complexity of the infrastructure. This approach delivers scientific workflows to more scientists and is becoming increasingly popular.To date, much workflow-based science gateway development effort has been invested in creating user-friendly and secure interfaces to setup parameters, execute workflows and collect results.However, interaction between users and executing workflows has not received a lot of attention.Scientific workflows have typically been executed in batch mode. This model does not work with human-in-the-loop workflows, which require continuous interaction between users and executing workflows.A fundamental contribution of this thesis is to show that gateways can support complex humanworkflow interactions, facilitating monitoring and steering of the workflow execution as it progresses. This is important because scientific workflows increasingly require user decisions and interactions at various steps; human decision-making is an important component of real-world computational science. In order to achieve this goal, the thesis presents the design, implementation and demonstration of WorkWays, an interactive workflow-based science gateway for supporting development and execution of human-in-the-loop scientific workflows. WorkWays consists of two distinct frameworks with well defined APIs and bindings: a framework that enables humanworkflow interaction and a framework for workflow development and execution.iii I acknowledge that an electronic copy of my thesis must be lodged with the University Library and, subject to the policy and procedures of The University of Queensland, the thesis be made available for research and study in accordance with the Copyright Act 1968 unless a period of embargo has been approved by the Dean of the Graduate School.I acknowledge that copyright of all material contained in my thesis resides with the copyright holder(s) of that material. Where appropriate I have obtained copyright permission from the copyright holder to reproduce material in this thesis.

show abstract

Enabling scientific workflow sharing through coarse-grained interoperability

Cited by 50 publications

References 17 publications

Infrastructure Aware Scientific Workflows and Infrastructure Aware Workflow Managers in Science Gateways

Infrastructure Aware Scientific Workflows and Infrastructure Aware Workflow Managers in Science Gateways

A novel approach to user-steering in scientific workflows

Interacting with scientific workflows

Contact Info

Product

Resources

About