Higher-Order Components for Grid Programming

Dünnweber, Jan; Gorlatch, Sergei

doi:10.1007/978-3-642-00841-2

Cited by 7 publications

(8 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The authors of [13] describe an algorithmic skeleton framework that offers skeletons as services in a Grid environment. These services are called Higher Order Components (HOC).…”

Section: Related Workmentioning

confidence: 99%

Facilitating Scientific Workflow Configuration with Parameterized Workflow Skeletons

Fleuren

Götze

Müller

2013

2013 39th Euromicro Conference on Software Engineering and Advanced Applications

View full text Add to dashboard Cite

This paper describes an operator for configuring scientific workflows that facilitates the process of assigning workflow activities to cloud resources.In general, modeling and configuring scientific workflows is complex and error-prone, because workflows are built of highly parallel patterns comprising huge numbers of tasks. Reusing tested patterns as building blocks avoids repeating errors. Workflow skeletons are parametrizable building blocks describing such patterns. Hence, scientists have a means to reuse validated parallel constructs for rapidly defining their in-silico experiments.Often, configurations of data parallel patterns are generated automatically. However, for many task parallel patterns each task needs to be configured manually. In frameworks like MapReduce, scientists have no control of how tasks are assigned to cloud resources. What is the strength of such patterns, may lead to unnecessary data transfers in other patterns.Workflow Skeletons facilitate the configuration by providing an operator that accepts parameters; this allows for scalable configurations saving time and cost by allocating cloud resources just in time. In addition, this configuration operator helps to define configurations that avoid unnecessary data transfers.

show abstract

“…The authors of [13] describe an algorithmic skeleton framework that offers skeletons as services in a Grid environment. These services are called Higher Order Components (HOC).…”

Section: Related Workmentioning

confidence: 99%

Facilitating Scientific Workflow Configuration with Parameterized Workflow Skeletons

Fleuren

Götze

Müller

2013

2013 39th Euromicro Conference on Software Engineering and Advanced Applications

View full text Add to dashboard Cite

show abstract

“…The authors of [6] describe an algorithmic skeleton framework that offers skeletons as services in a Grid environment. These services are called Higher Order Components (HOC).…”

Section: Related Workmentioning

confidence: 99%

Workflow Skeletons: Increasing Scalability of Scientific Workflows by Combining Orchestration and Choreography

Fleuren

Götze

Müller

2011

2011 IEEE Ninth European Conference on Web Services

View full text Add to dashboard Cite

Dataflow modeling is the natural way of composing scientific workflows, because they often comprise numerous data transformation steps applying massive parallelism. However, modeling control flow within dataflow is often achieved at the expense of clarity and comprehensibility.This paper describes scientific workflows maintaining the robustness of centralized control (using orchestration) by modeling control flow, while at the same time integrating sub-workflows that are modeled by workflow skeletons (using choreography) describing dataflow.Following the concept of algorithmic skeletons, we define workflow skeletons as re-usable parallel constructs describing dataflow connections between proxies representing services. Proxies are able to communicate with each other allowing for efficient coupling between parallel tasks and avoiding of unnecessary data transfers. Skeletons increase scalability on demand by accepting the number of parallel tasks.The primary contributions are a formal model describing workflow skeletons and a script language "Workflow Skeleton Language" (WorkSKEL). Furthermore, this paper demonstrates the definition of selected workflow patterns like pipeline and farm in WorkSKEL.

show abstract

“…In the context of parallel components, the works with HOCs (Higher Order Components) have shown interesting uses cases for applying skeletons for grid computing [13].…”

Section: B a Motivating Example Of Hpe Componentsmentioning

confidence: 99%

The design of a CCA framework with distribution, parallelism, and recursive composition

Carvalho

Corrêa

2010

2010 11th IEEE/ACM International Conference on Grid Computing

View full text Add to dashboard Cite

HPE is a platform of parallel components that complies to the # component model, whose components are intrinsically parallel. This paper describes the design of a new CCA framework based on HPE, aimed to reconcile distribution and parallelism of components. Besides exposing the essential differences between the two platforms, the new framework has a set of features that distinguishes it from other CCA frameworks.

show abstract

Higher-Order Components for Grid Programming

Cited by 7 publications

References 0 publications

Facilitating Scientific Workflow Configuration with Parameterized Workflow Skeletons

Facilitating Scientific Workflow Configuration with Parameterized Workflow Skeletons

Workflow Skeletons: Increasing Scalability of Scientific Workflows by Combining Orchestration and Choreography

The design of a CCA framework with distribution, parallelism, and recursive composition

Contact Info

Product

Resources

About