No abstract

Abstract. Solving distributed computing infrastructure (DCI) incompatibility issues in a generic way is a challenging and complex task. Gateways and workflow management systems are often tightly bound to some limited number of supported DCIs. To enable gateways access to many different DCIs and to solve DCI compatibility among the very different workflow management systems, we have developed a generic solution, the DCI Bridge. In this chapter we describe its internal architecture, provide usage scenario and show how the DCI Bridge resolves interoperability issues between various middleware-based DCIs. We also provide insight about the capabilities of the realized system. The generic DCI Bridge service seamlessly enables the execution of workflows (and jobs) on major DCI platforms such as ARC, Globus, gLite, UNICORE, SGE, PBS, as well as web services or clouds. IntroductionIn most cases, gateways and workflow management systems (and therefore their workflows) are tightly bound to some small number of specific distributed computing infrastructures (DCIs), and effort is required to enable additional DCI support. As a result, solving workflow management systems' DCI incompatibility, or their workflow interoperability [Krefting/2011] issues are very challenging and complex tasks. In this chapter we show a concept of how to enable generic DCI compatibility, which is feasible for many major gateways and grid workflow management systems (such as ASKALON [Duan/2005], MOTEUR [Glatard/2008], WS-PGRADE/gUSE [Kacsuk/2012], etc.) on workflow level (and also on the job level). To enable DCI compatibility among the different gateways and workflow management systems, we have developed the DCI Bridge, which is also one of the main components of the so-called fine-grained interoperability approach (FGI) developed by the SHIWA (SHaring Interoperable Workflows for large-scale scientific simulations on Available DCIs) project [Plankensteiner/2013]. In this chapter we target the generic DCI Bridge service component and describe its internal architecture, provide usage scenarios, and show how the DCI Bridge can resolve

SUMMARYState-of-the-art science gateways can be connected to several distributed computing infrastructures (DCIs) and are able to run jobs and workflows simultaneously in all those DCIs. Flexibility of accessing diverse data storages from these workflows and assisting end users to manage these storages are however the missing features in current gateway implementations, in which these problems often prove to be a barrier of exploiting the power of distributed computing by user communities having no or little IT competence. This paper addresses these issues by integrating a data bridging service called Data Avenue into WS-PGRADE/gUSE portal framework. Data Avenue offers tools for the end users to easily manage their data residing on various storage resources, and also, jobs become capable of accessing different storages regardless of the particular distributed computing infrastructure where the job is currently being run.