Smart Policy Driven Data Management and Data Federations

Fuhrmann, Patrick; Antonacci, Marica; Donvito, Giacinto; Keeble, Oliver; Millar, Paul

doi:10.22323/1.327.0001

Proceedings of International Symposium on Grids and Clouds 2018 in Conjunction With Frontiers in Computational Drug Discovery — 2018

DOI: 10.22323/1.327.0001

|View full text |Cite

Smart Policy Driven Data Management and Data Federations

Patrick Fuhrmann¹,

Marica Antonacci²,

Giacinto Donvito³

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2021

Publication Types

Select...

Book1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Leveraging High-Performance Computing and Cloud Computing with Unified Big-Data Workflows: The LEXIS Project

Hachinger

Golasowski

Martinovič

et al. 2021

Technologies and Applications for Big Data Value

View full text Add to dashboard Cite

Traditional usage models of Supercomputing centres have been extended by High-Throughput Computing (HTC), High-Performance Data Analytics (HPDA) and Cloud Computing. The complexity of current compute platforms calls for solutions to simplify usage and conveniently orchestrate computing tasks. These enable also non-expert users to efficiently execute Big Data workflows. In this context, the LEXIS project (‘Large-scale EXecution for Industry and Society’, H2020 GA 825532, https://lexis-project.eu) sets up an orchestration platform for compute- and data-intensive workflows. Its main objective is to implement a front-end and interfaces/APIs for distributed data management and workflow orchestration. The platform uses an open-source Identity and Access Management solution and a custom billing system. The data management API allows data ingestion and staging between various infrastructures. The orchestration API allows execution of workflows specified in extended TOSCA. LEXIS uses innovative technologies like YORC and Alien4Cloud for orchestration or iRODS/EUDAT-B2SAFE for data management, accelerated by Burst Buffers. Three pilot use cases from Aeronautics Engineering, Earthquake/Tsunami Analysis, and Weather and Climate Prediction are used to test the services. On the road towards longer-term sustainability, we are expanding this user base and aiming at the immersion of more Supercomputing centres within the platform.

show abstract

Leveraging High-Performance Computing and Cloud Computing with Unified Big-Data Workflows: The LEXIS Project

Hachinger

Golasowski

Martinovič

et al. 2021

Technologies and Applications for Big Data Value

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Smart Policy Driven Data Management and Data Federations

Cited by 1 publication

References 4 publications

Leveraging High-Performance Computing and Cloud Computing with Unified Big-Data Workflows: The LEXIS Project

Leveraging High-Performance Computing and Cloud Computing with Unified Big-Data Workflows: The LEXIS Project

Contact Info

Product

Resources

About