Digital repository as a service: automatic deployment of an Invenio-based repository using TOSCA orchestration and Apache Mesos

Abstract

In the framework of the H2020 INDIGO-DataCloud project, we have implemented an advanced solution for the automatic deployment of digital data repositories based on Invenio, the digital library framework developed by CERN. Exploiting cutting-edge technologies, such as Docker and Apache Mesos, and standard specifications to describe application architectures such as TOSCA, we are able to provide a service that simplifies the process of creating and managing repositories of various digital assets using cloud resources. An Invenio-based repository consists of a set of services (e.g. database, message queue, cache, workers and frontend) that need to be properly installed, configured and linked together. These operations, along with the provisioning of the resources and their monitoring and maintenance, can be challenging for individual researchers or small-to-moderate-sized research groups. To this purpose, the INDIGO-DataCloud platform provides advanced features for orchestrating the deployment of complex virtual infrastructures on distributed cloud environments: it is able to provision the required resources automatically over heterogeneous and/or hybrid cloud infrastructures and to configure them automatically ensuring dynamic elasticity and resilience. This approach has been successfully adapted to support the needs of the researchers and scholars in the domain of the Digital Arts and Humanities.

Towards Software Compliance Specification and Enforcement Using TOSCA

“…Among non-functional aspects, which can be modeled using TOSCA, are: (i) enhancement of reliability through scalability thresholds that ensure availability and allow re-instantiating failed components [10,11]; (ii) improvement of performance and resource utilization [11]; (iii) support of security-by-design (e.g., enforcement of certain encryption mechanisms and access policies) [12]; (iv) increase of compatibility and standardized blueprints [13]; (v) enhancement of maintainability through modularity, reusability, and analyzability of an application [2,14]; and (vi) ensuring portability and provider-agnostic deployment [12,15].…”

Intelligent orchestration of database resources in power system

“…Li Liyao et al [5] proposed an automatic deployment scheme on the OpenStack cloud platform by copying the mirror templates established according to different nodes, and then writing scripts to modify the configuration to achieve deployment. Marica Antonacci et al [6] used techniques such as Docker and Apache Mesos and standard rules describing application architecture to simplify the process of creating repositories of digital assets using cloud resources.…”