EC3: Elastic Cloud Computing Cluster

Caballer, Miguel; Alfonso, Carlos; Alvarruiz, Fernando; Moltó, Germán

doi:10.1016/j.jcss.2013.06.005

Cited by 43 publications

(46 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…More details about the elasticity policies can be found in [3]. In the first execution, represented in Figure 6(a), a hybrid infrastructure composed of nodes from our on-premises Cloud (OpenNebula) and on-demand public nodes from AWS has coped with the execution of jobs.…”

Section: Resultsmentioning

confidence: 99%

“…Virtual clusters in the Cloud introduce profound benefits for many computational workloads, but specially for embarrassingly parallel jobs. These benefits include the on-demand provision of per-application customised clusters and the ability to dynamically increase and decrease the number of working nodes of the virtual cluster depending on the current workload, as we demonstrated in our earlier work [3]. This work resulted in the creation of EC3 (Elastic Cloud Computing Cluster)…”

Section: Introductionmentioning

confidence: 91%

“…The elasticity management is carried out by the front-end node of the cluster, with the help of CLUES [32]. More details about the elasticity management are available in [3].…”

Section: Elastic Cloud Computing Cluster (Ec3)mentioning

confidence: 99%

“…It implements the policies used to decide when to increase the capacity of the cluster and those used to decide when to decrease the number of nodes. More details about the elasticity policies can be found in [3].…”

Section: Previously Developed Ec3 Componentsmentioning

confidence: 99%

“…1 [3] an open-source tool to deploy customised virtual elastic clusters on different on-premises, such as OpenNebula [4] and OpenStack [5], and public Cloud providers, such as Amazon Web Services (AWS) [6].…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Self-managed cost-efficient virtual elastic clusters on hybrid Cloud infrastructures

Calatrava

Romero

Moltó

et al. 2016

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

This paper describes the developments to produce EC3 (Elastic Cloud Computing Cluster), a tool that creates self-managed cost-efficient virtual hybrid elastic clusters on top of Infrastructure as a Service (IaaS) Clouds. Using spot instances, together with checkpointing techniques, EC3 can significantly reduce the total cost of executions while introducing automatic fault tolerance. Moreover, EC3 can deploy and manage hybrid clusters across on-premises and public Cloud resources, thus introducing Cloud bursting capabilities.A case study is presented to assess the effectiveness of the tool featuring the structural dynamic analysis of buildings. In addition, checkpointing algorithms are evaluated in a real Cloud environment with existing workloads to study their effectiveness. The results show the feasibility and benefits of this type of clusters for computationally intensive applications.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 91%

“…The elasticity management is carried out by the front-end node of the cluster, with the help of CLUES [32]. More details about the elasticity management are available in [3].…”

Section: Elastic Cloud Computing Cluster (Ec3)mentioning

confidence: 99%

Section: Previously Developed Ec3 Componentsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Self-managed cost-efficient virtual elastic clusters on hybrid Cloud infrastructures

Calatrava

Romero

Moltó

et al. 2016

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

show abstract

Dynamic Management of Virtual Infrastructures

et al. 2014

Self Cite

View full text Add to dashboard Cite

Cloud infrastructures are becoming an appropriate solution to address the computational needs of scientific applications. However, the use of public or onpremises Infrastructure as a Service (IaaS) clouds requires users to have non-trivial system administration skills. Resource provisioning systems provide facilities to choose the most suitable Virtual Machine Images (VMI) and basic configuration of multiple instances and subnetworks. Other tasks such as the configuration of cluster services, computational frameworks or specific applications are not trivial on the cloud, and normally users have to manually select the VMI that best fits, including undesired additional services and software packages. This paper presents a set of components that ease the access and the usability of IaaS clouds by automating the VMI selection, deployment, configuration, software installation, monitoring and update of Virtual Appliances. It supports APIs from a large number of virtual platforms, making user applications cloud-agnostic. In addition it integrates a contextualization system to enable the installation and configuration of all the user required applications providing the user with a fully functional infrastructure. Therefore, golden VMIs and configuration recipes can be easily reused across different deployments. Moreover, the contextualization agent included in the framework supports horizontal (increase/decrease the number of resources) and vertical (increase/decrease resources within a running Virtual Machine) by properly reconfiguring the software installed, considering the configuration of the

show abstract

Deployment of Elastic Virtual Hybrid Clusters Across Cloud Sites

et al. 2021

Self Cite

View full text Add to dashboard Cite

Virtual clusters are widely used computing platforms than can be deployed in multiple cloud platforms. The ability to dynamically grow and shrink the number of nodes has paved the way for customised elastic computing both for High Performance Computing and High Throughput Computing workloads. However, elasticity is typically restricted to a single cloud site, thus hindering the ability to provision computational resources from multiple geographically distributed cloud sites. To this aim, this paper introduces an architecture of open-source components that coherently deploy a virtual elastic cluster across multiple cloud sites to perform large-scale computing. These hybrid virtual elastic clusters are automatically deployed and configured using an Infrastructure as Code (IaC) approach on a distributed hybrid testbed that spans different organizations, including on-premises and public clouds, supporting automated tunneling of communications across the cluster nodes with advanced VPN topologies. The results indicate that cluster-based computing of embarrassingly parallel jobs can benefit from hybrid virtual clusters that aggregate computing resources from multiple cloud back-ends and bring them together into a dedicated, albeit virtual network.

show abstract

EC3: Elastic Cloud Computing Cluster

Cited by 43 publications

References 12 publications

Self-managed cost-efficient virtual elastic clusters on hybrid Cloud infrastructures

Self-managed cost-efficient virtual elastic clusters on hybrid Cloud infrastructures

Dynamic Management of Virtual Infrastructures

Deployment of Elastic Virtual Hybrid Clusters Across Cloud Sites

Contact Info

Product

Resources

About