Virtual Hadoop

Chen, Yiwei; Hung, Shih-Hao; Tu, Chia-Heng; Yeh, Chih Wei

doi:10.1145/2987386.2987408

Cited by 7 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [21] the authors propose a proactive autoscaling mechanism that scale-in/out containers and distribute the load among instances on the base of the network traffic intensity. In [12] the authors propose Virtual Hadoop a framework for deploying containerized Hadoop clusters on heterogeneous nodes. The framework include an scaling algorithm to meet application time constraints.…”

Section: Auto-scalingmentioning

confidence: 99%

A study on performance measures for auto-scaling CPU-intensive containerized applications

Casalicchio

2019

Cluster Comput

View full text Add to dashboard Cite

Autoscaling of containers can leverage performance measures from the different layers of the computational stack. This paper investigate the problem of selecting the most appropriate performance measure to activate auto-scaling actions aiming at guaranteeing QoS constraints. First, the correlation between absolute and relative usage measures and how a resource allocation decision can be influenced by them is analyzed in different workload scenarios. Absolute and relative measures could assume quite different values. The former account for the actual utilization of resources in the host system, while the latter account for the share that each container has of the resources used. Then, the performance of a variant of Kubernetes' auto-scaling algorithm, that transparently uses the absolute usage measures to scale-in/out containers, is evaluated through a wide set of experiments. Finally, a detailed analysis of the state-of-the-art is presented.

show abstract

Section: Auto-scalingmentioning

confidence: 99%

A study on performance measures for auto-scaling CPU-intensive containerized applications

Casalicchio

2019

Cluster Comput

View full text Add to dashboard Cite

show abstract

Implementing Hadoop Container Migrations in OpenNebula Private Cloud Environment

Kalyanaraman

Jothi

Balakrishnan

et al. 2020

Role of Edge Analytics in Sustainable Smart City Development

View full text Add to dashboard Cite

The state‐of‐the‐art in container technologies: Application, orchestration and security

Casalicchio

Iannucci

2020

Concurrency and Computation

View full text Add to dashboard Cite

SummaryContainerization is a lightweight virtualization technology enabling the deployment and execution of distributed applications on cloud, edge/fog, and Internet‐of‐Things platforms. Container technologies are evolving at the speed of light, and there are many open research challenges. In this paper, an extensive literature review is presented that identifies the challenges related to the adoption of container technologies in High Performance Computing, Big Data analytics, and geo‐distributed (Edge, Fog, Internet‐of‐Things) applications. From our study, it emerges that performance, orchestration, and cyber‐security are the main issues. For each challenge, the state‐of‐the‐art solutions are then analyzed. Performance is related to the assessment of the performance footprint of containers and comparison with the footprint of virtual machines and bare metal deployments, the monitoring, the performance prediction, the I/O throughput improvement. Orchestration is related to the selection, the deployment, and the dynamic control of the configuration of multi‐container packaged applications on distributed platforms. The focus of this work is on run‐time adaptation. Cyber‐security is about container isolation, confidentiality of containerized data, and network security. From the analysis of 97 papers, it came out that the state‐of‐the‐art is more mature in the area of performance evaluation and run‐time adaptation rather than in security solutions. However, the main unsolved challenges are I/O throughput optimization, performance prediction, multilayer monitoring, isolation, and data confidentiality (at rest and in transit).

show abstract

Virtual Hadoop

Cited by 7 publications

References 4 publications

A study on performance measures for auto-scaling CPU-intensive containerized applications

A study on performance measures for auto-scaling CPU-intensive containerized applications

Implementing Hadoop Container Migrations in OpenNebula Private Cloud Environment

The state‐of‐the‐art in container technologies: Application, orchestration and security

Contact Info

Product

Resources

About