Elastic Load Balancing for Dynamic Virtual Machine Reconfiguration Based on Vertical and Horizontal Scaling

Abstract

Abstract-Today, cloud computing applications are rapidly constructed by services belonging to different cloud providers and service owners. This work presents the inter-cloud elasticity framework, which focuses on cloud load balancing based on dynamic virtual machine reconfiguration when variations on load or on user requests volume are observed. We design a dynamic reconfiguration system, called inter-cloud load balancer (ICLB), that allows scaling up or down the virtual resources (thus providing automatized elasticity), by eliminating service downtimes and communication failures. It includes an inter-cloud load balancer for distributing incoming user HTTP traffic across multiple instances of inter-cloud applications and services and we perform dynamic reconfiguration of resources according to the real time requirements. The experimental analysis includes different topologies by showing how real-time traffic variation (using real world workloads) affects resource utilization and by achieving better resource usage in inter-cloud.

Elasticity in Cloud Computing: State of the Art and Research Challenges

“…[31], [54], [129], [130], [131], [132], [133] Migration [38], [45], [61], [73], [86], [90], [134], [135], [136], [137], [138], [139], [140], [141] Hybrid [37], [38], [44], [51], [58], [90], [91], [142] Architecture Centralized Most approaches presented in this table, except the decentralized ones. Decentralized [93], [94], [143], [144], [145], [146] Provider Single [22], [23], [24], [25], [27], [54], [55], [57], [78], [79], [82], [87], [100], [147] Multiple [28],…”

“…Most of the elasticity solutions and proposals support only a single cloud provider. However, there are other works [28], [53], [62], [63], [142] that handle elasticity between multiple cloud providers simultaneously.…”

Adaptive Microservice Scaling for Elastic Applications

“…A "horizontal" auto-scaling system would determine if the application needed to add (scale-out) or remove (scalein) an instance in order to maintain performance or reduce costs. It is also possible to reconfigure VMs by adding (scaleup) or removing (scale-down) computing resources [9]. This work focus on the more widely used horizontal auto-scaling systems (henceforth just auto-scaling systems).…”

Online Workload Burst Detection for Efficient Predictive Autoscaling of Applications

“…An application with high response time loses the user attraction and will reduce business opportunities for application owners. Therefore, application response time SLO is critical to ensure for cloud-hosted applications [1]- [3].…”