Automated scalability testing of software as a service

Moura, Paulo; Kon, Fábio

doi:10.1109/iwast.2013.6595784

Cited by 6 publications

(4 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We plan to use the Scalability Explorer tool [13] to reflectively create rules for service compositions. The choice of a rule-based CEP engine will allow us to easily adopt a vast number of different reconfiguration strategies to our prototype.…”

Section: Resultsmentioning

confidence: 99%

A middleware for reflective web service choreographies on the cloud

Furtado

Francesquini

Lago

et al. 2014

Proceedings of the 13th Workshop on Adaptive and Reflective Middleware

Self Cite

View full text Add to dashboard Cite

Web service composition is a commonly used solution to build distributed systems on the cloud. Choreographies are one specific kind of service composition in which the responsibilities for the execution of the system are shared by its service components without a central point of coordination. Due to the distributed nature of these systems, a manual approach to resource usage monitoring and allocation to maintain the expected Quality of Service (QoS) is not only inefficient but also does not scale. In this paper, we present an open source choreography enactment middleware that is capable of automatically deploying and executing a composition. Additionally, it also monitors the composition execution to perform automatic resource provisioning and dynamic service reconfiguration based on pre-defined Service Level Agreement (SLA) constraints. To achieve that, it keeps a meta-level representation of the compositions, which contains their specifications, deployment statuses, and QoS attributes. Application developers can write specific rules that take into account these meta-data to reason about the performance of the composition and change its behavior. Our middleware was evaluated on Amazon EC2 and our results demonstrate that, with little effort from the choreography developer or deployer, the middleware is able to maintain the established SLA using both horizontal and vertical scaling when faced with varying levels of load. Additionally, it also reduces operational costs by using as little computational resources as possible.

show abstract

Section: Resultsmentioning

confidence: 99%

A middleware for reflective web service choreographies on the cloud

Furtado

Francesquini

Lago

et al. 2014

Proceedings of the 13th Workshop on Adaptive and Reflective Middleware

Self Cite

View full text Add to dashboard Cite

show abstract

“…5 case studies are reported, using different operating systems and simulated services. Scalability Explorer, an automated framework for scalability testing is presented in [92], introducing scalability testing as TaaS through one experiment to evaluate a web service-based distributed matrix multiplication system hosted on Amazon EC2.…”

Section: ) Other Ways Of Testingmentioning

confidence: 99%

A Systematic Mapping Study of Empirical Studies on Software Cloud Testing Methods

Ahmad

Brereton

András

2017

2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C)

View full text Add to dashboard Cite

Abstract-Context: Software has become more complicated, dynamic, and asynchronous than ever, making testing more challenging. With the increasing interest in the development of cloud computing, and increasing demand for cloud-based services, it has become essential to systematically review the research in the area of software testing in the context of cloud environments. Objective: The purpose of this systematic mapping study is to provide an overview of the empirical research in the area of software cloud-based testing, in order to build a classification scheme. We investigate functional and non-functional testing methods, the application of these methods, and the purpose of testing using these methods. Method: We searched for electronically available papers in order to find relevant literature and to extract and analyze data about the methods used. Result: We identified 69 primary studies reported in 75 research papers published in academic journals, conferences, and edited books. Conclusion: We found that only a minority of the studies combine rigorous statistical analysis with quantitative results. The majority of the considered studies present early results, using a single experiment to evaluate their proposed solution.

show abstract

“…As a first step we are working on a software framework to automate scalability evaluation of distributed systems [25]. The intent is to provide a tool to simplify definition and execution of scalability experiments.…”

Section: Proposalmentioning

confidence: 99%

“…Common metrics proposed for scalability evaluation assume linear scal-ing [5,11,9,19,22], yet many use arbitrary thresholds for qualifying a system to be scalable [20]. Our aim is to provide components to perform automated analysis in order to verify if system performance remains the same when resource allocation is changed because of variatons in workload [25]. Our basis is deriving a model that captures the relation between workload and resource demand.…”

Section: Proposalmentioning

confidence: 99%

Using Performance Forecasting to Accelerate Elasticity

Moura

Kon

Voulgaris³

et al. 2015

Adaptive Resource Management and Scheduling for Cloud Computing

Self Cite

View full text Add to dashboard Cite

Abstract. Cloud computing facilitates dynamic resource provisioning. The automation of resource management, known as elasticity, has been subject to much research. Monitoring of a running service plays a crucial role, and adjustments are made when certain thresholds are crossed. On such occasions, it is common practice to simply add or remove resources. In this paper we ask ourselves how we can predict the performance of a service in order to dynamically adjust allocated resources based on predictions. In other words, instead of "repairing" because a threshold has been crossed, we attempt to stay ahead and allocate a best amount of resources in advance. To do so, we need to have accurate predictive models that are based on workloads. We present our approach, based on the Universal Scalability Law, and discuss initial experiments.

show abstract

Automated scalability testing of software as a service

Cited by 6 publications

References 26 publications

A middleware for reflective web service choreographies on the cloud

A middleware for reflective web service choreographies on the cloud

A Systematic Mapping Study of Empirical Studies on Software Cloud Testing Methods

Using Performance Forecasting to Accelerate Elasticity

Contact Info

Product

Resources

About