A cloud-based TaaS infrastructure with tools for SaaS validation, performance and scalability evaluation

Gao, Jerry; Manjula, K; Roopa, P.; Sumalatha, E.; Bai, Xiaoying; Tsai, Wei‐Tek; Uehara, Tadahiro

doi:10.1109/cloudcom.2012.6427555

Cited by 29 publications

(11 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Cloud testing tools and services are addressed in different studies. For instance, the authors of [50] propose CTaaS, a cloud-based TaaS environment aimed at supporting SaaS performance and scalability testing. The authors of [41] present PEESOS-Cloud, an architecture for conducting experiments in services using the characteristics of the workloads.…”

Section: Rq3mentioning

confidence: 99%

See 1 more Smart Citation

A Systematic Review on Cloud Testing

et al. 2019

View full text Add to dashboard Cite

A systematic literature review is presented that surveyed the topic of cloud testing over the period 2012--2017. Cloud testing can refer either to testing cloud-based systems (testing of the cloud) or to leveraging the cloud for testing purposes (testing in the cloud): both approaches (and their combination into testing of the cloud in the cloud) have drawn research interest. An extensive paper search was conducted by both automated query of popular digital libraries and snowballing, which resulted in the final selection of 147 primary studies. Along the survey, a framework has been incrementally derived that classifies cloud testing research among six main areas and their topics. The article includes a detailed analysis of the selected primary studies to identify trends and gaps, as well as an extensive report of the state-of-the-art as it emerges by answering the identified Research Questions. We find that cloud testing is an active research field, although not all topics have received enough attention and conclude by presenting the most relevant open research challenges for each area of the classification framework.

show abstract

Section: Rq3mentioning

confidence: 99%

“…The main objectives for moving software testing of the cloud in the cloud are performance [130], [41] and functional motivations [136], [19]. Security is the target of both the studies [88] and [109], whilst paper [50] covers multiple aspects: performance, elasticity, robustness, and reliability.…”

mentioning

confidence: 99%

A Systematic Review on Cloud Testing

et al. 2019

View full text Add to dashboard Cite

show abstract

“…However, we used part of the proposed ontology to classify our own performance metrics. Gao et al [17] propose a Testing-as-a-Service (TaaS) infrastructure and report a cloud-based TaaS environment with tools (known as CTaaS) developed to meet the needs in SaaS testing, performance, and scalability evaluation. One drawback of this approach is that its deployment cannot be hidden from the CSP, which might in return maliciously increase the capacity of the allocated resources to mitigate artificially the evaluation in favor of its own offering.…”

Section: Context and Motivationsmentioning

confidence: 99%

PRESENCE: Monitoring and Modelling the Performance Metrics of Mobile Cloud SaaS Web Services

Ibrahim

Wasim

Varrette

et al. 2018

Mobile Information Systems

View full text Add to dashboard Cite

Service Level Agreements (SLAs) are defining the quality of the services delivered from the Cloud Services Providers (CSPs) to the cloud customers. The services are delivered on a pay-per-use model. The quality of the provided services is not guaranteed by the SLA because it is just a contract. The developments around mobile cloud computing and the advent of edge computing technologies are contributing to the diffusion of the cloud services and the multiplication of offers. Although the cloud services market is growing for the coming years, unfortunately, there is no standard mechanism which exists to verify and assure that delivered services satisfy the signed SLA agreement in an automatic way. The accurate monitoring and modelling of the provided Quality of Service (QoS) is also missing. In this context, we aim at offering an automatic framework named PRESENCE, to evaluate the QoS and SLA compliance of Web Services (WSs) offered across several CSPs. Yet unlike other approaches, PRESENCE aims at quantifying in a fair and by stealth way the performance and scalability of the delivered WS. This article focuses on the first experimental results obtained on the accurate modelisation of each individual performance metrics. Indeed, 19 generated models are provided, out of which 78.9% accurately represent the WS performance metrics for two representative SaaS web services used for the validation of the PRESENCE approach. This opens novel perspectives for assessing the SLA compliance of Cloud providers using the PRESENCE framework.

show abstract

“…This means, the exiting tools try to simulate cache, network bandwidth and bowser agents to emulate real world network traffic. Some of the tools also use a dedicated cloud [3] during load tests. Consequently, the reports generated by these tools are not accurate with respect to actual internet users because the exiting tools do not consider the noise in the network.…”

Section: Introductionmentioning

confidence: 99%

A novel approach for collaborative last-mile performance testing implementation using an object-oriented approach

Tauro

Souza

et al. 2014

SIGSOFT Softw. Eng. Notes

View full text Add to dashboard Cite

The goal of this paper is to propose an implementation of a last-mile performance testing solution for small and medium organizations using a collaborative approach. This paper will discuss three important topics: (a) the willingness of small and medium organizations to participate in the collaborative approach, (b) an object-oriented implementation for generating the performance test scripts, and (c) an effective way for executing an almost no cost last-mile performance test. This paper will propose an overall approach for conducting economical last-mile performance testing for small and medium organizations using real machines as load testing agents.

show abstract

A cloud-based TaaS infrastructure with tools for SaaS validation, performance and scalability evaluation

Cited by 29 publications

References 15 publications

A Systematic Review on Cloud Testing

A Systematic Review on Cloud Testing

PRESENCE: Monitoring and Modelling the Performance Metrics of Mobile Cloud SaaS Web Services

A novel approach for collaborative last-mile performance testing implementation using an object-oriented approach

Contact Info

Product

Resources

About