MDABench: Customized benchmark generation using MDA

Zhu, Liming; Bui, Ngoc Bao; Liu, Yan; Gorton, Ian

doi:10.1016/j.jss.2006.10.052

Cited by 15 publications

(14 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, it has several limitations in terms of standards compatibility, leveraging existing code generation "cartridges" and load test modeling [27]. Thus, we have developed MDABench [28] using AndroMDA [1] for customized benchmark generation.…”

Section: Model Driven Benchmark Generation For Web Servicesmentioning

confidence: 99%

“…This can greatly reduce the cost and consequently the hurdle of performing performance engineering in practice. More details can be found at [27]. [27] for more details.…”

Section: Core Web Service Application Generationmentioning

confidence: 99%

“…More details can be found at [27]. [27] for more details. In the process of developing our approach and implementation, we integrated performance engineering best practices from the various leading technologies and our own experience.…”

Section: Core Web Service Application Generationmentioning

confidence: 99%

“…In addition to basic load testing configuration support [27] such as concurrent users and request mixes, we have also provided more realistic incremental and spike test simulation. They are based on Grinder 3 [10] and Microsoft Visual Studio 2005.…”

Section: Load Testing Configurationmentioning

confidence: 99%

“…The work is based on our previous research [27] on model driven customized benchmark generation and the MDABench toolkit [28]. This paper illustrates how to model the load testing suite using UML along with the core application design and generate deployable customized benchmark applications for Web Services platforms.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Model driven benchmark generation for web services

Zhu

Gorton

Liu

et al. 2006

Proceedings of the 2006 International Workshop on Service-Oriented Software Engineering

Self Cite

View full text Add to dashboard Cite

Web services solutions are being increasingly adopted in enterprise systems. However, ensuring the quality of service of Web services applications remains a costly and complicated performance engineering task. Some of the new challenges include limited controls over consumers of a service, unforeseeable operational scenarios and vastly different XML payloads. These challenges make existing manual performance analysis and benchmarking methods difficult to use effectively. This paper describes an approach for generating customized benchmark suites for Web services applications from a software architecture description following a Model Driven Architecture (MDA) approach. We have provided a performance-tailored version of the UML 2.0 Testing Profile so architects can model a flexible and reusable load testing architecture, including test data, in a standards compatible way. We extended our MDABench [27] tool to provide a Web service performance testing "cartridge" associated with the tailored testing profile. A load testing suite and automatic performance measurement infrastructure are generated using the new cartridge. Best practices in Web service testing are embodied in the cartridge and inherited by the generated code. This greatly reduces the effort needed for Web service performance benchmarking while being fully MDA compatible. We illustrate the approach using a case study on the Apache Axis platform.

show abstract

Section: Model Driven Benchmark Generation For Web Servicesmentioning

confidence: 99%

“…This can greatly reduce the cost and consequently the hurdle of performing performance engineering in practice. More details can be found at [27]. [27] for more details.…”

Section: Core Web Service Application Generationmentioning

confidence: 99%

Section: Core Web Service Application Generationmentioning

confidence: 99%

Section: Load Testing Configurationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Model driven benchmark generation for web services

Zhu

Gorton

Liu

et al. 2006

Proceedings of the 2006 International Workshop on Service-Oriented Software Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

Deriving performance-relevant infrastructure properties through model-based experiments with Ginpex

Hauck

Kuperberg²,

Huber

et al. 2013

Softw Syst Model

View full text Add to dashboard Cite

To predict the performance of an application, it is crucial to consider the performance of the underlying infrastructure. Thus, to yield accurate prediction results, performance-relevant properties and behaviour of the infrastructure have to be integrated into performance models. However, capturing these properties is a cumbersome and error-prone task, as it requires carefully engineered measurements and experiments. Existing approaches for creating infrastructure performance models require manual coding of these experiments, or ignore the detailed properties in the models. The contribution of this paper is the Goal-oriented INfrastructure Performance EXperiments (Ginpex) approach, which introduces goal-oriented and model-based specification and generation of executable performance experiments for automatically detecting and quantifying performance-relevant infrastructure properties. Ginpex provides a metamodel for experiment specification and comes with predefined experiment templates that provide automated experiment execution on the target platform and also automate the evaluation of the experiment results. We evaluate Ginpex using three case studies, where experiments are executed to quantify various infrastructure properties.

show abstract