Performance Regression Unit Testing: A Case Study

Horký, Vojtěch; Haas, František; Kotrč, Jaroslav; Lacina, Martin; Tůma, Petr

doi:10.1007/978-3-642-40725-3_12

Cited by 10 publications

(10 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The measurements required to generate a complete performance documentation would take too long for even a moderately sized projects -even for the testing purposes, the performance unit tests need to be run on carefully selected test cases only [20].…”

Section: Turning Tests Into Documentationmentioning

confidence: 99%

“…We consider performance unit tests as described in [4,20], using tools developed for the Java platform.…”

Section: Performance Unit Testsmentioning

confidence: 99%

“…We meet our goal by utilizing performance unit tests, introduced in detail in [4,20]. When a performance unit test accompanies a particular software artefact, we use the workload generation component of the unit test to execute perfor- 2 And experiments carry their own risks [2,17,9].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Utilizing Performance Unit Tests To Increase Performance Awareness

Horký

Libič

Marek

et al. 2015

Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering

Self Cite

View full text Add to dashboard Cite

Many decisions taken during software development impact the resulting application performance. The key decisions whose potential impact is large are usually carefully weighed. In contrast, the same care is not used for many decisions whose individual impact is likely to be small -simply because the costs would outweigh the benefits. Developer opinion is the common deciding factor for these cases, and our goal is to provide the developer with information that would help form such opinion, thus preventing performance loss due to the accumulated effect of many poor decisions.Our method turns performance unit tests into recipes for generating performance documentation. When the developer selects an interface and workload of interest, relevant performance documentation is generated interactively. This increases performance awareness -with performance information available alongside standard interface documentation, developers should find it easier to take informed decisions even in situations where expensive performance evaluation is not practical. We demonstrate the method on multiple examples, which show how equipping code with performance unit tests works.

show abstract

Section: Turning Tests Into Documentationmentioning

confidence: 99%

“…We consider performance unit tests as described in [4,20], using tools developed for the Java platform.…”

Section: Performance Unit Testsmentioning

confidence: 99%

See 1 more Smart Citation

Utilizing Performance Unit Tests To Increase Performance Awareness

Horký

Libič

Marek

et al. 2015

Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

“…Besides simple software documentation purposes, this use can also benefit software performance testing [5,15]. In this context, the models can be provided with the same inputs as in the early stages of the software development process, with one important addition -the models can be automatically calibrated against the actual performance in selected benchmarks.…”

Section: Modeling Contextmentioning

confidence: 99%

Constructing performance model of JMS middleware platform

Martinec

Marek

Steinhauser

et al. 2014

Proceedings of the 5th ACM/SPEC International Conference on Performance Engineering

Self Cite

View full text Add to dashboard Cite

Middleware performance models are useful building blocks in the performance models of distributed software applications. We focus on performance models of messaging middleware implementing the Java Message Service standard, showing how certain system design properties -including pipelined processing and message coalescing -interact to create performance behavior that the existing models do not capture accurately. We construct a performance model of the ActiveMQ messaging middleware that addresses the outlined issues and discuss how the approach extends to other middleware implementations.

show abstract

“…This task is made easier by the fact that the interface of each ensemble component is precisely specified, with communication taking place only through knowledge exchange. The input for testing therefore takes the shape of a snapshot(s) of the knowledge repository, initially prepared by knowledge generators implemented for that purpose [8].…”

Section: Performance Perspectivementioning

confidence: 99%

Towards Performance-Aware Engineering of Autonomic Component Ensembles

Bureš

Horký

Kit

et al. 2014

Leveraging Applications of Formal Methods, Verification and Validation. Technologies for Mastering Change

Self Cite

View full text Add to dashboard Cite

Abstract. Ensembles of autonomic components are a novel software engineering paradigm for development of open-ended distributed highly dynamic software systems (e.g. smart cyber-physical systems). Recent research centered around the concept of ensemble-based systems resulted in design and development models that aim to systematize and simplify the engineering process of autonomic components and their ensembles. These methods highlight the importance of covering both the functional concepts and the non-functional properties, specifically performance-related aspects of the future systems. In this paper we propose an integration of the emerging techniques for performance assessment and awareness into different stages of the development process. Our goal is to aid both designers and developers of autonomic component ensembles with methods providing performance awareness throughout the entire development life cycle (including runtime).

show abstract

Performance Regression Unit Testing: A Case Study

Cited by 10 publications

References 8 publications

Utilizing Performance Unit Tests To Increase Performance Awareness

Utilizing Performance Unit Tests To Increase Performance Awareness

Constructing performance model of JMS middleware platform

Towards Performance-Aware Engineering of Autonomic Component Ensembles

Contact Info

Product

Resources

About