Implementing and Applying the Stocks-Carrington Framework for Model-Based Testing

Cristiá, Maximiliano; Monetti, Pablo Rodriguez

doi:10.1007/978-3-642-10373-5_9

Cited by 18 publications

(23 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…TTF is automated in the tool Fastest [7]. BETA and TTF/Fastest have some similarities; both generate unit tests using input space partitioning techniques and have similar steps in their approach.…”

Section: Related Workmentioning

confidence: 99%

“…Formal methods and software testing are two techniques with this purpose. Many researchers have tried to combine these two techniques to take advantage of their most interesting aspects ( [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16]). This combination can bring benefits such as reduction of development costs through the application of verification techniques in the initial development phases, when faults are cheaper to be fixed, and automatic generation of tests from formal specifications [17].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

An empirical study of test generation with BETA

2016

View full text Add to dashboard Cite

Background: BETA (Bbased testing approach) is a toolsupported approach to generate test cases from Bmethod specifications through the application of input space partitioning and logical coverage criteria. The BETA tool automates the whole process, from the design of abstract test cases to the generation of executable test scripts. Methods: In this paper, we present an empirical study that was performed to evaluate and contribute to the development of BETA. The study evaluated the applicability of BETA on problems with different characteristics and used techniques of code coverage and mutation analysis to measure the quality of the generated test cases. The study was carried out in different rounds, and the results of each round were used as a reference for the improvement of the approach and its supporting tool. Results: These case studies were relevant not only for the evaluation of BETA but also to evaluate how different features affect the usability of the approach and the quality of the test cases and to compare the quality of the test cases generated using different coverage criteria. Conclusions:The results of this study showed that (1) BETAgenerated test scenarios for the different criteria follow theoretical expectations in terms of criteria subsumption; (2) the BETA implementation of the logical criteria generates more efficient test sets regarding code and mutation coverage than the input space partitioning ones; (3) it is important to go beyond the strict requirements of the criteria by adding some additional variation (randomization) of the input data; and (4) the algorithms designed to combine test requirements into test cases need to deal carefully with infeasible (logically unsatisfiable) combinations.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

An empirical study of test generation with BETA

2016

View full text Add to dashboard Cite

show abstract

“…Models are designed using from formal specifications (e.g. B, Z) (Utting and Legeard, 2007;Cristiá and Monetti, 2009) to a large variety of diagrams, such as state charts, use case, sequence diagrams (Briand and Labiche, 2001), (extended) finite state machines (Pedrosa et al, 2013;Karl, 2013) or graphs. Most of research in models for testing is focused on UML modeling language (Fowler, 2003).…”

Section: Related Workmentioning

confidence: 99%

Automated Model-based Testing Based on an Agnostic-platform Modeling Language

Sanz

Salas

Miguel

et al. 2015

Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development

View full text Add to dashboard Cite

Abstract:Currently multiple Domain Specific Languages (DSLs) are used for model-driven software development, in some specific domains. Software development methods, such as agile development, are test-centered, and their application in model-based frameworks requires model support for test development. We introduce a specific language to define generic test models, which can be automatically transformed into executable tests for particular testing platforms. The resulting test models represent the test plan for applications also built according to a model-based approach. The approach presented here includes some customisations for the application of the developed languages and transformation tools for some specific testing platforms. These languages and tools have been integrated with some specific DSL designed for software development.

show abstract

“…In [2] we presented Fastest 1 , the first automatic tool that partially implements the Test Template Framework (TTF). The TTF is a framework for model-based testing (MBT) specially well suited for unit testing from Z specifications proposed by Phil Stocks and David Carrington in [1] [3] [4].…”

Section: Introductionmentioning

confidence: 99%

“…Precisely, these are the reasons for which a tool like Fastest must implement both methods: they will complement each other, leaving to manual inspection just a small fraction of all test classes. In [2] we presented a simple but practical method for finding test cases from test classes-on average, our method can find a test case for 90% of the satisfiable test classes. Similarly, we devised the method introduced in this paper with essentially one goal in mind: to dramatically reduce the time needed to prune unsatisfiable test classes from testing trees produced by the TTF.…”

Section: Introductionmentioning

confidence: 99%

Pruning Testing Trees in the Test Template Framework by Detecting Mathematical Contradictions

Cristiá

Albertengo²,

Monetti³

2010

2010 8th IEEE International Conference on Software Engineering and Formal Methods

View full text Add to dashboard Cite

Abstract-Fastest is an automatic implementation of Phil Stocks and David Carrington's Test Template Framework (TTF) [1], a model-based testing (MBT) framework for the Z formal notation. In this paper we present a new feature of Fastest that helps TTF users to eliminate inconsistent test classes automatically. The method is very simple and practical, and makes use of the peculiarities of the TTF. Perhaps its most interesting features are extensibility and ease of use, since it does not assume previous knowledge on theorem proving. Also we compare the solution with a first attempt using the Z/EVES proof assistant and with the HOL-Z environment. At the end, we show the results of an empirical assessment based on applying Fastest to four real-world, industrial-strength case studies and to six toy examples.

show abstract

Implementing and Applying the Stocks-Carrington Framework for Model-Based Testing

Cited by 18 publications

References 13 publications

An empirical study of test generation with BETA

An empirical study of test generation with BETA

Automated Model-based Testing Based on an Agnostic-platform Modeling Language

Pruning Testing Trees in the Test Template Framework by Detecting Mathematical Contradictions

Contact Info

Product

Resources

About