Test templates: a specification-based testing framework

Stocks, Philip; Carrington, David

doi:10.1109/icse.1993.346025

Cited by 39 publications

(32 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…TTF (test template framework [6]) is an approach that generates unit tests from Z specifications. TTF is automated in the tool Fastest [7].…”

Section: Related Workmentioning

confidence: 99%

“…Formal methods and software testing are two techniques with this purpose. Many researchers have tried to combine these two techniques to take advantage of their most interesting aspects ( [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16]). This combination can bring benefits such as reduction of development costs through the application of verification techniques in the initial development phases, when faults are cheaper to be fixed, and automatic generation of tests from formal specifications [17].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

An empirical study of test generation with BETA

2016

View full text Add to dashboard Cite

Background: BETA (Bbased testing approach) is a toolsupported approach to generate test cases from Bmethod specifications through the application of input space partitioning and logical coverage criteria. The BETA tool automates the whole process, from the design of abstract test cases to the generation of executable test scripts. Methods: In this paper, we present an empirical study that was performed to evaluate and contribute to the development of BETA. The study evaluated the applicability of BETA on problems with different characteristics and used techniques of code coverage and mutation analysis to measure the quality of the generated test cases. The study was carried out in different rounds, and the results of each round were used as a reference for the improvement of the approach and its supporting tool. Results: These case studies were relevant not only for the evaluation of BETA but also to evaluate how different features affect the usability of the approach and the quality of the test cases and to compare the quality of the test cases generated using different coverage criteria. Conclusions:The results of this study showed that (1) BETAgenerated test scenarios for the different criteria follow theoretical expectations in terms of criteria subsumption; (2) the BETA implementation of the logical criteria generates more efficient test sets regarding code and mutation coverage than the input space partitioning ones; (3) it is important to go beyond the strict requirements of the criteria by adding some additional variation (randomization) of the input data; and (4) the algorithms designed to combine test requirements into test cases need to deal carefully with infeasible (logically unsatisfiable) combinations.

show abstract

“…TTF (test template framework [6]) is an approach that generates unit tests from Z specifications. TTF is automated in the tool Fastest [7].…”

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

An empirical study of test generation with BETA

2016

View full text Add to dashboard Cite

show abstract

“…The current research literature reports on specific tools for specific formal specification languages [9,12,27,34,47,53,55], manual methods for deriving tests from specifications [2,3,8,22,28], case studies on using specifications to check the output of the software on specifications [23,36,39,50], and formalizations of test specifications [7,16,52,51]. The term specification-based testing is used in the narrow sense of using specifications as a basis for deciding what tests to run on software.…”

Section: Related Workmentioning

confidence: 99%

“…They have been used as a basis for test case generation, to check the output of software on test inputs [32,40,42], and as a basis for formalizing test specifications (as opposed to functional specifications) [50,51,52]. This paper is primarily concerned with the first use, that of generating test cases from specifications, commonly referred to as specification-based testing.…”

Section: Introductionmentioning

confidence: 99%

Generating test data from state‐based specifications

Offutt

Liu

Abdurazik

et al. 2003

Software Testing Verif & Rel

272

159

View full text Add to dashboard Cite

show abstract

“…A formal software specification is one of the most useful documents to have when testing software, since it is a concise and precise description of functionality. Specification-based testing focuses on obtaining test data from specification [19]. Generating test data to cover all specification is a challenge for a complex system [6,21].…”

Section: Introductionmentioning

confidence: 99%

Generating Test Data for Specification-Based Tests Via Quasirandom Sequences

Chi

Jones

Evans

et al. 2006

Computational Science – ICCS 2006

View full text Add to dashboard Cite

Abstract. This paper presents work on generation of specificationdriven test data, by introducing techniques based on a subset of quasirandom sequences (completely uniformly distributed sequences) to generate test data. This approach is novel in software testing. This enhanced uniformity of quasirandom sequences leads to faster generation of test data covering all possibilities. We demonstrate by examples that welldistributed sequences can be a viable alternative to pseudorandom numbers in generating test data. In this paper, we present a method that can generate test data from a decision table specification more effectively via quasirandom numbers. Analysis of a simple problem in this paper shows that quasirandom sequences achieve better data than pseudorandom numbers, and have the potential to converge faster and so reduce the computational burden. Functional test coverage, an objective criteria, evaluates the quality of a test set to ensure that all specified behaviors will be exercised by the test data.

show abstract

Test templates: a specification-based testing framework

Cited by 39 publications

References 14 publications

An empirical study of test generation with BETA

An empirical study of test generation with BETA

Generating test data from state‐based specifications

Generating Test Data for Specification-Based Tests Via Quasirandom Sequences

Contact Info

Product

Resources

About