Protocol Conformance Testing a SIP Registrar: an Industrial Application of Formal Methods

Aichernig, Bernhard K.; Peischl, Bernhard; Weiglhofer, Martin; Wotawa, Franz

doi:10.1109/sefm.2007.31

Cited by 24 publications

(27 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In [2], we propose to use two different approaches for the design of test purposes. The first technique, which is discussed in this section, is based on structural coverage on the specification, e.g.…”

Section: Structural Test Purpose Designmentioning

confidence: 99%

“…To overcome these intricacies, we propose to use only the parts of the specification which exhibit the introduced fault [2]. Fortunately, we know where the specification has been mutated.…”

Section: Coping With Large Specificationsmentioning

confidence: 99%

“…This article is a companion paper to [2] and focuses on the comparison of structural and fault-based test purpose design. Unlike to [2] where we present the basic idea of fault-based test purpose design together with first empirical results, this article discusses our novel test case extraction algorithm in detail, classifies our strategies for fault-based test purpose design, and presents new empirical results on the evaluation of so called overlapping test purposes.…”

Section: Introductionmentioning

confidence: 99%

“…Unlike to [2] where we present the basic idea of fault-based test purpose design together with first empirical results, this article discusses our novel test case extraction algorithm in detail, classifies our strategies for fault-based test purpose design, and presents new empirical results on the evaluation of so called overlapping test purposes. Both items were not included in [2]. While [2] extends fault-based test purpose design for specifications with huge state spaces, this paper contains detailed figures about different strategies for our fault-based test purpose design approach.…”

Section: Introductionmentioning

confidence: 99%

“…Both items were not included in [2]. While [2] extends fault-based test purpose design for specifications with huge state spaces, this paper contains detailed figures about different strategies for our fault-based test purpose design approach.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Test purpose generation in an industrial application

Aichernig

Weiglhofer

Peischl

et al. 2007

Proceedings of the 3rd International Workshop on Advances in Model-Based Testing

Self Cite

View full text Add to dashboard Cite

Nowadays test engineers typically use two strategies for the design of test cases. First, test cases are designed related to some kind of structural coverage criteria. Second, test cases are created by having a specific fault model in mind. In this paper we evaluate these two supplementary techniques for test purpose design. We present a heuristic algorithm for the extraction of test cases from tgv's output, i.e., the test process. We discuss the problem of overlapping test purposes and illustrate improvements in terms of test execution time and in terms of number of test cases when minimizing this overlap. Furthermore, we evaluate different strategies for the generation of fault-based test purposes on our specification. For our evaluation, all extracted test cases are executed against a commercial and an open source implementation of a Session Initiation Protocol (SIP) Registrar.

show abstract

Section: Structural Test Purpose Designmentioning

confidence: 99%

“…To overcome these intricacies, we propose to use only the parts of the specification which exhibit the introduced fault [2]. Fortunately, we know where the specification has been mutated.…”

Section: Coping With Large Specificationsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Test purpose generation in an industrial application

Aichernig

Weiglhofer

Peischl

et al. 2007

Proceedings of the 3rd International Workshop on Advances in Model-Based Testing

Self Cite

View full text Add to dashboard Cite

show abstract

Killing strategies for model‐based mutation testing

Aichernig

Brandl

Jöbstl

et al. 2014

Software Testing Verif & Rel

Self Cite

View full text Add to dashboard Cite

Summary This article presents the techniques and results of a novel model‐based test case generation approach that automatically derives test cases from UML state machines. The main contribution of this article is the fully automated fault‐based test case generation technique together with two empirical case studies derived from industrial use cases. Also, an in‐depth evaluation of different fault‐based test case generation strategies on each of the case studies is given and a comparison with plain random testing is conducted. The test case generation methodology supports a wide range of UML constructs and is grounded on the formal semantics of Back's action systems and the well‐known input–output conformance relation. Mutation operators are employed on the level of the specification to insert faults and generate test cases that will reveal the faults inserted. The effectiveness of this approach is shown and it is discussed how to gain a more expressive test suite by combining cheap but undirected random test case generation with the more expensive but directed mutation‐based technique. Finally, an extensive and critical discussion of the lessons learnt is given as well as a future outlook on the general usefulness and practicability of mutation‐based test case generation. Copyright © 2014 John Wiley & Sons, Ltd.

show abstract