Mutation-Based Test-Case Generation with Ecdar

Larsen, Kim G.; Lorber, Florian; Nielsen, Brian; Nyman, Ulrik

doi:10.1109/icstw.2017.60

Cited by 17 publications

(14 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The method improves the test execution using the unfolded structure of the original specifications. Larsen et al[290] builds on this work and further improve its efficiency. Zhou et al[291] present a specificationbased mutation approach to test safety-critical systems.…”

mentioning

confidence: 99%

Mutation Testing Advances: An Analysis and Survey

Papadakis

Kintis

Zhang

et al. 2019

Advances in Computers

357

343

View full text Add to dashboard Cite

Mutation testing realises the idea of using artificial defects to support testing activities. Mutation is typically used as a way to evaluate the adequacy of test suites, to guide the generation of test cases and to support experimentation.Mutation has reached a maturity phase and gradually gains popularity both in academia and in industry. This chapter presents a survey of recent advances, over the past decade, related to the fundamental problems of mutation testing and sets out the challenges and open problems for the future development of the method. It also collects advices on best practices related to the use of mutation in empirical studies of software testing. Thus, giving the reader a 'mini-handbook'-style roadmap for the application of mutation testing as experimental methodology.

show abstract

mentioning

confidence: 99%

Mutation Testing Advances: An Analysis and Survey

Papadakis

Kintis

Zhang

et al. 2019

Advances in Computers

357

343

View full text Add to dashboard Cite

show abstract

“…Larsen et al [14] propose to use Ecdar to perform unbounded conformance checks, to provide a significant speed-up compared to [3], and to enable adaptive test-cases, which produce fewer inconclusive test verdicts.…”

Section: Related Workmentioning

confidence: 99%

“…Instead, we apply demonic completion on the test model and angelic completion on the mutants like the approach presented in [14]. This way, traces leading to missing behaviour will transition the test model into the universal location.…”

Section: Test-case Generationmentioning

confidence: 99%

“…We develop a test driver that executes the generated test-cases on an SUT. The test driver implementation is inspired by the algorithm presented by Larsen et al [14].…”

Section: Test Executionmentioning

confidence: 99%

“…One model-based testing technique is Model-Based Mutation Testing (MBMT). It has already been applied to Timed Automata (TA) with simulated time [3,14]. Larsen et al [14] use the model checker Ecdar [6] to perform unbounded conformance checks, to provide a significant speed-up compared to [3], and to enable adaptive test-cases, which produce fewer inconclusive test verdicts.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Effortless Fault Localisation: Conformance Testing of Real-Time Systems in Ecdar

Gundersen

Lorber

Nyman

et al. 2018

Electron. Proc. Theor. Comput. Sci.

Self Cite

View full text Add to dashboard Cite

Model checking of real-time systems has evolved throughout the years. Recently, the model checker Ecdar, using timed I/O automata, was used to perform compositional verification. However, in order to fully integrate model checking of real-time systems into industrial development, we need a productive and reliable way to test if such a system conforms to its corresponding model. Hence, we present an extension of Ecdar that integrates conformance testing into a new IDE that now features modelling, verification, and testing. The new tool uses model-based mutation testing, requiring only the model and the system under test, to locate faults and to prove the absence of certain types of faults. It supports testing using either real-time or simulated time. It parallelises test-case generation and test execution to provide a significant speed-up. We also introduce new mutation operators that improve the ability to detect and locate faults. Finally, we conduct a case study with 140 faulty systems, where Ecdar detects all faults.

show abstract

MUPPAAL: Efficient Elimination and Reduction of Useless Mutants in Real‐Time Model‐Based Systems

Cuartas,

Cortés,

Betancourt

et al. 2024

Software Testing Verif & Rel

View full text Add to dashboard Cite

To assess test quality, mutation testing (MT) creates mutants by injecting artificial faults into the system and evaluates the ability of tests to distinguish these mutants. Tests distinguishing more mutants have also been proven empirically to detect more real faults. MT has been applied to many domains. We focus on MT for timed safety‐critical systems modelled as Timed Automata (TA). While powerful, MT usually yields equivalent and duplicate mutants, the former having the same behaviour as the original system and the latter other mutants. Such useless mutants bring no value, waste execution time and can be difficult to detect. We integrate useless mutant detection and removal strategies in our mutation framework MUPPAAL. MUPPAAL leverages existing equivalence‐avoiding mutation operators and focuses on detecting mutant duplicates using a scalable bisimulation algorithm and a fast approximate one based on biased simulation. We also demonstrate how to design an operator that reduces the occurrence of mutant duplicates. We evaluate MUPPAAL on six systems, demonstrating that (1) mutant duplicates account for up to 32% of all generated mutants, (2) our bisimulation approach scales effectively with these systems and (3) biased simulations further enhance performance. Our heuristic is 10 times faster than bisimulation and limits the exploration to two times the number of exact duplicates compared to up to 10 times for the baseline.

show abstract

Mutation-Based Test-Case Generation with Ecdar

Cited by 17 publications

References 23 publications

Mutation Testing Advances: An Analysis and Survey

Mutation Testing Advances: An Analysis and Survey

Effortless Fault Localisation: Conformance Testing of Real-Time Systems in Ecdar

MUPPAAL: Efficient Elimination and Reduction of Useless Mutants in Real‐Time Model‐Based Systems

Contact Info

Product

Resources

About