MoMut::UML Model-Based Mutation Testing for UML

Abstract

Model-based mutation testing (MBMT) is a promising testing methodology that relies on a model of the system under test (SUT) to create test cases. Hence, MBMT is a socalled black-box testing approach. It also is fault based, as it creates test cases that are guaranteed to reveal certain faults: after inserting a fault into the model of the SUT, it looks for a test case revealing this fault. This turns MBMT into one of the most powerful and versatile test case generation approaches available as its tests are able to demonstrate the absence of certain faults, can achieve both, control-flow and data-flow coverage of model elements, and also may include information about the behaviour in the failure case. The latter becomes handy whenever the test execution framework is bound in the number of observations it can make and -as a consequence -has to restrict them. However, this versatility comes at a price: MBMT is computationally expensive. The tool MoMuT::UML 1 is the result of a multi-year research effort to bring MBMT from the academic drawing board to industrial use. In this paper we present the current stable version, share the lessons learnt when applying two generations of MoMuT::UML in an industrial setting, and give an outlook on the upcoming, third, generation.

Using mutation to design tests for aspect-oriented models

“…Mutation operators have also been defined for modeling languages such as finite state machines [8,18,26], state charts [32,52], Petri nets [17], and timed automata [44]. Mutation operators for models focus on the modeling elements and can do things like remove an element or change the target node for an edge.…”

“…SSI replaces each send with a receive and each receive with a send at synchronization events on edge introductions 8. DAI deletes each action at edge introductions [32] 9. RAI replaces each action at edge introductions by other actions [32] 10.…”

“…DAI deletes each action at edge introductions [32] 9. RAI replaces each action at edge introductions by other actions [32] 10. DIN deletes each invariant at node introductions 11.…”

Model-Based Testing of Stateful APIs with Modbat

“…Like in ModelJUnit [1], Modbat's models are based on extended finitestate machines (EFSMs). Yet there is a wide range of different modeling approaches used by different tools, for example, RTTester [20] and MoMuT::UML [21] use UML, T-VEC [22] uses models from Simulink, LOTOS, timed automata, etc. Furthermore, TTCN-3 is a popular testing language to model communication systems and protocols, and it is supported by various tools [23].…”

Applying Mutation Testing for Assessing Test Suites Quality at Model Level

“…Relevant to this research are mainly papers describing application of mutation testing to UML and OCL based models [1], [2], [14], [16] and papers providing information that can help to design mutation operators applicable to UML and OCL. The set of UML/OCL related mutation operators introduced by the author in [17] was developed based on the fault taxonomy for UML [9], traditional mutation operators, operators adapted from other formalisms [8], [15] and operators defined for specifications [5], [12] and contracts [12] and was supplemented with five new OCL-specific operators.…”