Online testing with model programs

Veanes, Margus; Campbell, Colin; Schulte, Wolfram; Tillmann, Nikolai

doi:10.1145/1081706.1081751

Cited by 47 publications

(41 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…I do not claim that research into model driven testing from finite-state models would be useless in general, especially as there exist case studies that prove otherwise [21]. However, our experience is that the number of industrial systems that have natural finite-state specifications is limited.…”

Section: Challengementioning

confidence: 98%

See 1 more Smart Citation

Implementing Conformiq Qtronic

Huima¹

2007

Testing of Software and Communicating Systems

View full text Add to dashboard Cite

Abstract. Conformiq Qtronic1 is a commercial tool for model driven testing. It derives tests automatically from behavioral system models. These are black-box tests [1] by nature, which means that they depend on the model and the interfaces of the system under test, but not on the internal structure (e.g. source code) of the implementation.In this essay, which accompanies my invited talk, I survey the nature of Conformiq Qtronic, the main implementation challenges that we have encountered and how we have approached them. Problem StatementConformiq Qtronic is an ongoing attempt to provide an industrially applicable solution to the following technical problem: Create an automatic method that provided an object (a model) M that describes the external behavior of an open system (begin interpreted via well-defined semantics) constructs a strategy to test real-life black-box systems (implementations) I in order to find out if they have the same external behavior as M .(Now the fact that we have created a company with the mission to solve this technical problem hints that we believe it to be a good idea to employ automatic methods of this kind in actual software development processes-which is not a priori self-evident. In this essay, however, I will not touch these commercial and methodological issues, but will concentrate on the technical problem only.)Two notes are due, and the first concerns the test harness. It is namely usually so that the model M describes a system with different interfaces and behavior than the real implementation that is being tested (iut, implementation under test). Virtually always, the model M is somehow described on a higher level of abstraction than the real implementation. As a concrete example, sip (Session Initiation Protocol) [2] is a packet-oriented protocol that is run over a transport (e.g. udp [3]) and that has an ascii encoding: every sip packet is encoded as a series of ascii characters. However, some possible model M for testing an sip implementation could define the logical flow of packets with their main contents but not describe, for instance, their actual encoding. How can this model M be used to test a real sip implementation that requires ascii encoded packets over udp? The answer is that the "abstract" tests generated automatically from 1 www.conformiq.com A.

show abstract

Section: Challengementioning

confidence: 98%

“…In contrast, the online algorithm can adapt to the already observed responses of the system under test, and choose the next test steps completely dynamically. [21,33] Challenge:…”

Section: Challengementioning

confidence: 99%

Implementing Conformiq Qtronic

Huima¹

2007

Testing of Software and Communicating Systems

View full text Add to dashboard Cite

show abstract

“…An online testing approach has been also proposed in [26], where testing of reactive systems is seen as a game between the tester and the IUT. The conformance between a IUT and its operational specification is given in terms of alternating simulation.…”

Section: Comparison With Ltsmentioning

confidence: 99%

Online Testing of LTL Properties for Java Code

Arcaini

Gargantini

Riccobene

2013

Hardware and Software: Verification and Testing

View full text Add to dashboard Cite

Abstract. LTL specifications are commonly used in runtime verification to describe the requirements about the system behavior. Efficient techniques derive, from LTL specifications, monitors that can check if system executions respect these properties. In this paper we present an online testing approach which is based on LTL properties of Java programs. We present an algorithm able to derive and execute test cases from monitors for LTL specifications. Our technique actively tests a Java class, avoids false failures, and it is able to check the correctness of the outputs also in the presence of nondeterminism. We devise several coverage criteria and strategies for visiting the monitors, providing different qualities in terms of test size, testing time, and fault detection capability.

show abstract

“…More about model-based testing applications and further motivation for the composition of model programs can be found in [4,8,17,16]. The most recent work related to model programs where composition is discussed from a practical perspective is the forthcoming textbook [11].…”

Section: Conclusion and Related Workmentioning

confidence: 99%

“…They are used in industrial tools like SpecExplorer [1] as a compact, expressive and precise way to specify complex behavior. Model programs are unwound into transition systems that can be used in model-based testing, for runtime conformance checking of a system under test, and for design validation [4,15,16,17].…”

Section: Introductionmentioning

confidence: 99%

Composition of Model Programs

Veanes

Campbell²,

Schulte

2007

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Abstract. Model programs are a useful formalism for software testing and design analysis. They are used in industrial tools, such as SpecExplorer, as a compact, expressive and precise way to specify complex behavior. One of the challenges with model programs has been the difficulty to separate contract modeling from scenario modeling. It has not been clear how to separate those concerns in a clean way. In this paper we introduce composition of model programs, motivate why it is useful to be able to compose model programs, and what composition of model programs formally means.

show abstract

Online testing with model programs

Cited by 47 publications

References 11 publications

Implementing Conformiq Qtronic

Implementing Conformiq Qtronic

Online Testing of LTL Properties for Java Code

Composition of Model Programs

Contact Info

Product

Resources

About