Tool support for statistical testing of software components

Abstract

We describe the " STSC" prototype

A passive test oracle using a component's API

“…This work contributes to a larger project on testing that aims to develop a framework and tool support for the statistical testing of software components [15,16], including a method for operational profile development [14].…”

“…This means that these two oracles to slightly more checking than the API oracle, but this additional checking resulted in only 12 additional lines in SymbolTable and 28 additional lines in Forest. To compare the fault-detection ability of these test oracles, we use the MuJava tool [8] for fault-seeding and the STSC tool [16] for test case generation, test case execution and test output evaluation.…”

“…The SymbolOracle contains the wrapper methods that have the same signatures as in SymbolTable, except that the oracle methods do not signal any exceptions. While the method can easily be extended to deal with exceptions, the oracles described in this paper were developed in the context of research on statistical testing [16]. In this work, components are tested according to the expected use of the component in an application, and as such we do not expect that any calls should signal an exception.…”

A Framework for Statistical Testing of Software Components

“…In this paper, we present a framework and tool support for the statistical testing of software components [5,6], including a method for operational profile development [7]. The goals of this paper are to:…”

Test orales for systems with complex outputs: the case of TTS systems

“…It is often said that active oracles directly drive their own testing activities reproducing the SUT behavior and generating expected outputs (MCDONALD; HOFFMAN;STROOPER, 1998;MCDONALD;HOFFMAN, 2003;MILLER;STROOPER, 2003;SHUKLA;CARRINGTON, 2005). Contrary to this premise, passive oracles act as simple comparators between current and expected test results.…”