A practical model‐based statistical approach for generating functional test cases: application in the automotive industry

Abstract

SUMMARYWith the growing complexity of industrial software applications, industrials are looking for efficient and practical methods to validate the software. This paper develops a model‐based statistical testing approach that automatically generates online and offline test cases for embedded software. It discusses an integrated framework that combines solutions for three major software testing research questions: (i) how to select test inputs; (ii) how to predict the expected results of a test; and (iii) when to stop testing software. The automatic selection of test inputs is based on a stochastic test model that accounts for the main particularity of embedded software: time sensitivity. Software test practitioners may design one or more test models when they generate random, user‐oriented, or fault‐oriented test inputs. A formal framework integrating existing and appropriate specification techniques was developed for the design of automated test oracles (executable software specifications) and the formal measurement of functional coverage. The decision to stop testing software is based on both test coverage objectives and cost constraints. This approach was tested on two representative case studies from the automotive industry. The experiment was performed at unit testing level in a simulated environment on a host personal computer (automatic test execution). The two software functionalities tested had previously been unit tested and validated using the test design approach conventionally used in the industry. Applying the proposed model‐based statistical testing approach to these two case studies, we obtained significant improvements in performing functional unit testing in a real and complex industrial context: more bugs were detected earlier and in a shorter time. Copyright © 2012 John Wiley & Sons, Ltd.

Functional Requirement-Based Test Case Prioritization in Regression Testing: A Systematic Literature Review

“…Awedikian and Yannou [94] proposed the model-based integrated statistical approach to generate automated functional test cases. Both quality, and cost objectives have been addressed by the proposed approach.…”

An Effective Verification Strategy for Testing Distributed Automotive Embedded Software Functions: A Case Study

“…A single fault could potentially cause devastating consequences [12]. As a result, about 50% of the total time spent on management and technical activities of automotive development is dedicated to software testing [13]. In the automotive industry, the standard V-model is most widely used for the engineering processes of embedded software development [13].…”

“…As a result, about 50% of the total time spent on management and technical activities of automotive development is dedicated to software testing [13]. In the automotive industry, the standard V-model is most widely used for the engineering processes of embedded software development [13]. A typical V-model implemented by Scania [4], a major manufacturer of commercial heavy vehicles in the European automotive industry, can be seen in Figure 1.1.…”

“…The standard V-model is most widely used in the automobile industry for the engineering processes of system software development [13]. Therefore, it can be inferred that the automotive system software testing generally takes place at several test levels across the right side of such a V-model.…”

Usefulness Simulation of Design Concepts

“…These probabilistic simulations provide valuable information to designers allowing them to tune design parameters and thus to respond adequately to the market demands. The probabilistic simulations can also be used by performing queries from an intelligent database generating relevant test vectors in software testing domain (see for instance [54]). This database is supposed to capture and render chunks of reality weighed by their importance (like test vectors associated with a high probability to generate a software bug).…”