Requirements driven falsification with coverage metrics

Dokhanchi, Adel; Zutshi, Aditya; Sriniva, Rahul T.; Sankaranarayanan, Sriram; Fainekos, Georgios

doi:10.1109/emsoft.2015.7318257

Cited by 26 publications

(13 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The static switched system has no dynamics and is included to show that both max and additive semantics can worsen the performance of falsification, compared to falsifying with Boolean semantics. The model is inspired by [43], and it has two inputs (u 1 , u 2 ) ∈ [0, 1] 2 which are kept constant. The model contains 16 blocks in total.…”

Section: Static Switched Systemmentioning

confidence: 99%

Enhancing Temporal Logic Falsification With Specification Transformation and Valued Booleans

Eddeland

Claessen

Smallbone

et al. 2020

IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst.

View full text Add to dashboard Cite

Cyber-Physical Systems (CPSs) are systems with both physical and software components, for example cars and industrial robots. Since these systems exhibit both discrete and continuous dynamics, they are complex and it is thus difficult to verify that they behave as expected. Falsification of temporal logic properties is an approach to find counterexamples to CPSs by means of simulation. In this paper, we propose two additions to enhance the capability of falsification and make it more viable in a large-scale industrial setting. The first addition is a framework for transforming specifications from a signal-based model into Signal Temporal Logic. The second addition is the use of Valued Booleans and an additive robust semantics in the falsification process. We evaluate the performance of the additive robust semantics on a set of benchmark models, and we can see that which semantics are preferable depend both on the model and on the specification. arXiv:1910.08306v1 [eess.SY]

show abstract

Section: Static Switched Systemmentioning

confidence: 99%

Enhancing Temporal Logic Falsification With Specification Transformation and Valued Booleans

Eddeland

Claessen

Smallbone

et al. 2020

IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst.

View full text Add to dashboard Cite

show abstract

“…3) Static Switched (SS) System: The static switched system is a model without any dynamics that is included as a simple case. The model is inspired by [30].…”

Section: B Additional Benchmark Problems 1) Automatic Transmission (At )mentioning

confidence: 99%

Falsifying Cyber-Physical Systems – a Hybrid Optimization-Free and an Optimization-Based Line-Search Approach

Ramezani¹,

Claessen²,

Smallbone³

et al. 2021

Preprint

View full text Add to dashboard Cite

<div>Cyber-physical systems (CPSs) are complex and exhibit both continuous and discrete dynamics, hence it is difficult to guarantee that they satisfy given specifications, i.e., the properties that must be fulfilled by the system. Falsification of temporal logic properties is a testing approach that searches for counterexamples of a given specification, which can be used to increase the confidence that a CPS does fulfill its specifications. Falsification can be done using random search methods or optimization methods. In this paper, a method based on combining random parameters together with considering extreme combinations of parameter values is proposed. Evaluation results on benchmark problems show that this method performs well on many of the problems. Optimization methods are needed when optimization-free methods do not perform well in falsification. The efficiency of the falsification is affected by the optimization methods used to search for inputs that might falsify the specifications. This paper presents a new optimization method for falsification, Line-search falsification, where optimization is done over line segments through a vector of inputs in the n-dimensional parameter space. The evaluation results on the benchmark problems show that using this method improves the falsification performance by reducing the number of simulations necessary to falsify a specification.</div>

show abstract

“…In this case, we sometimes divide the difficulty into small pieces-first get x 1 and x 2 simultaneously at a peak; then get x 3 and x 4 at a peak; finally, try to make them synchronize. Let us introduce formulas ϕ 12 and ϕ 34 such that falsifying them means matching the peak of x 1 , x 2 , and x 3 , x 4 respectively. Decomposing ϕ into ϕ 12 and ϕ 34 might help us in falsification for the following reasons.…”

Section: Example Model 2: Coincidental Sine Wavesmentioning

confidence: 99%

Causality-Aided Falsification

Akazaki

Kumazawa

Hasuo

2017

Electron. Proc. Theor. Comput. Sci.

View full text Add to dashboard Cite

Falsification is drawing attention in quality assurance of heterogeneous systems whose complexities are beyond most verification techniques' scalability. In this paper we introduce the idea of causality aid in falsification: by providing a falsification solver-that relies on stochastic optimization of a certain cost function-with suitable causal information expressed by a Bayesian network, search for a falsifying input value can be efficient. Our experiment results show the idea's viability.

show abstract

Requirements driven falsification with coverage metrics

Cited by 26 publications

References 40 publications

Enhancing Temporal Logic Falsification With Specification Transformation and Valued Booleans

Enhancing Temporal Logic Falsification With Specification Transformation and Valued Booleans

Falsifying Cyber-Physical Systems – a Hybrid Optimization-Free and an Optimization-Based Line-Search Approach

Causality-Aided Falsification

Contact Info

Product

Resources

About