Test generation for model based fieldbus profiles

Magnus, Stephan; Krause, Jan; Diedrich, Christian

doi:10.1109/icit.2012.6210017

Cited by 3 publications

(6 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As model‐driven development is popular in the industrial automation domain , several model‐based test case generation approaches for PLC programs have been proposed . Enoiu et al proposed model‐based test suite generation for FBD programs.…”

Section: Related Workmentioning

confidence: 99%

“…Test cases are generated only when test specifications are manually described. Magnus et al introduced a model‐based procedure of automatic test generation for fieldbus profile specification. Their tool transfers a UML state machine, capturing dynamic specifications of function blocks, into a special Petri net dialect and generates test cases with the round‐trip path coverage criterion.…”

Section: Related Workmentioning

confidence: 99%

“…All model‐driven techniques share the common aspect that they generate test cases from models with respect to specific goals such as coverage achievement and test requirements. Unlike other approaches , the proposed technique works directly on FBD programs without relying on intermediate models (e.g., UML, timed automata, or special Petri net dialect models). In addition to intuitive and straightforward coverage analysis, this work provides thorough analysis of the fault‐detection effectiveness of generated test suites, whereas none of the aforementioned studies do.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Automated test case generation for FBD programs implementing reactor protection system software

Jee

Shin

Cha

et al. 2014

Software Testing Verif & Rel

View full text Add to dashboard Cite

Automated and effective testing for function block diagram (FBD) programs has become an important issue, as FBD is increasingly used in implementing safety-critical systems. This work describes an automated test case generation technique for FBD programs and its associated tool-FBDTester. Given an FBD program and desired test coverage criteria, FBDTester generates test requirements and invokes the Satisfiability Modulo Theories solver iteratively to derive a set of test cases. An industrial case study using reactor protection system software shows that the automatically generated test suites detected at least 82% of the known faults, whereas manually generated test cases only detected approximately 35%. Mutation analysis revealed that the automatically generated test suites substantially outperformed manually generated ones. Although test sequence generation requires some manual effort in the current FBDTester, it is apparent that the proposed approach significantly improves the efficiency and the reliability of FBD testing. AUTOMATED TEST CASE GENERATION FOR FBD PROGRAMS 609 A real-world industrial case study was conducted using trip (shutdown) modules of the bistable processor (BP) of reactor protection systems developed in the Korea Nuclear Instrumentation and Control System R&D Center project. Test cases were manually generated by FBD testing professionals, taking nearly three man-months to generate test cases for the BP system. In the case study, test cases automatically generated by the FBDTester are compared with respect to fault detection capability using real faults detected in development. In addition, mutation analysis was also performed to compare effectiveness against a large number of artificial errors (i.e., mutants).The manually generated test cases only detected approximately 35% of the faults revealed in the preliminary version of the BP systems. The application of other techniques (e.g., model checking) detected the rest. Using the FBDTester, however, at least 82% of known faults in various modules were detected. In mutation analysis, the FBDTester also outperformed the manually generated test cases in almost all configurations. It is highly expected that the proposed approach could improve the efficiency and the reliability of FBD testing significantly.This paper is organized as follows. Section 2 explains FBD test coverage criteria as background for the study and Section 3 presents a literature survey of the most relevant research. A test case generation technique and an automated tool for FBD programs are described in Section 4. Section 5 reports the results of the KNICS BP case study and presents an evaluation of the proposed approach. The paper is concluded in Section 6.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Automated test case generation for FBD programs implementing reactor protection system software

Jee

Shin

Cha

et al. 2014

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…As model-driven development is popular in the industrial automation domain [38,39], several model-based test case generation approaches for PLC programs have been proposed [4][5][6][40][41][42][43][44][45]. Enoiu et al [6,40] proposed a model-based test suite generation for FBD programs.…”

Section: Test Generation For Fbd Programsmentioning

confidence: 99%

“…Unlike other works [4][5][6][40][41][42][43][44][45], Jee et al [7] and Song et al [8] developed test generation techniques that work directly on FBD programs without relying on intermediate models. FBDTester (from Jee et al [7]) and FBDTester 2.0 (from Song et al [8]) use FBD-specific structural coverage criteria-specifically, Basic Coverage (BC), Input Condition Coverage (ICC) and Complex Condition Coverage (CCC)-to automatically generate test suites.…”

Section: Test Generation For Fbd Programsmentioning

confidence: 99%

MuFBDTester: A mutation‐based test sequence generator for FBD programs implementing nuclear power plant software

Liu

Jee

Bae

2022

Software Testing Verif & Rel

View full text Add to dashboard Cite

Summary Function block diagram (FBD) is a standard programming language for programmable logic controllers (PLCs). PLCs have been widely used to develop safety‐critical systems such as nuclear reactor protection systems. It is crucial to test FBD programs for such systems effectively. This paper presents an automated test sequence generation approach using mutation testing techniques for FBD programs and the developed tool, MuFBDTester. Given an FBD program, MuFBDTester analyses the program and generates mutated programs based on mutation operators. MuFBDTester translates the given program and mutants into the input language of a satisfiability modulo theories (SMT) solver to derive a set of test sequences. The primary objective is to find the test data that can distinguish between the results of the given program and mutants. We conducted experiments with several examples including real industrial cases to evaluate the effectiveness and efficiency of our approach. With the control of test size, the results indicated that the mutation‐based test suites were statistically more effective at revealing artificial faults than structural coverage‐based test suites. Furthermore, the mutation‐based test suites detected more reproduced faults, found in industrial programs, than structural coverage‐based test suites. Compared to structural coverage‐based test generation time, the time required by MuFBDTester to generate one test sequence from industrial programs is approximately 1.3 times longer; however, it is considered to be worth paying the price for high effectiveness. Using MuFBDTester, the manual effort of creating test suites was significantly reduced from days to minutes due to automated test generation. MuFBDTester can provide highly effective test suites for FBD engineers.

show abstract

Test methodology for virtual commissioning based on behaviour simulation of production systems

Sub

Magnus

Thron

et al. 2016

2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA)

View full text Add to dashboard Cite

Test generation for model based fieldbus profiles

Cited by 3 publications

References 3 publications

Automated test case generation for FBD programs implementing reactor protection system software

Automated test case generation for FBD programs implementing reactor protection system software

MuFBDTester: A mutation‐based test sequence generator for FBD programs implementing nuclear power plant software

Test methodology for virtual commissioning based on behaviour simulation of production systems

Contact Info

Product

Resources

About