Test tool qualification through fault injection

Wang, Q.; Wallin, Andreas; Izosimov, Viacheslav; Ingelsson, Urban; Peng, Zebo

doi:10.1109/ets.2012.6233042

Cited by 2 publications

(7 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We use fault injection experiments to semi-automatically perform verification and validation on the monitor [16]. In these experiments, we inject faults into the testing tool and thereby measure the monitor's ability to detect unexpected behavior in the testing tool.…”

Section: Testing Tool Qualificationmentioning

confidence: 99%

“…In this case, the fault injection experiments must be adjusted. In [16] we describe a semi-automatic procedure for adjusting the fault injection experiments. In the third case, the monitor is able to detect all injected faults and no change to the monitor is required.…”

Section: Testing Tool Qualificationmentioning

confidence: 99%

“…Consequently, qualification of a HIL platform is a challenge. In our previous work in [16] and [17], a testing tool qualification method for HIL platforms is presented to reduce the qualification effort. The method includes a monitor and fault injection.…”

Section: Prior Workmentioning

confidence: 99%

“…However, automation requires extra effort with respect to tool qualification. In [16], a testing tool qualification method was presented, with a monitor to detect testing tool malfunction and fault injection into the testing tool to evaluate the capability of the monitor to detect malfunctions. The method is semi-automatic and reduces the effort for tool qualification as is described in the following case study.…”

Section: Verification and Validationmentioning

confidence: 99%

“…The method includes a monitor and fault injection. Our work in [16] and [17] focus on development of a semiautomatic qualification process for the HIL tool, while we do not consider traceability and testability of the Item requirements and within the HIL tool.The papers listed above have identified the need for a best practice and the need to develop and qualify tools. Previous papers on ISO 26262 have not discussed requirements traceability of safety-critical systems in the context of decomposition, nor for verification and validation.…”

mentioning

confidence: 99%

See 4 more Smart Citations

Requirement Decomposition and Testability in Development of Safety-Critical Automotive Components,

Izosimov

Ingelsson

Wallin

2012

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract.12 ISO26262 is a recently approved standard for functional safety in road vehicles. It provides guidelines on minimization of unreasonable safety risks during development of embedded systems in road vehicles. However, the development process specified in ISO26262 involves a number of steps that will require changing traditional and well established development processes. In a transition phase, however, due to lack of tool support, the steps may be performed manually, increasing the risk for delays and increased cost. This paper describes a case study in which we have successfully worked with traceability and testability of functional safety requirements, as well as safety requirements assigned to a testing tool that automates integration and verification steps, leading to standard-compliant tool qualification. Our tool qualification method employs fault injection as a validation method to increase confidence in the tool. Our case study will help to avoid many of the new pitfalls that can arise when attempting to realize standard-compliant development. IntroductionIndustry and academia struggle to improve safety of road vehicles. considering the severity and probability for each hazard, as well as a driver's ability to compensate (controllability). For high ASIL items, the standard requires stringent measures for risk minimization. In contrast to IEC61508, besides many other aspects, ISO26262 imposes qualification requirements on software tools used in the development process, which also includes verification and validation tools. While tools exist, they may not have been qualified or developed considering safety requirements. Consequently, to be ISO26262-compliant, existing tools must be qualified, and in each future version, re-qualified. Similar to IEC 61508, ISO26262 allows decomposition of high ASIL safety requirements, using two same-or-lower ASIL requirements and redundancy, monitoring or other safety-enhancing concept. Since development to a lower ASIL typically requires less effort, decomposition is an attractive possibility. However, the decomposition must be implemented by independent components and affects the system architecture. To demonstrate fulfillment of the original requirements, there shall be traceability to and from the decomposed requirements. As seen from above, ISO26262-compliant development include specification of safety requirement (including determination of ASIL), decomposition of safety requirements, requirement traceability and testability, qualification of software tools, verification and validation. This paper provides an example of how these steps can be performed. The aim is to help minimize pitfalls in transition to ISO26262.The next section reviews prior work. Section 3 presents requirements elicitation and traceability. Section 4 discusses testability, leading up to Section 5 which is about testing tool qualification. Section 6 presents a verification and validation strategy. These concepts are illustrated in a case study in Section 7. present a reference development...

show abstract

Section: Testing Tool Qualificationmentioning

confidence: 99%

Section: Testing Tool Qualificationmentioning

confidence: 99%

Section: Prior Workmentioning

confidence: 99%

Section: Verification and Validationmentioning

confidence: 99%

mentioning

confidence: 99%

See 3 more Smart Citations

Requirement Decomposition and Testability in Development of Safety-Critical Automotive Components,

Izosimov

Ingelsson

Wallin

2012

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

Quality assuring the quality assurance tool: applying safety-critical concepts to test framework development

Thörn¹,

Strandberg

Sundmark

et al. 2022

PeerJ Computer Science

View full text Add to dashboard Cite

The quality of embedded systems is demonstrated by the performed tests. The quality of such tests is often dependent on the quality of one or more testing tools, especially in automated testing. Test automation is also central to the success of agile development. It is thus critical to ensure the quality of testing tools. This work explores how industries with agile processes can learn from safety-critical system development with regards to the quality assurance of the test framework development. Safety-critical systems typically need adherence to safety standards that often suggests substantial upfront documentation, plans and a long-term perspective on several development aspects. In contrast, agile approaches focus on quick adaptation, evolving software and incremental deliveries. This article identifies several approaches of quality assurance of software development tools in functional safety development and agile development. The extracted approaches are further analyzed and processed into candidate solutions, i.e., principles and practices for the test framework quality assurance applicable in an industrial context. An industrial focus group with experienced practitioners further validated the candidate solutions through moderated group discussions. The two main contributions from this study are: (i) 48 approaches and 25 derived candidate solutions for test framework quality assurance in four categories (development, analysis, run-time measures, and validation and verification) with related insights, e.g., a test framework should be perceived as a tool-chain and not a single tool, (ii) the perceived value of the candidate solutions in industry as collected from the focus group.

show abstract

Test tool qualification through fault injection

Cited by 2 publications

References 1 publication

Requirement Decomposition and Testability in Development of Safety-Critical Automotive Components,

Requirement Decomposition and Testability in Development of Safety-Critical Automotive Components,

Quality assuring the quality assurance tool: applying safety-critical concepts to test framework development

Contact Info

Product

Resources

About