Bayesian framework for reliability assurance of a deployed safety critical system

Čukić, Bojan; Chakravarthy, D. Gowtham

doi:10.1109/hase.2000.895477

Cited by 14 publications

(11 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The envelopes are usually derived from previous experience (experience envelopes), and known system constraints (system envelopes). If any of the system constraint rules is violated, the violation must be reported and investigated, potentially leading to dismissal in the flight qualification process and redesign [1,14]. Manual development of test cases needed for this type of system assessment is tedious, time consuming and expensive.…”

Section: Introductionmentioning

confidence: 99%

Automated Generation of Test Trajectories for Embedded Flight Control Systems

Čukić

Taylor²,

Singh

2002

Int. J. Soft. Eng. Knowl. Eng.

View full text Add to dashboard Cite

Automated generation of test cases is a prerequisite for fast testing. Whereas the research in automated test data generation addressed the creation of individual test points, test trajectory generation has attracted limited attention. In simple terms, a test trajectory is defined as a series of data points, with each (possibly multidimensional) point relying upon the value(s) of previous point(s). Many embedded systems use data trajectories as inputs, including closed-loop process controllers, robotic manipulators, nuclear monitoring systems, and flight control systems. For these systems, testers can either handcraft test trajectories, use input trajectories from older versions of the system or, perhaps, collect test data in a high fidelity system simulator. While these are valid approaches, they are expensive and time-consuming, especially if the assessment goals require many tests.We developed a framework for expanding a small, conventionally developed set of test trajectories into a large set suitable, for example, for system safety assurance. Statistical regression is the core of this framework. The regression analysis builds a relationship between controllable independent variables and closely correlated dependent variables, which represent test trajectories. By perturbing the independent variables, new test trajectories are generated automatically. Our approach has been applied in the safety assessment of a fault tolerant flight control system. Linear regression, multiple linear regression, and autoregressive techniques are compared. The performance metrics include the speed of test generation and the percentage of "acceptable" trajectories, measured by the domain specific reasonableness checks.

show abstract

Section: Introductionmentioning

confidence: 99%

Automated Generation of Test Trajectories for Embedded Flight Control Systems

Čukić

Taylor²,

Singh

2002

Int. J. Soft. Eng. Knowl. Eng.

View full text Add to dashboard Cite

show abstract

“…The goal of reliability assessment [3] is to determine the failure probability with a predefined confidence. Ammann et al [1,3] devise stopping rules for the testing of software for reliability assessment.…”

Section: Related Workmentioning

confidence: 99%

A Framework for Reliability Assessment of Software Components

Shukla

Strooper

Carrington

2004

Component-Based Software Engineering

View full text Add to dashboard Cite

Abstract. This paper proposes a conceptual framework for the reliability assessment of software components that incorporates test case execution and output evaluation. Determining an operational profile and test output evaluation are two difficult and important problems that must be addressed in such a framework. Determining an operational profile is difficult, because it requires anticipating the future use of the component. An expected result is needed for each test case to evaluate the test result and a test oracle is used to generate these expected results. The framework combines statistical testing and test oracles implemented as self-checking versions of the implementations. The framework is illustrated using two examples that were chosen to identify the issues that must be addressed to provide tool support for the framework.

show abstract

“…The second possibility for improvement is making prior assumptions about the failure probability [6], as presented in later sections. The central question is how much testing should be conducted?…”

Section: Input Domain Based Models: Background and Limitationsmentioning

confidence: 99%

Software reliability corroboration

Smidts

Čukić²,

Günel³

et al.

27th Annual NASA Goddard/Ieee Software Engineering Workshop, 2002. Proceedings.

Self Cite

View full text Add to dashboard Cite

The authors suggest that subjective reliability estimation from the development lifecycle, based on observed behavior or the reflection of one's belief in the system quality, be included in certification. In statistical terms, the authors hypothesize that a system failure occurs with the estimated probability. Presumed reliability needs to be corroborated by statistical testing during the reliability certification phase. As evidence relevant to the hypothesis increases, the authors change the degree of belief in the hypothesis. Depending on the corroboration evidence, the system is either certified or rejected. The advantage of the proposed theory is an economically acceptable number of required system certification tests, even for high assurance systems so far considered impossible to certify.

show abstract

Bayesian framework for reliability assurance of a deployed safety critical system

Cited by 14 publications

References 12 publications

Automated Generation of Test Trajectories for Embedded Flight Control Systems

Automated Generation of Test Trajectories for Embedded Flight Control Systems

A Framework for Reliability Assessment of Software Components

Software reliability corroboration

Contact Info

Product

Resources

About