Properties of the Utility of Verification

Salado, Alejandro; Kannan, Hanumanthrao

doi:10.1109/syseng.2018.8544446

Cited by 19 publications

(25 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Rigidity also results from personal biases within the team, in which personal conflicts may overemphasize or undermine the beliefs of certain people on the team . Furthermore, curiosity seems to play a role in information collection activities, where the engineer's desire to close an information gap conflicts with the actual value of that information . Therefore, the scientific understanding of verification in systems engineering can be significantly enhanced by looking at the confounding effects of the individual engineer's mental models, the constraints and patterns informed by existing system development artifacts, and the interactions among various engineers.…”

Section: Discussionmentioning

confidence: 99%

“…Our position is affirmative and we have identified in the literature review section several cases where BNs seem to have been effective. More formally, we have also discussed how Belief graphs provide the necessary mathematical conditions to capture how engineers reason about planned verification and verification evidence to update their beliefs as a system development evolves, as we have discussed in more detail in prior work On quantifying beliefs : Although we have presented Bayesian analysis as the framework to quantify and operate with beliefs, the proposed elemental patterns are not limited to build BNs.…”

Section: Elemental Patterns To Form Verification Strategy Modelsmentioning

confidence: 99%

“…A “verification activity,” which usually takes the form of analysis, inspection, or test, is understood to be the collection of information about a specific aspect of the system under development (for simplicity, we will call this a system parameter) and “verification evidence” refers to such information. Because all models are wrong but some are useful and not every aspect of a system can be verified, verification activities are critical to system development because they shape the uncertainty associated with the functioning or performance of the system that is being developed . Therefore, a verification strategy has a direct effect on the expected utility of the system under development …”

Section: Introductionmentioning

confidence: 99%

“…Because all models are wrong but some are useful and not every aspect of a system can be verified, verification activities are critical to system development because they shape the uncertainty associated with the functioning or performance of the system that is being developed . Therefore, a verification strategy has a direct effect on the expected utility of the system under development …”

Section: Introductionmentioning

confidence: 99%

“…The primary focus of this paper is the formalization of modeling of verification strategies. Prior work by the authors addressed mathematical aspects of such modeling . This paper proposes seven elemental patterns of verification strategies.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Elemental patterns of verification strategies

Salado

Kannan

2019

Systems Engineering

Self Cite

View full text Add to dashboard Cite

This paper proposes a set of seven elemental patterns of verification strategies. These patterns can be useful in modeling verification strategies in a wide range of engineered systems. They form the building blocks under which any verification strategy can be modeled. The patterns lead to a fundamental understanding of the interplay between system parameters and verification activities, as well as an understanding of the mechanisms by which verification evidence builds up. For each pattern, we provide a description and a few examples of its application. A few important theoretical properties of the corresponding set of patterns are discussed, such as belief update, inferential properties, and graph disconnection, as well as some practical guidance to be taken into account when applying them to authentic verification problems. These patterns are intended to be a useful tool for researchers, practitioners, and educators, by formalizing the application of Bayesian networks to verification problems, hence facilitating instruction and communication among verification engineers and with researchers from other domains, particularly statisticians and Bayesian analysts.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Elemental Patterns To Form Verification Strategy Modelsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Elemental patterns of verification strategies

Salado

Kannan

2019

Systems Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

A Concept for Set‐based Design of Verification Strategies

Xu¹,

Salado²

2023

INSIGHT

View full text Add to dashboard Cite

In current practice, a verification strategy is defined at the beginning of an acquisition program and is agreed upon by customer and contractor at contract signature. Hence, the resources necessary to execute verification activities at various stages of the system development are allocated and committed at the beginning, when a small amount of knowledge about the system is available. However, contractually committing to a fixed verification strategy at the beginning of an acquisition program fundamentally leads to suboptimal acquisition performance. Essentially, the uncertain nature of system development will make verification activities that were not previously planned necessary and will make some of the planned ones unnecessary. To cope with these challenges, this paper presents an approach to apply set‐based design to the design of verification activities to enable the execution of dynamic contracts for verification strategies, ultimately resulting in more valuable verification strategies than current practice.

show abstract

A Concept for Set‐based Design of Verification Strategies

Salado

2019

INCOSE International Symp

Self Cite

View full text Add to dashboard Cite

In current practice, a verification strategy is defined at the beginning of an acquisition program and is agreed upon by customer and contractor at contract signature. Hence, the resources necessary to execute verification activities at various stages of the system development are allocated and committed at the beginning, when a small amount of knowledge about the system is available. However, contractually committing to a fixed verification strategy at the beginning of an acquisition program fundamentally leads to suboptimal acquisition performance. Essentially, the uncertain nature of system development will make verification activities that were not previously planned necessary, and will make some of the planned ones unnecessary. In order to cope with these challenges, this paper presents an approach to apply set‐based design to the design of verification activities to enable the execution of dynamic contracts for verification strategies, ultimately resulting in more valuable verification strategies than current practice.

show abstract

Properties of the Utility of Verification

Cited by 19 publications

References 19 publications

Elemental patterns of verification strategies

Elemental patterns of verification strategies

A Concept for Set‐based Design of Verification Strategies

A Concept for Set‐based Design of Verification Strategies

Contact Info

Product

Resources

About