Building high assurance human-centric decision systems

Heitmeyer, Constance L.; Pickett, Marc; Leonard, Elizabeth I.; Archer, Myla; Ray, Indrakshi; Aha, David W.; Trafton, J. Gregory

doi:10.1007/s10515-014-0157-z

Cited by 12 publications

(7 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, a cognitive model predicts human behavior and an adaptive agent assists the individual (e.g., formal modeling and analysis). Heitmeyer et al (2015) propose using Event Sequence Charts, a kind of Message Sequence Chart, and a Mode Diagram to represent system modes and transitions. It also provides outcomes from a new pilot study that analyzed the agent design utilizing synthesized user models.…”

Section: Schmidt Defined "Interactive Human Centered Artificialmentioning

confidence: 99%

Human-Centered Artificial Intelligence, a review

Domfeh¹

2022

Preprint

View full text Add to dashboard Cite

show abstract

Section: Schmidt Defined "Interactive Human Centered Artificialmentioning

confidence: 99%

Human-Centered Artificial Intelligence, a review

Domfeh¹

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…If there exists a concrete execution violating prop contained in  , feasible is set to true, and the witness concrete execution stored in variable t (Π ′ is undefined in this case). Then, as feasible is true, LPA-SCR returns the execution t witnessing that prop does not hold in Spec (lines [13][14][15]. Otherwise, if  is spurious, solve sets feasible to false and returns in Π ′ a mapping with the predicates needed to get rid of the spurious execution.…”

Section: Scr Abstraction Algorithmmentioning

confidence: 99%

“…Software cost reduction has been successfully used for eliciting the requirements of many safety critical applications, including an aircraft's operational flight program , a submarine's communications system , the control software of a nuclear power plant , among others . It has also been used as part of a process for developing human‐centric decision systems and as part of an approach to the development of trustworthy autonomous systems and to derive event‐based transition systems from goal‐oriented requirements models . In addition, several tools supporting automated analysis of SCR specifications have been developed, most notably the toolset introduced by Heitmeyer et al , which performs type checking, consistency checking (no contradictory requirements, no missing cases, etc), simulation of user provided scenarios, and other analysis tasks.…”

Section: Introductionmentioning

confidence: 99%

Improving lazy abstraction for SCR specifications through constraint relaxation

Degiovanni

Aguirre

Frias

2018

Software Testing Verif & Rel

View full text Add to dashboard Cite

Summary Formal requirements specifications, eg, software cost reduction (SCR) specifications, are challenging to analyse using automated techniques such as model checking. Since such specifications are meant to capture requirements, they tend to refer to real‐world magnitudes often characterized through variables over large domains. At the same time, they feature a high degree of nondeterminism, as opposed to other analysis contexts such as (sequential) program verification. This makes model checking of SCR specifications difficult even for symbolic approaches. Moreover, automated abstraction refinement techniques such as counterexample guided abstraction refinement fail in many cases in this context, since the concrete state space is typically large, and reaching specific states of interest may require complex executions involving many different states, causing these approaches to perform many abstraction refinements, and making them ineffective in practice. In this paper, an approach to tackle the above situation, through a 2‐stage abstraction, is presented. The specification is first relaxed, by disregarding the constraints imposed in the specification by physical laws or by the environment, before being fed to a counterexample guided abstraction refinement procedure, tailored to SCR. By relaxing the original specification, shorter spurious counterexamples are produced, favouring the abstraction refinement through the introduction of fewer abstraction predicates. Then, when a counterexample is concretizable with respect to the relaxed (concrete) specification but it is spurious with respect to the original specification, an efficient though incomplete refinement step is applied to the constraints, to cause the removal of the spurious case. This approach is experimentally assessed, comparing it with related techniques in the verification of properties and in automated test case generation, using various SCR specifications drawn from the literature as case studies. The experiments show that this new approach runs faster and scales better to larger, more complex specifications than related techniques.

show abstract

“…And about operational trust they use powerful simulation based on these models and also evocate model checking to validate human-machine interaction. For this, they have developed an approach in which cognitive models predict human behaviour ( [16]).…”

Section: Other Workmentioning

confidence: 99%

Formal Methods for Safe Design of Autonomous Systems Dedicated to Risk Management

Coudert¹,

Tanzi²

2017

IFIP Advances in Information and Communication Technology

View full text Add to dashboard Cite

A new generation of Autonomous systems (UAVs, ROVERs, etc.) is coming that will help improve the situational awareness and assessment, especially in difficult conditions like disasters. Rescuers should be relieved from time-consuming data collection tasks as much as possible and at the same time, Autonomous systems should assist data collection through a more insightful and automated guidance thanks to advanced sensing capabilities. In order to achieve this vision, two challenges must be addressed though. The first one is to achieve a sufficient autonomy. The second one relates to the reliability with respect to accidental (safety) or even malicious (security) risks. This however requires the design of new embedded architectures to be more autonomous, while mitigating the harm they may potentially cause. Increased complexity and flexibility requires resorting to modelling, simulation and formal verification techniques in order to validate such critical aspects.

show abstract

Building high assurance human-centric decision systems

Cited by 12 publications

References 31 publications

Human-Centered Artificial Intelligence, a review

Human-Centered Artificial Intelligence, a review

Improving lazy abstraction for SCR specifications through constraint relaxation

Formal Methods for Safe Design of Autonomous Systems Dedicated to Risk Management

Contact Info

Product

Resources

About