XAI Design Goals and Evaluation Metrics for Space Exploration: A Survey of Human Spaceflight Domain Experts

Barkouki, Tammer; Deng, Ziquan; Karasinski, John; Kong, Zhaodan

doi:10.2514/6.2023-1828

Cited by 2 publications

(2 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…If the autonomous system can explain its actions and reasoning, this can build trust between teammates (Le Vie et al, 2021;Zhang et al, 2021;Faulhaber et al, 2022;Faulhaber et al, 2022). In some cases, the participants preferred explanations that help prevent and mitigate anomalies and provide actionable information to make informed decisions (Barkouki et al, 2023).…”

Section: Recent Hat Empirical Study Literaturementioning

confidence: 99%

See 1 more Smart Citation

Comparison and synthesis of two aerospace case studies to develop human-autonomy teaming requirements

Tokadli

Dorneich

2023

Front. Aerosp. Eng.

View full text Add to dashboard Cite

This paper developed human-autonomy teaming (HAT) characteristics and requirements by comparing and synthesizing two aerospace case studies (Single Pilot Operations/Reduced Crew Operations and Long-Distance Human Space Operations) and the related recent HAT empirical studies. Advances in sensors, machine learning, and machine reasoning have enabled increasingly autonomous system technology to work more closely with human(s), often with decreasing human direction. As increasingly autonomous systems become more capable, their interactions with humans may evolve into a teaming relationship. However, humans and autonomous systems have asymmetric teaming capabilities, which introduces challenges when designing a teaming interaction paradigm in HAT. Additionally, developing requirements for HAT can be challenging for future operations concepts, which are not yet well-defined. Two case studies conducted previously document analysis of past literature and interviews with subject matter experts to develop domain knowledge models and requirements for future operations. Prototype delegation interfaces were developed to perform summative evaluation studies for the case studies. In this paper, a review of recent literature on HAT empirical studies was conducted to augment the document analysis for the case studies. The results of the two case studies and the literature review were compared and synthesized to suggest the common characteristics and requirements for HAT in future aerospace operations. The requirements and characteristics were grouped into categories of team roles, autonomous teammate types, interaction paradigms, and training. For example, human teammates preferred the autonomous teammate to have human-like characteristics (e.g., dialog-based conversation, social skills, and body gestures to provide cue-based information). Even though more work is necessary to verify and validate the requirements for HAT development, the case studies and recent empirical literature enumerate the types of functions and capabilities needed for increasingly autonomous systems to act as a teammate to support future operations.

show abstract

Section: Recent Hat Empirical Study Literaturementioning

confidence: 99%

“…Bi-directional communication is a necessity for effective information exchange. Effective human-like communication can support human teammates' trust when they receive explanations from the autonomous system (Le Vie et al, 2021;Zhang et al, 2021;Faulhaber et al, 2022;Faulhaber et al, 2022;Barkouki et al, 2023).…”

Section: Communication Modalitiesmentioning

confidence: 99%