Don't Just Swipe Left, Tell Me Why

Beltrán, Juan Felipe; Huang, Ziqi; Abouzied, Azza; Nandi, Arnab

doi:10.1145/3025171.3025212

Cited by 4 publications

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Toward Foraging for Understanding of StarCraft Agents

Penney

Dodge

Hilderbrand

et al. 2018

23rd International Conference on Intelligent User Interfaces

View full text Add to dashboard Cite

Assessing and understanding intelligent agents is a difficult task for users that lack an AI background. A relatively new area, called "Explainable AI," is emerging to help address this problem, but little is known about how users would forage through information an explanation system might offer. To inform the development of Explainable AI systems, we conducted a formative study -using the lens of Information Foraging Theory -into how experienced users foraged in the domain of StarCraft to assess an agent. Our results showed that participants faced difficult foraging problems. These foraging problems caused participants to entirely miss events that were important to them, reluctantly choose to ignore actions they did not want to ignore, and bear high cognitive, navigation, and information costs to access the information they needed. sign further in the Methodology section.) In addition, the participants had functionality to seek additional information about the replay, such as navigating around the game map, drilling down into production information, pausing, rewinding, fast-forwarding, and so on (Figure 1). However, we wanted a higher level of abstraction than features specific to StarCraft. Specifically, we aimed for (1) applicability to other RTS environments, and (2) connection with other research about humans seeking information. To that end, we turned to Information Foraging Theory (IFT).

show abstract

Toward Foraging for Understanding of StarCraft Agents

Penney

Dodge

Hilderbrand

et al. 2018

23rd International Conference on Intelligent User Interfaces

View full text Add to dashboard Cite

show abstract

Precision Interfaces for Different Modalities

Zhang

Raj

Sellam

et al. 2018

Proceedings of the 2018 International Conference on Management of Data

View full text Add to dashboard Cite

The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy Players

Penney

Dodge

Anderson

et al. 2021

ACM Trans. Interact. Intell. Syst.

View full text Add to dashboard Cite

Assessing and understanding intelligent agents is a difficult task for users who lack an AI background. ?Explainable AI? (XAI) aims to address this problem, but what should be in an explanation? One route toward answering this question is to turn to theories of how humans try to obtain information they seek. Information Foraging Theory (IFT) is one such theory. In this paper, we present a series of studies using IFT: the first investigates how expert explainers supply explanations in the RTS domain, the second investigates what explanations domain experts demand from agents in the RTS domain, and the last focuses on how both populations try to explain a state-of-the-art AI. Our results show that RTS environments like StarCraft offer so many options that change so rapidly, foraging tends to be very costly. Ways foragers attempted to manage such costs included ?satisficing? approaches to reduce their cognitive load, such as focusing more on What information than on Why information, strategic use of language to communicate a lot of nuanced information in a few words, and optimizing their environment when possible to make their most valuable information patches readily available. Further, when a real AI entered the picture, even very experienced domain experts had difficulty understanding and judging some of the AI's unconventional behaviors. Finally, our results reveal ways Information Foraging Theory can inform future XAI interactive explanation environments, and also how XAI can inform IFT.

show abstract

Don't Just Swipe Left, Tell Me Why

Cited by 4 publications

References 55 publications

Toward Foraging for Understanding of StarCraft Agents

Toward Foraging for Understanding of StarCraft Agents

Precision Interfaces for Different Modalities

The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy Players

Contact Info

Product

Resources

About