Learned human-agent decision-making, communication and joint action in a virtual reality environment

Abstract

Humans make decisions and act alongside other humans to pursue both short-term and long-term goals. As a result of ongoing progress in areas such as computing science and automation, humans now also interact with non-human agents of varying complexity as part of their day-to-day activities; substantial work is being done to integrate increasingly intelligent machine agents into human work and play. With increases in the cognitive, sensory, and motor capacity of these agents, intelligent machinery for human assistance can now reasonably be considered to engage in joint action with humans-i.e., two or more agents adapting their behaviour and their understanding of each other so as to progress in shared objectives or goals. The mechanisms, conditions, and opportunities for skillful joint action in human-machine partnerships is of great interest to multiple communities. Despite this, human-machine joint action is as yet underexplored, especially in cases where a human and an intelligent machine interact in a persistent way during the course of real-time, daily-life experience (as opposed to specialized, episodic, or time-limited settings such as game play, teaching, or task-focused personal computing applications). In this work, we contribute a virtual reality environment wherein a human and an agent can adapt their predictions, their actions, and their communication so as to pursue a simple foraging task. In a case study with a single participant, we provide an example of human-agent coordination and decision-making involving prediction learning on the part of the human and the machine agent, and control learning on the part of the machine agent wherein audio communication signals are used to cue its human partner in service of acquiring shared reward. These comparisons suggest the utility of studying human-machine coordination in a virtual reality environment, and identify further research that will expand our understanding of persistent human-machine joint action.

Serious Game-based Psychosocial Intervention to Foster Prosociality in Cyberbullying Bystanders

“…Social agents may be considered cognitive and evolving artificial intelligence entities that can reason about their own and others' actions, interact with other agents (Foo et al, 2007) and humans (van der Wal, 2012). As recent literature has suggested, social agents are becoming an increasingly significant part of individuals' lives in daily work and leisure activities (Pilarski et al, 2019). Hence, how these agents can trigger individuals' reactions and aid them in managing daily challenges, such as cyberbullying, is of utmost importance.…”

Affordance as general value function: A computational model

“…Predictions and predictive knowledge have been argued to be important parts of intelligent systems, especially when they are meant to interact with humans (Pilarski et al, 2019). An important application domain for such an interactive relationship is rehabilitation.…”

Dynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition

“…Action recognition has important applications in virtual reality [25] and intelligent surveillance [41]. With the popularization of 3D depth cameras and the development of human pose estimation technology [2], human skeleton data has become easier to obtain.…”