The Need for Combining Implicit and Explicit Communication in Cooperative Robotic Systems

Abstract

As the number of robots used in warehouses and manufacturing increases, so too does the need for robots to be able to manipulate objects, not only independently, but also in collaboration with humans and other robots. Our ability to effectively coordinate our actions with fellow humans encompasses several behaviours that are collectively referred to as joint action, and has inspired advances in human-robot interaction by leveraging our natural ability to interpret implicit cues. However, our capacity to efficiently coordinate on object manipulation tasks remains an advantageous process that is yet to be fully exploited in robotic applications. Humans achieve this form of coordination by combining implicit communication (where information is inferred) and explicit communication (direct communication through an established channel) in varying degrees according to the task at hand. Although these two forms of communication have previously been implemented in robotic systems, no system exists that integrates the two in a task-dependent adaptive manner. In this paper, we review existing work on joint action in human-robot interaction, and analyse the state-of-the-art in robot-robot interaction that could act as a foundation for future cooperative object manipulation approaches. We identify key mechanisms that must be developed in order for robots to collaborate more effectively, with other robots and humans, on object manipulation tasks in shared autonomy spaces.

Egocentric Gesture Recognition Using 3D Convolutional Neural Networks for the Spatiotemporal Adaptation of Collaborative Robots

“…Explicit interaction, on the one hand, is what is referred to as direct communication between the robot and the human. Implicit interaction, on the other, involves an action (or practical behavior), which represents a message in itself, rather than a message being conveyed through language, codified gestures (such as a thumbs-up or nod of the head) (Gildert et al, 2018 ) or other non-verbal, sensorimotor forms of communication to send coordination signals (Pezzulo et al, 2013 ; Vesper and Sevdalis, 2020 ).…”

When Agents Become Partners: A Review of the Role the Implicit Plays in the Interaction with Artificial Social Agents

“…A fair amount of research has been done on nonverbal agent behaviours, and some have explored explicit VAI [104], some implicit behaviours in HRI [107], while some suggest that combining both explicit and implicit cues in an interaction will lead to a better HAI [108].…”

Actualidad en el agro colombiano y aprovechamiento de los recursos visto desde la robótica

“…Desde el software se utilizan técnicas de inteligencia artificial, visión por computador y planificación de rutas (Gildert, 2018).…”

“…pueden operar en conjunto mediante la robótica cooperativa o sistemas cooperativos. Estos se definen como la capacidad que tienen los sistemas inteligentes de coordinar en acción conjunta, para ejecutar procesos a partir de diversos mecanismos subsecuentes (Gildert, 2018). Por ejemplo, al inicio de una misión en una extensión de tierra, un uav realiza un vuelo en el que inspecciona un área específica, se traza un mapa que luego es procesado para proporcionar una trayectoria al ugv.…”