Coordinating Human-Robot Teams with Dynamic and Stochastic Task Proficiencies

Abstract

As robots become ubiquitous in the workforce, it is essential that human-robot collaboration be both intuitive and adaptive. A robot’s ability to coordinate team activities improves based on its ability to infer and reason about the dynamic (i.e., the “learning curve”) and stochastic task performance of its human counterparts. We introduce a novel resource coordination algorithm that enables robots to schedule team activities by (1) actively characterizing the task performance of their human teammates and (2) ensuring the schedule is robust to temporal constraints given this characterization. We first validate our modeling assumptions via user study. From this user study, we create a data-driven prior distribution over human task performance for our virtual and physical evaluations of human-robot teaming. Second, we show that our methods are scalable and produce high-quality schedules. Third, we conduct a between-subjects experiment (n = 90) to assess the effects on a human-robot team of a robot scheduler actively exploring the humans’ task proficiency. Our results indicate that human-robot working alliance ( p\lt 0.001 ) and human performance ( p=0.00359 ) are maximized when the robot dedicates more time to exploring the capabilities of human teammates.

Shared Task Representation for Human–Robot Collaborative Navigation: The Collaborative Search Case

“…On the other hand, multiple fields work on robot's understanding of the human capabilities, preferences, plans and goals. For example, recently Tuli et al [8] built an ontological-based system for human intention inference in assembly operations (as in current goal), Liu et al [1] claimed to improve task scheduling in shared workspace settings through introducing dynamic and stochastic representations of the human task performance model and Rudenko et al [9] surveys advances in pedestrian trajectory prediction. Architecturally speaking, classically the human was treated as an element of the environment, but recently the paradigm of considering human-robot collaboration using a multi-agent view is receiving more attention [10].…”

RealTHASC—a cyber-physical XR testbed for AI-supported real-time human autonomous systems collaborations

“…Emerging techniques in machine learning (ML), AI, and computer vision are able to equip the next-generation of autonomous robots with unprecedented sensing, cognitive, and decision-making skills (Bassyouni and Elhajj, 2021). These "smart" robots will inevitably interact with humans as part of collaborative robot teams in unstructured and dynamic environments, thus requiring fundamental cross-cutting research not only in engineering and computer science but also in the humanities (Fong et al, 2003;Pendleton et al, 2017;Liu et al, 2021). Real-world tests with human subjects in the loop are necessary in almost every sector of robotics, including defense, agriculture, healthcare, and emergency-response systems, to name a few.…”

Modeling Human Steering Behavior in Haptic Shared Control of Autonomy-Enabled Unmanned Ground Vehicles

“…As robots continue to find applications in a wide range of real-world scenarios, the next wave of technological progress in the field of robotics appears to be centered around their ability to interact effectively with complex environments and autonomously execute tasks with minimal human supervision [1]- [3]. Although maintaining human's global control over autonomous systems contributes to increasing the initiative and awareness of dynamic, complex and interactive environments, the ability of robots to make unaided decisions also grows in significance [4]- [6].…”