Learning movement synchronization in multi-component robotic systems

Abstract

Imitation learning of tasks in multi-component robotic systems requires capturing concurrency and synchronization requirements in addition to task structure. Learning time-critical tasks depends furthermore on the ability to model temporal elements in demonstrations. This paper proposes a modeling framework based on Petri nets capable of modeling these aspects in a programming by demonstration context. In the proposed approach, models of tasks are constructed from segmented demonstrations as task Petri nets, which can be executed as discrete controllers for reproduction. We present algorithms that automatically construct models from demonstrations, showing how elements of time-critical tasks can be mapped into task Petri net elements. The approach is validated by an experiment in which a robot plays a musical passage on a keyboard.

Reframing HRI Education: A Dialogic Reformulation of HRI Education to Promote Diverse Thinking and Scientific Progress

“…The interaction can be indirect, when the user operates the robot by commanding it, or direct, when the communication between the user and robot is bidirectional and the robot can act on its own (Thrun, 2004). The role of humans in relation to robots can vary: The human can be a supervisor, operator, mechanic, teammate, bystander, mentor, or information consumer (e.g., Alenljung, et al, 2017;Goodrich & Schultz, 2007;Scholtz, 2003) and can directly transfer physical human skills to robots Thabet, Montebelli, & Kyrki, 2016;Tykall, Montebelli, & Kyrki, 2016).…”