This paper presents our development of an intuitive teleoperation system for Toyota's Human Support Robot. While this robot has been widely used as an autonomous agent in the field of service robotics, we explore a possibility of this robot for the use of remote assistance of daily activities in home environments. For rapid prototyping an affordable teleoperation system, we adopt a commercially available VR device as a user interface and develop a Robot Operating System (ROS)-based control framework building on the software application programming interfaces (APIs). In particular, we implement a singularity robust inverse kinematics algorithm to achieve a coordinated wholebody motion of the robot for safe and intuitive operation. We empirically evaluate the practical feasibility of the proposed teleoperation system through various test tasks. We discuss the potential and limitations of the current development for its future improvement.
This article identifies and summarizes software tools and frameworks proposed in the Human–Robot Interaction (HRI) literature for developing extended reality (XR) experiences using game engines. This review includes primary studies proposing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) solutions where humans can control or interact with real robotic platforms using devices that extend the user’s reality. The objective of this article is not to present an extensive list of applications and tools. Instead, we present recent, relevant, common, and accessible frameworks and software tools implemented in research articles published in high-impact robotics conferences and journals. For this, we searched papers published during a seven-years period between 2015 and 2022 in relevant databases for robotics (Science Direct, IEEE Xplore, ACM digital library, Springer Link, and Web of Science). Additionally, we present and classify the application context of the reviewed articles in four groups: social robotics, programming of industrial robots, teleoperation of industrial robots, and Human–Robot collaboration (HRC).
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.