A New UGV Teleoperation Interface for Improved Awareness of Network Connectivity and Physical Surroundings

Abstract

A reliable wireless connection between the operator and the teleoperated unmanned ground vehicle (UGV) is critical in many urban search and rescue (USAR) missions. Unfortunately, as was seen in, for example, the Fukushima nuclear disaster, the networks available in areas where USAR missions take place are often severely limited in range and coverage. Therefore, during mission execution, the operator needs to keep track of not only the physical parts of the mission, such as navigating through an area or searching for victims, but also the variations in network connectivity across the environment.In this paper, we propose and evaluate a new teleoperation user interface (UI) that includes a way of estimating the direction of arrival (DoA) of the radio signal strength (RSS) and integrating the DoA information in the interface. The evaluation shows that using the interface results in more objects found, and less aborted missions due to connectivity problems, as compared to a standard interface.The proposed interface is an extension to an existing interface centered on the video stream captured by the UGV. But instead of just showing the network signal strength in terms of percent and a set of bars, the additional information of DoA is added in terms of a color bar surrounding the video feed. With this information, the operator knows what movement directions are safe, even when moving in regions close to the connectivity threshold.

A Dynamic Motion Analysis of a Six-Wheel Ground Vehicle for Emergency Intervention Actions

“…For quality communication, these systems have scalability and security as objectives [ 27 , 28 ]. Tele-command is very important [ 28 ], even though its functionalities are due to its sensors; the video Infra-Red/Electro-Optical (IR/EO) devices and any other attached devices allow the sampling of data [ 29 , 30 , 31 ]. The navigation system of a robot is a non-structured environment that uses path planning, obstacle avoidance and circumnavigating, localization, and perceptive interpretation techniques.…”

A smart collaborative framework for dynamic multi-task offloading in IIoT-MEC networks

“…1: Overview of the proposed utility-aware offloading strategy, illustrating the dynamic task allocation process from multi-robot tasks to multi-edge devices. [7]. Cloud computing requires constant access to back-end infrastructure, leading to network congestion and delays, making it inadequate for real-time low-latency and highquality service applications.…”

Analog Twin Framework for Human and AI Supervisory Control and Teleoperation of Robots

“…Mobile robots require robust control and autonomy algorithms as well as cooperation algorithms to be useful in applications like exploration [1] and search and rescue missions [2], [3], where human access is difficult, but supervised human or artificial intelligence control is necessary [4]. Further, remote control and autonomy add the possibility of enabling an operator/AI algorithm to remote interface with the on-site environment robot by effectively using multi-modal sensor data inside the loop such as visual [5], tactile-visual [6], visual-vestibular [7], haptic cues [8], [9], artificial force [10], vibrotactile [11], visual-network [12], etc. This remote operation can be extended to collaborative robots to control a remote robot safely.…”