The remote operation and environment reconstruction of outdoor mobile robots using virtual reality

Tikanmäki, Antti; Bedrnik, Tomas; Raveendran, Rajesh; Röning, Juha

doi:10.1109/icma.2017.8016043

Cited by 10 publications

(7 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We find very appropriate the suggested use of a small number of tasks, and we wish these to follow the order given by the MANTRA as it fits nicely to robot teleguide actions. We always Overview first, while Zooming, Filtering and Details are applied on demand [31] [35]. Automatic adaptation based on speed and distance to objects is an available option useful for specific environments and situations.…”

Section: Adaptive Viewsmentioning

confidence: 99%

Intuitive Robot Teleoperation Through Multi-Sensor Informed Mixed Reality Visual Aids

et al. 2021

View full text Add to dashboard Cite

The work carried out by the University of Catania is in the framework of the project "Safe and Smart Farming with Artificial Intelligence and Robotics-programma ricerca di ateneo UNICT 2020-22 linea 2" ABSTRACT Mobile robotic systems have evolved to include sensors capable of truthfully describing robot status and operating environment as accurately and reliably as never before. This possibility is challenged by effective sensor data exploitation, because of the cognitive load an operator is exposed to, due to the large amount of data and time-dependency constraints. This paper addresses this challenge in remote-vehicle teleoperation by proposing an intuitive way to present sensor data to users by means of using mixed reality and visual aids within the user interface. We propose a method for organizing information presentation and a set of visual aids to facilitate visual communication of data in teleoperation control panels. The resulting sensor-information presentation appears coherent and intuitive, making it easier for an operator to catch and comprehend information meaning. This increases situational awareness and speeds up decision-making. Our method is implemented on a real mobile robotic system operating outdoor equipped with on-board internal and external sensors, GPS, and a reconstructed 3D graphical model provided by an assistant drone. Experimentation verified feasibility while intuitive and comprehensive visual communication was confirmed through an assessment, which encourages further developments.

show abstract

Section: Adaptive Viewsmentioning

confidence: 99%

Intuitive Robot Teleoperation Through Multi-Sensor Informed Mixed Reality Visual Aids

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Alternatively, the DJI's Inspire 2 is capable of high standard aerial filming and surveillance. The system supports the upgraded transmission of video with a dual signal frequency and channel that stream video from the main, as well as from an onboard camera simultaneously [11]. Released on 28 January 2018, DJI's Mavic Air uses advanced Visual Inertial Odometry (VIO) technology, a very effective sensing mechanism in FlightAutonomy 2.0 comprised of a main gimbal camera with dual-vision sensors with backward, forward, and downward direction movement, IMU redundancies, and a set of cores for computation [12].…”

Section: Related Workmentioning

confidence: 99%

Quadcopter-Based Rapid Response First-Aid Unit with Live Video Monitoring

Rizwan

Shehzad

Awais

2019

Drones

View full text Add to dashboard Cite

Air transport is the fastest way to reach areas with no direct land routes for ambulances. This paper presents the development of a quadcopter-based rapid response unit in an efficient aerial aid system to eliminate the delay time for first aid supplies. The system comprises a health monitoring and calling system for a field person working in open areas and a base station with the quadcopter. In an uncertain situation, the quadcopter is deployed from the base station towards the field person for immediate help through the specified path using constant Global System for Mobile (GSM)- and Global Positioning System (GPS)-based connections. The entire operation can be monitored at the base station with a Virtual Reality (VR) head-tracking system supported by a smartphone. The camera installed on the quadcopter is synchronized with the operator’s head movement while wearing a VR head-tracking system at the base station. Moreover, an Infrared (IR)-based obstacle-evasion model is implemented separately to explain the working of the autonomous collision-avoidance system. The system was tested, which confirmed the reduction in the response time to supply aid to the desired locations.

show abstract

“…Alternatively, the operator could be shown a 3D representation of the robotâĂŹs environment. This model may be produced from a priori knowledge [26,39], or âĂŸvirtualizedâĂŹ in real-time using 3D mapping [17,29,31,32]. Rendering the environment in 3D allows the operator to separate their viewpoint from the robotâĂŹs position, allowing either egocentric, exocentric or tethered viewpoints [14].…”

Section: Introductionmentioning

confidence: 99%

“…The primary efforts to achieve waypoint selection with a HMDbased interface that we have found are [1,26,32,36]. The target selection methods in these four implementations, which all use an exocentric viewpoint, are outlined below: Drag and drop.…”

Section: Introductionmentioning

confidence: 99%

Towards an immersive user interface for waypoint navigation of a mobile robot

Baker¹,

Bridgwater²,

Bremner³

et al. 2020

Preprint

View full text Add to dashboard Cite

In this paper, we investigate the utility of head-mounted display (HMD) interfaces for navigation of mobile robots. We focus on the selection of waypoint positions for the robot, whilst maintaining an egocentric view of the robot's environment. Inspired by virtual reality (VR) gaming, we propose a target selection method that uses the 6 degrees-of-freedom tracked controllers of a commercial VR headset. This allows an operator to point to the desired target position, in the vicinity of the robot, which the robot then autonomously navigates towards. A user study (37 participants) was conducted to examine the efficacy of this control strategy when compared to direct control, both with and without a communication delay. The results of the experiment showed that participants were able to learn how to use the novel system quickly, and the majority of participants reported a preference for waypoint control. Across all recorded metrics (task performance, operator workload and usability) the proposed waypoint control interface was not significantly affected by the communication delay, in contrast to direct control. The simulated experiment indicated that a real-world implementation of the proposed interface could be effective, but also highlighted the need to manage the negative effects of HMDsparticularly VR sickness.

show abstract

The remote operation and environment reconstruction of outdoor mobile robots using virtual reality

Cited by 10 publications

References 9 publications

Intuitive Robot Teleoperation Through Multi-Sensor Informed Mixed Reality Visual Aids

Intuitive Robot Teleoperation Through Multi-Sensor Informed Mixed Reality Visual Aids

Quadcopter-Based Rapid Response First-Aid Unit with Live Video Monitoring

Towards an immersive user interface for waypoint navigation of a mobile robot

Contact Info

Product

Resources

About