Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas

Abstract

Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.

High-Level Teleoperation System for Aerial Exploration of Indoor Environments

“…Extensive research on teleoperation of small sized aerial robots with various types of input-devices and according interactions, has been conducted in the past decade. Despite the popularity of novel interaction paradigms, like hand-gesture (Yu et al, 2017;Duan et al, 2018), body-gesture (Rognon et al, 2018), gaze (Yu et al, 2014;Erat et al, 2018;Yuan et al, 2019), and language (Huang et al, 2010(Huang et al, , 2019, more recent work still focuses on aspects of traditional joystick based teleoperation of small-sized UAVs, for example avoiding collisions during navigation (Cho et al, 2017). Sanders et al (2018) report that operators still prefer joystick control over indirect gazebased steering, whereas findings of Herrmann and Schmidt (2018) indicate that a traditional input device is more efficient than their extensive and carefully designed system based on natural interactions.…”

Smart solution for reducing the COVID‐19 risk using smart city technology

“…It is used for different applications such as delivering the food, observation of affected area etc. [20,21]. The following points are mentioned below to reduce the COVID risk:…”

Compressed sensing image restoration algorithm based on improved SURF operator

“…n } = arg min a t + an +λ X − T t a t + Tn an (19) In the equation (19), λ X − T t a t + Tn an indicates that the image is neither a texture part nor a structural part. Introducing the slack term in this way not only ensures that the decomposition algorithm extracts the structure and texture parts from the damaged image, but also removes the additive noise that may exist in the image.…”

“…Human vision is an extremely important means of perception for human beings. About 70% of the information people gotten is from vision [19][20][21]. Images are the material representation of human perception of vision, so images become an important way for people to understand the external world and themselves [4].…”