Natural Interaction Techniques for an Unmanned Aerial Vehicle System

Peshkova, Ekaterina; Hitz, Martin; Kaufmann, Bonifaz

doi:10.1109/mprv.2017.3

Cited by 52 publications

(28 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The main goal of natural user interfaces is to achieve an intuitive control method, which is defined as an interface that works at user's expectations [17]. Natural user interfaces allow non-expert users to control drones with a shorter training period, reduced workload and possibly even decrease aircraft crashes.…”

Section: Innovative Control Interfacesmentioning

confidence: 99%

“…Natural user interfaces allow non-expert users to control drones with a shorter training period, reduced workload and possibly even decrease aircraft crashes. A previous study proposed a series of design guidelines for natural user interfaces: (1) input vocabulary must employ mental models that are known to the targeted user, (2) natural behavior of users must be analyzed to discover user-defined mental models, (3) mixing gestures from different mental models in an input vocabulary should be avoided, (4) and important aspects (such as physiological, cultural differences, application, and ergonomics) must be considered in the final input vocabulary [17]. Additionally, the concept of using mental models when designing a user interface can enhance the final product.…”

Section: Innovative Control Interfacesmentioning

confidence: 99%

See 1 more Smart Citation

The State-of-the-Art of Human–Drone Interaction: A Survey

2019

View full text Add to dashboard Cite

Drones have expanded from military operations to performing a broad range of civilian applications. As drone usage increases, humans will interact with such systems more often, therefore, it is important to achieve a natural human-drone interaction. Although some knowledge can be derived from the field of human-robot interaction, drones can fly in a 3D space, which essentially changes how humans can interact with them, making human-drone interaction a field of its own. This paper is the first survey on the emerging field of human-drone interaction focusing on multi-rotor systems, providing an overview of existing literature and the current state of the art in the field. This work begins with an analysis and comparison of the drone models that are commonly used by end-users and researchers in the field of humandrone interaction. Following, the current state of the field is discussed, including the roles of humans in HDI, innovative control methods, remaining aspects of interaction, and novelty drone prototypes and applications. This paper concludes by presenting a discussion of current challenges and future work in the field of humandrone interaction. INDEX TERMS Drone, human-computer interaction, human-drone interaction, human-in-the-loop, humanrobot interaction, unmanned aerial vehicle.

show abstract

Section: Innovative Control Interfacesmentioning

confidence: 99%

Section: Innovative Control Interfacesmentioning

confidence: 99%

The State-of-the-Art of Human–Drone Interaction: A Survey

2019

View full text Add to dashboard Cite

show abstract

“…Hand gesture interaction is reported the most natural and fun method for drone navigation in the presented flight-tests in controlled indoor environments. Peshkova et al [ 94 ] give an comprehensive overview of natural interaction techniques for Unmanned Aerial Vehicles (UAVs). Input vocabularies are classified according to their underlying mental models and clustered into three classes ( imitative , instrumented and intelligent ).…”

Section: Applications and Contextsmentioning

confidence: 99%

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Bachmann

Weichert

Rinkenauer

2018

Sensors

127

View full text Add to dashboard Cite

Modern hardware and software development has led to an evolution of user interfaces from command-line to natural user interfaces for virtual immersive environments. Gestures imitating real-world interaction tasks increasingly replace classical two-dimensional interfaces based on Windows/Icons/Menus/Pointers (WIMP) or touch metaphors. Thus, the purpose of this paper is to survey the state-of-the-art Human-Computer Interaction (HCI) techniques with a focus on the special field of three-dimensional interaction. This includes an overview of currently available interaction devices, their applications of usage and underlying methods for gesture design and recognition. Focus is on interfaces based on the Leap Motion Controller (LMC) and corresponding methods of gesture design and recognition. Further, a review of evaluation methods for the proposed natural user interfaces is given.

show abstract

“…RC-transmitters and joysticks are the most common input devices used to control the quadrotors. The innovative natural user interface for the AR.Drone has been proposed in [16][17][18], where the hand gestures are translated into commands for the platform. The AR.Drone 2.0 (shown in Figure 8) was selected for the purposes of this experiment because it is relatively cheap compared to other drones and can be easily accessible for anybody willing to test it.…”

Section: Ardrone Platformmentioning

confidence: 99%

Natural UAV tele-operation for agricultural application by using Kinect sensor

Yin

Lan

Wen

et al. 2018

International Journal of Agricultural and Biological Engineering

View full text Add to dashboard Cite

Remote-controlled (RC) unmanned aerial vehicles (UAVs) have been extensively applied in agricultural areas, such as remote sensing, precise spraying pesticides for crop protection, agricultural situation inspection and so on, but these telemanipulated UAVs systems are operated entirely by a ground-based pilot with a need of eyes focus on the remote site UAV flight. The key issue existed in agricultural UAV teleoperation area is a longtime training needed. In this paper, a novel natural UAV teleoperation control system in agricultural application was proposed. In UAV teleoperation scenario, human operator gestures measured by using Kinect sensor can be used as control commands for UAV flight. Moreover, some UAV teleoperation control commands related to human hand gestures were defined, which is similar to the radio gymnastic exercises in China. Therefore, gesture recognition-based UAV teleoperation control is easy to learn and master. In addition, a new real time human hand gesture recognition algorithm was proposed. The stability of UAV flight dynamic of roll, pitch and yaw as well as attitude control were verified with the experiments based on the proposed method. At last, the usability and effectiveness of the proposed method has been verified by the experimental results.

show abstract

Natural Interaction Techniques for an Unmanned Aerial Vehicle System

Cited by 52 publications

References 24 publications

The State-of-the-Art of Human–Drone Interaction: A Survey

The State-of-the-Art of Human–Drone Interaction: A Survey

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Natural UAV tele-operation for agricultural application by using Kinect sensor

Contact Info

Product

Resources

About