Multimodal UAV Ground Control System

Abstract

As unmanned units become more capable of self-control, and as their integration into our military forces increase, the role of the operator of these units is going to change. Current UAV ground control systems typically require to much of the operator's attention per unit, and the role of the future operator will be more like that of a manager than that of a pilot. This paper describes research being done on a user interface for a future ground control system. Beginning with a visualization of a virtual battlefield, this next-generation UAV ground control system incorporates all available information and analyses in combination with a synthetic battlespace in a context-relevant manner. This marriage of synthetic and real information feeds, within a single visualization space, is designed to increase the situational awareness of a single operator. This virtual battlefield provides the operator with the information necessary to accomplish their task, with multiple modes of interaction for the user. The UAV Ground Control System detailed here utilizes a speech command interface, a wireless joystick interface, as well as a tablet-based direct manipulation interface similar to those used in general air unit ground control systems. Through these different types of interactions, an operator is presented with various sources of data to manage and command military units as clearly and simply as possible. As unmanned units become more capable of self-control, and as their integration into our military forces increase, the role of the operator of these units is going to change. Current UAV ground control systems typically require to much of the operator's attention per unit, and the role of the future operator will be more like that of a manager than that of a pilot. This paper describes research being done on a user interface for a future ground control system. Beginning with a visualization of a virtual battlefield, this next-generation UAV ground control system incorporates all available information and analyses in combination with a synthetic battlespace in a context-relevant manner. This marriage of synthetic and real information feeds, within a single visualization space, is designed to increase the situational awareness of a single operator. This virtual battlefield provides the operator with the information necessary to accomplish their task, with multiple modes of interaction for the user. The UAV Ground Control System detailed here utilizes a speech command interface, a wireless joystick interface, as well as a tablet-based direct manipulation interface similar to those used in general air unit ground control systems. Through these different types of interactions, an operator is presented with various sources of data to manage and command military units as clearly and simply as possible.

Virtual Teleoperation for Unmanned Aerial Vehicles

“…Thus, our proposal called for substantial investment in enhancing both of these leading edge devices. Although the research effort began immediately and ran concurrently with the infrastructure enhancement projects, the majority of the expenditures during the first two years of the project (2005)(2006)(2007) focused on enhancing the C6.…”

Synchronous parallelization of Particle Swarm Optimization with digital pheromones

“…A 'flyback' constraint handling mechanism was also introduced in this research to maintain a feasible population. A substantial amount of success has been achieved in utilizing PSO for applications such as aircraft design [41,42], topology and shape optimization [5,43], structural optimization [44,45], wireless network routing problems [46], optimization in manufacturing and production operations [47,48], collision detection problems [49], and detection of optimal paths for unmanned aerial vehicles (UAVs) [50,51] to name a few.…”

Development of Ground Control Software for Operation of Multiple Unmanned Aerial Vehicles

“…One-to-One Matching System 무인항공기의 운용은 대부분 단일 무인항공기와 하나의 지상통제 소프트웨어의 일대일 대응 시스 템이었다. 하지만 비행제어 컴퓨터의 비약적인 발전 등으로 무인항공기의 사용이 군, 산업에서 광범위하게 적용되기 시작하고, 그 역할이 다양 해지면서 사용자의 요구도 단일 무인항공기의 운 용에서 복수 무인항공기의 운용으로 확장되었다 [1,2]. 이렇게 사용자의 요구가 확장됨에 따라 지상제어 소프트웨어의 기능 또한 확장되어 적 용되어야 한다.…”

“…이렇게 사용자의 요구가 확장됨에 따라 지상제어 소프트웨어의 기능 또한 확장되어 적 용되어야 한다. 지금까지 사용자가 단순히 지상통제 소프트웨어 를 이용하여 단일 무인항공기와 일대일로 데이터 를 수신하고 임무를 송신하던 조종사의 개념 [3,4] 에서 하나의 지상통제 소프트웨어에서 다수의 무 인항공기에 대한 모든 정보를 관찰하고, 각각 개 별적인 임무 명령을 전달할 수 있는 관리자의 개 념으로 확장되어야 한다 [1]. 이러한 …”