Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalities

Abstract

Automatic detection of flying drones is a key issue where its presence, especially if unauthorized, can create risky situations or compromise security. Here, we design and evaluate a multi-sensor drone detection system. In conjunction with standard video cameras and microphone sensors, we explore the use of thermal infrared cameras, pointed out as a feasible and promising solution that is scarcely addressed in the related literature. Our solution integrates a fish-eye camera as well to monitor a wider part of the sky and steer the other cameras towards objects of interest. The sensing solutions are complemented with an ADS-B receiver, a GPS receiver, and a radar module. However, our final deployment has not included the latter due to its limited detection range. The thermal camera is shown to be a feasible solution as good as the video camera, even if the camera employed here has a lower resolution. Two other novelties of our work are the creation of a new public dataset of multi-sensor annotated data that expands the number of classes compared to existing ones, as well as the study of the detector performance as a function of the sensor-to-target distance. Sensor fusion is also explored, showing that the system can be made more robust in this way, mitigating false detections of the individual sensors.

Investigation of the Use of Drones by Construction Professionals in Addressing Built Environment Tasks

“…It includes contemporary developments like global positioning satellites, radar, Light Detection and Ranging (LiDAR), and Bluetooth detectors, as well as its emerging uses in transportation data collection technology. A multi-sensor drone-detection system with a fish-eye camera and detecting technologies, as shown in the output of [26], can gather data that helps in its interpretation. Remote-controlled aircraft systems and totally autonomous vehicles were the two technology branches that were combined to create drones whose applications were explored in their production.…”

A comparative study of joint video tracking and classification for countering unmanned aerial vehicles

“…, m k at current time t k . Usually, the association cost is based on the negative likelihood logarithm defined in (5).…”

“…Proposed developments are built on state-of-the-art machine learning techniques, extending methods from conclusions and related literature recommendations. 5,6 In fact, over the last few years, significant improvements have been made in addressing a wide variety of long-standing problems in machine learning, artificial intelligence, and computer vision. One of the research topics that has gained attention is the use of computer vision technology to accomplish multi-object detection and tracking tasks.…”

5G Positioning: Advantageous Aspects, Taxonomy, State-of-the-art Review and Future Trends

“…Localization is a great essence of the future wireless networks [1,2,3]. In today's era, precise positioning can enable various wireless use cases like indoor navigation [4,5], drone tracking [6], emergency service [7,8], vehicular navigation [9,10], inventory tracking [11,12], and plays a pivotal role in offering the location-based services [13,14]. Among all, vehicular navigation is becoming a new challenge where positioning is of the essence.…”