Hybrid event and frame-based system for target detection, tracking, and identification

Abstract

In this work, we demonstrate a hybrid event-based and frame-based imaging system for the task of target detection and tracking. This system leverages the change detection ability of event-based sensors (EBS) with relatively lower read-out bandwidth for the target detection task within a wide field of view, especially against static backgrounds. The frame-based sensor is used to track the detected target, as cued by the EBS sub-system, at higher spatial/angular resolution within a narrow field of view. Using field trials, the hybrid system is shown to detect and track a 30 cm small drone at stand-off distances up to 100 m at a speed of 12 m/s.