Reduced spatiotemporal bandwidth of motion stabilized event-based imaging sensors: experimental demonstration

Abstract

This work investigates event-based sensor (EBS) imaging system’s read-out bandwidth performance under linear motion, with and without hardware stabilization techniques. We implement three image stabilization methods using hardware rotation to cancel the sensor platform’s linear motion and recapture lost EBS performance. We successfully demonstrated the methods, showing a bandwidth reduction of over an order of magnitude in two scenes, 10 scene variations, and five EBS velocities. This work demonstrates the benefits of stabilization with EBS to reduce bandwidth requirements versus unstabilized EBS systems.

Analysis of event-based sensor system performance with moving object detection tasks

“…However, system performance is limited under motion and will require further improvement to achieve equivalent performance to the static configuration, while moving. Such improvements might include spatio-temporal algorithms such as spatio-temporal filters, or software [9] or hardware [5] stabilization.…”

“…An experimental setup was used to explore and quantify the three hardware stabilization methods described above. We continue to use a setup from our prior work [5] but provide some additional system details here. Subsection 1 describes the physical imaging system, as well as some details on the display.…”

“…Specifically, when should EBS be used in an imaging system, especially with respect to frame-based sensors, and when are frame-based sensors best. Several prior works have begun to address this topic, including with sensor performance for several different applications, with some listed here [5,6,7]. However, there is a gap in knowledge of the quantified performance of common algorithms and processing steps.…”