Event-based imaging of levitated microparticles

Abstract

Event-based imaging is a neuromorphic detection technique whereby an array of pixels detects a positive or negative change in light intensity at each pixel and is, hence, particularly well suited to detect motion. Compared to standard camera technology, an event-based camera reduces redundancy by not detecting regions of the image where there is no motion, allowing increased frame-rates without compromising on field-of-view. Here, we apply event-based imaging to detect the motion of a microparticle levitated under vacuum conditions, which greatly facilitates the study of nanothermodynamics and enables the independent detection and control of arrays of many particles.

Artificial intelligence-based spatio-temporal vision sensors: applications and prospects

“…Target object detection: Ren et al (Ren et al, 2022) used the pulse stream output by DVS to accumulate into images according to the frequency and synchronized with APS, and used DVS to cluster the generated target candidate area, and then used convolutional neural network to classify the target area target. Zeng et al (Zeng et al, 2023) utilized pseudo-labels of APS for vehicle detection in autonomous driving scenarios.…”

“…Zhao et al (Zhao J. et al, 2022) projected the pulse flow as a feature surface in space, and used the methods of motion compensation and Kalman filtering to stably track high-speed moving targets. Ren et al (Ren et al, 2022) used DVS and APS jointly for moving target detection, which detected target candidate regions from DVS pulse flow and classified them with CNN, and then used particle filter to locate and track the target. Huang et al (Huang et al, 2018) used CeleX's pulse signal to reconstruct and interpolate frames to improve the frame rate of the image sequence, and the pulse flow can guide the moving area for high-speed target tracking.…”