Motion Adaptive Deblurring with Single-Photon Cameras

Seets, Trevor; Ingle, Atul; Laurenzis, Martin; Velten, Andreas

doi:10.1109/wacv48630.2021.00199

Cited by 18 publications

(17 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In recent papers, [19][20][21][22] the method of photon flux measurement was introduced using the timing capability of single photon-counting avalanche diodes to estimate the photon flux as the rate at which photons arrive at the detector. Equation ( 1) states the photon flux estimate, φ, over m sampled frames which is given as the reciprocal of the mean photon arrival time (t) within the m sampled frames.…”

Section: Photon Flux Estimationmentioning

confidence: 99%

“…59-61 • Change point fitting (CPF): As in Ref. 22, we use statistical change point detection 62 to analyze photon flux data with either the kernel based 63,64 or pruned exact linear time (PELT) 65 algorithm. Then, the photon flux is fitted by the mean photon flux between two consecutive change points.…”

Section: Noise Characteristics and Noise Reductionmentioning

confidence: 99%

“…These timestamps are not correlated with any active light source and are instead recorded with respect to the SPAD camera's frame start times. Although these passively acquired photon timestamps do not provide information about the 3D scene structure, by exploiting the Poisson timing statistics, it was recently shown [19][20][21][22] that these passive timestamps provide scene intensity information.…”

Section: Introductionmentioning

confidence: 99%

“…Furthermore, the timing ability of SPAD sensors was used to determine the physical intensity by estimation of the photon flux from the photon impingement rate. [19][20][21][22] In this approach, the time between photon events is determined from the mean event time. It was shown that with photon flux measurements SPAD sensors are able to perform sensing with high dynamic range.…”

Section: Introductionmentioning

confidence: 99%

“…In prior work, we have demonstrated 22 compensation of motion by accumulating photon information along motion trajectories in these 3D (spatiotemporal) photon timestamp data sets. Further, we have published some preliminary investigations on the application of deep neutral network (DNN) image upscaling in a conference paper.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Comparison of super-resolution and noise reduction for passive single-photon imaging

et al. 2022

Self Cite

View full text Add to dashboard Cite

Single-photon sensitive image sensors have recently gained popularity in passive imaging applications where the goal is to capture photon flux (brightness) values of different scene points in the presence of challenging lighting conditions and scene motion. Recent work has shown that high-speed bursts of single-photon timestamp information captured using a single-photon avalanche diode camera can be used to estimate and correct for scene motion thereby improving signal-to-noise ratio and reducing motion blur artifacts. We perform a comparison of various design choices in the processing pipeline used for noise reduction, motion compensation, and upsampling of single-photon timestamp frames. We consider various pixelwise noise reduction techniques in combination with state-of-the-art deep neural network upscaling algorithms to super-resolve intensity images formed with single-photon timestamp data. We explore the trade space of motion blur and signal noise in various scenes with different motion content. Using real data captured with a hardware prototype, we achieved superresolution reconstruction at frame rates up to 65.8 kHz (native sampling rate of the sensor) and captured videos of fast-moving objects. The best reconstruction is obtained with the motion compensation approach, which achieves a structural similarity (SSIM) of about 0.67 for fastmoving rigid objects. We are able to reconstruct subpixel resolution. These results show the relative superiority of our motion compensation compared to other approaches that do not exceed an SSIM of 0.5.

show abstract

Section: Photon Flux Estimationmentioning

confidence: 99%

Section: Noise Characteristics and Noise Reductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Comparison of super-resolution and noise reduction for passive single-photon imaging

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

Quanta Video Restoration

Chennuri,

Chi,

Jiang

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Scintillation event imaging with a single photon avalanche diode camera

Bocchieri,

Charbon,

Velten

2024

Commun Eng

View full text Add to dashboard Cite

Position and time measurements of scintillation events encode information about the radiation source. Single photon avalanche diode (SPAD) arrays offer multiple-megapixel spatial resolution and tens of picoseconds temporal resolution for detecting single photons. Current lensless designs for measuring scintillation events use sensors that are lower in spatial resolution. Camera-based designs use sensors that are lower in temporal resolution or readout rate and cannot image individual interactions. Here we propose to image scintillation events in a thick, monolithic scintillator using a high-resolution SPAD camera. We demonstrate that a commercial SPAD camera is able to gather sufficient signal to image individual scintillation events and observe 3D shifts in their spatial distribution. Simulations show that a SPAD camera can localize individual scintillation events in 3D. We report direct imaging of gamma-ray interactions in a scintillator with a SPAD camera. The proposed design may allow to measure complex signatures of individual particles interacting in the scintillator.

show abstract

Motion Adaptive Deblurring with Single-Photon Cameras

Cited by 18 publications

References 23 publications

Comparison of super-resolution and noise reduction for passive single-photon imaging

Comparison of super-resolution and noise reduction for passive single-photon imaging

Quanta Video Restoration

Scintillation event imaging with a single photon avalanche diode camera

Contact Info

Product

Resources

About