Real-Time Reconstruction of 3D Videos From Single-Photon LiDaR Data in the Presence of Obscurants

Abstract

Single-photon methods are emerging as a key approach to 3D Imaging. This paper introduces a two step statistical based approach for real-time image reconstruction applicable to a transmission medium with extreme light scattering conditions. The first step is an optional target detection method to select informative pixels which have photons reflected from the target, hence allowing data compression. The second is a reconstruction algorithm that exploits data statistics and multiscale information to deliver clean depth and reflectivity images together with associated uncertainty maps. Both methods involve independent operations that are implemented in parallel on graphics processing units (GPUs), which enables real-time data processing of moving scenes at more than 50 depth frames per second for an image of 128 × 128 pixels. Comparisons with state-of-the-art algorithms on simulated and real underwater data demonstrate the benefit of the proposed framework for target detection, and for fast and robust depth estimation at multiple frames per second.

Simulation and design optimization of germanium-on-silicon single photon avalanche diodes

“…1 There is demand for single-photon detection in the short-wave infrared (SWIR) to enable long range eye-safe LIDAR, 2 operation in quantum systems at telecommunications wavelengths, 3 as well as imaging through obscurants. [4][5][6] Effective SWIR performance is not achievable with silicon SPADs due to limited absorption at wavelengths > 1 µm. We have previously demonstrated novel pseudo-planar germanium-on-silicon SPADs with absorption into the SWIR, which offer the prospect of lower costs, and easier CMOS integration compared to III-V SPADs.…”

Ge-on-Si single photon avalanche diode performance enhancement with photonic crystal nano-hole arrays

“…4 For LIDAR applications, for example, operation within the short-wave infrared (SWIR) wavelengths are preferred for three main reasons: reduced solar background radiation, resulting in lower ambient light noise and a higher signal-to-noise ratio (SNR); 5 the ability to use higher laser powers, up to ∼20 times compared to near-infrared (NIR), while maintaining eye safety; 6 and improved imaging through atmospheric obscurrants such as smoke and fog. [7][8][9] SWIR operation is therefore crucial for extending detection range in LIDAR systems and also for integrating with telecommunication networks in quantum applications such as QKD.…”