SNLOS: Non-line-of-sight Scanning through Temporal Focusing

Pediredla, Adithya; Dave, Akshat; Veeraraghavan, Ashok

doi:10.1109/iccphot.2019.8747336

Cited by 35 publications

(23 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Full color NLOS imaging with single pixel photomultiplier tube combined with a mask 23,24 has also been demonstrated. Further work includes real-time transient imaging for amplitude modulated continuous wave lidar applications 25 , analysis of missing features based on time-resolved NLOS measurements 26 , convolutional approximations to incorporate priors into FBP 27 , occlusion-aided NLOS imaging using SPADs 28,29 , Bayesian statistics reconstruction to account for random errors 30 , temporal focusing for a hidden volume of interest by altering the time delay profile of the hardware illumination 31 , and a database for NLOS imaging problems with different acquisition schemes 32 . Reconstruction times for all these methods remain in the minutes to hours range even for small scenes of less than a meter in diameter.…”

Section: Discussionmentioning

confidence: 99%

Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems

2020

View full text Add to dashboard Cite

Non-line-of-sight (NLOS) imaging recovers objects using diffusely reflected indirect light using transient illumination devices in combination with a computational inverse method. While capture systems capable of collecting light from the entire NLOS relay surface can be much more light efficient than single pixel point scanning detection, current reconstruction algorithms for such systems have computational and memory requirements that prevent real-time NLOS imaging. Existing real-time demonstrations also use retroreflective targets and reconstruct at resolutions far below the hardware limits. Our method presented here enables the reconstruction of room-sized scenes from non-confocal, parallel multi-pixel measurements in seconds with less memory usage. We anticipate that our method will enable real-time NLOS imaging when used with emerging single-photon avalanche diode array detectors with resolution only limited by the temporal resolution of the sensor.

show abstract

Section: Discussionmentioning

confidence: 99%

Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems

2020

View full text Add to dashboard Cite

show abstract

“…Finally, we show simulations for an NLOS imaging application. We follow Pediredla et al [2019a], who use a temporal focusing technique to scan voxelby-voxel a "looking around the corner" scene, as in Figure 10. Such a temporal focusing camera requires narrow time-gating for highfidelity reconstruction.…”

Section: Methodsmentioning

confidence: 99%

“…These include streak cameras [Velten et al 2013], intensified CCD (ICCD) sensors [Cester et al 2019;Pediredla et al 2017b], single-photon avalanche diodes (SPADs) [Gariepy et al 2015], continuous-wave time-of-flight sensors [Heide et al 2013;Peters et al 2015], Kerr gates [Ham 2019;Schmidt et al 2003;Takahashi et al 1994;Zhan et al 2016], and interferometry [Gkioulekas et al 2015]. Transient imaging has recently attracted increased interest within computer graphics, for applications such as non-line-of-sight imaging [Buttafava et al 2015;Chan et al 2017;Kirmani et al 2009;O'Toole et al 2018;Pediredla et al 2017aPediredla et al , 2019aTsai et al 2017;Velten et al 2012;Xin et al 2019], separating light transport components Wu et al 2014a,b], and inverting and seeing through scattering [Gkioulekas et al 2016;Satat et al 2016].…”

Section: Related Workmentioning

confidence: 99%

“…Gated laser ranging and short-wave-infrared sensors are used in military applications, to survey objects at specific distances [las 2019;Baker et al 2004]. Finally, even though most non-line-of-sight imaging algorithms require entire transients, some techniques use time-gated measurements [Laurenzis and Velten 2014;Pediredla et al 2019a;Thrampoulidis et al 2018] Time-gated imaging scenarios can arise even when using ToF technologies other than time-gated sensors. For example, even though typical CW-ToF sensors accumulate non-zero contributions from all photons regardless of their time-of-travel, it is possible to use special modulation patterns to create a camera that almost exclusively measures photons within a specific time-of-travel range [Tadano et al 2015].…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Ellipsoidal path connections for time-gated rendering

2019

Self Cite

View full text Add to dashboard Cite

During the last decade, we have been witnessing the continued development of new time-of-flight imaging devices, and their increased use in numerous and varied applications. However, physics-based rendering techniques that can accurately simulate these devices are still lacking: while existing algorithms are adequate for certain tasks, such as simulating transient cameras, they are very inefficient for simulating time-gated cameras because of the large number of wasted path samples. We take steps towards addressing these deficiencies, by introducing a procedure for efficiently sampling paths with a predetermined length, and incorporating it within rendering frameworks tailored towards simulating time-gated imaging. We use our open-source implementation of the above to empirically demonstrate improved rendering performance in a variety of applications, including simulating proximity sensors, imaging through occlusions, depth-selective cameras, transient imaging in dynamic scenes, and non-line-of-sight imaging. CCS Concepts: • Computing methodologies → Ray tracing.

show abstract

“…Spatial refocusing after the first scattering surface can be controlled using spatial-light-modulators and the focused spot can be scanned across the scene [64]. Temporal focusing uses an illumination pulse that is shaped in space and time to create an illumination pulse at an area in the hidden scene [65]. These techniques can improve the signal to noise ratio and resolution for the obtained reconstruction.…”

mentioning

confidence: 99%

Non-Line-of-Sight Imaging

Faccio¹

2019

Optics & Photonics News

View full text Add to dashboard Cite

Emerging single-photon-sensitive sensors combined with advanced inverse methods to process picosecond-accurate time-stamped photon counts have given rise to unprecedented imaging capabilities. Rather than imaging photons that travel along direct paths from a source to an object and back to the detector, non-line-of-sight (NLOS) imaging approaches analyze photons scattered from multiple surfaces that travel along indirect light paths to estimate 3D images of scenes outside the direct line of sight of a camera, hidden by a wall or other obstacles. Here we review recent advances in the field of NLOS imaging, discussing how to see around corners and future prospects for the field.

show abstract

SNLOS: Non-line-of-sight Scanning through Temporal Focusing

Cited by 35 publications

References 30 publications

Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems

Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems

Ellipsoidal path connections for time-gated rendering

Non-Line-of-Sight Imaging

Contact Info

Product

Resources

About