We present a methodology for recovering the perspective imagery of a non-line-of-sight scene based on plenoptic observations of indirect photons scattered from a homogeneous surface. Our framework segregates the visual contents observed along the scattering surface into angular and spatial components. Given the reflectance characteristics of the scatterer, we show that the former can be deduced from scattering measurements employing diversity in angle at individual surface points, whereas the latter can be deduced from captured images of the scatterer based on prior knowledge of occlusions within the scene. We then combine the visual contents from both components into a plenoptic modality capable of imaging at higher resolutions than what is allowed by the angular information content and discriminating against extraneous signals in complex scenes that spatial information struggles to discern. We demonstrate the efficacy of this approach by reconstructing the imagery of test scenes from both synthetic and measured data.

We use plenoptic measurements of visible, infrared, and THz radiation to locate and image objects that are hidden from direct view by detecting their passive radiation scattered from rough surfaces.

No abstract

We propose a novel passive procedure to estimate the 3D location of non-line-of-sight objects by measuring the light field of scattered long-wavelength infrared radiation. By scanning an infrared camera in a horizontal plane, the scattered light is collected as a light field cube. We introduce mathematics that separate the weak information-bearing signal in the light field cube from residual scattered light and utilize this information to determine highly precise object locations. Finally, we experimentally demonstrate the 3D localization procedure in a life-sized hallway consisting of diffusive walls using human-temperature non-line-of-sight objects.

We experimentally demonstrate depth estimation of human temperature NLOS objects from infrared light scattered off a construction wall. The measured IR light field is used to enhance the weak scattered signature and to perform depth estimation.