3D single-pixel video

Abstract

Photometric stereo is an established three-dimensional (3D) imaging technique for estimating surface shape and reflectivity using multiple images of a scene taken from the same viewpoint but subject to different illumination directions. Importantly, this technique requires the scene to remain static during image acquisition otherwise pixel-matching errors can introduce significant errors in the reconstructed image. In this work, we demonstrate a modified photometric stereo system with perfect pixel-registration, capable of reconstructing 3D images of scenes exhibiting dynamic behavior in real-time. Performing high-speed structured illumination of a scene and sensing the reflected light with four spatially-separated, single-pixel detectors, our system reconstructs continuous real-time 3D video at ∼8 frames per second for image resolutions of 64×64 pixels. Moreover, since this approach does not use a pixelated camera sensor, it can be readily extended to other wavelengths, such as the infrared, where camera technology is expensive.S Online supplementary data available from stacks.iop.org/JOPT/18/035203/mmedia

Single-pixel 3D reconstruction via a high-speed LED array

“…If the images are captured at the same time, the imaging rate of photometric stereo will be improved to be much faster. In structured light illumination based single-pixel 3D imaging, several detectors measure the back-scattered light intensities form different locations simultaneously, solving the problem of shooting sequence [13,19]. The 2D images reconstructed by different detectors appears to be illuminated from different directions.…”

“…An alternative and more fundamental approach will be to increase the rate of structured illumination. Previous works more or less suffered from the limited rate of the structured illumination, reaching 64 × 64 pixel resolution at 8 frame per second with a 22 KHz digital-micromirrordevice [19], or 32 × 32 pixel resolution at 10 fps with a 10 KHz LED array [27]. A 32 × 32 resolution LED array with a 500 KHz illumination rate was proposed in our previous work [28], achieving 1000 fps single-pixel imaging at a 25% compressive rate.…”

Multi-resolution progressive computational ghost imaging

“…Because all the photons transmitted (or reflected) from the object illuminate the same bucket detector, this technique has the superiority of high sensitivity in detection and high efficiency in information extraction [2], and in recent years, it has aroused increasing interest in the applications like remote sensing [3,4], biomedical imaging [5,6,7,8], super-resolution [9], optical encryption [10]. However, GI needs massive measurements to obtain an image with good visibility, which is difficult to realize real-time imaging [11]. Although the measurements can be decreased by some image reconstruction algorithms such as compressive ghost imaging, the optimization procedure of image restoration is timeconsuming and the computation resource required is relatively high, especially for a scene with a large field of view (FOV) and high resolution [12], which also hindered its application.…”

Fast Compressive 3D Single-pixel Imaging

“…A number of compressed sensing schemes have been developed in recent years to enable real-time compressed sensing for large image resolutions. In this work, we employ one of these compressive strategies, known as evolutionary compressed sensing [4,5], to demonstrate a real-time 3D single-pixel imaging system at ~8 Hz for 64 x 64 image resolution, 4 times faster than a conventional raster-scanning sampling strategy.…”