Reconstruction of multispectral light field (5d plenoptic function) based on compressive sensing with colored coded apertures from 2D projections

Abstract

ABSTRACT:In the last decade, spatio -angular (light field) acquisition systems have advanced due to the inclusion of coded apertures in the optical path. These coded apertures, modulate the light, encoding the information before being captured. Traditionally, these coded apertures are binary, i.e. block and unblock the light rays in the spatial dimension, capturing sparse information of the scene. In this work, the binary coded aperture is replaced by a colored coded aperture which modulates the source not only spatially but spectrally. Thereby, it is possible to capture light fields in multiple wavelengths yielding high spectral resolution. The spectral information provides many features of a scene in different wavelengths, these features are not present in the visible range of the electromagnetic spectrum. In this paper, an algorithm that simulates the light field sampling with colored coded apertures is proposed. The proposed algorithm, exploits the redundant information of the scene based on the compressive sensing theory thus, capturing just a sparse signal. The multidimensional image can be recovered from the underlying signal through a reconstruction algorithm. Several simulations show the quality of the multispectral light field reconstructions. The PSNR (Peak Signal to Noise Ratio) values obtained for the reconstructions are around 25 dB.