Spatio-spectro-temporal coded aperture design for multiresolution compressive spectral video sensing

Abstract

Abstract-Colored coded apertures (CCA) have been introduced in compressive spectral imaging (CSI) systems entailing richer coding strategies. CCA incorporate a wavelengthdependent coding procedure, which not only achieves spatial but also spectral coding in a single step. Even though the use of the CCA offers significant advantages and could also be applied to compressive spectral video sensing, this later application still exhibits diverse challenges originated by the temporal variable. The scene motion during the acquisition yields to motion artifacts such that these artifacts get aliased during the video reconstruction, damaging the entire data. As a result, multiresolution approaches have been proposed in order to alleviate the aliasing and enhance the video reconstruction. In this paper, it is proposed an algorithm to generate temporal colored coded aperture patterns that allow to sense the spatial, spectral and temporal information in an uniform way such that each spectral frame is spatially sensed at least once. In addition, it is proposed a multiresolution approach in the spectral multiplexing system allowing to extract optical flow estimates to address a higher quality reconstruction. Simulation results show an improvement up to 6 dB in terms of peak-signal to noise ratio (PSNR) in the reconstruction quality with the multiresolution approach using the designed patterns with respect to traditional random structures.