Optimized Multi-Spectral Filter Arrays for Spectral Reconstruction

Abstract

Multispectral filter array (MSFA)-based imaging is a compact, practical technique for snapshot spectral image capturing and reconstruction. The imaging and reconstruction quality is highly influenced by the spectral sensitivities and spatial arrangement of channels on MSFAs, and the used reconstruction method. In order to design a MSFA with high imaging capacity, we propose a sparse representation based approach to optimize spectral sensitivities and spatial arrangement of MSFAs. The proposed approach first overall models the various errors associated with spectral reconstruction, and then uses a global heuristic searching method to optimize MSFAs via minimizing the estimated error of MSFAs. Our MSFA optimization method can select filters from off-the-shelf candidate filter sets while assigning the selected filters to the designed MSFA. Experimental results on three datasets show that the proposed method is more efficient, flexible, and can design MSFAs with lower spectral construction errors when compared with existing state-of-the-art methods. The MSFAs designed by our method show better performance than others even using different spectral reconstruction methods.

Jointly Learning Band Selection and Filter Array Design for Hyperspectral Imaging

“…The advance in CFA design for RGB cameras sparks great interests in the CFA design for MS cameras [55,45,43,44,1,24,38,47,15,6,63,56]. An early work by Ramanath et al presented a CFA pattern which is composed of seven bands and they are arranged hexagonally [55].…”

Noninvasive hemoglobin sensing and imaging: optical tools for disease diagnosis

“…Nonetheless, optimization of the target wavelengths for snapshot imagers can substantially improve their performance. 166 , 184 – 187 …”

“…Nonetheless, optimization of the target wavelengths for snapshot imagers can substantially improve their performance. 166,[184][185][186][187] In addition to these intensity-based imaging methods, spatial frequency domain imaging (SFDI) can be used to interrogate hemoglobin-related biomarkers by exploiting modulated illumination of the tissue. SFDI typically uses sinusoidal patterns and extracts the demodulation of these patterns reflected from tissue to calculate absorption and scattering properties; 123,188 low frequencies are more sensitive to absorption whereas high frequencies are more sensitive to scattering.…”

Real-time Hyperspectral Imaging in Hardware via Trained Metasurface Encoders

“…Human eyes are not the best imaging apparatus for every possible realworld scenario. The works of [6,47,53] expand the concept of RGB cameras to arbitrary low-dimensional sampling of reflectance spectra. These works employ different variants of optimization routines, which converge to a set of optimal projectors from an initial number of candidates.…”