Measuring the shape (coordinates x, y, z ) and spectral characteristics (wavelength-dependent reflectance R (λi)) of macroscopic objects as a function of time (t) is of great interest in areas such as medical imaging, precision agriculture, or optical sorting. Here, we present an approach that allows to determine all these quantities with high resolution and accuracy, enabling measurement in five dimensions. We call this approach 5D hyperspectral imaging. We describe the design and implementation of a 5D sensor operating in the visible to near-infrared spectral range, which provides excellent spatial and spectral resolution, great depth accuracy, and high frame rates. The results of various experiments strongly indicate the great benefit of the new technology.

The contactless estimation of vital signs using conventional color cameras and ambient light can be affected by motion artifacts and changes in ambient light. On both these problems, a multimodal 3D imaging system with an irritation-free controlled illumination was developed in this work. In this system, real-time 3D imaging was combined with multispectral and thermal imaging. Based on 3D image data, an efficient method was developed for the compensation of head motions, and novel approaches based on the use of 3D regions of interest were proposed for the estimation of various vital signs from multispectral and thermal video data. The developed imaging system and algorithms were demonstrated with test subjects, delivering a proof-of-concept.

The fields of optical 3D measurement system applications are continuously expanding and becoming more and more diverse. To evaluate appropriate systems for various measurement tasks, comparable parameters are necessary, whereas the 3D modulation transfer function (3D-MTF) has been established as a further criterion. Its aim is the determination of the system response between the measurement of a straight, sharp-edged cube and its opposite ideal calculated one. Within the scope of this work simulations and practical investigations regarding the 3D-MTF’s influences and its main issues are specifically investigated. Therefore, different determined edge radii representing the high-frequency spectra lead to various decreasing 3D-MTF characteristics. Furthermore, rising sampling frequencies improve its maximum transfer value to a saturation point in dependence of the radius. To approve these results of previous simulations, three fringe projection scanners were selected to determine the diversity. As the best 3D-MTF characteristic, a saturated transfer value of has been identified at a sufficient sampling frequency, which is reached at four times the Nyquist limit. This high 3D resolution can mainly be achieved due to an improved camera projector interaction. Additionally, too small sampling ratios lead to uncertainties in the edge function determination, while higher ratios do not show major improvements. In conclusion, the 3D-MTF algorithm has thus been practically verified and its repeatability as well as its robustness have been confirmed.