No abstract

This paper focuses on a training-based method to reconstruct a scene's spectral reflectance from a single RGB image captured by a camera with known spectral response. In particular, we explore a new strategy to use training images to model the mapping between cameraspecific RGB values and scene reflectance spectra. Our method is based on a radial basis function network that leverages RGB white-balancing to normalize the scene illumination to recover the scene reflectance. We show that our method provides the best result against three state-of-art methods, especially when the tested illumination is not included in the training stage. In addition, we also show an effective approach to recover the spectral illumination from the reconstructed spectral reflectance and RGB image. As a part of this work, we present a newly captured, publicly available, data set of hyperspectral images that are useful for addressing problems pertaining to spectral imaging, analysis and processing.

No abstract

A) Source image (B) Target image (C) Our method (D) Reinhard et al. [2001] (E) Pitie et al. [2007] (F) Xiao and Ma [2009] Figure 1: This figure compares color transfer results of several methods. Our method incorporates information about the source and target scene illuminants and constrains the color transfer to lie within the color gamut of the target image. Our resulting image has a more natural look and feel than existing methods. Abstract This paper proposes a new approach for color transfer between two images. Our method is unique in its consideration of the scene illumination and the constraint that the mapped image must be within the color gamut of the target image. Specifically, our approach first performs a white-balance step on both images to remove color casts caused by different illuminations in the source and target image. We then align each image to share the same 'white axis' and perform a gradient preserving histogram matching technique along this axis to match the tone distribution between the two images. We show that this illuminant-aware strategy gives a better result than directly working with the original source and target image's luminance channel as done by many previous methods. Afterwards, our method performs a full gamut-based mapping technique rather than processing each channel separately. This guarantees that the colors of our transferred image lie within the target gamut. Our experimental results show that this combined illuminant-aware and gamut-based strategy produces more compelling results than previous methods. We detail our approach and demonstrate its effectiveness on a number of examples.

Project AutoVision aims to develop localization and 3D scene perception capabilities for a self-driving vehicle. Such capabilities will enable autonomous navigation in urban and rural environments, in day and night, and with cameras as the only exteroceptive sensors. The sensor suite employs many cameras for both 360-degree coverage and accurate multi-view stereo; the use of low-cost cameras keeps the cost of this sensor suite to a minimum. In addition, the project seeks to extend the operating envelope to include GNSS-less conditions which are typical for environments with tall buildings, foliage, and tunnels. Emphasis is placed on leveraging multi-view geometry and deep learning to enable the vehicle to localize and perceive in 3D space. This paper presents an overview of the project, and describes the sensor suite and current progress in the areas of calibration, localization, and perception.