Material Type Recognition of Indoor Scenes via Surface Reflectance Estimation

Abstract

There are fundamental difficulties in obtaining material type of an arbitrary object using traditional sensors. Existing material type recognition methods mostly focus on color based visual features and object-prior. Surface reflectance is another critical clue in the characterization of certain material type and can be observed by traditional sensors such as color camera and time-of-flight depth sensor. A material type is characterized well by relevant surface reflectance together with traditional visual appearance providing better description for material type recognition. In this work, we propose a material type recognition method based on both color and reflectance features using deep neural network. Proposed method is evaluated on both public and our own data sets showing promising material type recognition results.

Automatic Recognition of Indoor Fire and Combustible Material with Material-Auxiliary Fire Dataset

“…They tested the simplicity, effectiveness, robustness, and efficiency of the HMF2 model on two benchmark datasets. Lee et al [27] proposed a material-type identification method using a deep CNN based on color and reflectance features. The proposed method was evaluated on public datasets, showing promising results for material type identification.…”

Instantaneous Material Classification Using a Polarization-Diverse RMCW LIDAR

“…Several authors have looked at using off-the-shelf time-of-flight (ToF) cameras to exploit depth errors for classifying materials in an image, independent of the material color [7,11]; Tanaka et al also demonstrated that the accuracy could be greatly improved from 55.0% to 89.9% by sweeping the modulation frequency as well [7].…”