Material Classification Using Raw Time-of-Flight Measurements

Su, Shuochen; Heide, Felix; Swanson, Robin; Klein, Jonathan; Callenberg, Clara; Hullin, Matthias B.; Heidrich, Wolfgang

doi:10.1109/cvpr.2016.381

Cited by 49 publications

(40 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…'UVA' letters were used for this 3D depth imaging. The edges of each letter are recognizable, which supports the possibility of using a demonstrated ToF sensor for object and material recognition applications [37][38][39][40] . The fast switching performance of the hetero-integrated devices also elicits great potential for a spacious mapping application, such as LiDAR, where high-resolution can be realized by fast pulse repetition rate.…”

Section: Hetero-integration Of Gan Hemts and Gaas Vcselsmentioning

confidence: 67%

Hetero-integration enables fast switching time-of-flight sensors for light detection and ranging

Park

Baek

Dinare

et al. 2020

Sci Rep

View full text Add to dashboard Cite

The time-of-flight (ToF) principle is a method used to measure distance and construct three-dimensional (3D) images by detecting the time or the phase difference between emitted and back-reflected optical flux. The ToF principle has been employed for various applications including light ranging and detection (LiDAR), machine vision and biomedical engineering; however, bulky system size and slow switching speed have hindered the widespread application of ToF technology. To alleviate these issues, a demonstration of hetero-integration of GaN-based high electron mobility transistors (HEMTs) and GaAs-based vertical cavity surface emitting lasers (VCSELs) on a single platform via a cold-welding method was performed. The hetero-integrated ToF sensors show superior switching performance when compared to silicon-transistor-based systems, miniaturizing size and exhibiting stable ranging and high-resolution depth-imaging. This hetero-integrated system of dissimilar material-based highperformance devices suggests a new pathway towards enabling high-resolution 3D imaging and inspires broader range application of heterogeneously integrated electronics and optoelectronics.

show abstract

Section: Hetero-integration Of Gan Hemts and Gaas Vcselsmentioning

confidence: 67%

Hetero-integration enables fast switching time-of-flight sensors for light detection and ranging

Park

Baek

Dinare

et al. 2020

Sci Rep

View full text Add to dashboard Cite

show abstract

“…Material Recognition of Subsurface Scattering: The use of delay and exposure can yield fundamental new information about light scattering in materials, particularly subsurface scattering. Previous researchers have used time-of-flight measurements to achieve a similar result [28], [57]. Consider the delay profile for a given material.…”

Section: Results: Delay Profiles and Materials Recognitionmentioning

confidence: 99%

Programmable Non-Epipolar Indirect Light Transport: Capture and Analysis

Kubo

Jayasuriya

Iwaguchi

et al. 2021

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

The decomposition of light transport into direct and global components, diffuse and specular interreflections, and subsurface scattering allows for new visualizations of light in everyday scenes. In particular, indirect light contains a myriad of information about the complex appearance of materials useful for computer vision and inverse rendering applications. In this paper, we present a new imaging technique that captures and analyzes components of indirect light via light transport using a synchronized projector-camera system. The rectified system illuminates the scene with epipolar planes corresponding to projector rows, and we vary two key parameters to capture plane-to-ray light transport between projector row and camera pixel: (1) the offset between projector row and camera row in the rolling shutter (implemented as synchronization delay), and (2) the exposure of the camera row. We describe how this synchronized rolling shutter performs illumination multiplexing, and develop a nonlinear optimization algorithm to demultiplex the resulting 3D light transport operator. Using our system, we are able to capture live short and long-range non-epipolar indirect light transport, disambiguate subsurface scattering, diffuse and specular interreflections, and distinguish materials according to their subsurface scattering properties. In particular, we show the utility of indirect imaging for capturing and analyzing the hidden structure of veins in human skin.

show abstract

“…This aspect allows our method to overcome some of the critical practical limitations of the related imaging methods. The proposed method requires hardware (mostly consumer-grade electronics) that is far less expensive than that required for the TOF-based NLOS imaging [16,24,25,26,27,33,37,39,40], and the method is more robust than the memoryeffect based imaging techniques that have a limited field-ofview [11,21]. Moreover, a recent publication [31] also uses only ordinal digital cameras but would require very specific scene setup (an accidental occlusion) to obtain better performance.…”

Section: Related Workmentioning

confidence: 99%

Direct Object Recognition Without Line-Of-Sight Using Optical Coherence

Lei

Tan

et al. 2019

2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

View full text Add to dashboard Cite

Visual object recognition under situations in which the direct line-of-sight is blocked, such as when it is occluded around the corner, is of practical importance in a wide range of applications. With coherent illumination, the light scattered from diffusive walls forms speckle patterns that contain information of the hidden object. It is possible to realize non-line-of-sight (NLOS) recognition with these speckle patterns. We introduce a novel approach based on speckle pattern recognition with deep neural network, which is simpler and more robust than other NLOS recognition methods. Simulations and experiments are performed to verify the feasibility and performance of this approach.

show abstract

Material Classification Using Raw Time-of-Flight Measurements

Cited by 49 publications

References 19 publications

Hetero-integration enables fast switching time-of-flight sensors for light detection and ranging

Hetero-integration enables fast switching time-of-flight sensors for light detection and ranging

Programmable Non-Epipolar Indirect Light Transport: Capture and Analysis

Direct Object Recognition Without Line-Of-Sight Using Optical Coherence

Contact Info

Product

Resources

About