Evaluation of a time-gated-single-pixel-camera as a promising sensor for autonomous vehicles in harsh weather conditions

Bett, Claudia

doi:10.1051/jeos/2023023

Cited by 5 publications

(1 citation statement)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In a recent paper, we evaluated the performance of a time-gated-single-pixel-camera in adverse weather conditions with simulated data [8]. Here, we want to present first results with real measured data, which we acquired with our time gated camera.…”

Section: Introductionmentioning

confidence: 99%

Time-gated-single-pixel-camera: a promising sensor for robust object detection in adverse weather conditions for autonomously driven vehicles

Bett

Daiber-Huppert

Frenner

2023

Fifteenth International Conference on Machine Vision (ICMV 2022)

View full text Add to dashboard Cite

The degree of autonomy in vehicles depends directly on the performance of their sensor systems. The transition to even more autonomously driven cars therefore requires the development of robust sensor systems with different skills. Especially in adverse and changing weather conditions (rain, snow, fog, etc.), conventional sensor systems such as cameras perform unreliably. Moreover, data evaluation has to be performed in real-time, i.e. within a fraction of seconds, in order to safely guide the car through traffic and to avoid a crash with any obstacle. Therefore, we propose to use a so called timegated-single-pixel-camera, which combines the principles of time gating and compressed sensing [1]. In a single pixel camera, the amount of recorded data can be significantly reduced compared to a conventional camera by exploiting the inherent sparsity of scenes. The lateral information is gained with the help of binary masks in front of a simple photodiode. We optimize the pattern of the masks by including them as trainable parameters within our data evaluation neural network. Additionally, our camera is able to cope with adverse weather conditions due to the underlying time gating principle. The feasibility of our method is demonstrated by simulated and measured data as well.

show abstract

Section: Introductionmentioning

confidence: 99%

Time-gated-single-pixel-camera: a promising sensor for robust object detection in adverse weather conditions for autonomously driven vehicles

Bett

Daiber-Huppert

Frenner

2023

Fifteenth International Conference on Machine Vision (ICMV 2022)

View full text Add to dashboard Cite

show abstract

Development of a LiDAR system for low visibility conditions

Vierhub-Lorenz¹,

Gangelhoff²,

Werner³

et al. 2023

Optical Measurement Systems for Industrial Inspection XIII

View full text Add to dashboard Cite

Over the past years a lot of effort is being focused on realizing the vision of fully autonomously driving vehicles. The achievement of this goal strongly depends on the development of sensors that allow the perception of the environment by scanning it with high speed, precision and resolution. The sensors employed in autonomous vehicles typically comprise cameras, Radar and LiDAR Systems. Especially LiDAR and Camera Sensors deliver the necessary high-resolution data, but both suffer from strongly degrading signals in low visibility conditions. To guarantee the safe operation of autonomously driving vehicles the existing sensors need to be improved with respect to these conditions and new sensors need to be developed. In this contribution we present a LiDAR system design that is optimized for the operation in low visibility conditions. On one hand we address the technical details of the system such as choice of laser, detector, deflection unit and signal processing electronics. Besides the technical details of the system, we discuss the physical and technological limitations such as wavelength dependent scattering and absorption and eye safety considerations. We further give an outlook on a sensor fusion approach with a time-gated sensor with high lateral resolution for a better recognition of objects obscured by scattering media.

show abstract

Towards image-free object detection for autonomous vehicles under harsh environmental conditions

Bett

Frenner

Reichelt

2023

Optical Measurement Systems for Industrial Inspection XIII

View full text Add to dashboard Cite

There exist two key aspects to enable autonomous vehicles: Robust sensors to provide all relevant data concerning the vehicle's surroundings as well as algorithms to evaluate this data in real time. Apart from radar and ultrasonic sensors, optical sensors such as lidar and cameras are state-of-the-art in prototype autonomous vehicles. In adverse weather conditions, such as e.g. fog, snow, dust, heavy rain or poorly illuminated scenes, though, those sensors do not perform reliably. Recently, we proposed to use a time-gated-single-pixel-camera to not only significantly reduce the amount of recorded data but additionally filter ballistic object photons, i.e. suppress the effect of noise from the obscuring medium. Apart from generating 3D object information, such a system can operate fast enough to deal with the highly dynamic environment as well as respect eye-safety norms. Moreover, a time-gated-single-pixel-camera offers the ability of image-free detection of all relevant objects within the scene which speeds up data evaluation as well. Here, we want to report on our progress towards realizing such a system. We will demonstrate image-free object detection on simulated data. We realize multi-object detection by generating object heat-maps for the different classes. Additionally, we discuss the difficulties we have to overcome to robustly detect objects in real measured data and shortly present our prototype setup, which we have implemented on a car together with our partners from Fraunhofer

show abstract

Evaluation of a time-gated-single-pixel-camera as a promising sensor for autonomous vehicles in harsh weather conditions

Cited by 5 publications

References 31 publications

Time-gated-single-pixel-camera: a promising sensor for robust object detection in adverse weather conditions for autonomously driven vehicles

Time-gated-single-pixel-camera: a promising sensor for robust object detection in adverse weather conditions for autonomously driven vehicles

Development of a LiDAR system for low visibility conditions

Towards image-free object detection for autonomous vehicles under harsh environmental conditions

Contact Info

Product

Resources

About