Object Detection from a Vehicle Using Deep Learning Network and Future Integration with Multi-Sensor Fusion Algorithm

Abstract

Accuracy in detecting a moving object is critical to autonomous driving or advanced driver assistance systems (ADAS). By including the object classification from multiple sensor detections, the model of the object or environment can be identified more accurately. The critical parameters involved in improving the accuracy are the size and the speed of the moving object. All sensor data are to be used in defining a composite object representation so that it could be used for the class information in the core object's description. This composite data can then be used by a deep learning network for complete perception fusion in order to solve the detection and tracking of moving objects problem. Camera image data from subsequent frames along the time axis in conjunction with the speed and size of the object will further contribute in developing better recognition algorithms. In this paper, we present preliminary results using only camera images for detecting various objects using deep learning network, as a first step toward multi-sensor fusion algorithm development. The simulation experiments based on camera images show encouraging results where the proposed deep learning network based detection algorithm was able to detect various objects with certain degree of confidence. A laboratory experimental setup is being commissioned where three different types of sensors, a digital camera with 8 megapixel resolution, a LIDAR with 40m range, and ultrasonic distance transducer sensors will be used for multi-sensor fusion to identify the object in real-time.

Traffic Scene Analysis and Classification using Deep Learning

“…Two data sets have been evaluated using three GoogleNet, VggNet, and ResNet50 architectures in this research, and the highest level of accuracy has been obtained with the ResNet50 architecture. Through object classification with sensors, the model of the object or location can be recognized more accurately (15). An optimal approach to improve face recognition with and without a mask is proposed using machine learning and deep learning techniques, which use three classifiers: SVM, KNN, and DNN.…”

Investigation of Object Detection and Identification at Different Lighting Conditions for Autonomous Vehicle Application

“…Subsequently, Tensorflow Lite was used by deep learning to do the data learning for a person, motorcycle, car, bus, and truck. Then, the output of the moving object detection will be displayed [28]. Meanwhile, on how to enable the designed program to have the capability to perform the detection and identification task, the flow chart in Figure 4 At initial, the images for each object which included cars, trucks, motorcycles, buses, and people, were gathered to perform this experiment.…”

Coordinated control for path-following of an autonomous four in-wheel motor drive electric vehicle

“…The decision-making controller constantly communicates with the vehicle's surrounding environment via different sensors such as LIDAR, GPS, RADAR and camera to identify lanes, pedestrians, obstacles and other cars around the vehicle. [34][35][36][37][38][39] After processing data, according to vehicle current condition, the decision-making controller generates the desired path to meet the AGV's mission.…”