Automatic Object Detection, Labelling, and Localization by Camera’s Drone System

Abstract

This work explores the designing a system of an automated unmanned aerial vehicles (UAV( for objects detection, labelling, and localization using deep learning. This system takes pictures with a low-cost camera and uses a GPS unit to specify the positions. The data is sent to the base station via Wi-Fi connection.
 The proposed system consists of four main parts. First, the drone, which was assembled and installed, while a Raspberry Pi4 was added and the flight path was controlled. Second, various programs that were installed and downloaded to define the parts of the drone and its preparation for flight. In addition, this part included programs for both Raspberry Pi4 and servo, along with protocols for communication, video transmission, and sending and receiving signals between the drone and the computer. Third, a real-time, modified, one dimensional convolutional neural network (1D-CNN) algorithm, which was applied to detect and determine the type of the discovered objects (labelling). Fourth, GPS devices, which were used to determine the location of the drone starting and ending points . Trigonometric functions were then used for adjusting the camera angle and the drone altitude to calculate the direction of the detected object automatically.
 According to the performance evaluation conducted, the implemented system is capable of meeting the targeted requirements.

Compensation of Atmospheric Turbulence Phase Distortion Using Neural Network Adaptive Optics

“…Deployment: Once the model has been evaluated and tested, it can be deployed in a real-world application for which it was designed. In some cases, the model may need to be retrained periodically with new data to maintain its performance over time [50][51][52]. Following these steps, an NN-based AO system can be implemented to effectively correct wavefront distortions and improve image quality in astronomical observations.…”

Investigation of Numerical Simulation for Adaptive Optics System

“…The point object image, which is produced by optical system has been referred to as the impulse response or the Point Spread Function (PSF). It can be represented by [36][37][38]:…”

Improve The Fully Convolutional Network Accuracy by Levelset and The Deep Prior Method

“…ML methods can solve immense problems by analyzing massive amounts of data. Furthermore, deep learning techniques, mainly Deep Convolutional Neural Networks (DCNN), have been efficiently used in object detection [1], image classification [2], and caption creation [3]. CNN achieved better performance when compared with shallow and classical networks with hand-crafted features.…”