Air Channel Planning Based on Improved Deep Q-Learning and Artificial Potential Fields

Abstract

With the rapid advancement of unmanned aerial vehicle (UAV) technology, the widespread utilization of UAVs poses significant challenges to urban low-altitude safety and airspace management. In the coming future, the quantity of drones is expected to experience a substantial surge. Effectively regulating the flight behavior of UAVs has become an urgent and imperative issue that needs to be addressed. Hence, this paper proposes a standardized approach to UAV flight through the design of an air channel network. The air channel network comprises numerous single air channels, and this study focuses on investigating the characteristics of a single air channel. To achieve optimal outcomes, the concept of the artificial potential field algorithm is integrated into the deep Q-learning algorithm during the establishment of a single air channel. By improving the action space and reward mechanism, the resulting single air channel enables efficient avoidance of various buildings and obstacles. Finally, the algorithm is assessed through comprehensive simulation experiments, demonstrating its effective fulfillment of the aforementioned requirements.

Thrust Vector Control within a Geometric Sphere, and the Use of Euler's Tips to Create Jet Technology

“…Drone swarms have gained great popularity because, as a group, they can perform highly intelligent tasks [45]. Effective regulation of the behavior of an unmanned vehicle in flight has become a pressing and imperative issue that requires solutions [46]. These publications illustrate the fundamentals of swarm systems and provide future predictions.…”

Interdisciplinary Studies of Jet Systems using Euler Methodology and Computational Fluid Dynamics Technologies

“…Nowadays, the requirements for the accuracy of high-speed control of aircraft generally, and unmanned vehicles in particular, have increased [10][11][12], which is particularly important for a swarm of unmanned vehicles [13][14][15]. For unmanned vehicles, AI-based learning [16,17], including large ones [18], improves control performance. AI is applied to avoid collisions with obstacles [19][20][21].…”