Q-learning based Path Planning Method for UAVs using Priority Shifting

Carvalho, Kevin Braathen de; Oliveira, Iure Rosa L. de; Villa, Daniel Khéde Dourado; Caldeira, Alexandre G.; Sarcinelli-Filho, Mário; Brandão, Alexandre Santos

doi:10.1109/icuas54217.2022.9836175

Cited by 12 publications

(1 citation statement)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Learning makes it possible to assess each chromosome's fitness within the GA population. The cumulative rewards earned throughout the Q-learning process can be used to assess fitness [17]. Update the Qvalues based on the Q-learning equation using the hybrid technique afterward.…”

Section: Hybrid Ga/ql Approachesmentioning

confidence: 99%

Energy Efficient Path Planning Scheme for Unmanned Aerial Vehicle Using Hybrid Generic Algorithm-Based Q-Learning Optimization

Saeed,

Ali,

Abdelhaq

et al. 2024

IEEE Access

View full text Add to dashboard Cite

Efficient path planning optimization strategies are required to maximize flying time while consuming the least energy. This research offers a novel approach for energy-efficient path planning for Unmanned Aerial Vehicles (UAVs) that combines a hybrid evolutionary algorithm and Q-learning while accounting for the UAV's velocity and distance from obstacles. To overcome the constraints of traditional optimization approaches, the hybrid methodology combines genetic algorithms and Q-learning. The suggested approach optimizes path-planning decisions based on realtime information by considering the UAV's velocity and distance from obstacles. Genetic Algorithm (GA) creates a wide collection of candidate pathways. In contrast, Q-learning uses reinforcement learning to make educated selections based on the UAV's present velocity and proximity to static obstacles. This integration allows the UAV to modify its path dynamically based on its energy requirements and environmental constraints. The main goal is to develop a UAV path planning scheme capable of dealing with obstacle-filled environments to improve energy efficiency and collision avoidance during flight missions. Our experimental results show that the hybrid technique outperforms the classical GA method in terms of energy efficiency by significantly reducing energy consumption while maintaining a suitable collision rate and the best path cost to the desired locations. The analysis results improve the performance of the hybrid GA/QL algorithm by more than 57.14% compared to classical GA.

show abstract

Section: Hybrid Ga/ql Approachesmentioning

confidence: 99%