Feedback Strategies for Hypersonic Pursuit of a Ground Evader

Lee, Yoon Jae; Bakolas, Efstathios; Akella, Maruthi R.

doi:10.1109/aero53065.2022.9843434

Cited by 5 publications

(2 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the past, hypersonic aircraft mainly used traditional solutions, including unilateral trajectory planning [5][6][7][8][9][10][11] and bilateral game maneuvering [12][13][14][15][16][17][18][19], to deal with the PE problem.…”

Section: Introductionmentioning

confidence: 99%

“…Contrary to the unilateral design, game maneuvering considering the capabilities of both offensive and defensive sides generates maneuvering instructions by differential games [12][13][14], game theory [15][16][17], or other methods [18,19] to evade interceptors and implement target strikes. Among them, the most representative ones are the reference [13,15].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Intelligent Maneuver Strategy for a Hypersonic Pursuit-Evasion Game Based on Deep Reinforcement Learning

Guo,

Jiang,

Huang

et al. 2023

Aerospace

View full text Add to dashboard Cite

In order to improve the problem of overly relying on situational information, high computational power requirements, and weak adaptability of traditional maneuver methods used by hypersonic vehicles (HV), an intelligent maneuver strategy combining deep reinforcement learning (DRL) and deep neural network (DNN) is proposed to solve the hypersonic pursuit–evasion (PE) game problem under tough head-on situations. The twin delayed deep deterministic (TD3) gradient strategy algorithm is utilized to explore potential maneuver instructions, the DNN is used to fit to broaden application scenarios, and the intelligent maneuver strategy is generated with the initial situation of both the pursuit and evasion sides as the input and the maneuver game overload of the HV as the output. In addition, the experience pool classification strategy is proposed to improve the training convergence and rate of the TD3 algorithm. A set of reward functions is designed to achieve adaptive adjustment of evasion miss distance and energy consumption under different initial situations. The simulation results verify the feasibility and effectiveness of the above intelligent maneuver strategy in dealing with the PE game problem of HV under difficult situations, and the proposed improvement strategies are validated as well.

show abstract