Research on Evasion Policy of UCAV Against Infrared Air-to-Air Missile Based on Soft Actor Critic Algorithm

Huang, Conghui; Wang, Chaozhe; Chai, Shijie; Qi, Tao; Li, Yong

doi:10.1145/3547578.3547602

Cited by 2 publications

(2 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, V Hx0 and V Hy0 have the same components in the X and Y directions as the target's velocity at the time of release. The gravitational acceleration is taken as g = 9.8 m/s 2 and the air density as ρ = 1.29 kg/m 3 .…”

Section: Simulation Results and Analysismentioning

confidence: 99%

“…The adjoint method is used to analyze the effects of the target barrel roll rate, the number of simultaneous deployments of point source decoys, and the deployment interval on the miss distance in Reference [2]. Reference [3] analyzed the miss distance and anti-jamming probability of different anti-jamming methods for seekers in complex adversarial scenarios. The guidance laws mentioned in the above references are all analyzed using the PNG, indicating that infrared decoys have a significant impact on the PNG.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Design of Convergent and Accurate Guidance Law with Finite Time in Complex Adversarial Scenarios

Ding,

Wang,

et al. 2024

Aerospace

View full text Add to dashboard Cite

The target can deceive the flight vehicle by releasing an infrared decoy to make the line-of-sight (LOS) angle rate deflect greatly, thus causing the flight vehicle to miss the target. Therefore, in order to accurately strike the target in complex adversarial scenarios, this paper proposes a finite-time convergence guidance law (FTCG) combined with a finite-time disturbance observer (FTDO). The complex adversarial scenario is established by combining the relative motion model between the flight vehicle and the target and the motion model of the infrared decoy. Based on this, considering the dynamic characteristic of the flight vehicle’s autopilot, a guidance model is obtained. Utilizing sliding mode control theory and finite-time control theory, an FTCG of the LOS angle rate is designed. Then, the finite-time convergence of the guidance law is proved and the total convergence time is derived. Finally, for the target maneuvering that is difficult to measure in the guidance law, an FTDO is used to estimate and compensate for the target maneuvering in the guidance law. Simulation results show that the FTCG can make the LOS angle rate quickly converge and accurately strike the target in different scenarios, with a good guidance accuracy and robustness. Compared with the sliding mode guidance law (SMGL) and the adaptive sliding mode guidance law (ASMGL) based on an extended state observer (ESO), the advantages of the designed guidance law are illustrated. Finally, FTCG is extended to be three dimensional and compared with the proportional navigation guidance law (PNG) to further illustrate its effectiveness in a three-dimensional coordinate system.

show abstract

Section: Simulation Results and Analysismentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Design of Convergent and Accurate Guidance Law with Finite Time in Complex Adversarial Scenarios

Ding,

Wang,

et al. 2024

Aerospace

View full text Add to dashboard Cite

show abstract

Evade Unknown Pursuer via Pursuit Strategy Identification and Model Reference Policy Adaptation (MRPA) Algorithm

Su,

Zheng,

et al. 2024

Drones

View full text Add to dashboard Cite

The game of pursuit–evasion has always been a popular research subject in the field of Unmanned Aerial Vehicles (UAVs). Current evasion decision making based on reinforcement learning is generally trained only for specific pursuers, and it has limited performance for evading unknown pursuers and exhibits poor generalizability. To enhance the ability of an evasion policy learned by reinforcement learning (RL) to evade unknown pursuers, this paper proposes a pursuit UAV attitude estimation and pursuit strategy identification method and a Model Reference Policy Adaptation (MRPA) algorithm. Firstly, this paper constructs a Markov decision model for the pursuit–evasion game of UAVs that includes the pursuer’s attitude and trains an evasion policy for a specific pursuit strategy using the Soft Actor–Critic (SAC) algorithm. Secondly, this paper establishes a novel relative motion model of UAVs in pursuit–evasion games under the assumption that proportional guidance is used as the pursuit strategy, based on which the pursuit UAV attitude estimation and pursuit strategy identification algorithm is proposed to provide adequate information for decision making and policy adaptation. Furthermore, a Model Reference Policy Adaptation (MRPA) algorithm is presented to improve the generalizability of the evasion policy trained by RL in certain environments. Finally, various numerical simulations imply the precision of pursuit UAV attitude estimation and the accuracy of pursuit strategy identification. Also, the ablation experiment verifies that the MRPA algorithm can effectively enhance the performance of the evasion policy to deal with unknown pursuers.

show abstract

Research on Evasion Policy of UCAV Against Infrared Air-to-Air Missile Based on Soft Actor Critic Algorithm

Cited by 2 publications

References 2 publications

Design of Convergent and Accurate Guidance Law with Finite Time in Complex Adversarial Scenarios

Design of Convergent and Accurate Guidance Law with Finite Time in Complex Adversarial Scenarios

Evade Unknown Pursuer via Pursuit Strategy Identification and Model Reference Policy Adaptation (MRPA) Algorithm

Contact Info

Product

Resources

About