Transformer in reinforcement learning for decision-making: a survey

Yuan, Weilin; Chen, Jiaxing; Chen, Shaofei; Feng, Dawei; Hu, Zhenzhen; Li, Peng; Zhao, Weiwei

doi:10.1631/fitee.2300548

Front Inform Technol Electron Eng

2024

DOI: 10.1631/fitee.2300548

|View full text |Cite

Transformer in reinforcement learning for decision-making: a survey

Weilin Yuan,

Jiaxing Chen,

Shaofei Chen

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 98 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Intelligent Path Planning for UAV Patrolling in Dynamic Environments Based on the Transformer Architecture

Yu,

Tsai,

Chang

2024

Electronics

View full text Add to dashboard Cite

Due to its NP-Hard property, the Travelling Salesman Problem (TSP) has long been a prominent research topic in path planning. The goal is to design the algorithm with the fastest execution speed in order to find the path with the lowest travelling cost. In particular, new generative AI technology is continually emerging. The question of how to exploit algorithms from this realm to perform TSP path planning, especially in dynamic environments, is an important and interesting problem. The TSP application scenario investigated by this paper is that of an Unmanned Aerial Vehicle (UAV) that needs to patrol all specific ship-targets on the sea surface before returning to its origin. Hence, during the flight, we must consider real-time changes in wind velocity and direction, as well as the dynamic addition or removal of ship targets due to mission requirements. Specifically, we implement a Deep Reinforcement Learning (DRL) model based on the Transformer architecture, which is widely used in Generative AI, to solve the TSP path-planning problem in dynamic environments. Finally, we conduct numerous simulation experiments to compare the performance of our DRL model and the traditional heuristic algorithm, the Simulated Annealing (SA) method, in terms of operation time and path distance in solving the ordinary TSP, to verify the advantages of our model. Notably, traditional heuristic algorithms cannot be applied to dynamic environments, in which wind velocity and direction can change at any time.

show abstract

Intelligent Path Planning for UAV Patrolling in Dynamic Environments Based on the Transformer Architecture

Yu,

Tsai,

Chang

2024

Electronics

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Transformer in reinforcement learning for decision-making: a survey

Cited by 1 publication

References 98 publications

Intelligent Path Planning for UAV Patrolling in Dynamic Environments Based on the Transformer Architecture

Intelligent Path Planning for UAV Patrolling in Dynamic Environments Based on the Transformer Architecture

Contact Info

Product

Resources

About