Multi-Agent Reinforcement Learning Control for Consensus Problems of Uncertain Nonlinear Multi-Agent Systems

Zhu, Haijing; Mao, Weijie

doi:10.1109/cac53003.2021.9728588

Cited by 1 publication

(1 citation statement)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…6-7 ⃝). Unlike the above action-value function methods, UPDET [101] replaces the RNN-based component in the individual value function with a Transformer to optimize the policy at an action-group level and fits tasks with different observations and action configuration requirements, which offers significant improvements on the transfer capability of a multiagent system, especially in hard and complex multiagent tasks.…”

Section: Transformer-based Multiagent Reinforcement Learningmentioning

confidence: 99%

Transformer in Reinforcement Learning for Decision-Making: A Survey

Yuan¹,

Chen²,

Chen³

et al. 2023

Preprint

View full text Add to dashboard Cite

<p>Reinforcement learning (RL) has become a dominant decision-making paradigm and has achieved notable success in many real-world applications, such as autonomous driving, robotic manipulation, robotic navigation and gaming AI. However, the powerful abilities of the RL variants were developed with advanced machine learning techniques. For example, deep neural networks play a crucial role in unlocking RL’s potential in large-scale decision-making tasks. Inspired by present day major successes of Transformer in natural language processing and computer vision, numerous bottlenecks have been overcome by combining Transformer with RL for decision-making. This paper presents a multiangle systematic survey of various Transformerbased RL (TransRL) models applied in decision-making tasks, including basic models, advanced algorithms, representative implementation instances, applications, and known challenges. Our work aims to provide insights into problems that inherently arise with the current RL approaches, and examines how we can address them with better TransRL models. To our knowledge, we are the first to present a comprehensive review of the recent Transformers research developments in RL for decisionmaking. We hope this survey provides a comprehensive review of TransRL models and also inspires the RL community in its pursuit of future directions. Finally, to keep track of the rapid TransRL developments in the decision-making domains, we summarize the latest relevant papers and their open-source implementations at https://github.com/williamyuanv0/Transformerin-Reinforcement-Learning-for-Decision-Making-A-Survey.</p>

show abstract

Section: Transformer-based Multiagent Reinforcement Learningmentioning

confidence: 99%