Composing Synergistic Macro Actions for Reinforcement Learning Agents

Chen, Yuming; Chang, Kaun-Yu; Liu, Chien; Hsiao, Tsu-Ching; Hong, Zhang-Wei; Lee, Chun-Yi

doi:10.1109/tnnls.2022.3213606

IEEE Trans. Neural Netw. Learning Syst.

2024

DOI: 10.1109/tnnls.2022.3213606

|View full text |Cite

Composing Synergistic Macro Actions for Reinforcement Learning Agents

Yuming Chen

Kaun-Yu Chang²,

Chien Liu

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Enhancing Multi-Agent Cooperation Through Action-Probability-Based Communication

Bai,

Sugawara

2024

J. Robot. Mechatron.

View full text Add to dashboard Cite

Although communication plays a pivotal role in achieving coordinated activities in multi-agent systems, conventional approaches often involve complicated high-dimensional messages generated by deep networks. These messages are typically indecipherable to humans, are relatively costly to transmit, and require intricate encoding and decoding networks. This can pose a design limitation for the agents such as autonomous (mobile) robots. This lack of interpretability can lead to systemic issues with security and reliability. In this study, inspired by common human communication about likely actions in collaborative endeavors, we propose a novel approach in which each agent’s action probabilities are transmitted to other agents as messages, drawing inspiration from the common human practice of sharing likely actions in collaborative endeavors. Our proposed framework is referred to as communication based on action probabilities (CAP), and focuses on generating straightforward, low-dimensional, interpretable messages to support multiple agents in coordinating their activities to achieve specified cooperative goals. CAP streamlines our comprehension of the agents’ learned coordinated and cooperative behaviors and eliminates the need to use additional network models to generate messages. CAP’s network architecture is simpler than that of state-of-the-art methods, and our experimental results show that it nonetheless performed comparably, converged faster, and exhibited a lower volume of communication with better interpretability.

show abstract

Enhancing Multi-Agent Cooperation Through Action-Probability-Based Communication

Bai,

Sugawara

2024

J. Robot. Mechatron.

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Composing Synergistic Macro Actions for Reinforcement Learning Agents

Cited by 1 publication

References 15 publications

Enhancing Multi-Agent Cooperation Through Action-Probability-Based Communication

Enhancing Multi-Agent Cooperation Through Action-Probability-Based Communication

Contact Info

Product

Resources

About