SIRL: Self-Imitation Reinforcement Learning for Single-step Hitting Tasks

Luo, Yongle; Wang, Yuxin; Dong, Kun; Liu, Yu; Sun, Zhiyong; Zhang, Qiang; Song, Bo

doi:10.1109/icarm58088.2023.10218831

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Other1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Task-Oriented Self-Imitation Learning for Robotic Autonomous Skill Acquisition

Ran,

2024

Int. J. Human. Robot.

View full text Add to dashboard Cite

The inferior sample efficiency of reinforcement learning (RL) and the requirement for high-quality demonstrations in imitation learning (IL) will hinder their application in real-world robots. To address this challenge, a novel self-evolution framework, named task-oriented self-imitation learning (TOSIL), is proposed. To circumvent external demonstrations, the top-K self-generated trajectories are chosen as expert data from both per-episode exploration and long-term return perspectives. Each transition is assigned a guide reward, which is formulated by these trajectories. The guide rewards update as the agent evolves, encouraging good exploration behaviors. This methodology guarantees that the agent explores in the direction relevant to the task, improving sample efficiency and asymptotic performance. The experimental results on locomotion and manipulation tasks indicate that the proposed framework outperforms other state-of-the-art RL methods. Furthermore, the integration of suboptimal trajectories has the potential to improve the sample efficiency while maintaining performance. This is a significant advancement in autonomous skill acquisition for robots.

show abstract