An Experience Aggregative Reinforcement Learning With Multi-Attribute Decision-Making for Obstacle Avoidance of Wheeled Mobile Robot

Abstract

A variety of reinforcement learning (RL) methods are developed to achieve the motion control for the robotic systems, which has been a hot issue. However, the performance of the conventional RL methods often encounters a bottleneck, because the robots have difficulty in choosing an appropriate action in the control task due to the exploration-exploitation dilemma. To address this problem and improve the learning performance, this work introduces an experience aggregative reinforcement learning method with a Multi-Attribute Decision-Making (MADM) to achieve the real-time obstacle avoidance of wheeled mobile robot (WMR). The proposed method employs an experience aggregation method to cluster experiential samples and it can achieve more effective experience storage. Moreover, to achieve the effective action selection using the prior experience, an action selection policy based on a Multi-Attribute Decision-Making is proposed. Inspired by the hierarchical decision-making, this work decomposes the original obstacle avoidance task into two sub-tasks using a divide-and-conquer approach. Each sub-task is trained individually by a double Q-learning using a simple reward function. Each sub-task learns an action policy, which enables the sub-task to selects an appropriate action to achieve a single goal. The standardized rewards of sub-tasks are calculated when fusing these sub-tasks to eliminate differences in rewards for sub-tasks. Then, the proposed method integrates the prior experience of three trained sub-tasks via an action policy based on a MADM to complete the source task. Simulation results show that the proposed method outperforms competitors.

A Fuzzy Ensemble Method With Deep Learning for Multi-Robot System

“…In the future, we will extend the proposed method to more multi-agent systems. An adaptive strategy selection method is urgently needed to cooperate with situation assessment to achieve efficient decision-making [32][33] [34]. Besides, integrating the possibility of applying an advanced deep learning model [35] [36] for situation fusion is also a research direction.…”

Coordinated Load Shedding Control Scheme for Recovering Frequency in Islanded Microgrids

“…As one of the effective methods to solve the Q value overestimation problem in Q-learning, Double-Q learning was proposed in 2010 and widely used in reinforcement learning [29]- [30]. The Double-Q learning mechanism is shown in Fig.…”

Obstacle Avoidance Control for Multisteering Mode of Multiaxle Wheeled Robot Based on Trajectory Prediction Strategy

“…e FCE enables an autonomous robot to detect unknown obstacles and avoid collisions while guiding the robot toward the target. Hu et al [41] introduced an experiential aggregative reinforcement learning method based on multiattribute decision-making. To build a virtualforce field between the obstacles and the robot, Zheng et al [42] proposed a fast hybrid position/virtual force controller.…”