Evolutionary Reinforcement Learning System with Time-Varying Parameters

Abstract

In this paper, an evolutionary reinforcement learning system with time-varying parameters that can learn appropriate policy in dynamical POMDPs is proposed. The proposed system has time-varying parameters that can be adjusted by using reinforcement learning. Hence, the system can adapt to the time variation of the dynamical environment even if its variation cannot be observed. In addition, the state space of the environment is divided evolutionarily. So, one need not to divide the state space in advance. The efficacy of the proposed system is shown by mobile robot control simulation under the environment belongs to dynamical POMDPs. The environment is the passage that has gates iterate opening and closing.PDMDPs

Evolutionary reinforcement learning system with time-varying parameters

“…However, the learning systems proposed so far employ fixed learning parameters, and it is difficult to handle time-varying parameters. This study deals with such dynamical POMDP environments in which time changes cannot be observed, and proposes an appropriate learning method [9,10]. The proposed system employs learnable time-varying parameters, and thus is easily applicable to dynamical environments.…”