Deep reinforcement learning-based rehabilitation robot trajectory planning with optimized reward functions

Abstract

Deep reinforcement learning (DRL) provides a new solution for rehabilitation robot trajectory planning in the unstructured working environment, which can bring great convenience to patients. Previous researches mainly focused on optimization strategies but ignored the construction of reward functions, which leads to low efficiency. Different from traditional sparse reward function, this paper proposes two dense reward functions. First, azimuth reward function mainly provides a global guidance and reasonable constraints in the exploration. To further improve the efficiency, a process-oriented aspiration reward function is proposed, it is capable of accelerating the exploration process and avoid locally optimal solution. Experiments show that the proposed reward functions are able to accelerate the convergence rate by 38.4% on average with the mainstream DRL methods. The mean of convergence also increases by 9.5%, and the percentage of standard deviation decreases by 21.2%–23.3%. Results show that the proposed reward functions can significantly improve learning efficiency of DRL methods, and then provide practical possibility for automatic trajectory planning of rehabilitation robot.

Telehealth-Enabled In-Home Elbow Rehabilitation for Brachial Plexus Injuries Using Deep-Reinforcement-Learning-Assisted Telepresence Robots

“…Jin et al [ 9 ] have demonstrated the efficacy of DRL in improving post-stroke limb function, whereas Majhi and Kashyap [ 10 ] have explored adaptive algorithms for patient-specific therapy adjustments. Furthermore, the work by Wang et al [ 11 ] has been instrumental in showcasing how DRL can optimize engagement levels during robotic-assisted therapy. These studies underscore the potential of DRL to enhance the adaptability and personalization of rehabilitation protocols according to motor rehabilitation.…”

AI-based methodologies for exoskeleton-assisted rehabilitation of the lower limb: a review

“…We saw how deep reinforcement learning is still poorly investigated even if in other fields has been shown to surpass classical reinforcement learning. In particular deep reinforcement learning provides a new solution for rehabilitation robot trajectory planning and control strategies with a high accuracy (Wang et al, 2021a). Given the high quantity of algorithms available the choice strictly depends on the given problem (Arulkumaran et al, 2017).…”