Hierarchical critic learning optimal control for lower limb exoskeleton robots with prescribed constraints

Abstract

This paper presents a hierarchical critic learning optimal control (H‐CLOC) strategy for a lower limb exoskeleton system with prescribed state constraints. The prescribed state constraints of the exoskeleton are mathematically modeled by means of a state error transition function, which transforms the constrained state into an equivalent new unconstrained state. A hierarchical framework including a high‐level motion trajectory planner and a low‐level critic learning (CL) controller is proposed for optimal control of the exoskeleton. The estimation of human motion intentions is achieved using dynamic movement primitives (DMPs), which are capable of accurately replicating the original training trajectories during motion. The CL algorithm is implemented on the transformed unconstrained system while enhancing the learning capability of the proposed algorithm for the exoskeleton. The optimal control with prescribed constraints is analyzed for stability using the Lyapunov theorem. Finally, simulation results validate the effectiveness of the proposed H‐CLOC strategy for lower limb exoskeletons.