Hierarchical control by a higher center and the rhythm generator contributes to realize adaptive locomotion

Abstract

Many cyclic movements of vertebrates are produced by a rhythm generator in the spinal cord, which is often referred to as the central pattern generator. Meanwhile, higher centers, such as the cerebellum, are also involved in motor control. In this study, we discuss the control and learning mechanisms of these two control systems, focusing on the following problems: (1) how these two control systems generate a motor command cooperatively without conflict, and (2) how these control systems acquire motor commands. As a possible model to solve these problems, we propose a hierarchical motor control learning model on the basis of physiological knowledge. This model assumes that the higher center learns the timing and amplitude of a motor command and sends control signals to the rhythm generator. The rhythm generator is tuned by the control signals and acquires the ability to output a motor command to realize a target motion. By applying this model to a simulation experiment of the learning control of a one-dimensional hopping robot, hopping at a desired height was successful. Our simulation results also show that a multiple control system involving the higher center and rhythm generator is more robust than a single control system.

Learning programs is better than learning dynamics: A programmable neural network hierarchical architecture in a multi-task scenario

“…In the Artificial Neural Network (ANN) literature, a somewhat simpler control scheme is usually adopted, in which hierarchies are implemented as two-level ANNs. Numerous studies have addressed the learning of action primitives (Hioki, Miyazaki, & Nishii, 2013; Paine & Tani, 2004; Tani, Nishimoto, & Paine, 2008; Yamauchi & Beer, 1994), the acquisition of multi-level control hierarchies for robot navigation (Chersi, Donnarumma, & Pezzulo, 2013; Tani, 2003; Tani, Nishimoto, & Paine, 2008; Tani & Nolfi, 1999) and the acquisition of sub-goals (Bakker & Schmidhuber, 2004; Dindo, Donnarumma, Chersi, & Pezzulo, 2015; Maisto, Donnarumma, & Pezzulo, 2015; Mcgovern & Barto, 2001; Mussa-Ivaldi & Bizzi, 2000; Thoroughman & Shadmehr, 2000).…”