This paper presents a teleoperation control for an exoskeleton robotic system based on the brain-machine interface (BMI) and vision feedback. Vision compressive sensing, brainmachine reference commands, and adaptive fuzzy controllers in joint-space have been effectively integrated to enable robot performing manipulation tasks guided by human operator's mind. First, a visual-feedback link is implemented by video captured by a camera, allowing him/her to visualize the manipulator's workspace and the movements being executed. Then, compressed images are used as feedback errors in a nonvector space for producing SSVEP (Steady-State Visual Evoked Potentials) electroencephalography (EEG) signals, and it requires no prior information on features in contrast to the traditional visual servoing. The proposed EEG decoding algorithm generates control signals for the exoskeleton robot using features extracted from neural activity. Considering coupled dynamics and actuator input constraints during the robot manipulation, a local adaptive fuzzy controller has been designed following Lyapunov synthesis to drive the exoskeleton tracking the intended trajectories in human operator's mind and to provide a convenient way of dynamics compensation with minimal knowledge of the dynamics parameters of the exoskeleton robot. Extensive experiment studies employing three subjects have been performed to verify the validity of the proposed method.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.