Brain Responses to Errors During 3D Motion in a Hapto-Visual VR

Abstract

Abstract. We investigated brain potentials recorded by electroencephalography (EEG) signals in response to unpredictable haptic/kinesthetic disturbances to a continuously moving object in a hapto-visual 3D virtual world that highly resembles reality. Participants moved a virtual object from an initial position to a target position in the virtual environment. A large cylinder obscured part of the motion between the origin and the target. The position of the emerging object under the cylinder is disturbed, and hence unexpected, for part of the scenarios. This disturbance is perceived as an error. We examined the EEG signals locked to the error. Our results show a consistent disturbance-locked potential with an early negative peak followed by a positive peak. Peak-to-peak amplitude increased with the disturbance magnitude. Source estimation at the time of the negative and positive peaks revealed a strong activity in the vicinity of Brodmann area (BA) 7, known to be involved in hapto-visual integration and in the neural computation of dynamic motor errors. These results demonstrate the presence of haptic-disturbance-related brain activity under conditions of continuous motion. Results further suggest a feedback signal for error detection and correction in EEG-based Brain-Computer Interfaces (BCI) in applications such as telesurgery, manipulation of remote objects and rehabilitation.

Detecting System Errors in Virtual Reality Using EEG Through Error-Related Potentials

“…Yazmir et al [37] investigated the presence of error-related potentials in the brain activity of subjects submitted to errors in a hapto-visual task. The participants were asked to move a virtual object horizontally from an origin to a destination using a Phantom haptic arm.…”