Abstract.Objectives. Recent studies have started to explore the implementation of braincomputer interfaces (BCI) as part of driving assistant systems. The current study presents an EEG-based BCI that decodes error-related brain activity. Such information can be used, e.g., to predict driver's intended turning direction before reaching road intersections. Approach. We executed experiments in a car simulator (N = 22) and a real car (N = 8). While subject was driving, a directional cue was shown before reaching an intersection, and we classified the presence or not of an error-related potentials from EEG to infer whether the cued direction coincided with the subject's intention. In this protocol, the directional cue can correspond to an estimation of the driving direction provided by a driving assistance system. We analyze ERPs elicited during normal driving and evaluated the classification performance in both offline and online tests.Results. An average classification accuracy of 0.698 ± 0.065 was obtained in offline experiments in the car simulator, while tests in the real car yielded a performance of 0.682 ± 0.059. The results were significantly higher than chance level for all cases. Online experiments led to equivalent performances in both simulated and real car driving experiments. These results support the feasibility of decoding these signals to help estimating whether the driver's intention coincides with the advice provided by the driving assistant in a real car. Significance. The study demonstrates a BCI system in real-world driving, extending the work from previous simulated studies. As far as we know, this is the first online study in real car decoding driver's error-related brain activity. Given the encouraging results, the paradigm could be further improved by use of more sophisticated machine learning approaches and possibly be combined with applications in intelligent vehicles.

No abstract

The use of neural signals for prosthesis control is an emerging frontier of research to restore lost function to amputees and the paralyzed. Electrocorticography (ECoG) brain-machine interfaces (BMI) are an alternative to EEG and neural spiking and local field potential BMI approaches. Conventional ECoG BMIs rely on spectral analysis at specific electrode sites to extract signals for controlling prostheses. We compare traditional features with information about the connectivity of an ECoG electrode network. We use time-varying dynamic Bayesian networks (TV-DBN) to determine connectivity between ECoG channels in humans during a motor task. We show that, on average, TV-DBN connectivity decreases from baseline preceding movement and then becomes negative, indicating an alteration in the phase relationship between electrode pairs. In some subjects, this change occurs preceding and during movement, before changes in low or high frequency power. We tested TV-DBN output in a hand kinematic decoder and obtained an average correlation coefficient (r2) between actual and predicted joint angle of 0.40, and as high as 0.66 in one subject. This result compares favorably with spectral feature decoders, for which the average correlation coefficient was 0.13. This work introduces a new feature set based on connectivity and demonstrates its potential to improve ECoG BMI accuracy.

Brain-machine interfaces (BMIs) translate neural activities of the brain into specific instructions that can be carried out by external devices. BMIs have the potential to restore or augment motor functions of paralyzed patients suffering from spinal cord damage. The neural activities have been used to predict the 2D or 3D movement trajectory of monkey's arm or hand in many studies. However, there are few studies on decoding the wrist movement from neural activities in center-out paradigm. The present study developed an invasive BMI system with a monkey model using a 10×10-microelectrode array in the primary motor cortex. The monkey was trained to perform a two-dimensional forelimb wrist movement paradigm where neural activities and movement signals were simultaneous recorded. Results showed that neuronal firing rates highly correlated with forelimb wrist movement; > 70% (105/149) neurons exhibited specific firing changes during movement and > 36% (54/149) neurons were used to discriminate directional pairs. The neuronal firing rates were also used to predict the wrist moving directions and continuous trajectories of the forelimb wrist. The four directions could be classified with 96% accuracy using a support vector machine, and the correlation coefficients of trajectory prediction using a general regression neural network were above 0.8 for both horizontal and vertical directions. Results showed that this BMI system could predict monkey wrist movements in high accuracy through the use of neuronal firing information.

Abstract-Neural signatures of humans' movement intention can be exploited by future neuroprosthesis. We propose a method for detecting self-paced upper limb movement intention from brain signals acquired with both invasive and noninvasive methods. In the first study with scalp electroencephalograph (EEG) signals from healthy controls, we report single trial detection of movement intention using movementrelated potentials (MRPs) in a frequency range between 0.1 to 1 Hz. Movement intention can be detected above chance level (p<0.05) on average 460 ms before the movement onset with low detection rate during the non-movement intention period. Using intracranial EEG (iEEG) from one epileptic subject, we detect movement intention as early as 1500 ms before movement onset with accuracy above 90% using electrodes implanted in the bilateral supplementary motor area (SMA). The coherent results obtained with non-invasive and invasive method and its generalization capabilities across different days of recording, strengthened the theory that self-paced movement intention can be detected before movement initiation for the advancement in robot-assisted neurorehabilitation.