Hand movement classification based on surface electromyography (sEMG) pattern recognition is a promising approach for upper limb neuroprosthetic control. However, maintaining day-to-day performance is challenged by the non-stationary nature of sEMG in real-life operation. In this study, we propose a self-recalibrating classifier that can be automatically updated to maintain a stable performance over time without the need for user retraining. Our classifier is based on convolutional neural network (CNN) using short latency dimension-reduced sEMG spectrograms as inputs. The pretrained classifier is recalibrated routinely using a corrected version of the prediction results from recent testing sessions. Our proposed system was evaluated with the NinaPro database comprising of hand movement data of 40 intact and 11 amputee subjects. Our system was able to achieve ~10.18% (intact, 50 movement types) and ~2.99% (amputee, 10 movement types) increase in classification accuracy averaged over five testing sessions with respect to the unrecalibrated classifier. When compared with a support vector machine (SVM) classifier, our CNN-based system consistently showed higher absolute performance and larger improvement as well as more efficient training. These results suggest that the proposed system can be a useful tool to facilitate long-term adoption of prosthetics for amputees in real-life applications.

One of the fundamental principles of cortical brain regions, including the hippocampus, is that information is represented in the ensemble firing of populations of neurons, i.e., spatio-temporal patterns of electrophysiological activity. The hippocampus has long been known to be responsible for the formation of declarative, or fact-based, memories. Damage to the hippocampus disrupts the propagation of spatio-temporal patterns of activity through hippocampal internal circuitry, resulting in a severe anterograde amnesia. Developing a neural prosthesis for the damaged hippocampus requires restoring this multiple-input, multiple-output transformation of spatio-temporal patterns of activity. Because the mechanisms underlying synaptic transmission and generation of electrical activity in neurons are inherently nonlinear, any such prosthesis must be based on a nonlinear multiple-input, multiple-output model. In this paper, we have formulated the transformational process of multi-site propagation of spike activity between two subregions of the hippocampus (CA3 and CA1) as the identification of a multiple-input, multiple-output (MIMO) system, and proposed that it can be decomposed into a series of multiple-input, single-output (MISO) systems. Each MISO system is modeled as a physiologically plausible structure that consists of 1) linear/nonlinear feedforward Volterra kernels modeling synaptic transmission and dendritic integration, 2) a linear feedback Volterra kernel modeling spike-triggered after-potentials, 3) a threshold for spike generation, 4) a summation process for somatic integration, and 5) a noise term representing intrinsic neuronal noise and the contributions of unobserved inputs. Input and output spike trains were recorded from hippocampal CA3 and CA1 regions of rats performing a spatial delayed-nonmatch-to-sample memory task that requires normal hippocampal function. Kernels were expanded with Laguerre basis functions and estimated using a maximum-likelihood method. Complexity of the feedforward kernel was progressively increased to capture higher-order system nonlinear dynamics. Results showed higher prediction accuracies as kernel complexity increased. Self-kernels describe the nonlinearities within each input. Cross-kernels capture the nonlinear interaction between inputs. Second- and third-order nonlinear models were found to successfully predict the CA1 output spike distribution based on CA3 input spike trains. First-order, linear models were shown to be insufficient.

Developing a neural prosthesis for the damaged hippocampus requires restoring the transformation of population neural activities performed by the hippocampal circuitry. To bypass a damaged region, output spike trains need to be predicted from the input spike trains and then reinstated through stimulation. We formulate a multiple-input, multiple-output (MIMO) nonlinear dynamic model for the input-output transformation of spike trains. In this approach, a MIMO model comprises a series of physiologically-plausible multiple-input, single-output (MISO) neuron models that consist of five components each: (1) feedforward Volterra kernels transforming the input spike trains into the synaptic potential, (2) a feedback kernel transforming the output spikes into the spike-triggered afterpotential, (3) a noise term capturing the system uncertainty, (4) an adder generating the pre-threshold potential, and (5) a threshold function generating output spikes. It is shown that this model is equivalent to a generalized linear model with a probit link function. To reduce model complexity and avoid overfitting, statistical model selection and cross-validation methods are employed to choose the significant inputs and interactions between inputs. The model is applied successfully to the hippocampal CA3-CA1 population dynamics. Such a model can serve as a computational basis for the development of hippocampal prostheses.

This paper describes the development of a cognitive prosthesis designed to restore the ability to form new long-term memories typically lost after damage to the hippocampus. The animal model used is delayed nonmatch-to-sample (DNMS) behavior in the rat, and the “core” of the prosthesis is a biomimetic multi-input/multi-output (MIMO) nonlinear model that provides the capability for predicting spatio-temporal spike train output of hippocampus (CA1) based on spatio-temporal spike train inputs recorded presynaptically to CA1 (e.g., CA3). We demonstrate the capability of the MIMO model for highly accurate predictions of CA1 coded memories that can be made on a single-trial basis and in real-time. When hippocampal CA1 function is blocked and long-term memory formation is lost, successful DNMS behavior also is abolished. However, when MIMO model predictions are used to reinstate CA1 memory-related activity by driving spatio-temporal electrical stimulation of hippocampal output to mimic the patterns of activity observed in control conditions, successful DNMS behavior is restored. We also outline the design in very-large-scale integration for a hardware implementation of a 16-input, 16-output MIMO model, along with spike sorting, amplification, and other functions necessary for a total system, when coupled together with electrode arrays to record extracellularly from populations of hippocampal neurons, that can serve as a cognitive prosthesis in behaving animals.

Using a wireless single channel EEG device, we investigated the feasibility of using short-term frontal EEG as a means to evaluate the dynamic changes of mental workload. Frontal EEG signals were recorded from twenty healthy subjects performing four cognitive and motor tasks, including arithmetic operation, finger tapping, mental rotation and lexical decision task. Our findings revealed that theta activity is the common EEG feature that increases with difficulty across four tasks. Meanwhile, with a short-time analysis window, the level of mental workload could be classified from EEG features with 65%–75% accuracy across subjects using a SVM model. These findings suggest that frontal EEG could be used for evaluating the dynamic changes of mental workload.