Combining generative adversarial network and multi-output CNN for motor imagery classification

Abstract

Objective. Motor imagery (MI) classification is an important task in the brain–computer interface (BCI) field. MI data exhibit highly dynamic characteristics and are difficult to obtain. Therefore, the performance of the classification model will be challenged. Recently, convolutional neural networks (CNNs) have been employed for MI classification and have demonstrated favorable performances. However, the traditional CNN model uses an end-to-end output method, and part of the feature information is discarded during the transmission process. Approach. Herein, we propose a novel algorithm, that is, a combined long short-term memory generative adversarial networks (LGANs) and multi-output convolutional neural network (MoCNN) for MI classification, and an attention network for improving model performance. Specifically, the proposed method comprises three steps. First, MI data are obtained, and preprocessing is performed. Second, additional data are generated for training. Here, a data augmentation method based on a LGAN is designed. Last, the MoCNN is proposed to improve the classification performance. Main results. The BCI competition IV datasets 2a and 2b are employed to evaluate the performance of the proposed method. With multiple evaluation indicators, the proposed generative model can generate more realistic data. The expanded training set improves the performance of the classification model. Significance. The results show that the proposed method improves the classification of MI data, which facilitates motion imagination.

Research on the Style of Art Works based on Deep Learning

“…In this paper, the LBP method is adopted to extract texture features, as shown in formula (17) [24]:…”

Generative adversarial networks in EEG analysis: an overview

“…Motor Imagery (MI) is the activation of motor-related brain regions because of imagining a specific body part’s movement [ 21 ]. The decoding of the MI EEG signals is considered one of the main pillars of BCI studies.…”

Implementation of Financial Audited Robot Question and Answer Technology of Feature Processing and Improved Bi-LSTM

“…e reason is that people will make a judgment on text matching by comprehensively analyzing global semantic information, contextual semantic information, word similarity, as well as other external knowledge, and so on. On the premise of integrating information of different granularity levels, the text matching model is established by using the input layer, presentation layer, and matching layer, and its frame structure is shown in Figure 6 [17].…”