Jiaxin Xie1,2, Siyu Chen3,2, Yongqing Zhang1,4, Dongrui Gao1,3, Tiejun Liu1. 1. School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, People's Republic of China. 2. These authors contributed equally. 3. School of Computer Science, Chengdu University of Information Technology, Chengdu 610225, People's Republic of China. 4. School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, People's Republic of China.
Abstract
OBJECTIVE: Motor imagery (MI) classification is an important task in the brain-computer interface (BCI) field. MI data exhibit highly dynamic characteristics and are difficult to obtain. Therefore, the performance of the classification model will be challenged. Recently, convolutional neural networks (CNNs) have been employed for MI classification and have demonstrated favorable performances. However, the traditional CNN model uses an end-to-end output method, and part of the feature information is discarded during the transmission process. APPROACH: Herein, we propose a novel algorithm, that is, a combined long short-term memory generative adversarial networks (LGANs) and multi-output convolutional neural network (MoCNN) for MI classification, and an attention network for improving model performance. Specifically, the proposed method comprises three steps. First, MI data are obtained, and preprocessing is performed. Second, additional data are generated for training. Here, a data augmentation method based on a LGAN is designed. Last, the MoCNN is proposed to improve the classification performance. MAIN RESULTS: The BCI competition IV datasets 2a and 2b are employed to evaluate the performance of the proposed method. With multiple evaluation indicators, the proposed generative model can generate more realistic data. The expanded training set improves the performance of the classification model. SIGNIFICANCE: The results show that the proposed method improves the classification of MI data, which facilitates motion imagination.
OBJECTIVE: Motor imagery (MI) classification is an important task in the brain-computer interface (BCI) field. MI data exhibit highly dynamic characteristics and are difficult to obtain. Therefore, the performance of the classification model will be challenged. Recently, convolutional neural networks (CNNs) have been employed for MI classification and have demonstrated favorable performances. However, the traditional CNN model uses an end-to-end output method, and part of the feature information is discarded during the transmission process. APPROACH: Herein, we propose a novel algorithm, that is, a combined long short-term memory generative adversarial networks (LGANs) and multi-output convolutional neural network (MoCNN) for MI classification, and an attention network for improving model performance. Specifically, the proposed method comprises three steps. First, MI data are obtained, and preprocessing is performed. Second, additional data are generated for training. Here, a data augmentation method based on a LGAN is designed. Last, the MoCNN is proposed to improve the classification performance. MAIN RESULTS: The BCI competition IV datasets 2a and 2b are employed to evaluate the performance of the proposed method. With multiple evaluation indicators, the proposed generative model can generate more realistic data. The expanded training set improves the performance of the classification model. SIGNIFICANCE: The results show that the proposed method improves the classification of MI data, which facilitates motion imagination.