| Literature DB >> 32947766 |
Muhammad Tariq Sadiq1, Xiaojun Yu1, Zhaohui Yuan1, Muhammad Zulkifal Aziz1.
Abstract
The development of fast and robust brain-computer interface (BCI) systems requires non-complex and efficient computational tools. The modern procedures adopted for this purpose are complex which limits their use in practical applications. In this study, for the first time, and to the best of our knowledge, a successive decomposition index (SDI)-based feature extraction approach is utilized for the classification of motor and mental imagery electroencephalography (EEG) tasks. First of all, the public datasets IVa, IVb, and V from BCI competition III were denoised using multiscale principal analysis (MSPCA), and then a SDI feature was calculated corresponding to each trial of the data. Finally, six benchmark machine learning and neural network classifiers were used to evaluate the performance of the proposed method. All the experiments were performed for motor and mental imagery datasets in binary and multiclass applications using a 10-fold cross-validation method. Furthermore, computerized automatic detection of motor and mental imagery using SDI (CADMMI-SDI) is developed to describe the proposed approach practically. The experimental results suggest that the highest classification accuracy of 97.46% (Dataset IVa), 99.52% (Dataset IVb), and 99.33% (Dataset V) was obtained using feedforward neural network classifier. Moreover, a series of experiments, namely, statistical analysis, channels variation, classifier parameters variation, processed and unprocessed data, and computational complexity, were performed and it was concluded that SDI is robust for noise, and a non-complex and efficient biomarker for the development of fast and accurate motor and mental imagery BCI systems.Entities:
Keywords: Brain-Computer Interface; classification; electroencephalography; mental imagery; motor imagery; multiscale principal component analysis; neurorehabilitation; successive decomposition index
Year: 2020 PMID: 32947766 PMCID: PMC7570740 DOI: 10.3390/s20185283
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Figure 1Block diagram of the successive decomposition index for identification of motor and mental imagery activities.
Figure 2Multiscale principal component analysis (MSPCA) for denoising.
Figure 3Scatter plot of SDI features for dataset IVa and IVb subjects.
Statistical analysis.
| Participants | MI Tasks | Mean | Std | Median | KW |
|---|---|---|---|---|---|
| “aa“ | ”Class 1 (RH)“ | 4.071 | 0.506 | 4.088 | 2.16 × 10−19 |
| ”Class 2 (RF)” | 4.633 | 0.175 | 4.626 | ||
| “al” | “Class 1 (RH)” | 3.994 | 0.498 | 3.986 | 0.06112 |
| “Class 2 (RF)” | 4.333 | 0.931 | 4.178 | ||
| “av” | “Class 1 (RH)” | 3.655 | 0.516 | 3.698 | 3.27 × 10−40 |
| “Class 2 (RF)” | 5.961 | 0.139 | 5.979 | ||
| “aw” | “Class 1 (RH)” | 3.811 | 0.343 | 3.737 | 0.0001927 |
| “Class 2 (RF)” | 3.966 | 0.323 | 3.925 | ||
| “ay” | “Class 1 (RH)” | 5.766 | 0.535 | 5.725 | 5.81 × 10−39 |
| “Class 2 (RF)” | 3.948 | 0.660 | 4.058 | ||
| “IVb” | “Class 1 (LH)” | 3.716 | 0.440 | 3.734 | 4.09 × 10−5 |
| “Class 2 (RF)” | 3.993 | 0.524 | 3.979 |
List of 3 channels automated criteria.
| Subjects | Selected Channels |
|---|---|
| aa | CCP5, CP5, CP6 |
| al | C3, FFC7, CCP3 |
| av | FT9, P8, PPO8 |
| aw | C4, CCP6, CP6 |
| ay | CCP5, C3, CFC5 |
| IVb | C3, CCP5, C4 |
Figure 4Bar plots for the comparison of 3-channel automated, 3-channel, 18-channel, and 118-channel results: (a) FFNN classifier and (b) SVM classifier.
Figure 5(a–d) 10-fold Sensitivity, Specificity, Kappa, F1-Score for FFNN Classifier. (e–h) Ten-fold Sensitivity, Specificity, Kappa, and F1-Score for SVM Classifier.
Figure 6(a–f) PAM for Subjects “aa”, “al”, “av”, “aw”, “ay” and “Dataset IVb” respectively using FFNN classifier. (g–l) PAM for Subjects “aa”, “al”, “av”, “aw”, “ay” and “Dataset IVb” respectively for SVM classifier.
Classification (%) results for different parameters of the classifier.
| “Classifiers” | “Variations in Parameters” | “aa” | “al” | “av” | “aw” | “ay” | “Dataset IVb” |
|---|---|---|---|---|---|---|---|
| “NN” | “5 Neurons” | 97.61 | 93.30 | 77.78 | 83.67 | 95.43 | 99.52 |
| “10 Neurons” | 95.00 | 91.05 | 86.67 | 90.67 | 97.33 | 99.05 | |
| “20 Neurons” | 97.61 | 98.20 | 87.22 | 89.33 | 98.23 | 97.62 | |
| “30 Neurons” | 97.61 | 97.33 | 76.94 | 93.00 | 99.24 | 98.57 | |
| “40 Neurons” | 99.41 | 95.49 | 85.97 | 93.00 | 99.10 | 99.05 | |
| “MNN” | “5 Neurons” | 87.32 | 84.55 | 81.25 | 81.00 | 97.55 | 98.10 |
| “10 Neurons” | 89.71 | 88.30 | 72.78 | 63.00 | 98.33 | 92.38 | |
| “20 Neurons” | 89.71 | 86.68 | 74.86 | 80.67 | 99.12 | 97.14 | |
| “30 Neurons” | 95.74 | 94.58 | 78.33 | 91.00 | 96.34 | 93.33 | |
| “40 Neurons” | 96.99 | 96.42 | 79.72 | 81.67 | 99.56 | 94.29 | |
| “CFNN” | “5 Neurons” | 99.38 | 98.66 | 94.03 | 98.33 | 98.12 | 99.05 |
| “10 Neurons” | 99.41 | 99.55 | 93.06 | 98.33 | 97.24 | 99.52 | |
| “20 Neurons” | 100.00 | 97.77 | 98.75 | 91.00 | 99.10 | 99.23 | |
| “30 Neurons” | 99.41 | 99.55 | 95.28 | 91.33 | 100 | 99.52 | |
| “40 Neurons” | 100.00 | 100.00 | 97.64 | 94.33 | 95.00 | 99.05 | |
| “FFNN” | “5 Neurons” | 99.38 | 99.11 | 94.03 | 96.33 | 97.11 | 98.10 |
| “10 Neurons” | 98.75 | 98.24 | 91.81 | 98.00 | 98.67 | 98.57 | |
| “20 Neurons” | 100.00 | 97.31 | 90.69 | 96.33 | 97.98 | 99.52 | |
| “30 Neurons” | 99.41 | 98.66 | 95.28 | 98.33 | 99.65 | 99.52 | |
| “40 Neurons” | 100 | 98.33 | 92.7 | 96.7 | 100 | 99.5 | |
| “SVM” | “RBF” | 63.57 | 62.92 | 64.58 | 69.00 | 91.12 | 83.33 |
| “Linear” | 94.08 | 88.38 | 85.42 | 84.67 | 95.65 | 96.19 | |
| “Polynomial” | 98.20 | 95.53 | 87.22 | 85.33 | 99.12 | 99.52 | |
| “DA” | “Linear” | 98.82 | 99.09 | 86.53 | 94.67 | 97.33 | 98.10 |
| “Pseudo Quadratic” | 94.12 | 97.81 | 84.58 | 86.67 | 100.00 | 93.24 | |
| “Pseudo Linear” | 98.82 | 99.09 | 85.42 | 84.00 | 99.12 | 95.10 |
Figure 7Results obtained with 10-fold 10 times.
Figure 8Comparison between denoised and noisy datasets.
Different cases consider for SDI experimental work by employing dataset V.
|
| “Class 1 (LH)” vs. |
| “Class 1 (LH)” vs. |
| Class 2 (RH) vs. |
|
| “Class 1 (LH)“ vs. |
| ”Class 1 (LH)“ vs. |
| ”Class 2 (RH)“ vs. |
|
| ”Class 1 (LH)“ vs. |
| ”Class 1 (LH)“ vs. |
| ”Class 2 (RH)“ vs. |
Classification accuracies (%) obtained with different cases by employing dataset V.
| Classifiers | Cases | “P1” | “P2” | “P3” |
|---|---|---|---|---|
| “NN” | Case 1 | 100.00 | 98.22 | 96.67 |
| Case 2 | 93.21 | 97.98 | 97.44 | |
| Case 3 | 100.00 | 97.12 | 98.43 | |
|
|
|
|
| |
| “MNN” | Case 1 | 100.00 | 99.88 | 93.08 |
| Case 2 | 98.43 | 95.16 | 98.30 | |
| Case 3 | 93.21 | 90.34 | 94.12 | |
|
|
|
|
| |
| “CFNN” | Case 1 | 98.44 | 99.12 | 97.12 |
| Case 2 | 98.49 | 99.12 | 98.45 | |
| Case 3 | 96.34 | 99.34 | 96.34 | |
|
|
|
|
| |
| “FFNN” | Case 1 | 99.12 | 98.24 | 99.89 |
| Case 2 | 100.00 | 99.13 | 97.12 | |
| Case 3 | 98.09 | 97.12 | 98.12 | |
|
|
|
|
| |
| “SVM” | Case 1 | 95.23 | 94.32 | 99.12 |
| Case 2 | 94.74 | 95.23 | 94.98 | |
| Case 3 | 85.54 | 81.52 | 87.34 | |
|
|
|
|
| |
| “DA” | Case 1 | 93.45 | 94.55 | 93.19 |
| Case 2 | 94.14 | 96.34 | 95.83 | |
| Case 3 | 88.32 | 91.78 | 89.15 | |
|
|
|
|
|
Figure 9Performance parameters of FFNN classifier for Dataset V.
CADMMI-SDI application.
| Application Components | Description |
|---|---|
| Load EEG Data | Load Sample EEG data for a specified destination. The file type must be *.csv or *.xlsx |
| Test EEG Signal | Load test data from a specific folder. The file format should be *.csv or *.xlsx |
| Classifiers | Choose a classifier by drop-down selection. |
| Start | A key to initiate/start the process |
| Channel # | Input desired number of channels and press “Plot” to display. The channel number should be separated by a comma |
| Summary | Text section to demonstrate the specifics of the process underway |
| Signals | 2D plot window to display EEG signals |
| Features Scatter Plot | 2D plot window to display SDI feature corresponding to each channel |
Figure 10A display of CADMMI-SDI portraying all features and functionalities.
Figure 11Bar plots representing time complexity: (a) Execution Time for SDI feature extraction method. (b) Training time. (c) Testing time.
Performance comparison of motor imagery EEG signals in terms of classification accuracy (%) with other literature.
| Methods By | Suggested Methods | Classification Accuracy (%) | ||||||
|---|---|---|---|---|---|---|---|---|
| “aa” | “al” | “av” | “aw” | “ay” | “Avg.” | “Std.” | ||
|
|
|
| 98.3 | 92.7 | 96.7 |
|
| 2.7 |
| our previous work in 2019 [ | “Multivariate empirical wavelet transform tested with least-square support vector machines” | 95 | 95 | 95 |
|
| 97 | 2.7 |
| our previous work in 2019 [ | “Empirical wavelet transform tested with least-square support vector machines”/our last work | 94.5 | 91.7 | 97.2 | 95.6 | 97 | 95.2 | 2.3 |
| work by “Wu” et al. in 2008 [ | “Iterative spatio-spectral patterns learning” | 93.6 |
| 79.3 | 99.6 | 98.6 | 94.2 | 8.7 |
| work by “Kevric” et al. in 2017 [ | “Wavelet packet decomposition tested with K nearest neighbors” | 96 | 92.3 | 88.9 | 95.4 | 91.4 | 92.8 | 2.9 |
| work by “Siuly” et al. in 2011 [ | “Clustering tested with least-square support vector machines“ | 92.6 | 84.9 | 90.8 | 86.5 | 86.7 | 88.3 | 3.2 |
| work by ”Song“ et al. in 2007 [ | “Common spatial pattern tested with support vector machines” | 87.4 | 97.4 | 69.7 | 96.8 | 88.6 | 87.9 | 11.2 |
| work by “Lu” et al. in 2010 [ | “Regularized common spatial pattern tested with aggregation“ | 76.8 | 98.2 | 74.5 | 92.2 | 77 | 83.7 | 10.7 |
| work by ”Zhang“ et al. in 2013 [ | “Z-score tested with linear discriminant analysis” | 77.7 |
| 68.4 | 99.6 | 59.9 | 81.1 | 18.1 |
| work by “Lotte“ et al. in 2010 [ | ”Regularized common spatial pattern with selected subjects“. | 70.5 | 96.4 | 53.5 | 71.9 | 75.4 | 73.6 | 15.3 |
| ”Common spatial pattern with Tikhonov regularization“. | 71.4 | 96.4 | 63.3 | 71.9 | 86.9 | 77.9 | 13.4 | |
| ”Common spatial pattern with weighted Tikhonov regularization“. | 69.6 | 98.2 | 54.6 | 71.9 | 85.3 | 75.9 | 16.6 | |
| ”Spatially regularization common spatial pattern“. | 72.3 | 96.4 | 60.2 | 77.7 | 86.5 | 78.6 | 13.8 | |
| work by ”Yong“ et al. in 2008 [ | ”Sparse spatial filter optimization“ | 57.5 | 86.9 | 54.4 | 84.4 | 84.3 | 73.5 | 16 |
Performance comparison of mental imagery EEG signals in terms of classification accuracy (%) with other literature.
| Methods By | Suggested Methods | Classification Accuracy (%) | ||||
|---|---|---|---|---|---|---|
| “P1” | “P2” | “P3” | “Avg.” | “Std.” | ||
|
|
| 88.9 |
|
|
|
|
| work by “Siuly” et al. in 2017 [ | “Principal component analysis employed with random forest” |
| 75.2 | 82.8 | 83.3 | 8.3 |
| research by “Lin” et al. in 2009 [ | “Modified partical swarm optimization employed with neural networks” | 78.3 | 75.2 | 56.5 | 69.9 | 11.81 |
| work by “Siuly” et al. in 2011 [ | “Clustering employed with least-square support vector machines” | 68.2 | 64.8 | 52.1 | 61.7 | 8.5 |
| experiments by “Sun” et al. in 2008 [ | “Selection of electrodes with the help of Ensemble method” | 68.7 | 56.4 | 44.8 | 56.7 | 11.9 |
| work by “Sun” et al. in 2007 [ | “Ensemble Methods” | 70.6 | 48.9 | 40.9 | 53.4 | 15.4 |
| work by “Sun” et al. in 2009 [ | “Automated common spatial method” | 67.7 | 68.1 | 59.6 | 65.1 | 4.82 |