| Literature DB >> 34065035 |
Enrico Zero1, Chiara Bersani1, Roberto Sacile1.
Abstract
Automatizing the identification of human brain stimuli during head movements could lead towards a significant step forward for human computer interaction (HCI), with important applications for severely impaired people and for robotics. In this paper, a neural network-based identification technique is presented to recognize, by EEG signals, the participant's head yaw rotations when they are subjected to visual stimulus. The goal is to identify an input-output function between the brain electrical activity and the head movement triggered by switching on/off a light on the participant's left/right hand side. This identification process is based on "Levenberg-Marquardt" backpropagation algorithm. The results obtained on ten participants, spanning more than two hours of experiments, show the ability of the proposed approach in identifying the brain electrical stimulus associate with head turning. A first analysis is computed to the EEG signals associated to each experiment for each participant. The accuracy of prediction is demonstrated by a significant correlation between training and test trials of the same file, which, in the best case, reaches value r = 0.98 with MSE = 0.02. In a second analysis, the input output function trained on the EEG signals of one participant is tested on the EEG signals by other participants. In this case, the low correlation coefficient values demonstrated that the classifier performances decreases when it is trained and tested on different subjects.Entities:
Keywords: brain electrical activity; brain-computer interface; feedforward neural networks; system identification
Mesh:
Year: 2021 PMID: 34065035 PMCID: PMC8150891 DOI: 10.3390/s21103345
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Figure 1System architecture.
Figure 2Top vision of the layout of the experimental set environment.
Figure 3EEG Enobio Cap.
The files used to identify the function .
| Part. ID | File ID | Duration Time (s) | Start Time | Head Position Occurrence |
|---|---|---|---|---|
| P1 | F1 | 328 | 0 | L 14.2%, F 59.5%, R 26.3% |
| P1 | F2 | 310 | 51 d | L 28.9%, F 60.7%, R 10.5% |
| P1 | F3 | 319 | 51 d | L 18.0%, F 59.9%, R 22.1% |
| P1 | F4 | 336 | 54 d | L 12.0%, F 60.3%, R 27.7% |
| P1 | F5 | 335 | 54 d | L 11.9%, F 60.3%, R 27.8% |
| P1 | F6 | 328 | 54 d | L 18.5%, F 60.9%, R 20.6% |
| P1 | F7 | 306 | 100 d | L 17.9%, F 61.5%, R 20.6% |
| P1 | F8 | 307 | 100 d | L 20.2%, F 59.6%, R 20.2% |
| P1 | F9 | 328 | 100 d | L 16.7%, F 59.9%, R 23.4% |
| P1 | F10 | 305 | 100 d | L 22.8%, F 61.1%, R 16.1% |
| P2 | F1 | 341 | 0 | L 21.6%, F 60.7%, R 17.7% |
| P2 | F2 | 321 | 68 d | L 19.1%, F 59.8%, R 21.2% |
| P2 | F3 | 325 | 68 d | L 12.7%, F 60.3%, R 27.1% |
| P2 | F4 | 354 | 68 d | L 22.9%, F 61.7%, R 15.4% |
| P2 | F5 | 384 | 68 d | L 17.5%, F 61.3%, R 21.2% |
| P2 | F6 | 304 | 85 d | L 11.0%, F 60.4%, R 28.6% |
| P2 | F7 | 314 | 85 d | L 17.0%, F 59.5%, R 23.5% |
| P2 | F8 | 312 | 85 d | L 30.5%, F 60.9%, R 8.7% |
| P2 | F9 | 316 | 85 d | L 23.3%, F 62.0%, R 14.7% |
| P2 | F10 | 316 | 85 d | L 17.0%, F 60.1%, R 22.9% |
| P3 | F1 | 314 | 0 | L 19.1%, F 59.6%, R 21.3% |
| P4 | F1 | 300 | 0 | L 25.9%, F 59.3%, R 14.8% |
| P5 | F1 | 399 | 0 | L 16.8%, F 60.0%, R 23.2% |
| P6 | F1 | 308 | 0 | L 11.0%, F 60.7%, R 28.4% |
| P7 | F1 | 356 | 0 | L 23.0%, F 61.7%, R 15.8% |
| P8 | F1 | 304 | 0 | L 25.5%, F 61.7%, R 12.8% |
| P9 | F1 | 366 | 0 | L 19.7%, F 60.4%, R 19.9% |
| P10 | F1 | 377 | 0 | L 24.8%, F 59.6%, R 15.6% |
| P10 | F2 | 339 | 1 h | L 22.1%, F 59.9%, R 18.0% |
Figure 4Trend of channels O1, O2, and CZ vs. the output signal in file P4 F1.
Threshold values to evaluate correlation performance.
|
| Correlation Performance |
|---|---|
| 0.50 ≤ | strong |
| 0.30 ≤ | moderate |
| Weak |
Prediction performances by the first analysis.
| Participant ID | File ID |
|
|
|---|---|---|---|
| P1 | F1 | 0.12 | 0.86 |
| P1 | F2 | 0.20 | 0.80 |
| P1 | F3 | 0.32 | 0.78 |
| P1 | F4 | 0.14 | 0.84 |
| P1 | F5 | 0.26 | 0.78 |
| P1 | F6 | 0.21 | 0.71 |
| P1 | F7 | 0.30 | 0.61 |
| P1 | F8 | 0.37 | 0.48 |
| P1 | F9 | 0.42 | 0.79 |
| P1 | F10 | 0.38 | 0.38 |
| P2 | F1 | 0.31 | 0.71 |
| P2 | F2 | 0.19 | 0.86 |
| P2 | F3 | 0.12 | 0.88 |
| P2 | F4 | 0.16 | 0.86 |
| P2 | F5 | 0.16 | 0.82 |
| P2 | F6 | 0.29 | 0.82 |
| P2 | F7 | 0.30 | 0.78 |
| P2 | F8 | 0.28 | 0.57 |
| P2 | F9 | 0.27 | 0.76 |
| P2 | F10 | 0.35 | 0.87 |
| P3 | F1 | 0.31 | 0.82 |
| P4 | F1 | 0.02 | 0.98 |
| P5 | F1 | 0.13 | 0.91 |
| P6 | F1 | 0.37 | 0.59 |
| P7 | F1 | 0.35 | 0.66 |
| P8 | F1 | 0.33 | 0.76 |
| P9 | F1 | 0.33 | 0.78 |
| P10 | F1 | 0.18 | 0.89 |
| P10 | F2 | 0.32 | 0.93 |
r Values (P1).
|
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
| 0.90 | −0.18 | −0.21 | −0.73 | −0.39 | −0.74 | 0.40 | −0.17 | −0.35 | −0.15 |
|
| −0.23 | 0.78 | 0.59 | −0.79 | −0.70 | −0.78 | −0.32 | −0.21 | −0.42 | −0.47 |
|
| −0.33 | 0.52 | 0.71 | −0.8 | −0.65 | −0.81 | −0.19 | −0.35 | −0.10 | −0.14 |
|
| 0.01 | −0.59 | −0.56 | 0.84 | 0.73 | 0.82 | 0.04 | 0.57 | 0.15 | 0.19 |
|
| 0.06 | −0.53 | −0.5 | 0.84 | 0.82 | 0.84 | 0.49 | −0.09 | −0.01 | 0.08 |
|
| 0.17 | −0.54 | −0.47 | 0.84 | 0.76 | 0.85 | 0.37 | −0.15 | 0.13 | 0.13 |
|
| 0.70 | −0.14 | −0.14 | 0.70 | 0.60 | 0.70 | 0.67 | 0.27 | −0.07 | −0.02 |
|
| −0.11 | −0.48 | −0.40 | 0.80 | 0.68 | 0.81 | 0.35 | 0.55 | 0.31 | 0.08 |
|
| −0.69 | −0.06 | 0.22 | 0.41 | 0.33 | 0.45 | 0.39 | 0.07 | 0.80 | 0.68 |
|
| −0.66 | −0.32 | 0.00 | 0.78 | 0.52 | 0.77 | 0.20 | 0.31 | 0.83 | 0.79 |
MSE Values (P1).
|
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
| 0.09 | 0.51 | 0.41 | 0.52 | 0.49 | 0.47 | 0.35 | 0.41 | 0.40 | 0.40 |
|
| 0.54 | 0.17 | 0.46 | 0.93 | 1.23 | 1.33 | 0.86 | 0.78 | 0.78 | 0.68 |
|
| 0.48 | 0.41 | 0.31 | 1.10 | 1.72 | 1.73 | 0.50 | 0.41 | 0.40 | 0.38 |
|
| 1.25 | 2.64 | 2.18 | 0.11 | 0.19 | 0.13 | 2.39 | 2.46 | 2.26 | 2.79 |
|
| 0.79 | 1.88 | 1.41 | 0.14 | 0.13 | 0.13 | 1.95 | 1.84 | 1.50 | 1.93 |
|
| 1.05 | 2.13 | 1.64 | 0.12 | 0.17 | 0.11 | 2.25 | 2.11 | 1.70 | 2.16 |
|
| 0.28 | 0.43 | 0.40 | 0.58 | 0.47 | 0.45 | 0.25 | 0.38 | 0.40 | 0.38 |
|
| 0.48 | 0.47 | 0.42 | 1.01 | 1.08 | 1.07 | 0.33 | 0.30 | 0.37 | 0.40 |
|
| 0.85 | 0.45 | 0.37 | 0.34 | 0.35 | 0.35 | 0.34 | 0.41 | 0.32 | 0.35 |
|
| 0.88 | 0.42 | 0.43 | 0.55 | 0.71 | 0.51 | 0.36 | 0.38 | 0.35 | 0.34 |
r Values (P2).
|
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
| 0.78 | 0.62 | 0.77 | 0.62 | 0.77 | 0.41 | −0.01 | 0.01 | 0.02 | 0.0 |
|
| 0.09 | 0.86 | 0.86 | 0.86 | 0.85 | 0.29 | 0.51 | 0.61 | 0.70 | 0.52 |
|
| 0.01 | 0.77 | 0.87 | 0.77 | 0.84 | 0.21 | 0.31 | 0.11 | 0.26 | 0.33 |
|
| 0.00 | 0.78 | 0.86 | 0.76 | 0.86 | 0.27 | 0.37 | 0.38 | 0.42 | 0.43 |
|
| −0.14 | 0.83 | 0.86 | 0.83 | 0.87 | 0.30 | 0.60 | 0.58 | 0.72 | 0.60 |
|
| 0.15 | 0.42 | 0.60 | 0.42 | 0.83 | 0.75 | 0.70 | 0.69 | 0.77 | 0.80 |
|
| −0.00 | −0.12 | 0.44 | −0.12 | 0.39 | 0.42 | 0.80 | 0.72 | 0.84 | 0.86 |
|
| 0.15 | −0.22 | −0.24 | −0.22 | −0.11 | 0.37 | 0.71 | 0.72 | 0.8 | 0.65 |
|
| 0.16 | −0.20 | −0.15 | −0.20 | −0.21 | 0.53 | 0.62 | 0.66 | 0.81 | 0.72 |
|
| −0.11 | −0.36 | 0.05 | −0.36 | 0.04 | 0.41 | 0.78 | 0.71 | 0.83 | 0.87 |
MSE Values (P2).
|
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
| 0.29 | 0.26 | 0.29 | 0.43 | 0.31 | 0.31 | 0.63 | 1.13 | 0.93 | 0.68 |
|
| 0.40 | 0.16 | 0.15 | 0.17 | 0.15 | 0.51 | 0.47 | 0.30 | 0.36 | 0.46 |
|
| 0.43 | 0.20 | 0.13 | 0.18 | 0.16 | 0.40 | 0.44 | 0.34 | 0.35 | 0.45 |
|
| 0.44 | 0.17 | 0.15 | 0.15 | 0.54 | 0.58 | 0.33 | 0.43 | 0.59 | 0.21 |
|
| 0.42 | 0.20 | 0.15 | 0.16 | 0.15 | 0.48 | 0.51 | 0.31 | 0.40 | 0.51 |
|
| 0.40 | 0.34 | 0.28 | 0.32 | 0.29 | 0.25 | 0.36 | 0.52 | 0.41 | 0.35 |
|
| 0.38 | 0.42 | 0.38 | 0.33 | 0.36 | 0.36 | 0.29 | 0.33 | 0.28 | 0.31 |
|
| 0.39 | 0.55 | 0.57 | 0.41 | 0.47 | 0.47 | 0.39 | 0.26 | 0.30 | 0.39 |
|
| 0.37 | 0.55 | 0.50 | 0.39 | 0.44 | 0.37 | 0.35 | 0.27 | 0.26 | 0.34 |
|
| 0.39 | 0.44 | 0.40 | 0.36 | 0.38 | 0.32 | 0.30 | 0.34 | 0.28 | 0.30 |
Figure 5Predicted vs. actual values in P4 F1 testing (r = 0.98 and MSE = 0.02).
Figure 6Predicted vs. actual values in the second half of file P3 F1 (r = 0.82 and MSE = 0.31).
Figure 7Predicted vs. actual values in P1 F10 testing (r = 0.38 and MSE = 0.38).
r values in the second analysis.
|
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
| 0.41 | −0.09 | 0.08 | −0.07 | −0.02 | 0.21 | 0.01 | 0.03 | −0.07 | 0.01 |
|
| −0.36 | 0.64 | −0.17 | 0.06 | 0.19 | −0.30 | −0.09 | −0.02 | 0.14 | 0.23 |
|
| 0.52 | −0.53 | 0.81 | 0.07 | −0.26 | 0.60 | −0.22 | 0.41 | −0.05 | 0.08 |
|
| −0.07 | −0.17 | −0.42 | 0.93 | 0.08 | −0.48 | −0.72 | −0.24 | −0.04 | 0.19 |
|
| −0.31 | −0.02 | −0.50 | −0.62 | 0.90 | −0.27 | 0.80 | −0.64 | −0.15 | 0.02 |
|
| −0.04 | −0.21 | 0.45 | 0.10 | 0.11 | 0.53 | −0.56 | −0.48 | −0.04 | 0.03 |
|
| 0.31 | −0.08 | −0.52 | −0.16 | 0.33 | −0.57 | 0.67 | −0.11 | −0.27 | 0.23 |
|
| 0.51 | −0.32 | 0.67 | 0.43 | −0.62 | −0.57 | 0.41 | 0.72 | −0.09 | 0.10 |
|
| −0.06 | 0.78 | 0.19 | 0.42 | 0.40 | 0.11 | −0.26 | 0.01 | 0.80 | −0.59 |
|
| −0.63 | −0.50 | 0.29 | −0.33 | −0.58 | −0.19 | 0.62 | −0.23 | −0.74 | 0.84 |
MSE values in the second analysis.
|
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
|
| 0.33 | 0.41 | 0.46 | 0.40 | 0.59 | 0.41 | 0.45 | 0.41 | 0.46 | 0.58 |
|
| 0.55 | 0.27 | 0.50 | 0.39 | 0.71 | 0.43 | 0.42 | 0.49 | 0.44 | 0.44 |
|
| 0.38 | 0.41 | 0.25 | 0.40 | 0.96 | 0.36 | 0.43 | 0.42 | 0.47 | 0.63 |
|
| 0.74 | 2.26 | 2.40 | 0.05 | 6.95 | 0.62 | 0.67 | 0.70 | 1.01 | 0.61 |
|
| 0.40 | 0.40 | 0.65 | 0.42 | 0.12 | 0.45 | 0.27 | 0.89 | 0.47 | 0.62 |
|
| 0.37 | 0.40 | 0.36 | 0.40 | 1.18 | 0.33 | 0.42 | 0.49 | 0.38 | 0.78 |
|
| 0.37 | 0.37 | 0.42 | 0.37 | 0.69 | 0.42 | 0.32 | 0.39 | 0.43 | 0.46 |
|
| 0.33 | 0.37 | 0.43 | 0.35 | 0.49 | 0.62 | 0.32 | 0.28 | 0.45 | 0.44 |
|
| 0.75 | 0.64 | 0.72 | 0.72 | 0.68 | 0.85 | 0.81 | 0.96 | 1.39 | 0.34 |
|
| 0.63 | 0.63 | 0.52 | 0.60 | 0.85 | 0.60 | 0.51 | 0.61 | 0.20 | 0.96 |