| Literature DB >> 34025373 |
Candida Barreto1, Guilherme de Albuquerque Bruneri2, Guilherme Brockington3, Hasan Ayaz4,5,6,7,8, Joao Ricardo Sato1,9.
Abstract
Hyperscanning studies using functional Near-Infrared Spectroscopy (fNIRS) have been performed to understand the neural mechanisms underlying human-human interactions. In this study, we propose a novel methodological approach that is developed for fNIRS multi-brain analysis. Our method uses support vector regression (SVR) to predict one brain activity time series using another as the predictor. We applied the proposed methodology to explore the teacher-student interaction, which plays a critical role in the formal learning process. In an illustrative application, we collected fNIRS data of the teacher and preschoolers' dyads performing an interaction task. The teacher explained to the child how to add two numbers in the context of a game. The Prefrontal cortex and temporal-parietal junction of both teacher and student were recorded. A multivariate regression model was built for each channel in each dyad, with the student's signal as the response variable and the teacher's ones as the predictors. We compared the predictions of SVR with the conventional ordinary least square (OLS) predictor. The results predicted by the SVR model were statistically significantly correlated with the actual test data at least one channel-pair for all dyads. Overall, 29/90 channel-pairs across the five dyads (18 channels 5 dyads = 90 channel-pairs) presented significant signal predictions withthe SVR approach. The conventional OLS resulted in only 4 out of 90 valid predictions. These results demonstrated that the SVR could be used to perform channel-wise predictions across individuals, and the teachers' cortical activity can be used to predict the student brain hemodynamic response.Entities:
Keywords: fNIRS; hyperscanning; machine learning; support vector regression; teacher-student interaction
Year: 2021 PMID: 34025373 PMCID: PMC8137814 DOI: 10.3389/fnhum.2021.622146
Source DB: PubMed Journal: Front Hum Neurosci ISSN: 1662-5161 Impact factor: 3.169
FIGURE 1fNIRS montage. (Left) Participants during an experiment with fNIRS sensors attached (Middle and Right). fNIRS cortical measurement locations visualized on the brain surface, on prefrontal and temporal-parietal cortices. Red and blue circles represent light sources and detectors, respectively. EEG 10—10 international system positions are also depicted. The black lines and numbers are the fNIRS channels. The same montage was used for both student and teacher heads.
FIGURE 2Scheme of the bootstrapping approach. The two circles depict the student and teacher’s head. Green and orange circles represent the fNIRS sources and detectors. Full lines represent channels. For simplicity, we only include the SVR in this picture (Training the Model). However, the procedure with OLS is analogous.
FIGURE 3Representation of channels with significant signal’s predictions. (A,B) depict the channels predicted by the SVR and OLS models, respectively. Red lines represent channels with a statistically significant correlation between test and predicted data (without FDR corrections). Channels with significant outcomes after FDR corrections are presented in bold letters at Table 1. Dashed yellow represents the general channels. Blue and red circles are the source and detectors. Numbers from I to V represent the student-teacher dyads.
Correlation between SVR and OLS predictions and test data.
| Channel | Dyad I | Dyad II | Dyad III | Dyad IV | Dyad V |
| 1 | |||||
| 2 | |||||
| 3 | |||||
| 4 | 0.18* | ||||
| 5 | |||||
| 6 | |||||
| 7 | 0.12* (OLS) | ||||
| 8 | |||||
| 9 | 0.15* | 0.17* | |||
| 10 | 0.23* (OLS) | 0.22* | |||
| 11 | 0.18* | 0.30** | |||
| 12 | |||||
| 13 | |||||
| 15 | 0.15* | ||||
| 16 | 0.16* 0.20* (OLS) | ||||
| 17 |
Spearman Correlation between OLS predictions and Test data.
| Ch | Dyad 1 | Dyad 2 | Dyad 3 | Dyad 4 | Dyad 5 | ||||||||||
| S | P | FDR | S | P | FDR | S | P | FDR | S | P | FDR | S | P | FDR | |
| 1 | –0.039 | 0.78 | 1.00 | 0.056 | 0.66 | 0.89 | 0.029 | 0.34 | 0.50 | 0.002 | 0.53 | 0.92 | 0.024 | 0.30 | 0.94 |
| 2 | –0.043 | 0.74 | 1.00 | 0.041 | 0.32 | 0.89 | 0.156 | 0.04 | 0.13 | 0.067 | 0.25 | 0.92 | –0.133 | 0.80 | 0.94 |
| 3 | –0.036 | 0.60 | 1.00 | –0.026 | 0.79 | 0.89 | 0.053 | 0.06 | 0.17 | 0.101 | 0.21 | 0.92 | –0.064 | 0.47 | 0.94 |
| 4 | –0.075 | 0.93 | 1.00 | –0.026 | 0.70 | 0.89 | 0.111 | 0.23 | 0.46 | 0.069 | 0.31 | 0.92 | –0.110 | 0.62 | 0.94 |
| 5 | –0.008 | 0.33 | 1.00 | 0.081 | 0.07 | 0.62 | 0.157 | 0.03 | 0.13 | –0.074 | 0.37 | 0.92 | –0.147 | 0.92 | 0.94 |
| 6 | –0.062 | 0.86 | 1.00 | –0.038 | 0.50 | 0.89 | –0.043 | 0.84 | 0.89 | 0.007 | 0.46 | 0.92 | –0.152 | 0.90 | 0.94 |
| 7 | 0.117 | 0.13 | 0.140 | 0.05 | 0.030 | 0.36 | 0.50 | –0.037 | 0.33 | 0.92 | –0.173 | 0.90 | 0.94 | ||
| 8 | 0.031 | 0.30 | 1.00 | –0.058 | 0.51 | 0.89 | 0.016 | 0.75 | 0.84 | –0.165 | 0.97 | 0.97 | –0.124 | 0.85 | 0.94 |
| 9 | –0.110 | 0.90 | 1.00 | –0.077 | 0.76 | 0.89 | 0.039 | 0.43 | 0.52 | –0.070 | 0.75 | 0.97 | –0.193 | 0.91 | 0.94 |
| 10 | 0.005 | 0.30 | 1.00 | –0.026 | 0.44 | 0.89 | 0.226 | 0.04 | 0.156 | 0.10 | 0.92 | –0.022 | 0.36 | 0.94 | |
| 11 | –0.125 | 0.97 | 1.00 | 0.021 | 0.49 | 0.89 | 0.149 | 0.10 | 0.24 | –0.132 | 0.92 | 0.97 | –0.130 | 0.94 | 0.94 |
| 12 | –0.193 | 0.95 | 1.00 | –0.048 | 0.49 | 0.89 | 0.179 | 0.03 | 0.13 | –0.104 | 0.96 | 0.97 | –0.103 | 0.82 | 0.94 |
| 13 | –0.030 | 0.69 | 1.00 | –0.068 | 0.77 | 0.89 | –0.229 | 1.00 | 1.00 | –0.080 | 0.81 | 0.97 | –0.061 | 0.60 | 0.94 |
| 14 | –0.086 | 0.80 | 1.00 | 0.011 | 0.56 | 0.89 | –0.013 | 0.37 | 0.50 | –0.052 | 0.56 | 0.92 | –0.036 | 0.36 | 0.94 |
| 15 | –0.096 | 0.92 | 1.00 | –0.137 | 1.00 | 1.00 | 0.059 | 0.26 | 0.47 | –0.097 | 0.84 | 0.97 | –0.062 | 0.67 | 0.94 |
| 16 | –0.217 | 1.00 | 1.00 | –0.015 | 0.60 | 0.89 | 0.200 | 0.04 | –0.054 | 0.69 | 0.97 | –0.080 | 0.87 | 0.94 | |
| 17 | 0.029 | 0.31 | 1.00 | –0.014 | 0.49 | 0.89 | 0.070 | 0.39 | 0.50 | 0.051 | 0.26 | 0.92 | –0.088 | 0.61 | 0.94 |
| 18 | –0.012 | 0.42 | 1.00 | –0.110 | 0.89 | 0.94 | 0.066 | 0.11 | 0.24 | –0.030 | 0.48 | 0.92 | –0.106 | 0.69 | 0.94 |
Correlation between SVR predictions and Test data.
| Ch | Dyad 1 | Dyad 2 | Dyad 3 | Dyad 4 | Dyad 5 | ||||||||||
| S | P | FDR | S | P | FDR | S | P | FDR | S | P | FDR | S | P | FDR | |
| 1 | –0.010 | 0.57 | 0.72 | 0.083 | 0.14 | 0.17 | 0.094 | 0.06 | 0.18 | 0.139 | 0.04 | 0.162 | 0.246 | ||
| 2 | –0.090 | 0.91 | 0.91 | 0.283 | –0.004 | 0.51 | 0.66 | 0.072 | 0.20 | 0.321 | 0.228 | ||||
| 3 | –0.012 | 0.60 | 0.72 | –0.007 | 0.55 | 0.58 | 0.057 | 0.22 | 0.42 | 0.088 | 0.13 | 0.299 | 0.294 | ||
| 4 | 0.031 | 0.30 | 0.68 | 0.262 | –0.007 | 0.52 | 0.66 | 0.109 | 0.10 | 0.255 | 0.178 | 0.02 | |||
| 5 | 0.005 | 0.50 | 0.70 | 0.311 | <0.01 | 0.068 | 0.16 | 0.35 | –0.087 | 0.89 | 0.94 | 0.360 | |||
| 6 | –0.067 | 0.86 | 0.91 | 0.185 | 0.092 | 0.08 | 0.20 | 0.139 | 0.05 | 0.162 | 0.216 | ||||
| 7 | 0.013 | 0.46 | 0.70 | 0.174 | –0.055 | 0.80 | 0.84 | 0.078 | 0.17 | 0.321 | 0.331 | ||||
| 8 | 0.022 | 0.39 | 0.70 | 0.236 | 0.031 | 0.32 | 0.53 | 0.057 | 0.21 | 0.321 | 0.195 | ||||
| 9 | 0.120 | 0.04 | 0.26 | 0.293 | 0.154 | 0.11 | 0.171 | 0.108 | 0.061 | 0.21 | 0.27 | ||||
| 10 | 0.016 | 0.42 | 0.70 | 0.309 | –0.039 | 0.73 | 0.82 | 0.219 | 0.036 | 0.060 | 0.23 | 0.27 | |||
| 11 | 0.176 | 0.06 | 0.300 | –0.234 | 1.00 | 1.00 | –0.040 | 0.70 | 0.791 | –0.276 | 1.00 | 1.00 | |||
| 12 | 0.044 | 0.22 | 0.67 | 0.228 | 0.113 | 0.04 | 0.18 | 0.056 | 0.20 | 0.321 | 0.127 | 0.04 | 0.07 | ||
| 13 | 0.080 | 0.12 | 0.43 | 0.232 | 0.113 | 0.06 | 0.18 | –0.023 | 0.62 | 0.745 | 0.099 | 0.10 | 0.15 | ||
| 14 | 0.000 | 0.50 | 0.70 | 0.067 | 0.15 | 0.18 | 0.132 | 0.03 | 0.17 | –0.152 | 0.98 | 0.979 | 0.009 | 0.46 | 0.52 |
| 15 | 0.152 | 0.06 | –0.024 | 0.64 | 0.64 | 0.044 | 0.23 | 0.42 | 0.034 | 0.35 | 0.485 | 0.215 | |||
| 16 | 0.090 | 0.09 | 0.42 | 0.276 | 0.161 | 0.05 | 0.004 | 0.50 | 0.638 | –0.025 | 0.64 | 0.68 | |||
| 17 | 0.036 | 0.30 | 0.68 | 0.301 | –0.011 | 0.59 | 0.71 | 0.109 | 0.09 | 0.255 | 0.064 | 0.21 | 0.27 | ||
| 18 | –0.033 | 0.70 | 0.79 | 0.032 | 0.30 | 0.34 | 0.007 | 0.45 | 0.66 | 0.138 | 0.03 | 0.162 | 0.159 | 0.02 | 0.04 |