| Literature DB >> 33959060 |
P Archana Hebbar1,2, Kausik Bhattacharya1, Gowdham Prabhakar1, Abhay A Pashilkar2, Pradipta Biswas1.
Abstract
This paper discusses the utilization of pilots' physiological indications such as electroencephalographic (EEG) signals, ocular parameters, and pilot performance-based quantitative metrics to estimate cognitive workload. The study aims to derive a non-invasive technique to estimate pilot's cognitive workload and study their correlation with standard physiological parameters. Initially, we conducted a set of user trials using well-established psychometric tests for evaluating the effectiveness of pupil and gaze-based ocular metrics for estimating cognitive workload at different levels of task difficulty and lighting conditions. Later, we conducted user trials with the NALSim flight simulator using a business class Learjet aircraft model. We analyzed participants' ocular parameters, power levels of different EEG frequency bands, and flight parameters for estimating variations in cognitive workload. Results indicate that introduction of secondary task increases pilot's cognitive workload significantly. The beta frequency band of EEG, nearest neighborhood index specifying distribution of gaze fixation, L1 Norm of power spectral density of pupil diameter, and the duty cycle metric indicated variations in cognitive workload.Entities:
Keywords: EEG; cognitive load; flight simulator; ocular parameters; pupil dilation; saccades
Year: 2021 PMID: 33959060 PMCID: PMC8093450 DOI: 10.3389/fpsyg.2021.555446
Source DB: PubMed Journal: Front Psychol ISSN: 1664-1078
Figure 1Participant performing the visual N-back test.
Performance of the N-back test in terms of accuracy.
| Auditory N-back dark room | 0.961 (0.073) | 0.962 (0.059) | 0.874 (0.122) |
| Auditory N-back dynamic light room | 0.972 (0.084) | 0.948 (0.090) | 0.889 (0.121) |
| Visual N-back | 0.985 (0.041) | 0.942 (0.071) | 0.891 (0.132) |
| Auditory Arithmetic dark room | 0.992 (0.036) | 0.905 (0.135) | 0.770 (0.207) |
| Auditory Arithmetic dynamic light room | 0.968 (0.067) | 0.937 (0.134) | 0.730 (0.318) |
Repeated measure one-way ANOVA for each metric with effect size.
| L1NS Right eye | |
| L1NS Left eye | |
| STDP Right eye | |
| STDP Left eye | |
| LPF Left eye |
Figure 2L1NS of the right eye for (from top left) visual N-back, auditory N-Back dark room, auditory N-back dynamic lightroom, auditory arithmetic dark room, and auditory arithmetic dynamic lightroom.
Repeated measure one-way ANOVA for each metric with an effect size.
| L1NS Right eye | |
| L1NS Left eye | |
| STDP Right eye | |
| STDP Left eye | |
| LPF Left eye |
Repeated measure one-way ANOVA for each metric with an effect size.
| L1NS Right eye | |
| L1NS Left eye | |
| STDP Right eye | |
| STDP Left eye | |
| LPF Left eye | |
| LPF Right eye |
Repeated measure one-way ANOVA for each metric with effect size.
| LPF Left eye | |
| LPF Right eye |
Repeated measure one-way ANOVA for each metric with effect size.
| L1NS Right eye | |
| L1NS Left eye | |
| STDP Right eye | |
| STDP Left eye | |
| LPF Left eye | |
| LPF Right eye |
Tests of within-subjects effects.
| Light vs. Task Difficulty | Dark room (Auditory N-back) vs. dynamic light room (Auditory N-back) | STDP Left | |
| STDP Right | |||
| L1NS Left | |||
| L1NS Right | |||
| LPF Left | |||
| LPF Right | |||
| Dark room (Auditory Arithmetic) vs. dynamic light room (Auditory Arithmetic) | STDP Left | ||
| L1NS Left | |||
| Task Type vs. Task Difficulty | Auditory Arithmetic (Dynamic light room) vs. Auditory N-back (Dynamic light room) | STDP Left | |
| STDP Right | |||
| L1NS Left | |||
| L1NS Right | |||
| LPF Left | |||
| LPF Right | |||
| Presentation vs. Task Difficulty | Auditory N-back (Dark room) vs. Visual N-back | STDP Left | |
| L1NS Left | |||
| LPF Left | |||
| Auditory N-back (Dynamic light room) vs. Visual N-back | STDP Left | ||
| STDP Right | |||
| L1NS Left | |||
| L1NS Right | |||
| LPF Left |
Multivariate tests.
| Light vs. Task Difficulty | Dark room (Auditory N-back) vs. dynamic light room (Auditory N-back) | STDP Left | |
| STDP Right | |||
| L1NS Left | |||
| L1NS Right | |||
| LPF Left | |||
| LPF Right | |||
| Dark room (Auditory Arithmetic) vs. dynamic light room (Auditory Arithmetic) | STDP Left | ||
| L1NS Left | |||
| Task Type vs. Task Difficulty | Auditory Arithmetic (Dynamic light room) vs. Auditory N-back (Dynamic light room) | STDP Left | |
| STDP Right | |||
| L1NS Left | |||
| L1NS Right | |||
| LPF Left | |||
| LPF Right | |||
| Presentation vs. Task Difficulty | Auditory N-back (Dark room) vs. Visual N-back | STDP Left | |
| L1NS Left | |||
| LPF Left | |||
| Auditory N-back (Dynamic light room) vs. Visual N-back | STDP Left | ||
| STDP Right | |||
| L1NS Left | |||
| L1NS Right | |||
| LPF Left | |||
| LPF Right |
Figure 3Test scenario.
Task scenarios for Flight simulator study.
| Take off: Initial checks, apply full throttle, take off at 130 knots speed. | Similar to C1 till level segment. | A secondary task was added in addition to C2 condition. The secondary task was defined as pointing and selection in an adjacent secondary head down touchscreen display. |
Figure 4Apparatus. (A) Flight simulator setup. (B) Eye gaze tracker from Tobii [courtesy (14)]. (C) EEG headset from Emotiv [courtesy (15)].
EEG signal bandwidths.
| Theta band | 4–8 | Sleepy, drowsy, meditative, and dreaming | Increases, associated with fatigue (Borghini et al., |
| Alpha band | 8–13 | Relaxed, calm, lucid state of mind | Increases with aural secondary task indicating increased information processing and reduced concentration ability (Schrauf et al., |
| Low beta (LB) band | 13–21 | Alert, active concentration, busy, and anxious state of mind | Increases (Pavlov and Kotchoubey, |
| High beta (HB) band | 21–30 | Focus, quick thinking, working | Increases (Pavlov and Kotchoubey, |
| Gamma | 31–100 | Optimal frequency for thinking, active thought, peak focus | Increases |
Figure 5Median power of different EEG bands.
Statistical test results indicating changes in cognitive workload.
| Alpha band | χ2(2) = 8.0, | ||
| LB band | χ2(2) = 8.166, | ||
| HB band | χ2(2) =10.5, | ||
| Theta band | χ2(2) = 10.66, | ||
| C1–C2 | C1–C3 | C2–C3 | |
| Alpha band | – | ||
| LB band | – | ||
| HB band | – | ||
| Theta band | – | ||
Figure 6Fixation rate.
Figure 7Nearest Neighborhood Index.
Figure 8L1NS for left and right pupil diameters.
Figure 9Median of SI velocity.
Summary of analysis of ocular parameters.
| Fixation rate | – | ||
| NNI | χ2(2) = 9.5, | ||
| L1NS | χ2(2) = 6.17, | ||
| SI | – | ||
| Fixation rate | – | – | |
| NNI | – | ||
| L1NS | – | ||
| SI | – | – | – |
Figure 10PIW plots.
Figure 11Percentage RMSE in altitude and airspeed.
Comparison between parameters.
| C1–C2 | |||||||||
| C1–C3 | |||||||||
| C2–C3 |
Figure 12Correlation between EEG, ocular, and flying performance parameters (ρ is the pairwise linear correlation coefficient; p-val is the level of significance). (From top left) EEG: LB vs. theta, LB vs. HB; Ocular parameters: NNI vs. L1NS, L1NS vs. EEG LB; Flying performance: DC vs. L1NS, DC vs. theta.