OBJECTIVES: To compare the diagnostic utility of electroencephalography (EEG) using reduced, 8-channel montage (rm-EEG) to full, 18-channel montage (fm-EEG) for detection of generalized or hemispheric seizures and rhythmic periodic patterns (RPPs) by neurologists with extensive EEG training, neurology residents with minimal EEG exposure, and medical students without EEG experience. METHODS: We presented EEG samples in both fm-EEG (bipolar montage) and rm-EEG (lateral leads of bipolar montage) to 20 neurologists, 20 residents, and 42 medical students. Unanimous agreement of three senior epileptologists defined samples as seizures (n = 7), RPPs (n = 10), and normal or slowing (n = 20). Differences in median accuracy, sensitivity, and specificity were assessed using Wilcoxon signed-rank tests. RESULTS: Full and reduced EEG demonstrated similar accuracy when read by neurologists (fm-EEG: 95%, rm-EEG: 95%, p = 0.29), residents (fm-EEG: 80%, rm-EEG: 80%, p = 0.05), and students (fm-EEG: 60%, rm-EEG: 51%, p = 0.68). Moreover, neurologists' sensitivity for detecting seizure activity was comparable between fm-EEG (100%) and rm-EEG (98%) (p = 0.17). Furthermore, the specificity of rm-EEG for seizures and RPP (neurologists: 100%, residents: 90%, students: 86%) was significantly greater than that of fm-EEG (neurologists: 93%, p = 0.03; residents: 80%, p = 0.01; students: 69%, p < 0.001). CONCLUSIONS: The reduction of the number of EEG channels from 18 to 8 does not compromise neurologists' sensitivity for detecting seizures that are often a core reason for performing urgent EEG. It may also increase their specificity for detecting rhythmic and periodic patterns, and thereby providing important diagnostic information to guide patient's management. SIGNIFICANCE: Our study is the first to document the utility of a reduced channel EEG above the hairline compared to full montage EEG in aiding medical staff with varying degrees of EEG training to detect generalized or hemispheric seizures.
OBJECTIVES: To compare the diagnostic utility of electroencephalography (EEG) using reduced, 8-channel montage (rm-EEG) to full, 18-channel montage (fm-EEG) for detection of generalized or hemispheric seizures and rhythmic periodic patterns (RPPs) by neurologists with extensive EEG training, neurology residents with minimal EEG exposure, and medical students without EEG experience. METHODS: We presented EEG samples in both fm-EEG (bipolar montage) and rm-EEG (lateral leads of bipolar montage) to 20 neurologists, 20 residents, and 42 medical students. Unanimous agreement of three senior epileptologists defined samples as seizures (n = 7), RPPs (n = 10), and normal or slowing (n = 20). Differences in median accuracy, sensitivity, and specificity were assessed using Wilcoxon signed-rank tests. RESULTS: Full and reduced EEG demonstrated similar accuracy when read by neurologists (fm-EEG: 95%, rm-EEG: 95%, p = 0.29), residents (fm-EEG: 80%, rm-EEG: 80%, p = 0.05), and students (fm-EEG: 60%, rm-EEG: 51%, p = 0.68). Moreover, neurologists' sensitivity for detecting seizure activity was comparable between fm-EEG (100%) and rm-EEG (98%) (p = 0.17). Furthermore, the specificity of rm-EEG for seizures and RPP (neurologists: 100%, residents: 90%, students: 86%) was significantly greater than that of fm-EEG (neurologists: 93%, p = 0.03; residents: 80%, p = 0.01; students: 69%, p < 0.001). CONCLUSIONS: The reduction of the number of EEG channels from 18 to 8 does not compromise neurologists' sensitivity for detecting seizures that are often a core reason for performing urgent EEG. It may also increase their specificity for detecting rhythmic and periodic patterns, and thereby providing important diagnostic information to guide patient's management. SIGNIFICANCE: Our study is the first to document the utility of a reduced channel EEG above the hairline compared to full montage EEG in aiding medical staff with varying degrees of EEG training to detect generalized or hemispheric seizures.
Scalp electroencephalography (EEG) is commonly used in the evaluation of altered mental status (AMS) to determine the presence of functional abnormalities such as seizures. Recent consensus opinion from the American Clinical Neurophysiology Society (ACNS) states that “electrode template systems” may be used when rapid placement of EEG electrodes is essential or when EEG technicians are not immediately available (Herman et al., 2015). Such solutions will be especially valuable in the diagnosis of non-convulsive seizures, which can only be detected with EEG and have a significant impact on morbidity, mortality and neuronal health (Kaplan, 1996, DeLorenzo et al., 1998, Towne et al., 2000, Claassen et al., 2004, Meierkord and Holtkamp, 2007, Vespa et al., 2007). In fact, the majority of urgent EEGs are performed to rule out the most serious abnormalities such as non-convulsive status epilepticus (NCSE) (Quigg et al., 2001, Praline et al., 2007). However, current EEG practice with a full set of EEG electrodes is hampered by limited availability of technicians, machines, and trained neurologists, resulting in long delays in setup, recording and interpretation (Quigg et al., 2001, Kämppi et al., 2013, Gururangan et al., 2016). These delays in EEG acquisition limit its utility in emergent situations to detect pathological activity that are more likely to be present close to the onset of AMS and whose early detection may significantly impact both clinical management and patient outcomes (King et al., 1998, Quigg et al., 2001, Kolls and Husain, 2007, Ziai et al., 2012, Betjemann and Lowenstein, 2015, Paliwal et al., 2015, Gururangan et al., 2016, Sofat et al., 2016, Fernández et al., 2017, Jordan, 2017).Less resource-intensive and point-of-care EEG electrode templates, per the ACNS consensus, may have a reduced number of electrodes that could be deployed more rapidly at the bedside without waiting for trained technicians. Such EEG tools might shorten the delays for acquiring EEG, which may facilitate early detection of seizures or epileptiform activity and guide treatment decisions while awaiting the resources for a full diagnostic study (McMullan et al., 2010, Paliwal et al., 2015). While other rapid bedside diagnostics, such as those for cardiac emergencies, can reduce patients’ length of hospital stay, guide clinical management, and expedite completion of other diagnostic tests, no such point-of-care tool has been widely adopted for epileptic emergencies (McMullan et al., 2010, McMullan et al., 2012, Chan et al., 2013, Singer et al., 2015). This is partly due to controversies in the literature about the value of recording EEG with a non-conventional reduced number of electrodes (Kolls and Husain, 2007, Rubin et al., 2014, Tanner et al., 2014, Jordan, 2017).Though more EEG sensors would yield better spatial resolution and more sensitive detection of focal abnormalities, it remains controversial whether half of the number of conventional EEG electrodes can be used with equal utility in emergency situations to detect gross abnormalities – such as seizures, hemispheric slowing, or rhythmic and periodic patterns. These findings may have pathognomonic value in guiding the diagnostic workup and management of patients with altered mental status. Prior studies of reduced electrode arrays have been limited by their focus on differentiating patterns that might result in similar management, such as distinguishing between seizures and seizure-like patterns that lie on the ictal-interictal continuum (for example, periodic epileptiform discharges), which is a non-trivial task even with a full set of EEG channels (Chong and Hirsch, 2005, Foldvary-Schaefer et al., 2006, Kolls and Husain, 2007, Young et al., 2009, Tanner et al., 2014). Of these investigations, only one to our knowledge studied the utility of hairline EEG (as opposed to sub-hairline) to screen for NCSE, and while the authors concluded that hairline EEG lacked sensitivity for seizures, especially focal seizures, they did not demonstrate whether hairline EEG preserved sensitivity for generalized or hemispheric patterns (Kolls and Husain, 2007). We hypothesize that reducing the number of EEG sensors (i.e., only the temporal chains of a double banana montage) will still enable trained readers to identify hemispheric or bilateral seizures or seizure-like abnormalities, as well as the majority of seizures that originate in the temporal and frontal lobes (King et al., 1998). After all, the utility of point-of-care EEG is in identifying conditions that need urgent treatment with antiepileptic drugs (AEDs) or triaging patients who will need long term monitoring with a conventional EEG setup rather than in describing minor nuances, such as the presence of a single sharp wave, or subtle abnormalities of EEG background activity.A related question is whether reducing the number of EEG sensors affects the difficulty of making such diagnostic assessments. This is especially important if untrained individuals (such as junior residents or medical students) are to judge the presence of gross EEG abnormalities, a common request during off-hours when senior specialists may not be immediately available. We hypothesize that reducing the number of sensors will facilitate interpretation of EEG by untrained personnel because it decreases the amount of redundant (and potentially misleading) information that the individual would have to interpret (Ebersole and Bridgers, 1985). In the setting of a stat EEG study, the utility of the study lies in its ability to relay diagnostic information without too much delay (e.g., if EEG-untrained healthcare staff at the bedside can interpret seizures without waiting for the specialist to review the recordings).This study was designed to test the above hypotheses by comparing the diagnostic utility of reduced 8-channel montage (rm-EEG) and full 18-channel montage (fm-EEG) to detect seizures and rhythmic and periodic patterns (RPP) when read by neurologists with extensive EEG training, neurology residents with minimal EEG training, and medical students without EEG training.
Methods
Study protocol and approval
This study was conducted with the approval of the Stanford University Institutional Review Board. This report describes a retrospective diagnostic study based on a survey and was prepared using the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines (Bossuyt et al., 2015).
Montage design
Continuous EEG recordings obtained with electrodes placed according to standard 10–20 system (Acharya et al., 2016a). Samples of these recordings were displayed separately in both the full 18-channel longitudinal bipolar (double banana) montage (fm-EEG) and a reduced 8-channel montage comprising only the lateral chains of the double banana montage (rm-EEG) (Acharya et al., 2016b). Examples of the fm-EEG and rm-EEG images are shown in Fig. 1.
Fig. 1
Training samples of full and reduced montage EEG. Calibration bar: time scale represents 1 s (s), voltage scale represents 50 microvolts (μV). Abbreviations: RPP, rhythmic and periodic pattern.
Training samples of full and reduced montage EEG. Calibration bar: time scale represents 1 s (s), voltage scale represents 50 microvolts (μV). Abbreviations: RPP, rhythmic and periodic pattern.
Study participants
Survey responses were collected from 23 neurologists with extensive EEG training (10 epileptologists, 12 epilepsy fellows, 1 neurology resident [who was treated as a fellow for analysis]) from 7 institutions (California Pacific Medical Center, n = 1; Kaiser Permanente Redwood City, n = 1; Rush University, n = 4; Stanford University, n = 3; University of California, Los Angeles, n = 3; University of California, San Francisco, n = 4; Yale University, n = 7), 20 resident physicians in neurology training with minimal EEG training from Stanford University (n = 9) and Yale University (n = 11), and 42 medical students without EEG training from Stanford University. Demographic information was collected, including gender, level of training (i.e., medical student, resident, fellow, attending), years of EEG experience (i.e., none, less than 1, 1 to 2, 2 to 10, more than 10), and pediatric versus adult specialization.
Survey design
Each survey contained 44 unique EEG samples, each 15-s in duration, from continuous EEG recordings acquired in routine patient care. We felt that these 44 samples facilitated a representative range of electrographic abnormalities while keeping the duration of the survey practical. A single 15-s epoch was selected to mimic the standard presentation of a single page of EEG recording and to limit the ability of each rater to experience the EEG information differently from the others (e.g., by scrolling between pages). Samples were presented in an online survey as static images in a random order, and each sample was presented twice (non-sequentially), once in fm-EEG format and once in rm-EEG format. Participants were unable to adjust the layout of the channels or other settings. For each of the 88 sample presentations, both physicians and students were asked to indicate whether the sample contained seizure activity (question 1). Physicians (both epilepsy-trained neurologists and residents) were additionally asked whether the sample contained any other pathological activity (question 2), and to indicate the presence and laterality of the following specific findings (question 3): seizure, slowing, lateralized periodic discharges (LPDs), generalized periodic discharges (GPDs), triphasic waves (TWs), and burst suppression. Physicians were also able to enter other specific findings or comments. Two fm-EEG training samples with answers, one of generalized seizure and one of diffuse slowing, were shown to acquaint respondents with the survey; these training samples were not repeated in the actual survey. In addition, the time spent on each sample (in seconds) was recorded.
Classification of survey responses
Physicians’ (both epilepsy-trained neurologists and residents) responses were classified as seizure or RPP (vs. not) based on their responses to questions 1 and 2, selecting the specific findings of seizure, LPD, GPD, or TW in question 3, or any comment indicating that the sample contained seizure or RPP. For medical students, we classified samples as seizure or RPP based on their response to question 1 indicating seizure activity.
Reference standard for EEG findings
Of the 23 epilepsy-trained neurologists who participated in the study, we identified three senior epileptologists from different institutions with at least 10 years of experience in adult epilepsy. We defined a reference standard based on the unanimous agreement (3/3) of these epileptologists on the classification of each fm-EEG sample as seizure or RPP (vs. not) and as generalized (vs. focal). We grouped seizure-like patterns (i.e., periodic epileptiform discharges), under the ACNS definition of rhythmic and periodic patterns, which encompasses EEG abnormalities with prognostic significance, association with seizures, and potential risk for neuronal injury (Chong and Hirsch, 2005, Hirsch et al., 2013, Pedersen et al., 2013, Koren et al., 2016, Ruiz et al., 2017). The reference standard defined samples as seizure (n = 7; 6 generalized, 1 focal), RPP (n = 10; 8 generalized, 2 focal), and other non-rhythmic, non-periodic activity (e.g., normal or slowing; n = 20; 18 generalized, 2 focal); 7 samples were excluded due to disagreement among the reference standard epileptologists. Substantial agreement was observed between the three epileptologists who formed the reference standard (Fleiss’ kappa 0.79).
Statistical analysis
We calculated the accuracy, sensitivity, and specificity (reported as mean ± SD and median [IQR]) of fm-EEG and rm-EEG for the detection of generalized or hemispheric seizures and rhythmic periodic patterns by calculating the percentage of respondents who correctly detected the presence or absence of rhythmic and periodic abnormalities (according to the reference standard) and averaging across all samples. The concordance between fm-EEG and rm-EEG was measured by calculating the percentage of neurologists who provided the same classification of an EEG sample in both formats, averaged across samples, irrespective of whether it matched the reference standard. In order to demonstrate the impact of reducing the number of EEG channels on each rater’s determination of seizure or RPP, we calculated a false negative rate (FNR) for each rater by scoring each rater’s rm-EEG responses against their own fm-EEG responses for samples determined by the reference standard to represent seizure or RPP (i.e., if the rater detected a seizure or RPP using the standard EEG setup, what percentage missed this activity in the limited montage). We also calculated overall accuracy (against the reference standard) of fm-EEG and rm-EEG for each participant (except for the three epileptologists who formed the reference standard). The time spent per sample (reported as mean ± SD) was calculated by averaging across raters for each sample and then across samples. We excluded outliers over 1000 s (which might indicate that the rater may have been interrupted during the survey); overall, 23 outliers were removed (<1% of total data).Differences between fm-EEG and rm-EEG in these diagnostic statistics were assessed using Wilcoxon signed-rank tests with continuity correction for tied comparisons (Shapiro-Wilk tests demonstrated significant deviations from the normal distribution). Differences in overall accuracy between raters associated with demographic characteristics were evaluated using Kruskal-Wallis tests, and Mann-Whitney tests were used to perform post hoc pairwise comparisons if the omnibus Kruskal-Wallis test was significant. Differences in average time spent per sample, as well as differences in time spent per sample between correct and incorrect responses, were assessed using two-tailed paired t-tests. A significance level of α=0.05 was used with Bonferroni correction for multiple comparisons.
Results
Characteristics of our survey participants are shown in Table 1. All neurologists (i.e., epilepsy attendings and fellows) had some EEG experience, including fellows within the first year of EEG fellowship training (30%) and fellows and attendings with more than one year of experience (70%); 15% of neurologists were pediatric epilepsy specialists and 35% were attending epileptologists. Among resident physicians, 35% had no EEG experience (of whom 71% were post-graduate year 2), and all residents with one year or more of EEG training were in their final year of residency (post-graduate year 4). None of the medical students had experience in reading EEG. The STARD flow diagram is shown in Fig. 2.
Characteristics of survey respondents.Abbreviations: PGY, post-graduate year.STARD flow diagram. Abbreviations: FN, false negative; FP, false positive; RPP, rhythmic and periodic pattern; TN, true negative; TP, true positive.The diagnostic utility (i.e., accuracy, sensitivity, and specificity) of fm-EEG and rm-EEG for detecting seizures and RPP are shown in Fig. 3. Overall, 92 ± 11% of epilepsy-trained neurologists correctly evaluated all brief, 15-s EEG samples using rm-EEG (95% [15%], range: 60–100%), compared to 94 ± 8% (95% [10%], range: 70–100%) using fm-EEG. Resident physicians judged these samples with similar accuracy using rm-EEG (75 ± 21%, 80% [25%], range: 25–100%) and fm-EEG (80 ± 13%, 80% [15%], range: 45–100%), and likewise, medical student accuracy for assessing the 15-s EEG samples was comparable between rm-EEG (58 ± 28%, 57% [52%], range: 14–93%) and fm-EEG (59 ± 22%, 60% [33%], range: 14–90%). We then analyzed the sensitivity for generalized or hemispheric seizures and RPP, separately, and the specificity for seizures and RPP. Neurologists detected seizure activity with comparable sensitivity using both fm-EEG (98 ± 4%, 100% [0%]) and rm-EEG (93 ± 9%, 98% [13%]), however residents identified such activity with greater sensitivity using fm-EEG (90 ± 12%, 95% [15%]) compared to rm-EEG (76 ± 15%, 75% [21%]). Medical student sensitivity for seizures was only slightly above chance using fm-EEG (62 ± 12%, 63% [18%]) and below chance using rm-EEG (46 ± 20%, 38% [11%]). All three groups demonstrated significantly higher sensitivity for diagnosing generalized or hemispheric RPP (not including seizures) using fm-EEG (neurologists: 97 ± 7%, 100% [1%]; residents: 74 ± 17%, 78% [26%]; students: 43 ± 18%, 43% [29%]) compared to rm-EEG (neurologists: 82 ± 15%, 83% [23%]; residents: 56 ± 24%, 53% [40%]; students: 30 ± 17%, 24% [19%]), however we observed significantly greater specificity for RPP (i.e., detection of normal or slow activity) using rm-EEG (neurologists: 97 ± 5%, 100% [5%]; residents: 86 ± 9%, 90% [15%]; students: 77 ± 19%, 86% [13%]) compared to fm-EEG (neurologists: 91 ± 8%, 93% [8%]; residents: 82 ± 10%, 80% [11%]; students: 66 ± 23%, 69% [27%]).
Fig. 3
Diagnostic utility of full and reduced montage EEG for detection generalized or hemispheric seizures and rhythmic periodic patterns. Data (accuracy, sensitivity, and specificity) are given as median values, p values calculated using Wilcoxon signed-rank tests. Abbreviations: Gen, generalized; RPP, rhythmic or periodic patterns (not including seizure); Sz, seizure.
Diagnostic utility of full and reduced montage EEG for detection generalized or hemispheric seizures and rhythmic periodic patterns. Data (accuracy, sensitivity, and specificity) are given as median values, p values calculated using Wilcoxon signed-rank tests. Abbreviations: Gen, generalized; RPP, rhythmic or periodic patterns (not including seizure); Sz, seizure.The percentage of neurologists who provided the same diagnosis using fm-EEG and rm-EEG (concordance) was high overall (88 ± 12%, 90% [20%]), and higher for generalized seizure samples (92 ± 11%, 98% [16%]) and generalized activity (91 ± 10%, 95% [15%]) than for those showing seizure-like RPP (83 ± 14%, 83% [19%]) or focal patterns (70 ± 14%, 70% [10%]). The concordance of resident diagnoses using fm-EEG and rm-EEG was also considerable (78 ± 12%, 80% [20%]). Similarly, samples showing generalized seizures (78 ± 14%, 80% [14%]) displayed greater concordance than those showing RPP (71 ± 15%, 70% [24%]). The concordance for medical students was 70 ± 11% (69% [17%]), and similar concordance was observed for samples showing generalized seizures (67 ± 6%, 68% [2%]) and RPP (67 ± 10%, 68% [10%]).In a more granular analysis, we identified the reason for lower accuracy of all three groups of respondents in evaluation of rm-EEG samples with seizure-like (but not seizure) activity. By scoring each rater’s rm-EEG responses against his/her fm-EEG responses on samples showing seizures or generalized/hemispheric RPP, we found that the FNR associated with a reduction in the number of channels was significantly greater for RPP than for seizure. While using rm-EEG resulted in neurologists missing only 7 ± 10% (7% [17%]) of generalized seizure samples that they correctly identified on fm-EEG, their FNR was 17 ± 14% (17% [16%], p < 0.003) for generalized RPP. Similarly, the FNR for residents was significantly greater for RPP (34 ± 27%, 34% [36%]) than for seizure activity (22 ± 23%, 22% [43%], p = 0.041). Students, however, did not display a significantly different FNR among seizure (43 ± 36%, 43% [67%]) or RPP (56 ± 56%, 56% [67%]) samples (p = 0.099). We identified three samples with RPP that were missed by the majority of neurologists using rm-EEG (Fig. 4). Panels 4A (missed by 65% of neurologists, 80% of residents, and 52% of students using fm-EEG, and by 95% of neurologists, 70% of residents, and 79% of students using rm-EEG) and 4B (missed by 45% of neurologists, 50% of residents, and 21% of students using fm-EEG, and by 75% of neurologists, 90% of residents, and 33% of students using rm-EEG) show focal RPP that is less obvious on lateral channels of the double banana montage (i.e., restricted to the medial channels). Panel 4C was originally interpreted as generalized seizure by the original interpreting epileptologist and was defined as RPP (but not seizure) by our reference standard; however, while 95% of neurologists, 85% of residents, and 69% of students diagnosed this pattern as RPP using fm-EEG, only 50% of neurologists and residents, and 45% of students, did so using rm-EEG.
Fig. 4
Rhythmic or periodic EEG samples misclassified on reduced montage by the majority of neurologists. (Panel A) Periodic activity missed by 95% on rm-EEG (fm-EEG: 65%). (Panel B) Frontal intermittent rhythmic delta activity (FIRDA) classified by reference standard as rhythmic, periodic activity but labeled as normal/slow by 75% on rm-EEG (fm-EEG: 45%). (Panel C) Rhythmic and periodic activity identified by 95% on fm-EEG but classified as normal/slow by 50% on rm-EEG. Calibration bar: time scale represents 1 s (s), voltage scale represents 50 microvolts (μV).
Rhythmic or periodic EEG samples misclassified on reduced montage by the majority of neurologists. (Panel A) Periodic activity missed by 95% on rm-EEG (fm-EEG: 65%). (Panel B) Frontal intermittent rhythmic delta activity (FIRDA) classified by reference standard as rhythmic, periodic activity but labeled as normal/slow by 75% on rm-EEG (fm-EEG: 45%). (Panel C) Rhythmic and periodic activity identified by 95% on fm-EEG but classified as normal/slow by 50% on rm-EEG. Calibration bar: time scale represents 1 s (s), voltage scale represents 50 microvolts (μV).Additionally, in two other EEG samples (Fig. 5A and B), the ratings of the majority of neurologists differed from the diagnoses provided by the three reference standard epileptologists, suggesting that the referees may have incorrectly classified these samples; in one EEG sample (Fig. 5C), our review of the sample and the attending physician interpretation of the original EEG from which the sample was drawn resulted in a similar conclusion. The clinical EEG report for these samples noted focal seizures during the displayed epochs, however these samples were all classified as non-rhythmic, non-periodic activity (e.g., normal or slowing) by the senior epileptologists who formed our reference standard. Despite the abundance of myogenic artifact, the focal seizure contained in Panel 5A was detected by 75% of neurologists and 85% of residents using fm-EEG and 35% of neurologists and 30% of residents using rm-EEG, but these responses were scored as incorrect based on the reference standard; this sample was associated with the lowest observed concordance between fm-EEG and rm-EEG among both neurologists (50%) and residents (45%). The focal rhythmic abnormality in channel F8-T4 of Panel 5B was detected by only 1 of the reference standard epileptologists, but was detected by the vast majority of neurologists (85% on fm-EEG and 95% on rm-EEG), as well as the majority of residents (70% on fm-EEG and 60% on rm-EEG). Panel 5C displays a left medial frontal seizure that is also visible in the reduced montage (channel Fp1-F7), however this seizure was missed by all three reference standard epileptologists, 80% of neurologists and residents using fm-EEG, and 95% of neurologists and 80% of residents using rm-EEG. With the exception of Panel 5C, none of the samples in Figs. 4 and 5 had 100% agreement among the senior epileptologists who formed the reference standard.
Fig. 5
Samples with seizure activity misclassified by reference standard epileptologists. (Panel A) Right temporal seizure obscured by abundant myogenic artifact (due to associated automatisms) detected by 75% and 35% of neurologists using fm-EEG and rm-EEG, respectively. (Panel B) Right frontotemporal seizure detected by 95% of neurologists on rm-EEG (fm-EEG: 80%), but classified as non-seizure/seizure-like by reference standard. (Panel C) Patient had continuous multifocal nonconvulsive seizures, seen during this epoch in left frontal and medial channels, that was missed by all three senior epileptologists who formed the reference standard and the majority of neurologists (fm-EEG: 80%, rm-EEG: 95%). Calibration bar: time scale represents 1 s (s), voltage scale represents 50 microvolts (μV).
Samples with seizure activity misclassified by reference standard epileptologists. (Panel A) Right temporal seizure obscured by abundant myogenic artifact (due to associated automatisms) detected by 75% and 35% of neurologists using fm-EEG and rm-EEG, respectively. (Panel B) Right frontotemporal seizure detected by 95% of neurologists on rm-EEG (fm-EEG: 80%), but classified as non-seizure/seizure-like by reference standard. (Panel C) Patient had continuous multifocal nonconvulsive seizures, seen during this epoch in left frontal and medial channels, that was missed by all three senior epileptologists who formed the reference standard and the majority of neurologists (fm-EEG: 80%, rm-EEG: 95%). Calibration bar: time scale represents 1 s (s), voltage scale represents 50 microvolts (μV).Overall diagnostic accuracy for seizures and RPP using fm-EEG differed significantly (p < 0.001 for overall Kruskal-Wallis test), as might be expected, between neurologists (94 ± 5%, 95% [3%]), residents (80 ± 12%, 81% [20%], p < 0.001 vs. neurologists), and medical students (59 ± 11%, 59% [16%], p < 0.001 vs. neurologists, p < 0.001 vs. residents). Otherwise, no significant differences were associated with demographic characteristics. Attendings and fellows displayed comparable accuracy using fm-EEG (attendings: 95 ± 5%, 95% [4%]; fellows: 94 ± 5%, 95% [5%]; p = 0.46), as did pediatric (93 ± 6%, 95% [5%]) and adult (97 ± 3%, 97% [5%]) attending epilepsy specialists (p = 0.27). Among residents, differences in post-graduate training year (PGY2: 79 ± 10%, 81% [IQR 14%]; PGY3: 81 ± 15%, 84% [IQR 3%]; PGY4: 82 ± 14%, 85% [IQR 22%]) were not associated with significant differences in accuracy (p = 0.79). Neurologists and residents with different years of EEG experience also evaluated fm-EEG with similar accuracy (neurologists: p = 0.56, residents: p = 0.33), and there were no significant institutional differences in neurologists’ or residents’ judgments (neurologists: p = 0.49, residents: p = 0.079).Neurologists spent, on average, 42.4 ± 14.7 s on fm-EEG samples (correct: 44.3 ± 17.1 s, incorrect: 46.3 ± 45.7 s, p = 0.79) compared to 45.2 ± 17.4 s on rm-EEG samples (correct: 46.9 ± 20.7 s, incorrect: 48.9 ± 43.1 s, p = 0.79) (difference between overall fm-EEG and rm-EEG: p = 0.33). Residents took 32.3 ± 14.2 s to evaluate fm-EEG samples (correct: 33.5 ± 18.2 s, incorrect: 38.2 ± 72.2 s, p = 0.68) compared to 28.9 ± 12.9 s for rm-EEG samples (correct: 30.7 ± 17.3 s, incorrect: 29.8 ± 18.4 s, p = 0.82) (difference between overall fm-EEG and rm-EEG: p = 0.140). Medical students spent 9.6 ± 3.5 s (correct: 9.4 ± 3.5 s, incorrect: 9.7 ± 5.9 s, p = 0.79) using fm-EEG and 8.9 ± 4.1 s (correct: 8.5 ± 4.3 s, incorrect: 10.2 ± 8.7 s, p = 0.24) using rm-EEG (difference between overall fm-EEG and rm-EEG: p = 0.34).
Discussion
Summary of findings
Our study compared the diagnostic utility of EEG with a reduced number of sensors (rm-EEG) to conventional EEG with a full set of sensors (fm-EEG) in detecting abnormalities such as seizures and seizure-like rhythmic and periodic patterns. We compared responses from EEG-trained neurologists (epileptologists and epilepsy fellows), minimally trained neurology residents, and EEG-untrained medical students to describe the range of the utility of reduced electrode arrays when read by providers of varying levels of expertise. Using rm-EEG, we report comparable accuracy in all three groups for seizures and RPPs, preserved sensitivity for seizures when read by neurologists, and greater specificity (and consequently positive predictive value) for seizures and RPPs across training levels. We also highlight samples that were misclassified using the full EEG montage by the expert epileptologists that formed our reference standard, indicating the impact of inter-rater variability on EEG interpretation and fundamental issues with assuming a “gold standard” for EEG patterns.
Comparison with prior reports
To date, several studies of reduced electrode arrays in the evaluation of adult patients have been published (Bridgers and Ebersole, 1988, Foldvary et al., 2000, Foldvary-Schaefer et al., 2006, Kolls and Husain, 2007, Young et al., 2009, Karakis et al., 2010, Nitzschke et al., 2012, Grant et al., 2014a, Rubin et al., 2014, Tanner et al., 2014, Brenner et al., 2015, Lepola et al., 2015, Muraja-Murro et al., 2015, Herta et al., 2017). Many of these have found higher specificity and lower sensitivity for reduced montage EEG configurations. To our knowledge, only three studies described devices with sensitivity comparable to their specificity (Karakis et al., 2010, Grant et al., 2014a, Brenner et al., 2015). However, these studies have significant variability in their methodology, such as electrode number and coverage, montage construction, EEG sample duration, presentation of other clinical or video information, reference standard definition, EEG patterns of interest, and threshold for clinical significance (Jordan, 2017). As such, the prior studies did not use the same experimental restrictions to compare reduced montage diagnoses to interpretations obtained using full montage EEG. Thus, it has remained unclear whether the limited performance of raters in these studies was associated with the reduction of channels, or whether it was also a characteristic of raters’ performance in general, even using full montage EEG (Tu et al., 2017).Some recent studies have compared automated computer detection with reduced channels to physician diagnosis have reflected more on the characteristics of proprietary algorithms than on the value of reduced electrode arrays (Herta et al., 2017). In the recent study by Herta and colleagues, it was shown that certain epileptic activities could in fact be recognized with similar sensitivity using a reduced number of electrodes. However, in that study and other previous studies, the performance of the model was not measured using the EEG montage that we utilized here (i.e., ten electrodes above the hairline corresponding to the lateral leads of the double banana montage).Our study is different from previous reports in at least five important domains. First, our rm-EEG configuration used the lateral leads of double banana montage (i.e., not sub-hairline). Second, our work focused on the yield of rm-EEG in identifying epileptic abnormalities, such as generalized and hemispheric seizures, that will need urgent medical interventions or might benefit from long-term monitoring with conventional EEG rather than the yield of rm-EEG in detecting all kinds of abnormalities. We are mindful that rm-EEG may not have the same utility as fm-EEG in detecting focal events, especially if they are solely present in areas where our rm-EEG did not provide coverage (e.g., parasagittal regions) (Ebersole and Bridgers, 1985, Kolls and Husain, 2007). It is also important to note that our motivation for the current study was not to test whether rm-EEG has the same utility as fm-EEG in all aspects of clinical practice, for instance, in the detection of single epileptic spikes or in pre-surgical localization of epileptic foci. Third, we examined if the utility of rm-EEG is preserved in situations when EEG-untrained individuals, such as junior residents or medical students, have to decide on the presence or absence of these abnormalities, demonstrating the spectrum of utility. Individuals with minimal EEG exposure are particularly susceptible to information overload (i.e., being unable to see the forest for the trees) when interpreting EEG recordings, and the reduction of channels might serve to reduce the amount of visual information, and therefore the cognitive load, with which untrained individuals must make a diagnostic assessment (Hall and Walton, 2004). Fourth, we presented EEG data as fixed 15-s snapshots to make it difficult for reviewers to make a diagnostic assessment based on a single page of EEG. Since the overarching goal of this study was to compare the utility of rm-EEG and fm-EEG, we made every attempt to provide the reviewers with the same data (except for the number of channels) in both rm-EEG and fm-EEG and to minimize their freedom to alter EEG parameters during their review. Lastly, we aimed to minimize rater bias by recruiting EEG readers across several institutions.
Limitations of the study
The novelty of our design aside, we are mindful that, in clinical practice, EEG readers have the option of scrolling back and forth between pages to observe evolution of activity, changing the montage or the amplitude of waveforms on visual display, and reviewing video information, clinical context, or hours of preceding EEG data. Thus, our experimental design might have made the reading of EEGs more difficult, particularly with regard to viewing evolution of ictal activity in such a short sample, and given rise to underestimates of diagnostic utility. It is also possible that recruiting EEG readers from several major institutions and across the experience spectrum might have also contributed to significant inter-rater variability that has been reported in the literature to exist even between expert epileptologists in applying EEG terminology or in classifying specific patterns (Mani et al., 2012, Gaspard et al., 2014, Grant et al., 2014b, Halford et al., 2015, Tu et al., 2017). Future studies might explore the impact of these factors (e.g., sample duration, visual display settings, presence of absence of other clinical information, visualization of seizure onset and evolution) on physician confidence in assigning a diagnosis. Finally, the limited number of focal abnormalities (n = 5) in our sample prevented us from assessing the utility of reduced electrode arrays for aiding in the detection of focal seizures or rhythmic and periodic patterns.
Conclusion
Reduced channel EEG has reasonable utility for detecting generalized or hemispheric seizures and rhythmic periodic patterns, and it has the potential to provide physicians with quick and pragmatic diagnostic information.
Authors: Nancy Foldvary-Schaefer; Jose De Ocampo; Edward Mascha; Richard Burgess; Dudley Dinner; Harold Morris Journal: J Clin Neurophysiol Date: 2006-02 Impact factor: 2.177
Authors: Johannes P Koren; Johannes Herta; Susanne Pirker; Franz Fürbass; Manfred Hartmann; Tilmann Kluge; Christoph Baumgartner Journal: Clin Neurophysiol Date: 2015-11-23 Impact factor: 3.708
Authors: Andres Rodriguez Ruiz; Jan Vlachy; Jong Woo Lee; Emily J Gilmore; Turgay Ayer; Hiba Arif Haider; Nicolas Gaspard; J Andrew Ehrenberg; Benjamin Tolchin; Tadeu A Fantaneanu; Andres Fernandez; Lawrence J Hirsch; Suzette LaRoche Journal: JAMA Neurol Date: 2017-02-01 Impact factor: 18.302
Authors: Bin Tu; G Bryan Young; Agnieszka Kokoszka; Andres Rodriguez-Ruiz; Jay Varma; Linda M Eerikäinen; Nadege Assassi; Stephan A Mayer; Jan Claassen; Mika O K Särkelä Journal: Epilepsia Open Date: 2017-01-03
Authors: Deepika Kurup; Kapil Gururangan; Masoom J Desai; Matthew S Markert; Dawn S Eliashiv; Paul M Vespa; Josef Parvizi Journal: Front Neurol Date: 2022-06-29 Impact factor: 4.086
Authors: Paul M Vespa; DaiWai M Olson; Sayona John; Kyle S Hobbs; Kapil Gururangan; Kun Nie; Masoom J Desai; Matthew Markert; Josef Parvizi; Thomas P Bleck; Lawrence J Hirsch; M Brandon Westover Journal: Crit Care Med Date: 2020-09 Impact factor: 9.296
Authors: Baharan Kamousi; Suganya Karunakaran; Kapil Gururangan; Matthew Markert; Barbara Decker; Pouya Khankhanian; Laura Mainardi; James Quinn; Raymond Woo; Josef Parvizi Journal: Neurocrit Care Date: 2020-10-06 Impact factor: 3.210