Stephanie Ahrens1, Jaime D Twanow2, Jorge Vidaurre2, Satyanarayana Gedela3, Melissa Moore-Clingenpeel4, Adam P Ostendorf2. 1. Division of Neurology, Department of Pediatrics, The Ohio State University and Nationwide Children's Hospital, Columbus, Ohio. Electronic address: stephanie.ahrens@nationwidechildrens.org. 2. Division of Neurology, Department of Pediatrics, The Ohio State University and Nationwide Children's Hospital, Columbus, Ohio. 3. Division of Neurology, Department of Pediatrics, Emory University and Children's Healthcare of Atlanta, Atlanta, Georgia. 4. Division of Critical Care Medicine, Department of Pediatrics, Biostatistics Core, The Research Institute, The Ohio State University and Nationwide Children's Hospital, Columbus, Ohio.
Abstract
OBJECTIVES: Electroencephalography (EEG) technologists commonly screen continuous EEG. Until now, the inter-rater agreement or sensitivity for important EEG findings has been unknown in this group. METHODS: Twenty-nine EEG technologists and three clinical neurophysiologists interpreted 90 five-minute samples of pediatric critical care EEG. Inter-rater agreement was examined with Cohen's kappa and Fleiss' kappa for EEG findings. A gold-standard consensus agreement was developed for examining sensitivity and specificity for seizures or discontinuity. Kruskal-Wallis tests with Benjamani-Hochberg corrections for multiple comparisons were utilized to examine associations between correct scoring and certification status and years of experience. RESULTS: Aggregate agreement was moderate for seizures and fair for EEG background continuity among EEG technologists. Individual agreement for seizures and continuity varied from slight to substantial. For individual EEG technologists, sensitivity for seizures ranged from 44 to 93% and sensitivity for continuity ranged from 81 to 100%. Raters with Certified Long Term Monitoring credentials were more likely to identify seizures correctly. SIGNIFICANCE: This is the first study to evaluate inter-rater agreement and interpretation correctness among EEG technologists interpreting pediatric critical care EEG. EEG technologists demonstrated better aggregate agreement for seizure detection than other EEG findings, yet individual results and internal consistency varied widely. These data provide important insight into the common practice of utilizing EEG technologists for screening critical care EEG.
OBJECTIVES: Electroencephalography (EEG) technologists commonly screen continuous EEG. Until now, the inter-rater agreement or sensitivity for important EEG findings has been unknown in this group. METHODS: Twenty-nine EEG technologists and three clinical neurophysiologists interpreted 90 five-minute samples of pediatric critical care EEG. Inter-rater agreement was examined with Cohen's kappa and Fleiss' kappa for EEG findings. A gold-standard consensus agreement was developed for examining sensitivity and specificity for seizures or discontinuity. Kruskal-Wallis tests with Benjamani-Hochberg corrections for multiple comparisons were utilized to examine associations between correct scoring and certification status and years of experience. RESULTS: Aggregate agreement was moderate for seizures and fair for EEG background continuity among EEG technologists. Individual agreement for seizures and continuity varied from slight to substantial. For individual EEG technologists, sensitivity for seizures ranged from 44 to 93% and sensitivity for continuity ranged from 81 to 100%. Raters with Certified Long Term Monitoring credentials were more likely to identify seizures correctly. SIGNIFICANCE: This is the first study to evaluate inter-rater agreement and interpretation correctness among EEG technologists interpreting pediatric critical care EEG. EEG technologists demonstrated better aggregate agreement for seizure detection than other EEG findings, yet individual results and internal consistency varied widely. These data provide important insight into the common practice of utilizing EEG technologists for screening critical care EEG.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Jay Gavvala; Nicholas Abend; Suzette LaRoche; Cecil Hahn; Susan T Herman; Jan Claassen; Mícheál Macken; Stephan Schuele; Elizabeth Gerard Journal: Epilepsia Date: 2014-09-29 Impact factor: 5.864
Authors: Courtney J Wusthoff; Joseph Sullivan; Hannah C Glass; Renée A Shellhaas; Nicholas S Abend; Taeun Chang; Tammy N Tsuchida Journal: Epilepsia Date: 2017-02-06 Impact factor: 5.864
Authors: J J Halford; D Shiau; J A Desrochers; B J Kolls; B C Dean; C G Waters; N J Azar; K F Haas; E Kutluay; G U Martz; S R Sinha; R T Kern; K M Kelly; J C Sackellares; S M LaRoche Journal: Clin Neurophysiol Date: 2014-11-20 Impact factor: 3.708
Authors: Nicholas S Abend; Shavonne L Massey; Mark Fitzgerald; France Fung; Natalie J Atkin; Rui Xiao; Alexis A Topjian Journal: J Clin Neurophysiol Date: 2017-11 Impact factor: 2.177
Authors: Adam P Ostendorf; Stephanie M Ahrens; Fred Alexander Lado; Susan T Arnold; Shasha Bai; Meriem K Bensalem Owen; Kevin E Chapman; Dave F Clarke; Mariah Eisner; Nathan B Fountain; Johanna M Gray; Jennifer L Hopp; Ellen Riker; Stephan U Schuele; Barbara V Small; Susan T Herman Journal: Neurology Date: 2021-12-08 Impact factor: 11.800