Taneeta Mindy Ganguly1, Colin A Ellis1, Danni Tu1, Russell T Shinohara1, Kathryn A Davis1, Brian Litt1, Jay Pathmanathan2. 1. From the Department of Neurology (T.M.G., C.A.E., K.A.D., B.L., J.P.), and Penn Statistics in Imaging and Visualization Endeavor (PennSIVE) Center of Excellence (D.T., R.T.S.), Center for Clinical Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania; Department of Biostatistics, Epidemiology, & Informatics (D.T., R.T.S.) and Center for Biomedical Image Computing and Analytics (R.T.S.), University of Pennsylvania, Philadelphia. 2. From the Department of Neurology (T.M.G., C.A.E., K.A.D., B.L., J.P.), and Penn Statistics in Imaging and Visualization Endeavor (PennSIVE) Center of Excellence (D.T., R.T.S.), Center for Clinical Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania; Department of Biostatistics, Epidemiology, & Informatics (D.T., R.T.S.) and Center for Biomedical Image Computing and Analytics (R.T.S.), University of Pennsylvania, Philadelphia. jay.pathmanathan@pennmedicine.upenn.edu.
Abstract
BACKGROUND AND OBJECTIVES: The aim of this work was to test the accuracy of Persyst commercially available automated seizure detection in critical care EEG by comparing automated seizure detections to human review in a manually reviewed cohort and on a large scale. METHODS: Automated seizure detections (Persyst versions 12 and 13) were compared to human review in a pilot cohort of 229 seizures from 85 EEG records and then in an expanded cohort of 7,924 EEG records. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated for individual seizures (pilot cohort) and for entire records (pilot and expanded cohorts). We assessed EEG features associated with the accuracy of automated seizure detections. RESULTS: In the pilot cohort, accuracy of automated detection for individual seizures was modest (sensitivity 0.50, PPV 0.60). At the record level (did the recording contain seizures or not?), sensitivity was higher (pilot cohort 0.78, expanded cohort 0.91), PPV was low (pilot cohort 0.40, expanded cohort 0.08), and NPV was high (pilot cohort 0.88, expanded cohort 0.97). Different software versions (version 12 vs 13) performed similarly. Sensitivity was higher for records containing focal-onset seizures compared to generalized-onset seizures (0.93 vs 0.85, p = 0.012). DISCUSSION: In critical care continuous EEG recordings, automated detection of individual seizures had rates of both false negatives and false positives that bring into question its utility as a seizure alarm in clinical practice. At the level of entire EEG records, the absence of automated detections accurately predicted EEG records without true seizures. The true value of Persyst automated seizure detection appears to lie in triaging of low-risk EEGs. CLASSIFICATION OF EVIDENCE: This study provides Class II evidence that an automated seizure detection program cannot accurately identify EEG records that contain seizures.
BACKGROUND AND OBJECTIVES: The aim of this work was to test the accuracy of Persyst commercially available automated seizure detection in critical care EEG by comparing automated seizure detections to human review in a manually reviewed cohort and on a large scale. METHODS: Automated seizure detections (Persyst versions 12 and 13) were compared to human review in a pilot cohort of 229 seizures from 85 EEG records and then in an expanded cohort of 7,924 EEG records. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated for individual seizures (pilot cohort) and for entire records (pilot and expanded cohorts). We assessed EEG features associated with the accuracy of automated seizure detections. RESULTS: In the pilot cohort, accuracy of automated detection for individual seizures was modest (sensitivity 0.50, PPV 0.60). At the record level (did the recording contain seizures or not?), sensitivity was higher (pilot cohort 0.78, expanded cohort 0.91), PPV was low (pilot cohort 0.40, expanded cohort 0.08), and NPV was high (pilot cohort 0.88, expanded cohort 0.97). Different software versions (version 12 vs 13) performed similarly. Sensitivity was higher for records containing focal-onset seizures compared to generalized-onset seizures (0.93 vs 0.85, p = 0.012). DISCUSSION: In critical care continuous EEG recordings, automated detection of individual seizures had rates of both false negatives and false positives that bring into question its utility as a seizure alarm in clinical practice. At the level of entire EEG records, the absence of automated detections accurately predicted EEG records without true seizures. The true value of Persyst automated seizure detection appears to lie in triaging of low-risk EEGs. CLASSIFICATION OF EVIDENCE: This study provides Class II evidence that an automated seizure detection program cannot accurately identify EEG records that contain seizures.
Authors: Susan T Herman; Nicholas S Abend; Thomas P Bleck; Kevin E Chapman; Frank W Drislane; Ronald G Emerson; Elizabeth E Gerard; Cecil D Hahn; Aatif M Husain; Peter W Kaplan; Suzette M LaRoche; Marc R Nuwer; Mark Quigg; James J Riviello; Sarah E Schmitt; Liberty A Simmons; Tammy N Tsuchida; Lawrence J Hirsch Journal: J Clin Neurophysiol Date: 2015-04 Impact factor: 2.177
Authors: Brad K Kamitaki; Alma Yum; James Lee; Shelly Rishty; Kartik Sivaraaman; Abdolreza Esfahanizadeh; Ram Mani; Stephen Wong Journal: Seizure Date: 2019-05-20 Impact factor: 3.184
Authors: F Fürbass; P Ossenblok; M Hartmann; H Perko; A M Skupch; G Lindinger; L Elezi; E Pataraia; A J Colon; C Baumgartner; T Kluge Journal: Clin Neurophysiol Date: 2014-10-02 Impact factor: 3.708
Authors: M Brandon Westover; Mouhsin M Shafi; Matt T Bianchi; Lidia M V R Moura; Deirdre O'Rourke; Eric S Rosenthal; Catherine J Chu; Samantha Donovan; Daniel B Hoch; Ronan D Kilbride; Andrew J Cole; Sydney S Cash Journal: Clin Neurophysiol Date: 2014-07-11 Impact factor: 3.708
Authors: Ikuko Laccheo; Hasan Sonmezturk; Amar B Bhatt; Luke Tomycz; Yaping Shi; Marianna Ringel; Gina DiCarlo; DeAngelo Harris; John Barwise; Bassel Abou-Khalil; Kevin F Haas Journal: Neurocrit Care Date: 2015-04 Impact factor: 3.210