Jian Hu1, France W Fung2, Marin Jacobwitz3, Darshana S Parikh4, Lisa Vala5, Maureen Donnelly5, Alexis A Topjian6, Nicholas S Abend7, Rui Xiao8. 1. Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania Perelman School of Medicine, United States. 2. Department of Pediatrics (Division of Neurology), Children's Hospital of Philadelphia, United States; Departments of Neurology and Pediatrics, University of Pennsylvania Perelman School of Medicine, United States. 3. Department of Pediatrics (Division of Neurology), Children's Hospital of Philadelphia, United States. 4. Department of Anesthesia and Critical Care Medicine, Children's Hospital of Philadelphia, United States; Department of Neurodiagnostics, Children's Hospital of Philadelphia, United States. 5. Department of Neurodiagnostics, Children's Hospital of Philadelphia, United States. 6. Department of Anesthesia and Critical Care Medicine, Children's Hospital of Philadelphia, United States; Department of Anesthesia & Critical Care, University of Pennsylvania Perelman School of Medicine, United States. 7. Department of Pediatrics (Division of Neurology), Children's Hospital of Philadelphia, United States; Departments of Neurology and Pediatrics, University of Pennsylvania Perelman School of Medicine, United States; Department of Anesthesia & Critical Care, University of Pennsylvania Perelman School of Medicine, United States; Center for Clinical Epidemiology and Biostatistics, University of Pennsylvania Perelman School of Medicine, United States; Department of Neurodiagnostics, Children's Hospital of Philadelphia, United States. 8. Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania Perelman School of Medicine, United States; Center for Clinical Epidemiology and Biostatistics, University of Pennsylvania Perelman School of Medicine, United States. Electronic address: xiaor@email.chop.edu.
Abstract
OBJECTIVE: To determine whether machine learning techniques would enhance our ability to incorporate key variables into a parsimonious model with optimized prediction performance for electroencephalographic seizure (ES) prediction in critically ill children. METHODS: We analyzed data from a prospective observational cohort study of 719 consecutive critically ill children with encephalopathy who underwent clinically-indicated continuous EEG monitoring (CEEG). We implemented and compared three state-of-the-art machine learning methods for ES prediction: (1) random forest; (2) Least Absolute Shrinkage and Selection Operator (LASSO); and (3) Deep Learning Important FeaTures (DeepLIFT). We developed a ranking algorithm based on the relative importance of each variable derived from the machine learning methods. RESULTS: Based on our ranking algorithm, the top five variables for ES prediction were: (1) epileptiform discharges in the initial 30 minutes, (2) clinical seizures prior to CEEG initiation, (3) sex, (4) age dichotomized at 1 year, and (5) epileptic encephalopathy. Compared to the stepwise selection-based approach in logistic regression, the top variables selected by our ranking algorithm were more informative as models utilizing the top variables achieved better prediction performance evaluated by prediction accuracy, AUROC and F1 score. Adding additional variables did not improve and sometimes worsened model performance. CONCLUSION: The ranking algorithm was helpful in deriving a parsimonious model for ES prediction with optimal performance. However, application of state-of-the-art machine learning models did not substantially improve model performance compared to prior logistic regression models. Thus, to further improve the ES prediction, we may need to collect more samples and variables that provide additional information.
OBJECTIVE: To determine whether machine learning techniques would enhance our ability to incorporate key variables into a parsimonious model with optimized prediction performance for electroencephalographic seizure (ES) prediction in critically ill children. METHODS: We analyzed data from a prospective observational cohort study of 719 consecutive critically ill children with encephalopathy who underwent clinically-indicated continuous EEG monitoring (CEEG). We implemented and compared three state-of-the-art machine learning methods for ES prediction: (1) random forest; (2) Least Absolute Shrinkage and Selection Operator (LASSO); and (3) Deep Learning Important FeaTures (DeepLIFT). We developed a ranking algorithm based on the relative importance of each variable derived from the machine learning methods. RESULTS: Based on our ranking algorithm, the top five variables for ES prediction were: (1) epileptiform discharges in the initial 30 minutes, (2) clinical seizures prior to CEEG initiation, (3) sex, (4) age dichotomized at 1 year, and (5) epileptic encephalopathy. Compared to the stepwise selection-based approach in logistic regression, the top variables selected by our ranking algorithm were more informative as models utilizing the top variables achieved better prediction performance evaluated by prediction accuracy, AUROC and F1 score. Adding additional variables did not improve and sometimes worsened model performance. CONCLUSION: The ranking algorithm was helpful in deriving a parsimonious model for ES prediction with optimal performance. However, application of state-of-the-art machine learning models did not substantially improve model performance compared to prior logistic regression models. Thus, to further improve the ES prediction, we may need to collect more samples and variables that provide additional information.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Katherine L Wagenman; Taylor P Blake; Sarah M Sanchez; Maria T Schultheis; Jerilynn Radcliffe; Robert A Berg; Dennis J Dlugos; Alexis A Topjian; Nicholas S Abend Journal: Neurology Date: 2014-01-02 Impact factor: 9.910
Authors: Alexis A Topjian; Ana M Gutierrez-Colina; Sarah M Sanchez; Robert A Berg; Stuart H Friess; Dennis J Dlugos; Nicholas S Abend Journal: Crit Care Med Date: 2013-01 Impact factor: 7.598
Authors: Nicholas S Abend; Ana Gutierrez-Colina; Huaqing Zhao; Rong Guo; Eric Marsh; Robert R Clancy; Dennis J Dlugos Journal: J Clin Neurophysiol Date: 2011-02 Impact factor: 2.177
Authors: Juan A Piantino; Mark S Wainwright; Michele Grimason; Craig M Smith; Elora Hussain; Dan Byron; Anthony Chin; Carl Backer; Marleta Reynolds; Joshua Goldstein Journal: Pediatr Crit Care Med Date: 2013-07 Impact factor: 3.624
Authors: Aaron F Struck; Gamaleldin Osman; Nishi Rampal; Siddhartha Biswal; Benjamin Legros; Lawrence J Hirsch; M Brandon Westover; Nicolas Gaspard Journal: Ann Neurol Date: 2017-07-19 Impact factor: 10.422
Authors: Daphne M Hasbani; Alexis A Topjian; Stuart H Friess; Todd J Kilbaugh; Robert A Berg; Cindy W Christian; Dennis J Dlugos; Jimmy Huh; Nicholas S Abend Journal: Pediatr Crit Care Med Date: 2013-09 Impact factor: 3.624
Authors: Nick Kane; Jayant Acharya; Sandor Benickzy; Luis Caboclo; Simon Finnigan; Peter W Kaplan; Hiroshi Shibasaki; Ronit Pressler; Michel J A M van Putten Journal: Clin Neurophysiol Pract Date: 2017-08-04
Authors: France W Fung; Jiaxin Fan; Darshana S Parikh; Lisa Vala; Maureen Donnelly; Marin Jacobwitz; Alexis A Topjian; Rui Xiao; Nicholas S Abend Journal: J Clin Neurophysiol Date: 2022-04-20 Impact factor: 2.590