Wendong Ge1, Jin Jing1, Sungtae An2, Aline Herlopian3, Marcus Ng4, Aaron F Struck5, Brian Appavu6, Emily L Johnson7, Gamaleldin Osman8, Hiba A Haider9, Ioannis Karakis9, Jennifer A Kim3, Jonathan J Halford10, Monica B Dhakar9, Rani A Sarkis11, Christa B Swisher12, Sarah Schmitt10, Jong Woo Lee11, Mohammad Tabaeizadeh13, Andres Rodriguez9, Nicolas Gaspard14, Emily Gilmore15, Susan T Herman16, Peter W Kaplan17, Jay Pathmanathan18, Shenda Hong2, Eric S Rosenthal1, Sahar Zafar1, Jimeng Sun19, M Brandon Westover20. 1. Massachusetts General Hospital, Department of Neurology, Boston, MA, United States; Harvard Medical School, Boston, MA, United States. 2. Georgia Institute of Technology, College of Computing, Atlanta, GA, Georgia. 3. Yale University, United States. 4. University of Manitoba, Canada. 5. University of Wisconsin Madison Department of Neurology, United States. 6. University of Arizona College of Medicine, Phoenix, United States. 7. Johns Hopkins School of Medicine, United States. 8. Henry Ford Hospital, United States. 9. Emory University School of Medicine, Georgia. 10. Medical University of South Carolina, United States. 11. Brigham and Women's Hospital, United States. 12. Duke University Hospital, United States. 13. Baylor College of Medicine, United States. 14. Université Libre de Bruxelles, Hôpital Erasme and Yale University, Belgium. 15. Yale University, Yale New Haven Hospital, United States. 16. Barrow Neurological Institute, Phoenix, AZ, United States. 17. Johns Hopkins University, United States. 18. University of Pennsylvania, PA, United States. 19. University of Illinois at Urbana-Champaign, College of Computing, Champaign, IL, United States. 20. Massachusetts General Hospital, Department of Neurology, Boston, MA, United States; Harvard Medical School, Boston, MA, United States. Electronic address: mwestover@partners.org.
Abstract
OBJECTIVES: Seizures and seizure-like electroencephalography (EEG) patterns, collectively referred to as "ictal interictal injury continuum" (IIIC) patterns, are commonly encountered in critically ill patients. Automated detection is important for patient care and to enable research. However, training accurate detectors requires a large labeled dataset. Active Learning (AL) may help select informative examples to label, but the optimal AL approach remains unclear. METHODS: We assembled >200,000 h of EEG from 1,454 hospitalized patients. From these, we collected 9,808 labeled and 120,000 unlabeled 10-second EEG segments. Labels included 6 IIIC patterns. In each AL iteration, a Dense-Net Convolutional Neural Network (CNN) learned vector representations for EEG segments using available labels, which were used to create a 2D embedding map. Nearest-neighbor label spreading within the embedding map was used to create additional pseudo-labeled data. A second Dense-Net was trained using real- and pseudo-labels. We evaluated several strategies for selecting candidate points for experts to label next. Finally, we compared two methods for class balancing within queries: standard balanced-based querying (SBBQ), and high confidence spread-based balanced querying (HCSBBQ). RESULTS: Our results show: 1) Label spreading increased convergence speed for AL. 2) All query criteria produced similar results to random sampling. 3) HCSBBQ query balancing performed best. Using label spreading and HCSBBQ query balancing, we were able to train models approaching expert-level performance across all pattern categories after obtaining ∼7000 expert labels. CONCLUSION: Our results provide guidance regarding the use of AL to efficiently label large EEG datasets in critically ill patients.
OBJECTIVES: Seizures and seizure-like electroencephalography (EEG) patterns, collectively referred to as "ictal interictal injury continuum" (IIIC) patterns, are commonly encountered in critically ill patients. Automated detection is important for patient care and to enable research. However, training accurate detectors requires a large labeled dataset. Active Learning (AL) may help select informative examples to label, but the optimal AL approach remains unclear. METHODS: We assembled >200,000 h of EEG from 1,454 hospitalized patients. From these, we collected 9,808 labeled and 120,000 unlabeled 10-second EEG segments. Labels included 6 IIIC patterns. In each AL iteration, a Dense-Net Convolutional Neural Network (CNN) learned vector representations for EEG segments using available labels, which were used to create a 2D embedding map. Nearest-neighbor label spreading within the embedding map was used to create additional pseudo-labeled data. A second Dense-Net was trained using real- and pseudo-labels. We evaluated several strategies for selecting candidate points for experts to label next. Finally, we compared two methods for class balancing within queries: standard balanced-based querying (SBBQ), and high confidence spread-based balanced querying (HCSBBQ). RESULTS: Our results show: 1) Label spreading increased convergence speed for AL. 2) All query criteria produced similar results to random sampling. 3) HCSBBQ query balancing performed best. Using label spreading and HCSBBQ query balancing, we were able to train models approaching expert-level performance across all pattern categories after obtaining ∼7000 expert labels. CONCLUSION: Our results provide guidance regarding the use of AL to efficiently label large EEG datasets in critically ill patients.
Authors: Sándor Beniczky; Lawrence J Hirsch; Peter W Kaplan; Ronit Pressler; Gerhard Bauer; Harald Aurlien; Jan C Brøgger; Eugen Trinka Journal: Epilepsia Date: 2013-09 Impact factor: 5.864
Authors: L J Hirsch; S M LaRoche; N Gaspard; E Gerard; A Svoronos; S T Herman; R Mani; H Arif; N Jette; Y Minazad; J F Kerrigan; P Vespa; S Hantus; J Claassen; G B Young; E So; P W Kaplan; M R Nuwer; N B Fountain; F W Drislane Journal: J Clin Neurophysiol Date: 2013-02 Impact factor: 2.177
Authors: Jin Jing; Emile d’Angremont; Sahar Zafar; Eric S Rosenthal; Mohammad Tabaeizadeh; Senan Ebrahim; Justin Dauwels; M Brandon Westover Journal: Annu Int Conf IEEE Eng Med Biol Soc Date: 2018-07
Authors: Johannes P Koren; Johannes Herta; Susanne Pirker; Franz Fürbass; Manfred Hartmann; Tilmann Kluge; Christoph Baumgartner Journal: Clin Neurophysiol Date: 2015-11-23 Impact factor: 3.708