Korey Kam1, David M Rapoport2, Ankit Parekh2, Indu Ayappa2, Andrew W Varga3. 1. Division of Pulmonary, Critical Care and Sleep Medicine, Icahn School of Medicine at Mount Sinai, USA. Electronic address: korey.kam@mssm.edu. 2. Division of Pulmonary, Critical Care and Sleep Medicine, Icahn School of Medicine at Mount Sinai, USA. 3. Division of Pulmonary, Critical Care and Sleep Medicine, Icahn School of Medicine at Mount Sinai, USA. Electronic address: andrew.varga@mssm.edu.
Abstract
BACKGROUND: Recent advancement in deep learning provides a pivotal opportunity to potentially supplement or supplant the limiting step of manual sleep scoring. NEW METHOD: In this paper, we characterize the WaveSleepNet (WSN), a deep convolutional neural network (CNN) that uses wavelet transformed images of mouse EEG/EMG signals to autoscore sleep and wake. RESULTS: WSN achieves an epoch by epoch mean accuracy of 0.86 and mean F1 score of 0.82 compared to manual scoring by a human expert. In mice experiencing mechanically induced sleep fragmentation, an overall epoch by epoch mean accuracy of 0.80 is achieved by WSN and classification of non-REM (NREM) sleep is not compromised, but the high level of sleep fragmentation results in WSN having greater difficulty differentiating REM from NREM sleep. We also find that WSN achieves similar levels of accuracy on an independent dataset of externally acquired EEG/EMG recordings with an overall epoch by epoch accuracy of 0.91. We also compared conventional summary sleep metrics in mice sleeping ad libitum. WSN systematically biases sleep fragmentation metrics of bout number and bout length leading to an overestimated degree of sleep fragmentation. COMPARISON WITH EXISTING METHODS: In a cross-validation, WSN has a greater macro and stage-specific accuracy compared to a conventional random forest classifier. Examining the WSN, we find that it automatically learns spectral features consistent with manual scoring criteria that are used to define each class. CONCLUSION: These results suggest to us that WSN is capable of learning visually agreeable features and may be useful as a supplement to human manual scoring.
BACKGROUND: Recent advancement in deep learning provides a pivotal opportunity to potentially supplement or supplant the limiting step of manual sleep scoring. NEW METHOD: In this paper, we characterize the WaveSleepNet (WSN), a deep convolutional neural network (CNN) that uses wavelet transformed images of mouse EEG/EMG signals to autoscore sleep and wake. RESULTS: WSN achieves an epoch by epoch mean accuracy of 0.86 and mean F1 score of 0.82 compared to manual scoring by a human expert. In mice experiencing mechanically induced sleep fragmentation, an overall epoch by epoch mean accuracy of 0.80 is achieved by WSN and classification of non-REM (NREM) sleep is not compromised, but the high level of sleep fragmentation results in WSN having greater difficulty differentiating REM from NREM sleep. We also find that WSN achieves similar levels of accuracy on an independent dataset of externally acquired EEG/EMG recordings with an overall epoch by epoch accuracy of 0.91. We also compared conventional summary sleep metrics in mice sleeping ad libitum. WSN systematically biases sleep fragmentation metrics of bout number and bout length leading to an overestimated degree of sleep fragmentation. COMPARISON WITH EXISTING METHODS: In a cross-validation, WSN has a greater macro and stage-specific accuracy compared to a conventional random forest classifier. Examining the WSN, we find that it automatically learns spectral features consistent with manual scoring criteria that are used to define each class. CONCLUSION: These results suggest to us that WSN is capable of learning visually agreeable features and may be useful as a supplement to human manual scoring.
Authors: Mark Cicero; Alexander Bilbily; Errol Colak; Tim Dowdell; Bruce Gray; Kuhan Perampaladas; Joseph Barfett Journal: Invest Radiol Date: 2017-05 Impact factor: 6.016
Authors: Andrew W Varga; Akifumi Kishi; Janna Mantua; Jason Lim; Viachaslau Koushyk; David P Leibert; Ricardo S Osorio; David M Rapoport; Indu Ayappa Journal: J Neurosci Date: 2014-10-29 Impact factor: 6.167
Authors: Andre Esteva; Brett Kuprel; Roberto A Novoa; Justin Ko; Susan M Swetter; Helen M Blau; Sebastian Thrun Journal: Nature Date: 2017-01-25 Impact factor: 49.962
Authors: Heidi Danker-Hopfe; Peter Anderer; Josef Zeitlhofer; Marion Boeck; Hans Dorn; Georg Gruber; Esther Heller; Erna Loretz; Doris Moser; Silvia Parapatics; Bernd Saletu; Andrea Schmidt; Georg Dorffner Journal: J Sleep Res Date: 2009-03 Impact factor: 3.981
Authors: Anna E Mullins; Ankit Parekh; Korey Kam; Bresne Castillo; Zachary J Roberts; Ahmad Fakhoury; Daphne I Valencia; Reagan Schoenholz; Thomas M Tolbert; Jason Z Bronstein; Anne M Mooney; Omar E Burschtin; David M Rapoport; Indu Ayappa; Andrew W Varga Journal: Front Physiol Date: 2021-11-22 Impact factor: 4.566