| Literature DB >> 33802799 |
Manish Sharma1, Jainendra Tiwari1, U Rajendra Acharya2,3,4.
Abstract
Sleep stage classification plays a pivotal role in effective diagnosis and treatment of sleep related disorders. Traditionally, sleep scoring is done manually by trained sleep scorers. The analysis of electroencephalogram (EEG) signals recorded during sleep by clinicians is tedious, time-consuming and prone to human errors. Therefore, it is clinically important to score sleep stages using machine learning techniques to get accurate diagnosis. Several studies have been proposed for automated detection of sleep stages. However, these studies have employed only healthy normal subjects (good sleepers). The proposed study focuses on the automated sleep-stage scoring of subjects suffering from seven different kind of sleep disorders such as insomnia, bruxism, narcolepsy, nocturnal frontal lobe epilepsy (NFLE), periodic leg movement (PLM), rapid eye movement (REM) behavioural disorder and sleep-disordered breathing as well as normal subjects. The open source physionet's cyclic alternating pattern (CAP) sleep database is used for this study. The EEG epochs are decomposed into sub-bands using a new class of optimized wavelet filters. Two EEG channels, namely F4-C4 and C4-A1, combined are used for this work as they can provide more insights into the changes in EEG signals during sleep. The norm features are computed from six sub-bands coefficients of optimal wavelet filter bank and fed to various supervised machine learning classifiers. We have obtained the highest classification performance using an ensemble of bagged tree (EBT) classifier with 10-fold cross validation. The CAP database comprising of 80 subjects is divided into ten different subsets and then ten different sleep-stage scoring tasks are performed. Since, the CAP database is unbalanced with different duration of sleep stages, the balanced dataset also has been created using over-sampling and under-sampling techniques. The highest average accuracy of 85.3% and Cohen's Kappa coefficient of 0.786 and accuracy of 92.8% and Cohen's Kappa coefficient of 0.915 are obtained for unbalanced and balanced databases, respectively. The proposed method can reliably classify the sleep stages using single or dual channel EEG epochs of 30 s duration instead of using multimodal polysomnography (PSG) which are generally used for sleep-stage scoring. Our developed automated system is ready to be tested with more sleep EEG data and can be employed in various sleep laboratories to evaluate the quality of sleep in various sleep disorder patients and normal subjects.Entities:
Keywords: classification; electroencephalogram (EEG); polysomnogram (PSG); sleep disorders; sleep stage; wavelet filters
Year: 2021 PMID: 33802799 PMCID: PMC8002569 DOI: 10.3390/ijerph18063087
Source DB: PubMed Journal: Int J Environ Res Public Health ISSN: 1660-4601 Impact factor: 3.390
Summary of the state-of-the-art automated sleep stage classification studies conducted.
| Work | Description | Performance (%) |
|---|---|---|
| Kim et al. [ |
|
73.6% 72.3 |
| Sharma et al. [ |
|
|
| Timplalexis et al. [ |
|
|
| Tripathi et al. [ |
|
|
| Widasari et al. [ |
|
|
Description of the cyclic alternating pattern (CAP) sleep database.
| Subject Type | Subjects Available | Recordings Available @512 Hz | Number-of Epochs | Male & Female | Age (in yrs) (Mean ± Std) |
|---|---|---|---|---|---|
| Healthy | 16 | 6 | 6063 | 2 M & 4 F | 32 ± 4.89 |
| Insomnia | 9 | 7 | 8551 | 3 M & 5 F | 61.75 ± 10.20 |
| Bruxism | 2 | 1 | 427 | 1 M | 34 |
| Narcolepsy | 5 | 5 | 5614 | 2 M & 3 F | 31.6 ± 10.32 |
| NFLE | 40 | 27 | 26,883 | 13 M & 14 F | 30.03 ± 10.53 |
| PLM | 10 | 9 | 7574 | 6 M & 3 F | 54.44 ± 6.37 |
| RBD | 22 | 22 | 22,676 | 19 M & 3 F | 70.72 ± 6.23 |
| SBD | 4 | 3 | 2879 | 3 M | 69.33 ± 6.12 |
| Total | 108 | 80 | 80667 | 48M & 32F | 48.25 ± 19.69 |
Sleep stage-wise and subject-wise details of epoch distribution in the original unbalanced database.
| Sleep Stage | Healthy | Seven Different Disorders | Total | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Insomnia | Bruxism | Narcolepsy | NFLE | PLM | RBD | SBD | Epochs | (in %) | ||
|
| 445 | 3801 | 44 | 1303 | 3155 | 1332 | 5266 | 495 | 15,841 | 19.64% |
|
| 280 | 223 | 34 | 301 | 1098 | 266 | 1048 | 269 | 3519 | 4.36% |
|
| 2172 | 2456 | 144 | 1708 | 10,630 | 2748 | 7446 | 1324 | 28,628 | 35.50% |
|
| 573 | 670 | 39 | 476 | 2987 | 955 | 2880 | 224 | 8804 | 10.92% |
|
| 1184 | 415 | 99 | 568 | 4108 | 956 | 2506 | 352 | 10,188 | 12.63% |
|
| 1409 | 986 | 67 | 1258 | 4905 | 1317 | 3530 | 215 | 13,687 | 16.97% |
|
| 6063 | 8551 | 427 | 5614 | 26,883 | 7574 | 22,676 | 2879 | 80,667 | |
Sleep stage-wise and subject-wise details of epoch distribution in the created balanced data.
| Sleep Stage | Healthy | Seven Different Disorders | Total | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Insomnia | Bruxism | Narcolepsy | NFLE | PLM | RBD | SBD | Epochs | (in %) | ||
|
| 1000 | 1400 | 71 | 935 | 4480 | 1262 | 3779 | 480 | 13,407 | 16.67% |
|
| 1000 | 1400 | 71 | 935 | 4480 | 1262 | 3779 | 480 | 13,407 | 16.67% |
|
| 1000 | 1400 | 71 | 935 | 4480 | 1262 | 3779 | 480 | 13,407 | 16.67% |
|
| 1000 | 1400 | 71 | 935 | 4480 | 1262 | 3779 | 480 | 13,407 | 16.67% |
|
| 1000 | 1400 | 71 | 935 | 4480 | 1262 | 3779 | 480 | 13,407 | 16.67% |
|
| 1000 | 1400 | 71 | 935 | 4480 | 1262 | 3779 | 480 | 13,407 | 16.67% |
|
| 6000 | 8400 | 426 | 5610 | 26,880 | 7572 | 22,674 | 2880 | 80,442 | |
Figure 1Flowchart of the proposed methodology.
Figure 2Tuning of hyper parameters of the ensemble of bagged trees (EBT) classifier: Mis-classification error vs. number of trees.
Statistical analysis using ANOVA for F4-C4 channel.
| Feature | Sub-Band | Rank | W (Mean ± Std) | S1 (Mean ± std) | S2 (Mean ± Std) | S3 (Mean ± Std) | S4 (Mean ± Std) | REM (Mean ± Std) | |
|---|---|---|---|---|---|---|---|---|---|
|
| Sb-1 | 2 | 0 | 20,656.14 ± 54,855.48 | 9281.65 ± 9331.55 | 13,761.47 ± 9066.79 | 18,321.05 ± 11,585.59 | 28,405.90 ± 16,908.07 | 9989.34 ± 6288.26 |
| Sb-2 | 1 | 0 | 749.99 ± 1307.83 | 296.04 ± 692.05 | 197.74 ± 328.99 | 162.27 ± 216.34 | 154.04 ± 354.95 | 167.73 ± 114.87 | |
| Sb-3 | 16 | 0 | 2740.34 ± 4746.11 | 877.57 ± 1053.98 | 644.24 ± 718.22 | 528.03 ± 452.74 | 486.95 ± 602.20 | 560.29 ± 450.23 | |
| Sb-4 | 13 | 0 | 5857.94 ± 9138.12 | 2190.28 ± 1620.46 | 1749.38 ± 1380.68 | 1449.88 ±928.23 | 1277.17 ± 800.73 | 1796.56 ±1233.18 | |
| Sb-5 | 14 | 0 | 7843.60 ± 10,155.93 | 3975.20 ± 2416.01 | 3764.24 ± 2709.47 | 3173.00 ± 1925.92 | 2813.16 ± 1394.38 | 3579.89 ± 2530.63 | |
| Sb-6 | 4 | 0 | 6880.60 ± 9721.22 | 4182.79 ± 2983.74 | 4832.37 ± 3530.33 | 5016.90 ± 3619.34 | 5092.04 ± 3125.72 | 3765.75 ± 2241.55 | |
|
| Sb-1 | 3 | 0 | 1368.82 ± 3627.26 | 624.28 ± 896.76 | 884.61 ± 663.45 | 1110.23 ± 718.85 | 1658.00 ± 980.41 | 610.15 ± 488.75 |
| Sb-2 | 7 | 1.13 × 10−121 | 16.32 ± 62.57 | 15.08 ± 130.57 | 5.61 ± 61.93 | 4.02 ± 47.44 | 4.37 ± 57.16 | 2.85 ± 4.35 | |
| Sb-3 | 15 | 0 | 74.06 ± 136.78 | 28.04 ± 80.17 | 17.09 ± 48.82 | 12.85 ± 35.01 | 12.22 ± 48.50 | 14.02 ± 28.81 | |
| Sb-4 | 11 | 0 | 204.88 ± 351.47 | 76.59 ± 97.83 | 56.15 ± 65.52 | 45.08 ± 64.96 | 39.13 ± 51.53 | 55.86 ± 48.13 | |
| Sb-5 | 8 | 0 | 363.07 ± 571.78 | 181.13 ± 167.77 | 165.59 ± 132.54 | 138.25 ± 116.83 | 122.02 ± 81.54 | 152.98 ± 114.36 | |
| Sb-6 | 10 | 0 | 440.48 ± 803.03 | 267.51 ± 282.30 | 298.63 ± 234.43 | 302.81 ± 239.25 | 301.61 ± 193.20 | 225.46 ± 137.81 | |
|
| Sb-1 | 9 | 0 | 279.62 ± 609.45 | 139.41 ± 295.40 | 198.69 ± 189.74 | 218.39 ± 172.16 | 287.81 ± 192.23 | 117.48 ± 135.51 |
| Sb-2 | 6 | 3.39 × 10−34 | 3.01 ± 31.62 | 6.05 ± 69.16 | 1.64 ± 34.01 | 1.16 ± 28.38 | 1.33 ± 30.19 | 0.30 ± 0.92 | |
| Sb-3 | 17 | 0 | 11.51 ± 28.84 | 5.93 ± 37.01 | 2.69 ± 20.83 | 1.78 ± 13.42 | 1.85 ± 20.98 | 1.89 ± 5.85 | |
| Sb-4 | 5 | 0 | 35.35 ± 76.92 | 13.10 ± 39.59 | 7.90 ± 23.04 | 5.76 ± 20.35 | 4.83 ± 21.26 | 7.46 ± 13.76 | |
| Sb-5 | 12 | 0 | 71.53 ± 157.27 | 33.31 ± 74.26 | 27.44 ± 42.13 | 22.45 ± 39.66 | 19.76 ± 29.94 | 24.59 ± 33.29 | |
| Sb-6 | 18 | 0 | 97.71 ± 247.88 | 58.77 ± 126.53 | 62.01 ± 68.44 | 58.84 ± 75.50 | 54.32 ± 47.08 | 43.76 ± 37.97 |
Statistical analysis using ANOVA for C4-A1 channel.
| Feature | Sub-Band | Rank | W (Mean ± Std) | S1 (Mean ± std) | S2 (Mean ± Std) | S3 (Mean ± Std) | S4 (Mean ± Std) | REM (Mean ± Std) | |
|---|---|---|---|---|---|---|---|---|---|
|
| Sb-1 | 1 | 0 | 36,981.35 ± 58,883.51 | 23,963.81 ± 20,242.16 | 32,003.79 ± 18,531.48 | 41,632.86 ± 16,256.33 | 63,699.18 ± 27,718.67 | 25,232.93 ± 13,663.27 |
| Sb-2 | 14 | 0 | 1563.97 ± 1513.03 | 852.80 ± 980.33 | 534.78 ± 650.33 | 437.19 ± 466.81 | 345.76 ± 449.87 | 358.28 ± 371.59 | |
| Sb-3 | 5 | 0 | 5904.82 ± 5616.39 | 2981.21 ± 2803.20 | 1990.35 ± 2449.27 | 1665.68 ± 1614.53 | 1349.09 ± 1264.19 | 1361.41 ± 1437.16 | |
| Sb-4 | 13 | 0 | 12,578.84 ± 11,387.83 | 6533.51 ± 4718.18 | 4690.19 ± 3691.48 | 4069.94 ± 2870.76 | 3403.56 ± 2202.58 | 4172.80 ± 2942.39 | |
| Sb-5 | 3 | 0 | 15,775.64 ± 12,303.67 | 10,209.32 ± 4514.26 | 8824.32 ± 4143.84 | 7721.53 ± 2683.56 | 6881.04 ± 2166.72 | 7998.54 ± 3353.39 | |
| Sb-6 | 6 | 0 | 14,728.59 ± 11,745.06 | 11,078.86 ± 5189.41 | 11,424.13 ± 4806.48 | 11,800.24 ± 3853.04 | 11,895.95 ± 4454.35 | 9165.82 ± 3029.86 | |
|
| Sb-1 | 4 | 0 | 2425.35 ± 3989.36 | 1578.19 ± 1751.27 | 2019.55 ± 1399.18 | 2501.36 ± 1138.42 | 3702.32 ± 1584.33 | 1554.12 ± 1183.25 |
| Sb-2 | 7 | 0 | 30.16 ± 64.44 | 24.86 ± 126.99 | 11.47 ± 62.72 | 8.30 ± 46.92 | 7.33 ± 57.06 | 6.42 ± 8.19 | |
| Sb-3 | 16 | 0 | 150.45 ± 159.77 | 81.05 ± 106.23 | 49.31 ± 73.79 | 37.86 ± 50.84 | 30.66 ± 53.66 | 34.96 ± 47.16 | |
| Sb-4 | 2 | 0 | 431.08 ± 428.95 | 228.16 ± 210.81 | 153.65 ± 150.42 | 125.85 ± 119.98 | 103.22 ± 83.31 | 138.40 ± 126.72 | |
| Sb-5 | 17 | 0 | 719.14 ± 662.50 | 463.36 ± 263.17 | 391.92 ± 214.74 | 337.04 ± 164.01 | 299.96 ± 111.59 | 349.51 ± 177.53 | |
| Sb-6 | 15 | 0 | 904.04 ± 887.55 | 681.53 ± 364.61 | 695.50 ± 313.77 | 702.02 ± 251.02 | 697.05 ± 262.48 | 544.97 ± 195.84 | |
|
| Sb-1 | 18 | 0 | 491.43 ± 757.98 | 336.28 ± 510.28 | 431.10 ± 370.31 | 477.72 ± 303.09 | 630.99 ± 313.80 | 302.60 ± 355.54 |
| Sb-2 | 10 | 3.27 × 10 | 4.30 ± 31.83 | 7.18 ± 71.13 | 2.19 ± 33.77 | 1.39 ± 25.34 | 1.59 ± 29.97 | 0.78 ± 1.43 | |
| Sb-3 | 8 | 0 | 20.73 ± 32.27 | 12.47 ± 38.15 | 6.43 ± 20.30 | 4.29 ± 15.56 | 3.73 ± 23.68 | 5.22 ± 9.53 | |
| Sb-4 | 11 | 0 | 69.69 ± 91.72 | 37.35 ± 59.70 | 22.08 ± 39.13 | 15.64 ± 30.68 | 11.96 ± 24.28 | 21.98 ± 34.33 | |
| Sb-5 | 9 | 0 | 136.69 ± 180.07 | 84.12 ± 97.30 | 66.58 ± 67.29 | 54.39 ± 55.85 | 47.25 ± 37.82 | 61.45 ± 68.00 | |
| Sb-6 | 12 | 0 | 183.10 ± 263.80 | 137.42 ± 131.19 | 138.07 ± 96.04 | 129.94 ± 79.24 | 120.41 ± 61.44 | 105.42 ± 74.07 |
Figure 3Results of ANOVA post-hoc test obtained using the whole database.
Summary of classification average accuracy obtained during each trial using the EBT classifier with 10-fold cross validation (CV).
| Type of Subject | Channel | Trial 1 | Trial 2 | Trial 3 | Trial 4 | Trial 5 | Mean ± Std |
|---|---|---|---|---|---|---|---|
| Healthy | F4-C4 | 74.96 | 71.86 | 72.46 | 71.56 | 73.66 | 72.9 ± 1.26 |
| C4-A1 | 73.1 | 72.2 | 74.8 | 73.4 | 72.5 | 73.2 ± 0.91 | |
| F4-C4 + C4-A1 | 76.26 | 77.66 | 79.06 | 79.66 | 78.86 | 78.3 ± 1.21 | |
| Insomnia | F4-C4 | 86.74 | 86.14 | 86.14 | 85.64 | 85.84 | 86.1 ± 0.37 |
| C4-A1 | 86.76 | 85.46 | 85.46 | 86.56 | 85.26 | 85.9 ± 0.63 | |
| F4-C4 + C4-A1 | 85.14 | 86.24 | 84.44 | 84.54 | 86.64 | 85.4 ± 0.89 | |
| Bruxism | F4-C4 | 62.34 | 64.84 | 63.74 | 63.94 | 62.64 | 63.5 ± 0.91 |
| C4-A1 | 66.34 | 64.04 | 63.94 | 66.24 | 65.94 | 65.3 ± 1.08 | |
| F4-C4 + C4-A1 | 67.78 | 65.78 | 65.48 | 68.58 | 65.88 | 66.7 ± 1.24 | |
| Narcolepsy | F4-C4 | 77.06 | 78.46 | 76.16 | 77.16 | 76.16 | 77 ± 0.85 |
| C4-A1 | 76.52 | 78.02 | 74.32 | 76.22 | 75.42 | 76.1 ± 1.23 | |
| F4-C4 + C4-A1 | 80.2 | 77.9 | 77.9 | 79.8 | 80.7 | 79.3 ± 1.18 | |
| NFLE | F4-C4 | 71.8 | 72.8 | 72.6 | 71.1 | 70.7 | 71.8 ± 0.82 |
| C4-A1 | 72.18 | 71.98 | 71.78 | 72.58 | 73.98 | 72.5 ± 0.79 | |
| F4-C4 + C4-A1 | 76.5 | 78.5 | 77.7 | 78.8 | 76 | 77.5 ± 1.09 | |
| PLM | F4-C4 | 73.88 | 71.58 | 74.28 | 72.08 | 74.68 | 73.3 ± 1.24 |
| C4-A1 | 74.7 | 74.6 | 74.9 | 76.5 | 73.8 | 74.9 ± 0.88 | |
| F4-C4 + C4-A1 | 77.24 | 78.34 | 78.14 | 79.34 | 76.94 | 78 ± 0.85 | |
| RBD | F4-C4 | 66.06 | 67.66 | 65.76 | 64.56 | 64.96 | 65.8 ± 1.07 |
| C4-A1 | 68.56 | 66.86 | 66.06 | 67.76 | 66.76 | 67.2 ± 0.87 | |
| F4-C4 + C4-A1 | 71.38 | 72.88 | 70.38 | 72.78 | 72.08 | 71.9 ± 0.93 | |
| SDB | F4-C4 | 70.52 | 68.12 | 68.12 | 69.72 | 68.02 | 68.9 ± 1.03 |
| C4-A1 | 70.94 | 72.34 | 74.24 | 71.54 | 73.44 | 72.5 ± 1.21 | |
| F4-C4 + C4-A1 | 74.06 | 74.96 | 73.96 | 75.36 | 73.16 | 74.3 ± 0.78 | |
| Healthy + Unhealthy subjects | F4-C4 | 70.1 | 68.6 | 68.4 | 71 | 69.9 | 69.6 ± 0.97 |
| C4-A1 | 68.58 | 71.78 | 70.18 | 70.28 | 70.68 | 70.3 ± 1.03 | |
| F4-C4 + C4-A1 | 73.38 | 75.78 | 76.08 | 76.28 | 75.98 | 75.5 ± 1.07 |
Performance of sleep stage classification obtained using the unbalanced dataset and EBT classifier with 10-fold CV.
| Type of Subject | Total Subjects Available | Recordings Available @512 Hz | Channel | Accuracy (%) | No. of Epochs | Prediction Speed (obs/s) | Training Time (s) |
|---|---|---|---|---|---|---|---|
| Healthy | 16 | 6 | F4-C4 | 72.9 | 6063 | 15,000 | 25.23 |
| C4-A1 | 73.2 | 17,000 | 20.25 | ||||
| F4-C4 + C4-A1 | 78.3 | 17,000 | 22.26 | ||||
| Insomnia | 9 | 7 | F4-C4 | 86.1 | 8551 | 23,000 | 22.73 |
| C4-A1 | 85.9 | 23,000 | 22.46 | ||||
| F4-C4 + C4-A1 | 85.4 | 13,000 | 28.69 | ||||
| Bruxism | 2 | 1 | F4-C4 | 63.5 | 427 | 1500 | 4.84 |
| C4-A1 | 65.3 | 1400 | 4.88 | ||||
| F4-C4 + C4-A1 | 66.7 | 1600 | 5.02 | ||||
| Narcolepsy | 5 | 5 | F4-C4 | 77.0 | 5614 | 11,000 | 14.00 |
| C4-A1 | 76.1 | 11,000 | 14.45 | ||||
| F4-C4 + C4-A1 | 79.3 | 13000 | 15.77 | ||||
| NFLE | 40 | 27 | F4-C4 | 71.8 | 26,883 | 21,000 | 62.38 |
| C4-A1 | 72.5 | 19,000 | 63.17 | ||||
| F4-C4 + C4-A1 | 77.5 | 20,000 | 78.32 | ||||
| PLM | 10 | 9 | F4-C4 | 73.3 | 7574 | 14,000 | 18.74 |
| C4-A1 | 74.9 | 9700 | 27.70 | ||||
| F4-C4 + C4-A1 | 78.0 | 16,000 | 20.94 | ||||
| RBD | 22 | 22 | F4-C4 | 65.8 | 22,676 | 15,000 | 63.79 |
| C4-A1 | 67.2 | 18,000 | 54.45 | ||||
| F4-C4 + C4-A1 | 71.9 | 12,000 | 119.48 | ||||
| SDB | 4 | 3 | F4-C4 | 68.9 | 2879 | 5900 | 10.72 |
| C4-A1 | 72.5 | 5300 | 12.45 | ||||
| F4-C4 + C4-A1 | 74.3 | 6100 | 13.53 | ||||
| Healthy + Unhealthy subjects | 108 | 80 | F4-C4 | 69.6 | 80,667 | 18,000 | 239.74 |
| C4-A1 | 70.3 | 18,000 | 239.80 | ||||
| F4-C4 + C4-A1 | 75.5 | 19,000 | 286.92 |
Confusion matrix corresponding to sleep stage classification of healthy subjects with unbalanced data using the EBT classifier with 10-fold CV.
| CT-1: Healthy (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 68.8% | 15.7% | 5.4% | 0.9% | 0.4% | 8.8% | 0.71 |
| S1 | 21.4% | 42.5% | 23.2% | 0.0% | 0.7% | 12.1% | 0.44 |
| S2 | 1.3% | 2.3% | 80.9% | 6.0% | 1.2% | 8.4% | 0.80 |
| S3 | 0.9% | 0.2% | 28.6% | 56.9% | 12.6% | 0.9% | 0.59 |
| S4 | 0.3% | 0.1% | 1.9% | 5.7% | 91.7% | 0.2% | 0.91 |
| REM | 1.1% | 1.8% | 11.8% | 0.9% | 0.5% | 84.0% | 0.83 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of healthy subjects with balanced data using the EBT classifier with 10-fold CV.
| CT-1: Healthy (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 97.7% | 1.4% | 0.5% | 0.1% | 0.1% | 0.2% | 0.96 |
| S1 | 0.5% | 99.3% | 0.0% | 0.0% | 0.0% | 0.2% | 0.95 |
| S2 | 2.3% | 5.0% | 64.1% | 12.5% | 2.3% | 13.8% | 0.73 |
| S3 | 0.3% | 0.1% | 3.3% | 94.0% | 2.3% | 0.0% | 0.86 |
| S4 | 0.2% | 0.1% | 1.4% | 9.8% | 88.5% | 0.0% | 0.92 |
| REM | 2.1% | 5.0% | 8.0% | 1.5% | 0.9% | 82.5% | 0.83 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of insomnia patients with balanced data using the EBT classifier with 10-fold CV.
| CT-2: Insomnia (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 96.2% | 0.7% | 2.6% | 0.1% | 0.1% | 0.4% | 0.93 |
| S1 | 44.8% | 7.2% | 37.7% | 0.4% | 0.0% | 9.9% | 0.11 |
| S2 | 8.9% | 0.6% | 81.6% | 3.6% | 0.4% | 4.9% | 0.82 |
| S3 | 1.3% | 0.0% | 17.9% | 56.9% | 9.7% | 0.1% | 0.73 |
| S4 | 0.0% | 0.0% | 2.2% | 14.5% | 83.4% | 0.0% | 0.82 |
| REM | 4.7% | 0.1% | 13.8% | 0.1% | 0.1% | 81.2% | 0.82 |
|
| |||||||
|
| |||||||
Confusion Matrix corresponding to sleep stage classification of insomnia patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-2: Insomnia (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 92.1% | 4.0% | 2.7% | 0.2% | 0.3% | 0.6% | 0.93 |
| S1 | 0.0% | 100% | 0.0% | 0.0% | 0.0% | 0.0% | 0.95 |
| S2 | 5.6% | 4.5% | 74.1% | 7.1% | 0.7% | 7.9% | 0.82 |
| S3 | 0.3% | 0.0% | 1.1% | 97.1% | 1.4% | 0.0% | 0.95 |
| S4 | 0.0% | 0.0% | 0.0% | 0.0% | 100.0% | 0.0% | 0.99 |
| REM | 1.1% | 1.1% | 3.9% | 0.1% | 0.1% | 93.6% | 0.93 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of bruxism patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-3: Bruxism (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 54.5% | 15.9% | 18.2% | 6.8% | 2.3% | 2.3% | 0.48 |
| S1 | 41.2% | 17.6% | 29.4% | 0.0% | 8.8% | 2.9% | 0.20 |
| S2 | 6.9% | 5.6% | 75.0% | 6.3% | 2.8% | 3.5% | 0.72 |
| S3 | 7.7% | 0.0% | 46.2% | 10.3% | 35.9% | 0.0% | 0.13 |
| S4 | 4.0% | 4.0% | 6.1% | 5.1% | 80.8% | 0.0% | 0.80 |
| REM | 0.0% | 0.0% | 11.9% | 0.0% | 0.0% | 88.1% | 0.89 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of bruxism patients with balanced data using the EBT classifier with 10-fold CV.
| CT-3: Bruxism (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 90.1% | 8.5% | 0.0% | 0.0% | 0.0% | 1.4% | 0.89 |
| S1 | 0.0% | 97.2% | 0.0% | 0.0% | 2.8% | 0.0% | 0.82 |
| S2 | 8.5% | 19.7% | 45.1% | 14.1% | 5.6% | 7.0% | 0.59 |
| S3 | 2.8% | 0.0% | 2.8% | 94.4% | 0.0% | 0.0% | 0.85 |
| S4 | 1.4% | 9.9% | 4.2% | 12.7% | 71.8% | 0.0% | 0.79 |
| REM | 0.0% | 1.4% | 1.4% | 0.0% | 1.4% | 95.8% | 0.94 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of narcolepsy patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-4: Narcolepsy (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 91.0% | 1.7% | 4.3% | 0.1% | 0.2% | 2.8% | 0.87 |
| S1 | 29.6% | 21.3% | 17.9% | 0.0% | 0.3% | 30.9% | 0.30 |
| S2 | 3.9% | 1.2% | 84.0% | 3.4% | 0.6% | 7.0% | 0.80 |
| S3 | 1.5% | 0.0% | 35.1% | 50.6% | 11.6% | 1.3% | 0.58 |
| S4 | 0.7% | 0.0% | 5.1% | 9.2% | 85.0% | 0.0% | 0.86 |
| REM | 5.5% | 2.0% | 10.1% | 0.1% | 0.0% | 82.4% | 0.81 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of narcolepsy patients with balanced data using the EBT classifier with 10-fold CV.
| CT-4: Narcolepsy (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 87.0% | 5.1% | 3.0% | 0.1% | 0.2% | 4.6% | 0.89 |
| S1 | 0.3% | 99.7% | 0.0% | 0.0% | 0.0% | 0.0% | 0.91 |
| S2 | 3.5% | 5.7% | 71.7% | 10.9% | 1.0% | 7.3% | 0.78 |
| S3 | 0.2% | 0.0% | 2.0% | 95.8% | 1.9% | 0.0% | 0.91 |
| S4 | 0.1% | 0.1% | 0.4% | 3.1% | 96.3% | 0.0% | 0.97 |
| REM | 5.0% | 8.6% | 7.0% | 0.3% | 0.1% | 79.0% | 0.83 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of nocturnal frontal lobe epilepsy patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-5: NFLE (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 86.0% | 2.5% | 8.0% | 0.1% | 0.3% | 3.1% | 0.81 |
| S1 | 42.3% | 23.5% | 18.6% | 0.3% | 0.0% | 15.3% | 0.34 |
| S2 | 2.2% | 0.4% | 87.7% | 3.9% | 1.2% | 4.7% | 0.81 |
| S3 | 0.2% | 0.0% | 50.3% | 34.1% | 15.1% | 0.2% | 0.43 |
| S4 | 0.1% | 0.0% | 5.3% | 8.1% | 86.5% | 0.0% | 0.86 |
| REM | 3.1% | 0.7% | 16.3% | 0.5% | 0.3% | 79.1% | 0.81 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of Nocturnal frontal lobe epilepsy patients with balanced data using the EBT classifier with 10-fold CV.
| CT-5: NFLE (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 93.5% | 3.3% | 1.4% | 0.1% | 0.1% | 1.6% | 0.93 |
| S1 | 0.0% | 100.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.96 |
| S2 | 3.2% | 2.2% | 68.8% | 15.1% | 1.9% | 8.9% | 0.73 |
| S3 | 0.2% | 0.1% | 9.1% | 84.2% | 6.1% | 0.3% | 0.80 |
| S4 | 0.1% | 0.0% | 1.6% | 9.% | 89.1% | 0.0% | 0.90 |
| REM | 3.2% | 2.2% | 8.6% | 1.3% | 0.4% | 84.3% | 0.86 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of periodic leg movement patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-6: PLM (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 83.4% | 4.6% | 9.7% | 0.3% | 0.3% | 1.7% | 0.84 |
| S1 | 32.3% | 22.6% | 25.2% | 0.4% | 0.0% | 19.5% | 0.28 |
| S2 | 3.5% | 1.3% | 83.8% | 7.2% | 0.4% | 3.7% | 0.82 |
| S3 | 0.5% | 0.0% | 26.0% | 59.8% | 13.2% | 0.5% | 0.61 |
| S4 | 0.2% | 0.0% | 1.4% | 15.1% | 83.2% | 0.2% | 0.84 |
| REM | 1.4% | 0.9% | 8.8% | 0.7% | 0.2% | 88.1% | 0.87 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of periodic leg movement patients with balanced data using the EBT classifier with 10-fold CV.
| CT-6: PLM (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 89.5% | 4.3% | 4.3% | 0.3% | 0.1% | 1.5% | 0.90 |
| S1 | 0.0% | 100.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.96 |
| S2 | 5.9% | 2.9% | 69.5% | 15.1% | 1.0% | 5.6% | 0.72 |
| S3 | 0.6% | 0.1% | 11.4% | 80.0% | 7.6% | 0.3% | 0.78 |
| S4 | 0.0% | 0.0% | 1.0% | 8.7% | 90.3% | 0.0% | 0.91 |
| REM | 3.2% | 1.7% | 7.6% | 1.3% | 0.3% | 85.8% | 0.89 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of REM behavioural disorder patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-7: RBD (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 87.9% | 1.1% | 8.3% | 0.2% | 0.2% | 2.2% | 0.84 |
| S1 | 29.0% | 36.2% | 24.2% | 0.4% | 0.0% | 10.2% | 0.47 |
| S2 | 6.0% | 1.0% | 79.6% | 5.5% | 1.4% | 6.5% | 0.73 |
| S3 | 1.4% | 0.0% | 31.6% | 51.6% | 12.3% | 3.2% | 0.56 |
| S4 | 0.3% | 0.0% | 4.1% | 14.3% | 80.5% | 0.9% | 0.80 |
| REM | 9.1% | 1.0% | 31.6% | 3.3% | 0.8% | 54.1% | 0.61 |
|
| |||||||
|
| |||||||
Confusion Matrix corresponding to sleep stage classification of REM behavioural disorder patients with balanced data using the EBT classifier with 10-fold CV.
| CT-7: RBD (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 84.1% | 4.9% | 5.5% | 0.7% | 0.2% | 4.7% | 0.84 |
| S1 | 0.1% | 99.8% | 0.1% | 0.0% | 0.0% | 0.1% | 0.94 |
| S2 | 6.9% | 4.7% | 59.7% | 13.0% | 2.3% | 13.5% | 0.64 |
| S3 | 0.8% | 0.1% | 8.8% | 79.9% | 7.9% | 2.5% | 0.78 |
| S4 | 0.1% | 0.0% | 0.4% | 6.3% | 92.7% | 0.6% | 0.91 |
| REM | 7.3% | 3.3% | 13.2% | 5.5% | 1.1% | 69.6% | 0.73 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of sleep-breathing disorder patients with unbalanced data using the EBT classifier with 10-fold CV.
| CT-8: SBD (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 81.4% | 9.1% | 8.5% | 0.2% | 0.0% | 0.8% | 0.76 |
| S1 | 34.9% | 29.4% | 34.2% | 0.0% | 0.4% | 1.1% | 0.35 |
| S2 | 3.8% | 3.4% | 89.0% | 2.0% | 1.1% | 0.8% | 0.83 |
| S3 | 0.0% | 0.0% | 60.3% | 22.8% | 17.0% | 0.0% | 0.31 |
| S4 | 0.3% | 0.0% | 7.1% | 8.0% | 84.7% | 0.0% | 0.84 |
| REM | 6.5% | 5.1% | 25.6% | 0.9% | 3.7% | 58.1% | 0.70 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of sleep-breathing disorder patients with balanced data using the EBT classifier with 10-fold CV.
| CT-8: SBD (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 78.1% | 14.2% | 4.6% | 1.0% | 0.2% | 1.9% | 0.83 |
| S1 | 5.2% | 91.0% | 2.3% | 0.0% | 0.8% | 0.0% | 0.85 |
| S2 | 4.8% | 8.8% | 67.3% | 12.7% | 2.3% | 4.2% | 0.75 |
| S3 | 0.0% | 0.0% | 2.9% | 95.4% | 1.7% | 0.0% | 0.88 |
| S4 | 0.4% | 0.2% | 0.8% | 5.8% | 92.5% | 0.2% | 0.94 |
| REM | 0.4% | 0.4% | 1.3% | 0.4% | 0.4% | 97.1% | 0.95 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of all disorders combined with unbalanced data using the EBT classifier with 10-fold CV.
| CT-9: All Disordered (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 88.9% | 1.3% | 7.5% | 0.1% | 0.1% | 2.1% | 0.84 |
| S1 | 39.7% | 21.4% | 24.2% | 0.1% | 0.1% | 14.5% | 0.31 |
| S2 | 4.6% | 0.6% | 85.4% | 3.6% | 1.0% | 4.9% | 0.78 |
| S3 | 1.1% | 0.0% | 42.5% | 42.1% | 12.9% | 1.3% | 0.50 |
| S4 | 0.1% | 0.0% | 6.0% | 10.2% | 83.4% | 0.2% | 0.84 |
| REM | 6.0% | 0.9% | 22.3% | 1.4% | 0.3% | 69.1% | 0.74 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of all disordered patients with balanced data using the EBT classifier with 10-fold CV.
| CT-9: All disordered (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 87.7% | 4.9% | 3.8% | 0.6% | 0.2% | 2.9% | 0.87 |
| S1 | 0.1% | 99.8% | 0.1% | 0.0% | 0.0% | 0.1% | 0.94 |
| S2 | 6.7% | 3.3% | 65.6% | 12.8% | 1.4% | 10.2% | 0.71 |
| S3 | 0.6% | 0.0% | 8.0% | 85.4% | 5.1% | 0.9% | 0.82 |
| S4 | 0.1% | 0.1% | 0.9% | 6.9% | 91.9% | 0.1% | 0.92 |
| REM | 5.7% | 3.5% | 10.0% | 2.9% | 0.4% | 77.5% | 0.81 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of all subjects combined (healthy + seven disordered) with unbalanced data using the EBT classifier with 10-fold CV.
| CT-10: All Subjects Combined (Unbalanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 87.8% | 1.5% | 7.9% | 0.2% | 0.1% | 2.4% | 0.83 |
| S1 | 39.2% | 21.4% | 24.2% | 0.1% | 0.1% | 15.0% | 0.31 |
| S2 | 4.7% | 0.6% | 84.4% | 3.7% | 1.1% | 5.5% | 0.78 |
| S3 | 1.2% | 0.0% | 43.4% | 41.1% | 13.1% | 1.2% | 0.49 |
| S4 | 0.2% | 0.0% | 5.9% | 9.6% | 84.0% | 0.2% | 0.84 |
| REM | 5.9% | 0.8% | 22.5% | 1.3% | 0.4% | 69.1% | 0.73 |
|
| |||||||
|
| |||||||
Confusion matrix corresponding to sleep stage classification of all patients combined with balanced data using the EBT classifier with 10-fold CV.
| CT-10: All Subjects Combined (Balanced Data) | |||||||
|---|---|---|---|---|---|---|---|
| True Class | Predicted Class | F1 Score | |||||
| Wake | S1 | S2 | S3 | S4 | R | ||
| Wake | 88.1% | 5.0% | 3.5% | 0.4% | 0.1% | 2.9% | 0.88 |
| S1 | 0.0% | 100% | 0.0% | 0.0% | 0.0% | 0.0% | 0.94 |
| S2 | 6.2% | 3.0% | 66.5% | 12.5% | 1.4% | 10.4% | 0.70 |
| S3 | 0.6% | 0.1% | 6.9% | 87.5% | 4.4% | 0.6% | 0.84 |
| S4 | 0.1% | 0.0% | 0.8% | 6.6% | 92.3% | 0.1% | 0.93 |
| REM | 5.5% | 3.2% | 10% | 2.8% | 0.5% | 78% | 0.81 |
|
| |||||||
|
| |||||||
Sleep stage-wise epochs and accuracy (before balancing) using the EBT classifier with 10-fold CV.
| Sleep Stage | All Subjects Combined | Healthy Group | Sleep-Disordered Group | |||
|---|---|---|---|---|---|---|
| Epochs | Epochs (in %) | Epoch | Epochs (in %) | Epoch | Epochs (in %) | |
|
| 15,841 | 19.64 | 445 | 7.34 | 15,396 | 20.65 |
|
| 3519 | 4.36 | 280 | 4.62 | 3239 | 4.34 |
|
| 28,628 | 35.50 | 2172 | 35.82 | 26,456 | 35.48 |
|
| 8804 | 10.92 | 573 | 9.45 | 8231 | 11.04 |
|
| 10,188 | 12.63 | 1184 | 19.53 | 9004 | 12.07 |
|
| 13,687 | 16.97 | 1409 | 23.24 | 12,278 | 16.45 |
|
| 80,667 | 100.00 | 6063 | 100.00 | 74,604 | 100.00 |
|
|
|
|
| |||
Sleep stage-wise epochs and accuracy (after balancing) using the EBT classifier with 10-fold CV.
| Sleep Stage | All Subjects Combined | Healthy Group | Disordered-Group | |||
|---|---|---|---|---|---|---|
| Epochs | Epochs (in %) | Epoch | Epochs (in %) | Epoch | Epochs (in %) | |
|
| 14,000 | 16.66 | 1000 | 16.66 | 12,500 | 16.66 |
|
| 14,000 | 16.66 | 1000 | 16.66 | 12,500 | 16.66 |
|
| 14,000 | 16.66 | 1000 | 16.66 | 12,500 | 16.66 |
|
| 14,000 | 16.66 | 1000 | 16.66 | 12,500 | 16.66 |
|
| 14,000 | 16.66 | 1000 | 16.66 | 12,500 | 16.66 |
|
| 14,000 | 16.66 | 1000 | 16.66 | 12,500 | 16.66 |
|
| 84,000 | 100 | 6000 | 100 | 75,000 | 100 |
|
|
|
|
| |||
Figure 4ROC curves obtained for the classifier whole database using the EBT with 10-fold CV.