| Literature DB >> 33286442 |
Jorge Jiménez-García1, Gonzalo C Gutiérrez-Tobal1,2, María García1,2, Leila Kheirandish-Gozal3, Adrián Martín-Montero1, Daniel Álvarez1,2,4, Félix Del Campo1,2,4, David Gozal3, Roberto Hornero1,2.
Abstract
The reference standard to diagnose pediatric Obstructive Sleep Apnea (OSA) syndrome is an overnight polysomnographic evaluation. When polysomnography is either unavailable or has limited availability, OSA screening may comprise the automatic analysis of a minimum number of signals. The primary objective of this study was to evaluate the complementarity of airflow (AF) and oximetry (SpO2) signals to automatically detect pediatric OSA. Additionally, a secondary goal was to assess the utility of a multiclass AdaBoost classifier to predict OSA severity in children. We extracted the same features from AF and SpO2 signals from 974 pediatric subjects. We also obtained the 3% Oxygen Desaturation Index (ODI) as a common clinically used variable. Then, feature selection was conducted using the Fast Correlation-Based Filter method and AdaBoost classifiers were evaluated. Models combining ODI 3% and AF features outperformed the diagnostic performance of each signal alone, reaching 0.39 Cohens's kappa in the four-class classification task. OSA vs. No OSA accuracies reached 81.28%, 82.05% and 90.26% in the apnea-hypopnea index cutoffs 1, 5 and 10 events/h, respectively. The most relevant information from SpO2 was redundant with ODI 3%, and AF was complementary to them. Thus, the joint analysis of AF and SpO2 enhanced the diagnostic performance of each signal alone using AdaBoost, thereby enabling a potential screening alternative for OSA in children.Entities:
Keywords: AdaBoost; airflow; nonlinear analysis; oximetry; sleep apnea–hypopnea syndrome; spectral analysis
Year: 2020 PMID: 33286442 PMCID: PMC7517204 DOI: 10.3390/e22060670
Source DB: PubMed Journal: Entropy (Basel) ISSN: 1099-4300 Impact factor: 2.524
Sociodemographic and clinical data of the subjects involved in the study. Subjects distributions represented as N° (%). Age, normalized body mass index (BMI z-score) and apnea–hypopnea index (AHI) represented as the median (interquartile range).
| All | Training Set | Test Set | |
|---|---|---|---|
| N° of Subjects | 974 | 584 (60%) | 390 (40%) |
| Age (years) | 6.00 [3.00, 8.00] | 6.00 [3.00, 8.00] | 5.50 [3.00, 9.00] |
| N° of Males | 599 (61.50%) | 346 (59.25%) | 253 (64.87%) |
| N° of Females | 375 (38.50%) | 238 (40.75%) | 137 (35.13%) |
| BMI | −0.22 [−0.60, 0.37] | −0.24 [−0.61, 0.43] | −0.17 [−0.58, 0.27] |
| AHI (events/hour) | 3.80 [1.53, 9.35] | 4.08 [1.71, 10.00] | 3.30 [1.40, 7.87] |
| N° of No OSA | 171 (17.56%) | 96 (16.44%) | 75 (19.23%) |
| N° of Mild OSA | 398 (40.86%) | 229 (39.21%) | 169 (43.33%) |
| N° of Moderate OSA | 176 (18.07%) | 113 (19.35%) | 63 (16.15%) |
| N° of Severe OSA | 229 (23.51%) | 146 (25.00%) | 83 (21.28%) |
Normalized body mass index (BMI z-score); apnea–hypopnea index (AHI); Obstructive Sleep Apnea (OSA).
Figure 1Workflow of the proposed methodology. Fast Correlation-Based Filter (FCBF); Obstructive Sleep Apnea (OSA).
Figure 2(a) Mean Power Spectral Densities of AF signals for each Obstructive Sleep Apnea (OSA) severity group. (b) Definition of the spectral Band of Interest (BOI).
Figure 3Absolute value of Spearman’s correlation coefficient (ρ) between Central Tendency Measure (CTM) and the apnea–hypopnea index as a function of radius (r) in the training set. (a) Airflow (AF) signal; (b) oximetry (SpO2) signal.
Spearman’s correlation coefficient of sample entropy with apnea–hypopnea index in the training set for different values of the parameters m and r.
| AF | SpO2 | |||||
|---|---|---|---|---|---|---|
| −0.0872 |
| 0.0026 | 0.5502 | 0.5516 |
| |
| −0.0753 | −0.0863 | −0.1168 | 0.5123 | 0.5118 | 0.5134 | |
| −0.0777 | −0.0802 | −0.0914 | 0.4786 | 0.4786 | 0.4784 | |
| −0.0832 | −0.0824 | −0.0886 | 0.4395 | 0.4381 | 0.4399 | |
| 0.0897 | −0.0880 | −0.0910 | 0.3895 | 0.3899 | 0.3900 | |
| 0.0983 | −0.0951 | −0.0966 | 0.3341 | 0.3350 | 0.3367 | |
Airflow (AF) signal; (b) oximetry (SpO2). Maximum absolute values represented in bold.
Spearman’s correlation coefficients (ρ) with the apnea–hypopnea index and their corresponding p-values of features in the training set and p-values of the Kruskal–Wallis test.
| Feature | AF | SpO2 | ||||
|---|---|---|---|---|---|---|
| Spearman | Kruskal–Wallis | Spearman | Kruskal–Wallis | |||
|
|
| |||||
|
| 0.1693 | <<0.01 | 0.0061 * | −0.4135 | <<0.01 | <<0.01 |
|
| −0.2481 | <<0.01 | <<0.01 | 0.5145 | <<0.01 | <<0.01 |
|
| −0.1655 | <<0.01 | 0.0024 * | −0.1879 | <<0.01 | <<0.01 |
|
| 0.3580 | <<0.01 | <<0.01 | 0.0968 | 0.0194 | 0.0103 * |
|
| 0.2070 | <<0.01 | <<0.01 | −0.3467 | <<0.01 | <<0.01 |
|
| 0.3979 | <<0.01 | <<0.01 | −0.6187 | <<0.01 | <<0.01 |
|
| −0.0660 | 0.1111 | 0.0409 * | 0.3871 | <<0.01 | <<0.01 |
|
| −0.1187 | <0.01 | 0.0270 * | 0.5586 | <<0.01 | <<0.01 |
|
| 0.3492 | <<0.01 | <<0.01 | 0.6773 | <<0.01 | <<0.01 |
|
| 0.2979 | <<0.01 | <<0.01 | 0.6352 | <<0.01 | <<0.01 |
|
| −0.1418 | <<0.01 | <<0.01 | 0.0184 | 0.6574 | 0.4893 * |
|
| −0.0967 | 0.0195 | 0.0112* | 0.0356 | 0.3899 | 0.4643 * |
|
| 0.3591 | <<0.01 | <<0.01 | 0.6753 | <<0.01 | <<0.01 |
|
| 0.3245 | <<0.01 | <<0.01 | 0.6646 | <<0.01 | <<0.01 |
|
| 0.3588 | <<0.01 | <<0.01 | 0.6504 | <<0.01 | <<0.01 |
|
| −0.1280 | <0.01 | 0.0117 * | 0.1209 | <0.01 | 0.0073 * |
|
| 0.3464 | <<0.01 | <<0.01 | 0.0060 | 0.8842 | 0.9340 * |
|
| 0.2741 | <<0.01 | <<0.01 | 0.1247 | <0.01 | 0.0234 * |
|
| 0.1304 | <0.01 | 0.0024 * | 0.1075 | <0.01 | 0.0742 * |
| ODI 3% | — | — | — | 0.6918 | <<0.01 | <<0.01 |
*: Not lower than the Bonferroni corrected p-value (p = 0.01/6). Airflow (AF) signal; (b) oximetry (SpO2).
Figure 4Results of the feature selection in the training set using Fast Correlation-Based Filter (FCBF). (a) sets without ODI 3%; (b) sets with ODI 3%.
Figure 5Performance in the training set of AdaBoost models as a function of the number of base classifiers (L) and the learning rate (ν), with their optimum values highlighted. (a) AF subset; (b) SpO2 subset; (c) AF + SpO2 subset; (d) AF + ODI subset; (e) SpO2 + ODI subset; (f) AF + SpO2 + ODI subset.
Confusion matrices of the predictions of AdaBoost models in the test set using the subsets AF, SpO2 and AF + SpO2.
| AdaBoost (Without ODI 3%) | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Severity Levels | Estimated: AF | Estimated: SpO2 | Estimated: AF + SpO2 | ||||||||||
| No | Mild | Mod. | Sev. | No | Mild | Mod. | Sev. | No | Mild. | Mod. | Sev. | ||
| Actual | No | 1 | 55 | 16 | 3 | 17 | 50 | 8 | 0 | 19 | 47 | 8 | 1 |
| Mild | 1 | 97 | 53 | 18 | 19 | 119 | 30 | 1 | 21 | 111 | 35 | 2 | |
| Mod. | 1 | 29 | 22 | 11 | 5 | 29 | 24 | 5 | 6 | 24 | 27 | 6 | |
| Sev. | 0 | 25 | 25 | 33 | 3 | 12 | 34 | 34 | 2 | 8 | 36 | 37 | |
Confusion matrices of the predictions of AdaBoost models in the test set using the subsets AF + ODI, SpO2 + ODI and AF + SpO2 + ODI.
| AdaBoost (With ODI 3%) | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Severity Levels | Estimated: AF + ODI | Estimated: SpO2 + ODI | Estimated: AF + SpO2 + ODI | ||||||||||
| No | Mild | Mod. | Sev. | No | Mild | Mod. | Sev. | No | Mild | Mod. | Sev. | ||
| Actual | No | 27 | 44 | 3 | 1 | 26 | 45 | 3 | 1 | 28 | 43 | 3 | 1 |
| Mild | 23 | 115 | 30 | 1 | 23 | 113 | 32 | 1 | 25 | 113 | 30 | 1 | |
| Mod. | 2 | 24 | 32 | 5 | 7 | 18 | 32 | 6 | 7 | 18 | 33 | 5 | |
| Sev. | 0 | 9 | 22 | 52 | 1 | 8 | 22 | 52 | 2 | 8 | 21 | 52 | |
Confusion matrix of the predictions of ODI 3% in the test set.
| ODI 3% | |||||
|---|---|---|---|---|---|
| Severity Levels | Estimated | ||||
| No | Mild | Mod. | Sev. | ||
| Actual | No | 65 | 7 | 1 | 2 |
| Mild | 110 | 35 | 11 | 13 | |
| Mod. | 18 | 14 | 8 | 23 | |
| Sev. | 6 | 6 | 3 | 68 | |
Diagnostic performances of AdaBoost models and ODI 3% in the test set in the apnea–hypopnea index cutoffs 1, 5 and 10 events/hour (e/h).
| Cutoff | Subset | Se | Sp | Acc | PPV | NPV | LR+ | LR- |
|---|---|---|---|---|---|---|---|---|
| 1 e/h | AF | 99.37% | 1.33% | 80.51% | 80.88% | 33.33% | 1.0071 | 0.4762 |
| SpO2 | 91.43% | 22.67% | 78.21% | 83.24% | 38.64% | 1.1823 | 0.3782 | |
| AF + SpO2 | 90.79% | 25.33% | 78.21% | 83.63% | 39.58% | 1.2160 | 0.3634 | |
| AF + ODI | 92.06% | 36.00% | 81.28% | 85.80% | 51.92% | 1.4385 | 0.2205 | |
| SpO2 + ODI | 90.16% | 34.67% | 79.49% | 85.29% | 45.61% | 1.3800 | 0.2839 | |
| AF + SpO2 + ODI | 89.21% | 37.33% | 79.23% | 85.67% | 45.16% | 1.4235 | 0.2891 | |
| ODI 3% | 57.46% | 86.67% | 63.08% | 94.76% | 32.66% | 4.3095 | 0.4908 | |
| 5 e/h | AF | 62.33% | 63.11% | 62.82% | 50.28% | 73.68% | 1.6898 | 0.5969 |
| SpO2 | 66.44% | 84.02% | 77.44% | 71.32% | 80.71% | 4.1567 | 0.3995 | |
| AF + SpO2 | 72.60% | 81.15% | 77.95% | 69.74% | 83.19% | 3.8511 | 0.3376 | |
| AF + ODI | 76.03% | 85.66% | 82.05% | 76.03% | 85.66% | 5.3002 | 0.2799 | |
| SpO2 + ODI | 76.71% | 84.84% | 81.79% | 75.17% | 85.89% | 5.0589 | 0.2745 | |
| AF + SpO2 + ODI | 76.03% | 85.66% | 82.05% | 76.03% | 85.66% | 5.3002 | 0.2799 | |
| ODI 3% | 69.86% | 88.93% | 81.79% | 79.07% | 83.14% | 6.3135 | 0.3389 | |
| 10 e/h | AF | 39.76% | 89.58% | 78.97% | 50.77% | 84.62% | 3.8144 | 0.6725 |
| SpO2 | 40.96% | 98.05% | 85.90% | 85.00% | 86.00% | 20.9598 | 0.6021 | |
| AF + SpO2 | 44.58% | 97.07% | 85.90% | 80.43% | 86.63% | 15.2062 | 0.5710 | |
| AF + ODI | 62.65% | 97.72% | 90.26% | 88.14% | 90.63% | 27.4768 | 0.3822 | |
| SpO2 + ODI | 62.65% | 97.39% | 90.00% | 86.67% | 90.61% | 24.0422 | 0.3835 | |
| AF + SpO2 + ODI | 62.65% | 97.72% | 90.26% | 88.14% | 90.63% | 27.4768 | 0.3822 | |
| ODI 3% | 81.93% | 87.62% | 86.41% | 64.15% | 94.72% | 6.6189 | 0.2063 |
Diagnostic performances of state-of-the-art approaches in the context of childhood Obstructive Sleep Apnea syndrome.
| Study | N | Signal | Methods (Extraction/Selection/Classification) | Validation | Cutoff | Se | Sp | Acc |
|---|---|---|---|---|---|---|---|---|
| Chang et al. (2013) [ | 141 | SpO2 | ODI, questionnaires/-/LR | -- | 5 | 60.0 | 86.0 | 76.6 |
| Wu et al. (2017) [ | 311 | — | Clinical parameters/-/Stepwise LR | Holdout | 5 | 94.8 | 25.0 | 78.2 |
| Gil et al. (2010) [ | 21 | PPG | DAP events, HRV, PTTV/Wrapper/LDA | -- | 5 | 75.0 | 85.7 | 80.0 |
| Lázaro et al. (2014) [ | 21 | PPG | DAP events, spectral analysis of PRV/Wrapper/LDA | -- | 5 | 100 | 71.4 | 86.6 |
| Garde et al. (2014) [ | 146 | SpO2, PRV | Time, frequency, nonlinear/-/LDA | Four-fold | 5 | 88.4 | 83.6 | 84.9 |
| Garde et al. (2019) [ | 207 | SpO2, PRV | Time, frequency, ODI (SpO2); standard spectral bands (PRV)/-/LR (3 binary models) | Holdout | 1 | 68.0 | 86.0 | 71.0 |
| 5 | 58.0 | 89.0 | 78.0 | |||||
| 10 | 90.0 | 87.0 | 88.0 | |||||
| Álvarez et al. (2018) [ | 142 | SpO2 | Time domain, ODI, symbolic dynamics/FSLR/LR | Bootstrap | 5 | 73.5 | 89.5 | 83.3 |
| Barroso-Garcia et al. (2017) [ | 501 | AF | CTM and SpecEn/FSLR/LR (3 binary models) | Holdout | 1 | 60.5 | 58.6 | 60.0 |
| 5 | 65.0 | 80.6 | 76.0 | |||||
| 10 | 83.3 | 79.0 | 80.0 | |||||
| Crespo et al. (2018) [ | 176 | SpO2 | Time, frequency, nonlinear, ODI/FCBF/LDA, QDA, LR (3 binary models) | Bootstrap | 1 | 93.9 | 37.8 | 84.3 |
| 5 | 70.0 | 91.4 | 82.7 | |||||
| Hornero et al. (2017) [ | 4191 | SpO2 | Time, frequency, nonlinear, ODI/FCBF/MLP regression | Holdout | 1 | 84.0 | 53.2 | 75.2 |
| 5 | 68.2 | 87.2 | 81.7 | |||||
| 10 | 68.7 | 94.1 | 90.2 | |||||
| Xu et al. (2019) [ | 432 | SpO2 | ODI, M3F/-/MLP regression | Direct validation | 1 | 95.3 | 19.1 | 79.6 |
| 5 | 77.8 | 80.5 | 79.4 | |||||
| 10 | 73.5 | 92.7 | 88.2 | |||||
| Vaquerizo-Villar et al. (2018) [ | 981 | SpO2 | DFA, ODI/FCBF/MLP regression | Holdout | 1 | 97.1 | 23.3 | 82.7 |
| 5 | 78.8 | 83.7 | 81.9 | |||||
| 10 | 77.1 | 94.8 | 91.1 | |||||
| Barroso-García et al. (2020) [ | 946 | AF, ODI | Recurrence plots, ODI/FCBF/Bayesian MLP regression | Holdout | 1 | 97.7 | 22.2 | 83.2 |
| 5 | 78.7 | 78.3 | 78.5 | |||||
| 10 | 78.8 | 94.3 | 91.0 | |||||
| This Study | 974 | AF, SpO2 | Time, Frequency, Nonlinear, ODI/FCBF/Multiclass AdaBoost | Holdout | 1 | 92.1 | 36.0 | 81.3 |
| 5 | 76.0 | 85.7 | 82.1 | |||||
| 10 | 62.7 | 97.7 | 90.3 |
Airflow signal (AF); Central Tendency Measure (CTM); Decreases in Amplitude of Plethysmography (DAP); Detrended Fluctuation Analysis (DFA); Fast Correlation-Based Filter (FCBF); Forward Stepwise Logistic Regression (FSLR); Heart Rate Variability (HRV); Linear Discriminant Analysis (LDA); Logistic Regression (LR); third order moment in frequency domain (M3F); Multilayer Perceptron (MLP); number of subjects (N); Oxygen Desaturation Index (ODI); Photoplethysmography (PPG); Pulse Rate Variability (PRV); Pulse Transit Time Variability (PTTV); Quadratic Discriminant Analysis (QDA); Spectral Entropy (SpecEn); oxygen saturation signal (SpO2).