Deep Learning for Diagnosis and Classification of Obstructive Sleep Apnea: A Nasal Airflow-Based Multi-Resolution Residual Network.

PURPOSE: This study evaluated a novel approach for diagnosis and classification of obstructive sleep apnea (OSA), called Obstructive Sleep Apnea Smart System (OSASS), using residual networks and single-channel nasal pressure airflow signals.
METHODS: Data were collected from the sleep center of the First Affiliated Hospital, Sun Yat-sen University, and the Integrative Department of Guangdong Province Traditional Chinese Medical Hospital. We developed a new model called the multi-resolution residual network (Mr-ResNet) based on a residual network to detect nasal pressure airflow signals recorded by polysomnography (PSG) automatically. The performance of the model was assessed by its sensitivity, specificity, accuracy, and F1-score. We built OSASS based on Mr-ResNet to estimate the apnea‒hypopnea index (AHI) and to classify the severity of OSA, and compared the agreement between OSASS output and the registered polysomnographic technologist (RPSGT) score, assessed by two technologists.
RESULTS: In the primary test set, the sensitivity, specificity, accuracy, and F1-score of Mr-ResNet were 90.8%, 90.5%, 91.2%, and 90.5%, respectively. In the independent test set, the Spearman correlation for AHI between OSASS and the RPSGT score determined by two technologists was 0.94 (p < 0.001) and 0.96 (p < 0.001), respectively. Cohen's Kappa scores for classification between OSASS and the two technologists' scores were 0.81 and 0.84, respectively.
CONCLUSION: Our results indicated that OSASS can automatically diagnose and classify OSA using signals from a single-channel nasal pressure airflow, which is consistent with polysomnographic technologists' findings. Thus, OSASS holds promise for clinical application.

Introduction

Undiagnosed and untreated obstructive sleep apnea (OSA) is a major health burden worldwide,1,2 and is associated with several severe health consequences, such as cardiac arrhythmia, heart attacks, stroke, and even sudden death,3,4 and can increase the risk of traffic accidents.5 Polysomnography (PSG) is regarded as the gold standard for the accurate diagnosis of OSA, and is performed at a specialized sleep center or laboratory.6 Multiple physiological signals pertaining to electroencephalogram (EEG), electrooculograms (EOG), electromyogram (EMG), electrocardiogram (ECG), respiration, and pulse oxygen saturation (SpO2) are recorded during overnight PSG.7 The output requires manual scoring by sleep specialists, which is time-consuming, labor-intensive, and error-prone, making it a complex and expensive process, which markedly affects the availability and accessibility of OSA diagnostic resources.

Although unattended abbreviated testing for routine screening of OSA at home, based on a reduced number of physiological signals, has been encouraged during the last few years,8 the accuracy of most analysis software has been shown to be relatively poor, underestimating the condition.9,10 Therefore, there is a need for an intelligent OSA diagnostic system that uses fewer signals, analyzes more patients more rapidly, and eliminates the high intra- and inter-scorer variability.11

Deep learning (DL)12 has achieved some success in the field of automated OSA diagnosis using single-channel signals. A convolutional neural network (CNN) is a popular structure in DL.12 Urtnasan et al13 showed the performance of a six-layer CNN model for OSA detection from a single-lead ECG signal, with a sensitivity, specificity, and accuracy of 96% each. Jiang et al14 proposed a multi-scale parallel CNN for automatic sleep apnea detection using single-channel EEG signals, with an accuracy of 89.1%. Haidar et al15 compared two classification methods based on nasal airflow signals and proved that CNN (with an accuracy of 74.7%) was superior to a support vector machine (SVM), a traditional machine-learning algorithm (which had an accuracy of 72.0%). Van Steenkiste et al16 identified sleep apnea from chest and abdominal breathing data using a long short-term memory network (LSTM),17,18 another deep learning algorithm called a recurrent neural network (RNN),12,18 with an average accuracy of 77.2% and 75.0%, respectively. However, most methods only classify apnea, ignoring hypopnea,19 which is also important for individualized diagnosis20,21 and treatment.22,23

Using airflow signals to estimate the apnea‒hypopnea index (AHI) is a suitable method, as it is completely in accordance with the rules of manual scoring, but models based on one-channel respiratory signals exhibit inferior performance. The residual network (ResNet) approach24 is an outstanding means of implementing a CNN and can accelerate the training of ultra-deep neural networks, yielding improved accuracy. To the best of our knowledge, there have been no reports using ResNet and airflow signals to detect OSA. In this study, we propose a DL architecture called multi-resolution ResNet (Mr-ResNet) based on ResNet, that uses only raw nasal pressure airflow signals to learn and extract relevant features automatically, and achieves high sensitivity (90.8%) and specificity (90.5%), with an accuracy of 91.2%. The architecture of Mr-ResNet was presented at 2020 International Conference on Neural Computing for Advanced Applications (Shenzhen, China).25 Based on Mr-ResNet, we built an OSA Smart System (OSASS) to estimate AHI and classify OSA severity in a manner that was consistent with scoring by polysomnographic technologists in a real clinical setting. These results demonstrate that the novel concept has good prospects for clinical application, which can be widely used for large-scale OSA screening, rapid diagnosis, and remote diagnosis systems.

Methods

Subjects and Database

The Clinical Research Ethics Committee of the First Affiliated Hospital, Sun Yat-sen University approved the research protocol (approval No. 2,019,119). Given the retrospective nature of the study and considering that we ensured participant privacy by confirming that the study was conducted in compliance with the Declaration of Helsinki, the Institutional Review Board approved our application for an exemption regarding the requirement to obtain written informed consent from the patients.

In this study, two datasets were used to develop and verify the model, including one database of adult patients with suspected OSA collected from the sleep center of the First Affiliated Hospital, Sun Yat-sen University (FAH database), and another one collected from the Integrative Department of Guangdong Province Traditional Chinese Medical Hospital (CMH database). The FAH database contains 405 PSG records, which were collected using an Embla device (Embla N7000, San Diego, CA, USA), which recorded seven EEGs, right and left EOGs, one chin muscle EMG, ECG, SpO2, nasal pressure airflow, thoracic and abdominal respiratory movements, body position, snoring sound, and video monitoring, between January 2018 and December 2019. The CMH database information was collected from 45 patients using the same device. All records were manually analyzed by RemLogic 3.4.1 software (Embla) using the 2012 American Academy of Sleep Medicine (AASM) scoring rules.19 According to these rules, an obstructive apnea event was defined as a ≥ 90% drop in respiratory flow for at least 10 s, associated with breathing effort. A hypopnea event was defined as a ≥ 30% drop in respiratory flow for at least 10 s, associated with ≥ 3% oxygen desaturation or arousal; and the AHI was defined as the number of apneas and hypopneas per hour of total sleep time (TST).

Subjects who met the following criteria were excluded: patients (1) aged < 18 years; (2) with TST < 240 min; (3) with central sleep apnea events > 50%; (4) with other coexisting sleep disorders; and (5) with pulmonary dysfunction (Figure 1). The subjects from the FAH database were divided into two groups to make up the training and primary test sets, by first sorting all patients based on their AHI and randomly selecting about 10% of every severity category for the primary test set. The CMH test set included a similar proportion of subjects for the primary test set. The demographic and polysomnographic characteristics of all subjects in the whole FAH dataset, training set, primary test set, and the CMH test set are presented in Table 1.

Figure 1

Workflow diagram for the development and evaluation of OSASS.

Table 1

Demographic and Polysomnographic Characteristics of Subjects

	FAH Dataset	Training Set	Primary Test Set	CMH Test Set
Subjects, n (%)	405 (100)	360 (88.9)	45 (11.1)	45 (100)
Male, n (%)	355 (87.7)	315 (87.5)	40 (88.9)	40 (88.9)
Age, years	40.0 (31.0‒48.0)	40.0 (31.0‒48.0)	38.0 (30.0‒46.0)	39.0 (32.0‒48.0)
BMI, kg/m2	25.6 (23.4‒28.0)	25.6 (23.5‒28.0)	25.7 (22.1‒27.7)	24.7 (22.2‒27.3)
PSG Parameters
TST, min	467.3 (404.5‒524.7)	464.2 (404.1‒524.0)	481.3 (423.0‒550.1)	467.0 (411.5‒509.7)
AHI, No./h	22.9 (7.9‒49.0)	23.0 (8.1‒49.2)	20.4 (7.0‒48.6)	20.8 (10.1‒39.6)
AI, No./h	9.3 (1.9‒34.6)	9.4 (1.9‒35.1)	8.5 (1.3‒33.7)	8.6 (3.0‒27.7)
HI, No./h	8.0 (4.3‒14.0)	8.2 (4.4‒13.9)	6.9 (4.2‒14.1)	6.4 (2.6‒13.6)
OSA Severity
No OSA, n (%)	47 (11.6)	41 (11.4)	6 (13.3)	6 (13.3)
Mild, n (%)	106 (26.2)	95 (26.4)	11 (24.5)	11 (24.5)
Moderate, n (%)	85 (21.0)	76 (21.1)	9 (20.0)	9 (20.0)
Severe, n (%)	167 (41.2)	148 (41.1)	19 (42.2)	19 (42.2)

Note: Data are presented as n (%) or median (interquartile range).

Abbreviations: FAH, First Affiliated Hospital; CMH, Chinese Medical Hospital; BMI, body mass index; PSG, polysomnography; TST, total sleep time; AHI, apnea‒hypopnea index; AI, apnea index; HI, hypopnea index; OSA, obstructive sleep apnea.

Preprocessing and Datasets

The database contained time-series and one-channel nasal pressure airflow signals obtained with a sampling frequency of 200 Hz. To take full advantage of classic neural networks, we needed to convert the original time series data into spectrograms. Therefore, the preprocessing procedures for the raw signal included signal segmentation, short-time Fourier transform (STFT),26 and grayscale transform. The 6-h original airflow data of each subject was split into 30-s non-overlapping segments, and each segment had a corresponding label. We labeled a segment A or H if an apnea or hypopnea waveform lasted longer than 10 seconds, respectively, while other segments were labeled N. Following this rule, the numbers of A, H, and N events were obtained; the statistics of the event distribution are shown in Figure 1. Then, 30-s segments were converted into corresponding spectrograms by STFT to generate our datasets (Figure 2). The size of the sliding windows was 64 and the overlap of the windows was 32 for the STFT calculation in each 30-s non-overlapping segment.

Figure 2

Typical example of the input airflow signal and corresponding spectrograms.

Deep Learning Algorithm

In this study, we proposed an intelligent system called OSASS for OSA diagnosis and classification. The core of OSASS is Mr-ResNet, a DL architecture based on ResNet. A schematic representation of the proposed approach is shown in Figure 3. First, Mr-ResNet was used to determine normal breathing, apnea, and hypopnea events from spectrograms. Next, post-processing was used to calculate the AHI. Finally, the estimated AHI values were used to classify subjects into the standard OSA severity categories: no OSA (AHI < 5), mild (5 ≤ AHI < 15), moderate (15 ≤ AHI < 30), and severe OSA (30 ≤ AHI).

Figure 3

Block diagram of OSASS for OSA diagnosis and classification.

We implemented the proposed Mr-ResNet using PyTorch, and trained it using the stochastic gradient descent algorithm with a learning rate of 0.0001, batch size of 64, and iterations of 20. All the training and validating work was performed on a CentOS 7 server with 2 Tesla K80 graphics cards each of whose running memory has 11,439 MiB.

Statistical Analysis

All statistical analyses were performed using IBM SPSS version 25.0 (SPSS, Chicago, IL, USA) and R version 4.0.2 (R Foundation for Statistical Computing, Vienna, Austria). The performance of the Mr-ResNet model was quantified by several accepted measurements, including sensitivity, specificity, accuracy, and F1-score. PSG records of the CMH database were manually reanalyzed in accordance with the same standard of the 2012 AASM by two registered polysomnographic technologists (RPSGT). Spearman correlation coefficient and Bland‒Altman plots were evaluated to measure the agreement of OSASS and both manual RPSGT scores. A p-value < 0.05 was considered statistically significant. Finally, to assess the OSA severity classification accuracy, confusion matrices and Cohen’s Kappa were calculated. The Kappa scores were interpreted as follows: values ≤ 0, indicated no agreement, values of 0.01‒0.20 indicated none to slight agreement, 0.21‒0.40 indicated fair agreement, 0.41‒0.60 indicated moderate agreement, 0.61‒0.80 indicated substantial agreement, and 0.81‒1.00 indicated almost perfect agreement.27

Results

Performance of Mr-ResNet

Table 2 shows the performance of the proposed Mr-ResNet model for the automated detection of OSA from a single-channel airflow signal in the primary test set. The overall sensitivity, specificity, accuracy, and F1-score were 90.8%, 90.5%, 91.2%, and 90.5%, respectively. While these values slightly decreased with increasing AHI, the performance did not significantly change among the different severity groups.

Table 2

Performance of Mr-ResNet for OSA Detection in the Primary Test Set

Primary Test Set	N	Sen (%)	Spe (%)	Acc (%)	F1-Score (%)
A/H/N	32,398	90.8	90.5	91.2	90.5
Events
Normal breathing	23,539	91.1	90.8	92.3	90.6
Apnea	5914	92.2	91.3	93.0	90.0
Hypopnea	2945	89.6	89.4	90.5	90.9
Severity
AHI < 5	6	91.0	90.8	91.4	90.7
5 ≤ AHI < 15	11	90.9	90.6	91.3	90.6
15 ≤ AHI < 30	9	90.5	90.2	91.0	90.3
AHI ≥ 30	19	90.1	90.0	90.8	90.0

Abbreviations: OSA, obstructive sleep apnea; Sen, sensitivity; Spe, specificity; Acc, accuracy; A, apnea; H, hypopnea; N, normal breathing; AHI, apnea‒hypopnea index.

Additionally, we compared the performance of the proposed method with previous studies using single-channel signals. As shown in Table 3, three conclusions can be drawn: the CNN model based on ECG signals performed better than other single-channel signal methods; the DL algorithm performed better than the machine-learning algorithm; the model for only apnea detection performed better than one using apnea and hypopnea detection. Choi et al28 proposed estimating apnea‒hypopnea (AH) events using CNN from airflow signals, and achieved a satisfactory specificity (98.5%) and accuracy (96.6%) in detection, but not high sensitivity (81.1%). It is thus apparent that the foremost advantage of the Mr-ResNet model is that it can distinguish apnea and hypopnea events with high sensitivity (90.8%), while maintaining high specificity (90.5%) and accuracy (91.2%), which implies that our results provide more important guidance for diagnosing OSA, which is a complex and heterogeneous disorder.29

Table 3

Comparison with Previous Studies

Study	Signal	Dataset	Subjects	Model	Event	Sen (%)	Spe (%)	Acc (%)
Dey et al30	ECG	Apnea-ECG dataset	35	CNN	A/N	98.9	97.8	99.2
Jiang et al14	EEG	MIT-BIH database	16	CNN	A/N	93.1	82.9	89.1
Vaquerizo‒Villar et al31	SpO2	CHAT-baseline dataset	453	CNN	AH/N	95.4	96.7	93.6
Álvarez et al32	SpO2	Own database	239	SVM	AH/N	97.8	16.7	92.7
	AF		239	SVM	AH/N	97.8	66.7	95.8
Gutiérrez‒Tobal et al33	AF	Own database	317	AB-CART	AH/N	89.0	80.0	86.5
Haidar et al15	AF	MESA dataset	100	CNN	A/N	74.7	–	74.7
Choi et al28	AF	Own database + MESA dataset	179	CNN	AH/N	81.1	98.5	96.6
This study	AF	Own database	450	Mr-ResNet	A/H/N	90.8	90.5	91.2

Abbreviations: Sen, sensitivity; Spe, specificity; Acc, accuracy; ECG, electrocardiogram; EEG, electroencephalogram; SpO2, pulse oxygen saturation; AF, airflow; MIT-BIH, Massachusetts Institute of Technology-Beth Israel Hospital; CHAT, Childhood Adenotonsillectomy Trial; MESA, Multi-Ethnic Study of Atherosclerosis; CNN, convolutional neural network; SVM, support vector machine; AB‒CART, AdaBoost‒classification and regression trees; Mr-ResNet, multi-resolution residual network; A, apnea; N, normal breathing; H, hypopnea; AH, apnea‒hypopnea.

Estimation of AHI

The proposed OSASS performed well in the independent test set. The sleep respiratory events for all patients in the CMH test set were calculated by OSASS, and strong significant correlations were observed between OSASS and RPSGT scores. Spearman correlation coefficients for AI, HI, and AHI between OSASS and the scores of technologist 1 were 0.96, 0.71, and 0.94, respectively. Spearman correlation coefficients for AI, HI, and AHI between OSASS and scores of technologist 2 were 0.97, 0.59, and 0.96, respectively. The correlation and Bland‒Altman plots are shown in Figures 4 and 5. In the Bland–Altman plot, the x-axis depicts the mean values of AI, HI, and AHI measured with the OSASS and RPSGT and the y-axis depicts the difference between the estimated and reference values. The black dashed lines denote the bias and 95% upper and lower limits of agreement.

Figure 4

Correlation and Bland–Altman plots of AI, HI, and AHI between OSASS and technologist 1.

Figure 5

Correlation and Bland–Altman plots of AI, HI, and AHI between OSASS and technologist 2.

Classification of OSA

The estimated AHI values were used to classify the subjects from the CMH test set into the standard OSA severity categories (no, mild, moderate, and severe OSA). Table 4 shows the confusion matrices for OSA severity classification for each technologist’s scores vs OSASS. The Kappa scores between OSASS and the individual technologist’s scores were both above 0.8 (Table 5), which indicates almost perfect agreement (0.8 < Kappa < 1).

Table 4

Confusion Matrices for OSA Classification in CMH Test Set

		OSASS
		No OSA	Mild	Moderate	Severe
Technologist 1	No OSA	6	0	0	0
	Mild	1	9	0	0
	Moderate	0	2	7	2
	Severe	0	0	1	17
Technologist 2	No OSA	6	1	0	0
	Mild	1	9	0	0
	Moderate	0	1	7	1
	Severe	0	0	1	18

Note: Bold values represent the number of subjects classified into the same severity categories by OSASS and technologists.

Abbreviations: OSA, obstructive sleep apnea; OSASS, Obstructive Sleep Apnea Smart System.

Table 5

Kappa Values for OSA Classification Among OSASS and Individual Technologists

	OSASS	Technologist 1	Technologist 2
OSASS	1
Technologist 1	0.81	1
Technologist 2	0.84	0.91	1

Abbreviation: OSASS, Obstructive Sleep Apnea Smart System.

Discussion

In this study, we developed an intelligent OSA diagnosis and classification system for respiratory event detection using a DL algorithm based on nasal pressure airflow signals. The main findings of our work are as follows: (1) We improved a neural network from ResNet to capture multi-resolution imaging features of airflow signals without any handcrafted engineering to generate high-accuracy AH estimates, which has not been presented previously. (2) In comparison with other research, the proposed model offers competitive performance with only one-channel airflow signals, which can detect both apnea and hypopnea events overnight with a sensitivity of 90.8%, a specificity of 90.5%, an accuracy of 91.2%, and F1-score of 90.5%. (3) Our proposed method corresponds well with RPSGT scores for OSA diagnosis and classification, in which performance was validated using an independent hospital database.

Owing to the non-stationary and nonlinear characteristics of sleep data, traditional machine-learning methods require researchers to expend much energy on feature extraction, while neural networks can solve such problems well. Therefore, neural network technology is increasingly applied to automated OSA detection. As a popular structure in DL, the accuracy of a CNN increases with increasing network depth. However, when the network depth increases to a certain level, the accuracy decreases rapidly, as the deeper network becomes more difficult to optimize. ResNet solves this problem with a simple structure, and its short connection structure breaks the traditional layer-by-layer transmission of neural networks, which can accelerate the training of ultra-deep neural networks, yielding improved accuracy.34 In this study, we proposed the DL architecture called MR-ResNet, based on ResNet, in which the 3 × 3 filters were replaced by a new block containing multi-level group convolution. The structure we used makes full use of group convolution and residual-like connections at both levels, to maximize feature extraction capabilities and reduce the number of network parameters, which greatly improves the training speed of our network.

To simplify the diagnostic technique, various alternative methods have been proposed to replace PSG and minimize the number of sensors required in recent decades, such as ECG,13,30,35 EEG,14,36 SpO2,31,37 respiratory,16,38 and snoring signals.39,40 However, the most appropriate physiological signals for the development of simple and accurate screening tests for OSA remain unknown. Overall, single-channel systems have been reported, and the results were similar to those obtained with algorithms using multiple data channels. These approaches place fewer limitations on patient movement and can be more convenient for use in the ambulatory environment than systems employing multiple channels.

Previous single-channel studies for the automated detection of OSA were mostly based on ECG.41,42 Dey et al30 reported that their framework employing a CNN can achieve a very high degree of sensitivity, specificity, and accuracy using single-lead ECG signals, ie, 98.9%, 97.8%, and 99.2%, respectively. However, they did not classify hypopnea events. Yet, this information is important, because hypopnea is the main respiratory event in some OSA patients, which has significance for guiding individualized treatment.19,22,23 According to the AASM criteria of sleep apnea and hypopnea, many studies also use airflow and SpO2 signals to detect respiratory events. In the study of Álvarez et al,32 airflow signals were analyzed based on the machine-learning algorithm, OSA detection with a sensitivity of more than 90%, but a specificity of less than 70%. Choi et al28 proposed estimating AH events using CNN from airflow signals and achieved a satisfactory specificity (98.5%) and accuracy (96.6%) in detection, but the sensitivity was only 81.1%. Vaquerizo-Villar et al31 proposed using CNN to detect AH events from SpO2 raw data. The experiment achieved a classification sensitivity, specificity, and accuracy of 95.4%, 96.7%, and 93.6%, respectively, but only in pediatric patients. The above results show that the performance of the model based on a single-channel airflow signal can still be improved. This was due to the non-standard airflow waveforms, especially the hypopnea waveform, which challenged the learning algorithms. In this study, to solve this problem, we converted the original time series data into spectrograms by STFT and make full use of the advantage of Mr-ResNet to maximize feature extraction capabilities. Based on this approach, we were able to achieve high sensitivity (90.8%) and specificity (90.5%), with an accuracy of 91.2%.

Airflow signals have been used to estimate AHI and determine OSA severity categories.15,28,33 However, these studies were applied to a limited number of segments and performance was not assessed on over-night data or on an OSA population. One novelty of this study is that the performance of OSASS in OSA diagnosis and classification was compared with the scores of two sleep specialists using an independent hospital database. Although the OSASS performed slightly worse in hypopnea index (HI) estimation (Spearman correlation coefficient for HI between OSASS and technologist 1, and technologist 2, was 0.71 and 0.59, respectively), the results are still impressive considering that the dataset was completely new and scored by different people. With our study design, the Bland–Altman plot, as a measure of agreement, was appropriate to perform within-subject comparisons for the two methods.43 The Kappa agreement between OSASS and technologist 1 and technologist 2 was 0.81 and 0.84, respectively, which suggests that OSASS is capable of reasonably estimating OSA severity. These results show that OSASS generalizes reasonably well.

There were some limitations to this study. First, OSASS is likely to underestimate the severity of hypopnea when compared to a full PSG scoring, due to a lack of SpO2 and EEG data; this is particularly true for OSA patients in whom hypopnea events are dominant. Second, OSASS only classifies obstructive apnea, hypopnea, and normal breathing, but not central and mixed sleep apnea, as this would require information about the breathing effort, which is not present in the airflow signal. Although central and mixed sleep apneas occur very rarely, it affects the results partly. Third, OSASS is not able to auto-extract TST. Yet, accurate estimation of sleeping time can increase the accuracy of the estimated AHI, particularly in individuals with low sleep efficiency.44 Finally, a small population was investigated in this study, additional evidence on the effectiveness of OSASS for OSA screening in the presence of comorbidities, particularly cardiovascular and pulmonary diseases, is required. Thus, further studies should be conducted to address these limitations to increase the clinical usefulness of the present model.

Conclusion

This paper proposed the Mr-ResNet framework for AHI estimation using only one-channel nasal pressure airflow signals, and validated the model against two datasets. Our findings imply that this new diagnosis and classification system of OSA demonstrated good feasibility for clinical application as well as scalability.