Mirna Ayache1,2, Kingman P Strohl1,2. 1. Division of Pulmonary, Critical Care and Sleep Medicine, University Hospitals Cleveland Medical Center, Cleveland, Ohio. 2. Division of Pulmonary, Critical Care and Sleep Medicine, Louis Stokes Cleveland VA Medical Center, Cleveland, Ohio.
Abstract
STUDY OBJECTIVES: To assess the interrater reliability and accuracy of overnight pulse oximetry (OPO) interpretations by pulmonary fellows using a comprehensive structured template and after a brief educational session. METHODS: Using the template, four pulmonary and critical care (PCC) fellows interpreted OPO saturation waveforms and parameters extracted from 50 adult consecutive in-laboratory sleep studies. The template included three saturation parameters (mean saturation, oxygen desaturation index [ODI], and cumulative desaturation time) and description of the saturation waveform. A scoring system was proposed combining waveform characteristics and ODI to determine the suspicion for moderate to severe sleep apnea. Waveform description and mean saturation determined the suspicion for cardiopulmonary disease (CPD). Cumulative desaturation time determined need for oxygen prescription. Apnea-hypopnea index was extracted from the sleep study results. RESULTS: The overall interrater reliability for final recommendations (sleep apnea suspicion, presence of CPD, and oxygen prescription) was high (kappa = .81, 95% confidence interval [CI] .76-.88). Good agreement was noted in CPD evaluation and suspicion of moderate to severe sleep apnea (kappa = .70, 95% CI .46-.86 and kappa = .65, 95% CI .56-.77 respectively). The interrater reliability for oxygen prescription was in an excellent range (kappa = .98, 95% CI .91-1.00). The accuracy of a high sleep apnea suspicion score in detecting apnea-hypopnea index ≥ 15 events/h ranged from 88.0% to 94.0% (sensitivity 91.3% to 95.7%, specificity 81.5% to 92.6%). Desaturations due to CPD were identified by 75% of the raters as desaturations due to conditions other than sleep apnea. CONCLUSIONS: A structured template for OPO interpretation can produce a high interrater agreement and good accuracy, and make it a reliable clinical tool. COMMENTARY: A commentary on this article appears in this issue on page 497.
STUDY OBJECTIVES: To assess the interrater reliability and accuracy of overnight pulse oximetry (OPO) interpretations by pulmonary fellows using a comprehensive structured template and after a brief educational session. METHODS: Using the template, four pulmonary and critical care (PCC) fellows interpreted OPO saturation waveforms and parameters extracted from 50 adult consecutive in-laboratory sleep studies. The template included three saturation parameters (mean saturation, oxygen desaturation index [ODI], and cumulative desaturation time) and description of the saturation waveform. A scoring system was proposed combining waveform characteristics and ODI to determine the suspicion for moderate to severe sleep apnea. Waveform description and mean saturation determined the suspicion for cardiopulmonary disease (CPD). Cumulative desaturation time determined need for oxygen prescription. Apnea-hypopnea index was extracted from the sleep study results. RESULTS: The overall interrater reliability for final recommendations (sleep apnea suspicion, presence of CPD, and oxygen prescription) was high (kappa = .81, 95% confidence interval [CI] .76-.88). Good agreement was noted in CPD evaluation and suspicion of moderate to severe sleep apnea (kappa = .70, 95% CI .46-.86 and kappa = .65, 95% CI .56-.77 respectively). The interrater reliability for oxygen prescription was in an excellent range (kappa = .98, 95% CI .91-1.00). The accuracy of a high sleep apnea suspicion score in detecting apnea-hypopnea index ≥ 15 events/h ranged from 88.0% to 94.0% (sensitivity 91.3% to 95.7%, specificity 81.5% to 92.6%). Desaturations due to CPD were identified by 75% of the raters as desaturations due to conditions other than sleep apnea. CONCLUSIONS: A structured template for OPO interpretation can produce a high interrater agreement and good accuracy, and make it a reliable clinical tool. COMMENTARY: A commentary on this article appears in this issue on page 497.
Authors: Subooha Zafar; Indu Ayappa; Robert G Norman; Ana C Krieger; Joyce A Walsleben; David M Rapoport Journal: Chest Date: 2005-01 Impact factor: 9.410
Authors: Frédéric Sériès; R John Kimoff; Debra Morrison; Marie Helene Leblanc; Mark Smilovitch; Jonathan Howlett; Alexander G Logan; John S Floras; T Douglas Bradley Journal: Chest Date: 2005-05 Impact factor: 9.410
Authors: Nancy A Collop; W McDowell Anderson; Brian Boehlecke; David Claman; Rochelle Goldberg; Daniel J Gottlieb; David Hudgel; Michael Sateia; Richard Schwab Journal: J Clin Sleep Med Date: 2007-12-15 Impact factor: 4.062
Authors: Joshua M Bock; Kirk J Rodysill; Andrew D Calvin; Soumya Vungarala; Karine R Sahakyan; Stephen S Cha; Anna Svatikova; Francisco Lopez-Jimenez; Virend K Somers Journal: Front Cardiovasc Med Date: 2021-12-15
Authors: Daniel J Levendowski; Garun S Hamilton; Erik K St Louis; Thomas Penzel; David Dawson; Philip R Westbrook Journal: Nat Sci Sleep Date: 2019-07-12