STUDY OBJECTIVES: The clinical performance of home sleep apnea tests (HSATs) can be described by their (diagnostic) accuracy, defined as the percentage agreement with the obstructive sleep apnea severity category (normal, mild, moderate, and severe) based on polysomnography. Rather than reporting on accuracy, there has been a strong reliance in the literature to report correlation coefficients between the apnea-hypopnea index of HSATs and polysomnography to support claims of diagnostic performance. This is surprising, as it has been well described that correlation coefficients are inadequate to evaluate equivalence between 2 parameters. The aim of this study was to systematically investigate the magnitude of the discrepancies between correlation coefficients and diagnostic accuracy reported in or retrievable from HSAT validation studies. METHODS: We compared the discrepancy between accuracy and apnea-hypopnea index correlation coefficients of all validation papers that met the inclusion criteria. A total of 20 papers were retained, representing a participant pool of 1,652. RESULTS: The weighted average apnea-hypopnea index correlation across all 20 papers was 0.82 and the weighted average accuracy was 0.61, highlighting a discrepancy of 0.21 and an overall misdiagnosis rate of 39%. CONCLUSIONS: The results of our study confirm the need for increased scientific rigor in selecting primary performance endpoints to support clinical performance claims of HSATs. CITATION: Massie F, Van Pee B, Bergmann J. Correlations between home sleep apnea tests and polysomnography outcomes do not fully reflect the diagnostic accuracy of these tests. J Clin Sleep Med. 2022;18(3):871-876.
STUDY OBJECTIVES: The clinical performance of home sleep apnea tests (HSATs) can be described by their (diagnostic) accuracy, defined as the percentage agreement with the obstructive sleep apnea severity category (normal, mild, moderate, and severe) based on polysomnography. Rather than reporting on accuracy, there has been a strong reliance in the literature to report correlation coefficients between the apnea-hypopnea index of HSATs and polysomnography to support claims of diagnostic performance. This is surprising, as it has been well described that correlation coefficients are inadequate to evaluate equivalence between 2 parameters. The aim of this study was to systematically investigate the magnitude of the discrepancies between correlation coefficients and diagnostic accuracy reported in or retrievable from HSAT validation studies. METHODS: We compared the discrepancy between accuracy and apnea-hypopnea index correlation coefficients of all validation papers that met the inclusion criteria. A total of 20 papers were retained, representing a participant pool of 1,652. RESULTS: The weighted average apnea-hypopnea index correlation across all 20 papers was 0.82 and the weighted average accuracy was 0.61, highlighting a discrepancy of 0.21 and an overall misdiagnosis rate of 39%. CONCLUSIONS: The results of our study confirm the need for increased scientific rigor in selecting primary performance endpoints to support clinical performance claims of HSATs. CITATION: Massie F, Van Pee B, Bergmann J. Correlations between home sleep apnea tests and polysomnography outcomes do not fully reflect the diagnostic accuracy of these tests. J Clin Sleep Med. 2022;18(3):871-876.
Authors: Jan Hedner; David P White; Atul Malhotra; Sarah Herscovici; Stephen D Pittman; Ding Zou; Ludger Grote; Giora Pillar Journal: J Clin Sleep Med Date: 2011-06-15 Impact factor: 4.062
Authors: Ji Ho Choi; Eun Joong Kim; Yang Soo Kim; June Choi; Tae Hoon Kim; Soon Young Kwon; Heung Man Lee; Sang Hag Lee; Chol Shin; Seung Hoon Lee Journal: Acta Otolaryngol Date: 2010-07 Impact factor: 1.494
Authors: Lawrence J Epstein; David Kristo; Patrick J Strollo; Norman Friedman; Atul Malhotra; Susheel P Patil; Kannan Ramar; Robert Rogers; Richard J Schwab; Edward M Weaver; Michael D Weinstein Journal: J Clin Sleep Med Date: 2009-06-15 Impact factor: 4.062
Authors: Li Weimin; Wang Rongguang; Huang Dongyan; Liu Xiaoli; Jin Wei; Yang Shiming Journal: Eur Arch Otorhinolaryngol Date: 2013-05-25 Impact factor: 2.503