Matthew W Brault1,2, Bruce E Landon1,3, Alan M Zaslavsky1. 1. Department of Health Care Policy, Harvard Medical School, Boston. 2. Harvard PhD Program in Health Policy, Harvard University, Cambridge. 3. Division of General Medicine and Primary Care, Beth Israel Deaconess Medical Center, Boston, MA.
Abstract
BACKGROUND: The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey includes items about chronic conditions, health history, and self-rated health. Questions remain about the concordance between patient reports and administrative sources on questions related to health history. OBJECTIVE: To validate CAHPS measures of chronic conditions against claims-based measures from the Medicare Chronic Conditions Warehouse (CCW). METHODS: We linked CAHPS responses from 301,050 fee-for-service Medicare beneficiaries in 2010-2012 with summaries of their claims in the CCW and identified nearest equivalent measures of conditions across sources. We calculated sensitivities and specificities for conditions and estimated regression models to assess the effects of patient characteristics on the sensitivity. RESULTS: The sensitivity of CAHPS measures differed across conditions, ranging from 0.513 for history of stroke to 0.773 for history of cancer. Sensitivity was generally lower for older beneficiaries, those reporting good self-rated health, and those with fair or poor mental health. Specificity was 0.904 or greater for all conditions, up to 0.961 for stroke. CONCLUSIONS: Despite difference in timeframes and definitions of conditions, the measured sensitivities demonstrated reasonable validity. Variation in sensitivity is consistent with covariates that either directly measure health severity within a diagnosis or can be construed as a proxy for severity of illness.
BACKGROUND: The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey includes items about chronic conditions, health history, and self-rated health. Questions remain about the concordance between patient reports and administrative sources on questions related to health history. OBJECTIVE: To validate CAHPS measures of chronic conditions against claims-based measures from the Medicare Chronic Conditions Warehouse (CCW). METHODS: We linked CAHPS responses from 301,050 fee-for-service Medicare beneficiaries in 2010-2012 with summaries of their claims in the CCW and identified nearest equivalent measures of conditions across sources. We calculated sensitivities and specificities for conditions and estimated regression models to assess the effects of patient characteristics on the sensitivity. RESULTS: The sensitivity of CAHPS measures differed across conditions, ranging from 0.513 for history of stroke to 0.773 for history of cancer. Sensitivity was generally lower for older beneficiaries, those reporting good self-rated health, and those with fair or poor mental health. Specificity was 0.904 or greater for all conditions, up to 0.961 for stroke. CONCLUSIONS: Despite difference in timeframes and definitions of conditions, the measured sensitivities demonstrated reasonable validity. Variation in sensitivity is consistent with covariates that either directly measure health severity within a diagnosis or can be construed as a proxy for severity of illness.
Authors: Megan A Mullins; Jasdeep S Kler; Marisa R Eastman; Mohammed Kabeto; Lauren P Wallner; Lindsay C Kobayashi Journal: Cancer Epidemiol Biomarkers Prev Date: 2021-11-04 Impact factor: 4.090