Emily M Bucholz1, Sara L Toomey2, Charles E McCulloch3, Naomi Bardach4. 1. Department of Cardiology, Boston Children's Hospital (EM Bucholz), Boston, Mass; Harvard Medical School (EM Bucholz and SL Toomey), Boston, Mass. 2. Harvard Medical School (EM Bucholz and SL Toomey), Boston, Mass; Department of Pediatrics, Boston Children's Hospital (SL Toomey), Boston, Mass. 3. Department of Epidemiology and Biostatistics, University of California San Francisco (CE McCulloch). 4. Department of Pediatrics, University of California San Francisco (N Bardach). Electronic address: bardachn@peds.ucsf.edu.
Abstract
BACKGROUND: Outcome and utilization quality measures are adjusted for patient case-mix including demographic characteristics and comorbid conditions to allow for comparisons between hospitals and health plans. However, controversy exists around whether and how to adjust for social risk factors. OBJECTIVE: To assess an approach to incorporating social risk variables into a pediatric measure of utilization from the Pediatric Quality Measures Program (PQMP). METHODS: We used data from California Medicaid claims (2015-16) and Massachusetts All Payer Claims Database (2014-2015) to calculate health plan performance using measure specifications from the Pediatric Asthma Emergency Department Use measure. Health plan performance categories were assessed using mixed effect negative binomial models with and without adjustment for social risk factors, with both models adjusting for age, gender and chronic condition category. Mixed effects linear models were then used to compare patient social risk for health plans that changed performance categories to patient social risk for health plans that did not. RESULTS: Of 133 health plans, serving 404,649 pediatric patients with asthma, 7% to 13% changed performance categories after social risk adjustment. Health plans that moved to higher performance categories cared for lower socioeconomic status (SES) patients whereas those that moved to lower performance categories cared for higher SES patients. CONCLUSIONS: Adjustment for social risk factors changed performance rankings on the PQMP Pediatric Asthma Emergency Department Use measure for a substantial number of health plans. Some health plans caring for higher risk patients performed more poorly when social risk factors were not included in risk adjustment models. In light of this, social risk factors are incorporated into the National Quality Forum-endorsed measure; whether to incorporate social risk factors into pediatric quality measures will differ depending on the use case.
BACKGROUND: Outcome and utilization quality measures are adjusted for patient case-mix including demographic characteristics and comorbid conditions to allow for comparisons between hospitals and health plans. However, controversy exists around whether and how to adjust for social risk factors. OBJECTIVE: To assess an approach to incorporating social risk variables into a pediatric measure of utilization from the Pediatric Quality Measures Program (PQMP). METHODS: We used data from California Medicaid claims (2015-16) and Massachusetts All Payer Claims Database (2014-2015) to calculate health plan performance using measure specifications from the Pediatric Asthma Emergency Department Use measure. Health plan performance categories were assessed using mixed effect negative binomial models with and without adjustment for social risk factors, with both models adjusting for age, gender and chronic condition category. Mixed effects linear models were then used to compare patient social risk for health plans that changed performance categories to patient social risk for health plans that did not. RESULTS: Of 133 health plans, serving 404,649 pediatric patients with asthma, 7% to 13% changed performance categories after social risk adjustment. Health plans that moved to higher performance categories cared for lower socioeconomic status (SES) patients whereas those that moved to lower performance categories cared for higher SES patients. CONCLUSIONS: Adjustment for social risk factors changed performance rankings on the PQMP Pediatric Asthma Emergency Department Use measure for a substantial number of health plans. Some health plans caring for higher risk patients performed more poorly when social risk factors were not included in risk adjustment models. In light of this, social risk factors are incorporated into the National Quality Forum-endorsed measure; whether to incorporate social risk factors into pediatric quality measures will differ depending on the use case.
Authors: Valerie S Harder; Judith S Shaw; Charles E McCulloch; Lindsay Kill; Keith J Robinson; Michelle T Shepard; Michael D Cabana; Naomi S Bardach Journal: Pediatrics Date: 2020-12 Impact factor: 7.124