Sharon-Lise T Normand1, Katya Zelevinsky2, Haley K Abing2, Marcela Horvitz-Lennon3. 1. Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts, USA; Department of Biostatistics, Harvard Chan School of Public Health, Boston, Massachusetts, USA. Electronic address: sharon@hcp.med.harvard.edu. 2. Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts, USA. 3. RAND Corporation, Boston, Massachusetts, USA; Cambridge Health Alliance, Cambridge, Massachusetts, USA.
Abstract
BACKGROUND: Quantifying quality of health care can provide valuable information to patients, providers, and policy makers. However, the observational nature of measuring quality complicates assessments. METHODS: We describe a conceptual model for defining quality and its implications about the data collected, how to make inferences about quality, and the assumptions required to provide statistically valid estimates. Twenty-one binary or polytomous quality measures collected from 101,051 adult Medicaid beneficiaries aged 18-64 years with schizophrenia from 5 U.S. states show methodology. A categorical principal components analysis establishes dimensionality of quality, and item response theory models characterize the relationship between each quality measure and a unidimensional quality construct. Latent regression models estimate racial/ethnic and geographic quality disparities. RESULTS: More than 90% of beneficiaries filled at least 1 antipsychotic prescription and 19% were hospitalized for schizophrenia during a 12-month observational period in our multistate cohort with approximately 2/3 nonwhite beneficiaries. Four quality constructs emerged: inpatient, emergency room, pharmacologic/ambulatory, and ambulatory only. Using a 2-parameter logistic model, pharmacologic/ambulatory care quality varied from -2.35 to 1.26 (higher = better quality). Black and Latinx beneficiaries had lower pharmacologic/ambulatory quality compared with whites. Race/ethnicity modified the association of state and pharmacologic/ambulatory care quality in latent regression modeling. Average quality ranged from -0.28 (95% confidence interval, -2.15 to 1.04) for blacks in New Jersey to 0.46 [95% confidence interval, -0.89 to 1.40] for whites in Michigan. CONCLUSIONS: By combining multiple quality measures using item response theory models, a composite measure can be estimated that has more statistical power to detect differences among subjects than the observed mean per subject.
BACKGROUND: Quantifying quality of health care can provide valuable information to patients, providers, and policy makers. However, the observational nature of measuring quality complicates assessments. METHODS: We describe a conceptual model for defining quality and its implications about the data collected, how to make inferences about quality, and the assumptions required to provide statistically valid estimates. Twenty-one binary or polytomous quality measures collected from 101,051 adult Medicaid beneficiaries aged 18-64 years with schizophrenia from 5 U.S. states show methodology. A categorical principal components analysis establishes dimensionality of quality, and item response theory models characterize the relationship between each quality measure and a unidimensional quality construct. Latent regression models estimate racial/ethnic and geographic quality disparities. RESULTS: More than 90% of beneficiaries filled at least 1 antipsychotic prescription and 19% were hospitalized for schizophrenia during a 12-month observational period in our multistate cohort with approximately 2/3 nonwhite beneficiaries. Four quality constructs emerged: inpatient, emergency room, pharmacologic/ambulatory, and ambulatory only. Using a 2-parameter logistic model, pharmacologic/ambulatory care quality varied from -2.35 to 1.26 (higher = better quality). Black and Latinx beneficiaries had lower pharmacologic/ambulatory quality compared with whites. Race/ethnicity modified the association of state and pharmacologic/ambulatory care quality in latent regression modeling. Average quality ranged from -0.28 (95% confidence interval, -2.15 to 1.04) for blacks in New Jersey to 0.46 [95% confidence interval, -0.89 to 1.40] for whites in Michigan. CONCLUSIONS: By combining multiple quality measures using item response theory models, a composite measure can be estimated that has more statistical power to detect differences among subjects than the observed mean per subject.
Authors: Anthony F Lehman; Jeffrey A Lieberman; Lisa B Dixon; Thomas H McGlashan; Alexander L Miller; Diana O Perkins; Julie Kreyenbuhl Journal: Am J Psychiatry Date: 2004-02 Impact factor: 18.112
Authors: Joyce C West; Joshua E Wilk; Mark Olfson; Donald S Rae; Steve Marcus; William E Narrow; Harold A Pincus; Darrel A Regier Journal: Psychiatr Serv Date: 2005-03 Impact factor: 3.084
Authors: Susan M Essock; Nancy H Covell; Emily Leckman-Westin; Jeffrey A Lieberman; Lloyd I Sederer; Edith Kealey; Molly T Finnerty Journal: Psychiatr Serv Date: 2009-12 Impact factor: 3.084
Authors: Marcela Horvitz-Lennon; Rita Volya; Julie M Donohue; Judith R Lave; Bradley D Stein; Sharon-Lise T Normand Journal: Health Serv Res Date: 2014-03-13 Impact factor: 3.402