Elise H Lawson1, Rachel Louie, David S Zingmond, Greg D Sacks, Robert H Brook, Bruce Lee Hall, Clifford Y Ko. 1. *Department of Surgery, David Geffen School of Medicine, University of California, Los Angeles, CA †Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL ‡VA Greater Los Angeles Healthcare System, Los Angeles, CA §Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA ¶RAND Corporation, Santa Monica, CA ||UCLA Jonathan and Karin Fielding School of Public Health, Los Angeles, CA **Department of Surgery, School of Medicine, Washington University in St Louis, and Barnes Jewish Hospital, St Louis, MO ††Center for Health Policy and the Olin Business School at Washington University in St Louis, St Louis, MO ‡‡Department of Surgery, John Cochran Veterans Affairs Medical Center, St Louis, MO §§BJC Healthcare, St Louis, MO.
Abstract
OBJECTIVE: To examine the validity of hybrid quality measures that use both clinical registry and administrative claims data, capitalizing on the strengths of each data source. BACKGROUND: Previous studies demonstrate substantial disagreement between clinical registry and administrative claims data on the occurrence of postoperative complications. Clinical data have greater validity than claims data for quality measurement but can be burdensome for hospitals to collect. METHODS: American College of Surgeons National Surgical Quality Improvement Program records were linked to Medicare inpatient claims (2005-2008). National Quality Forum-endorsed risk-adjusted measures of 30-day postoperative complications or death assessed hospital quality for patients undergoing colectomy, lower extremity bypass, or all surgical procedures. Measures use hierarchical multivariable logistic regression to identify statistical outliers. Measures were applied using clinical data, claims data, or a hybrid of both data sources. Kappa statistics assessed agreement on determinations of hospital quality. RESULTS: A total of 111,984 patients participated from 206 hospitals. Agreement on hospital quality between clinical and claims data was poor. Hybrid models using claims data to risk-adjust complications identified by clinical data had moderate agreement with all clinical data models, whereas hybrid models using clinical data to risk-adjust complications identified by claims data had routinely poor agreement with all clinical data models. CONCLUSIONS: Assessments of hospital quality differ substantially when using clinical registry versus administrative claims data. A hybrid approach using claims data for risk adjustment and clinical data for complications may be a valid alternative with lower data collection burden. For quality measures focused on postoperative complications to be meaningful, such policies should require, at a minimum, collection of clinical outcomes data.
OBJECTIVE: To examine the validity of hybrid quality measures that use both clinical registry and administrative claims data, capitalizing on the strengths of each data source. BACKGROUND: Previous studies demonstrate substantial disagreement between clinical registry and administrative claims data on the occurrence of postoperative complications. Clinical data have greater validity than claims data for quality measurement but can be burdensome for hospitals to collect. METHODS: American College of Surgeons National Surgical Quality Improvement Program records were linked to Medicare inpatient claims (2005-2008). National Quality Forum-endorsed risk-adjusted measures of 30-day postoperative complications or death assessed hospital quality for patients undergoing colectomy, lower extremity bypass, or all surgical procedures. Measures use hierarchical multivariable logistic regression to identify statistical outliers. Measures were applied using clinical data, claims data, or a hybrid of both data sources. Kappa statistics assessed agreement on determinations of hospital quality. RESULTS: A total of 111,984 patients participated from 206 hospitals. Agreement on hospital quality between clinical and claims data was poor. Hybrid models using claims data to risk-adjust complications identified by clinical data had moderate agreement with all clinical data models, whereas hybrid models using clinical data to risk-adjust complications identified by claims data had routinely poor agreement with all clinical data models. CONCLUSIONS: Assessments of hospital quality differ substantially when using clinical registry versus administrative claims data. A hybrid approach using claims data for risk adjustment and clinical data for complications may be a valid alternative with lower data collection burden. For quality measures focused on postoperative complications to be meaningful, such policies should require, at a minimum, collection of clinical outcomes data.
Authors: Liliana Bordeianou; Christy E Cauley; Donna Antonelli; Sarah Bird; David Rattner; Matthew Hutter; Sadiqa Mahmood; Deborah Schnipper; Marc Rubin; Ronald Bleday; Pardon Kenney; David Berger Journal: Dis Colon Rectum Date: 2017-01 Impact factor: 4.585
Authors: Jose F Figueroa; Daniel M Blumenthal; Yevgeniy Feyman; Austin B Frakt; Alexander Turchin; Gheorghe Doros; Qi Gao; Yang Song; Karen E Joynt Maddox Journal: JAMA Cardiol Date: 2019-03-01 Impact factor: 14.676