Nicholas H Osborne1, Lauren H Nicholas2, Andrew M Ryan3, Jyothi R Thumma4, Justin B Dimick3. 1. Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor2Center for Clinical Management Research, Veterans Affairs Ann Arbor Healthcare System, University of Michigan, Ann Arbor. 2. Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland. 3. Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor4Department of Health Policy and Management, School of Public Health, University of Michigan, Ann Arbor. 4. Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor.
Abstract
IMPORTANCE: The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) provides feedback to hospitals on risk-adjusted outcomes. It is not known if participation in the program improves outcomes and reduces costs relative to nonparticipating hospitals. OBJECTIVE: To evaluate the association of enrollment and participation in the ACS NSQIP with outcomes and Medicare payments compared with control hospitals that did not participate in the program. DESIGN, SETTING, AND PARTICIPANTS: Quasi-experimental study using national Medicare data (2003-2012) for a total of 1,226,479 patients undergoing general and vascular surgery at 263 hospitals participating in ACS NSQIP and 526 nonparticipating hospitals. A difference-in-differences analytic approach was used to evaluate whether participation in ACS NSQIP was associated with improved outcomes and reduced Medicare payments compared with nonparticipating hospitals that were otherwise similar. Control hospitals were selected using propensity score matching (2 control hospitals for each ACS NSQIP hospital). MAIN OUTCOMES AND MEASURES: Thirty-day mortality, serious complications (eg, pneumonia, myocardial infarction, or acute renal failure and a length of stay >75th percentile), reoperation, and readmission within 30 days. Hospital costs were assessed using price-standardized Medicare payments during hospitalization and 30 days after discharge. RESULTS: After accounting for patient factors and preexisting time trends toward improved outcomes, there were no statistically significant improvements in outcomes at 1, 2, or 3 years after (vs before) enrollment in ACS NSQIP. For example, in analyses comparing outcomes at 3 years after (vs before) enrollment, there were no statistically significant differences in risk-adjusted 30-day mortality (4.3% after enrollment vs 4.5% before enrollment; relative risk [RR], 0.96 [95% CI, 0.89 to 1.03]), serious complications (11.1% after enrollment vs 11.0% before enrollment; RR, 0.96 [95% CI, 0.91 to 1.00]), reoperations (0.49% after enrollment vs 0.45% before enrollment; RR, 0.97 [95% CI, 0.77 to 1.16]), or readmissions (13.3% after enrollment vs 12.8% before enrollment; RR, 0.99 [95% CI, 0.96 to 1.03]). There were also no differences at 3 years after (vs before) enrollment in mean total Medicare payments ($40 [95% CI, -$268 to $348]), or payments for the index admission (-$11 [95% CI, -$278 to $257]), hospital readmission ($245 [95% CI, -$231 to $721]), or outliers (-$86 [95% CI, -$1666 to $1495]). CONCLUSIONS AND RELEVANCE: With time, hospitals had progressively better surgical outcomes but enrollment in a national quality reporting program was not associated with the improved outcomes or lower Medicare payments among surgical patients. Feedback on outcomes alone may not be sufficient to improve surgical outcomes.
IMPORTANCE: The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) provides feedback to hospitals on risk-adjusted outcomes. It is not known if participation in the program improves outcomes and reduces costs relative to nonparticipating hospitals. OBJECTIVE: To evaluate the association of enrollment and participation in the ACS NSQIP with outcomes and Medicare payments compared with control hospitals that did not participate in the program. DESIGN, SETTING, AND PARTICIPANTS: Quasi-experimental study using national Medicare data (2003-2012) for a total of 1,226,479 patients undergoing general and vascular surgery at 263 hospitals participating in ACS NSQIP and 526 nonparticipating hospitals. A difference-in-differences analytic approach was used to evaluate whether participation in ACS NSQIP was associated with improved outcomes and reduced Medicare payments compared with nonparticipating hospitals that were otherwise similar. Control hospitals were selected using propensity score matching (2 control hospitals for each ACS NSQIP hospital). MAIN OUTCOMES AND MEASURES: Thirty-day mortality, serious complications (eg, pneumonia, myocardial infarction, or acute renal failure and a length of stay >75th percentile), reoperation, and readmission within 30 days. Hospital costs were assessed using price-standardized Medicare payments during hospitalization and 30 days after discharge. RESULTS: After accounting for patient factors and preexisting time trends toward improved outcomes, there were no statistically significant improvements in outcomes at 1, 2, or 3 years after (vs before) enrollment in ACS NSQIP. For example, in analyses comparing outcomes at 3 years after (vs before) enrollment, there were no statistically significant differences in risk-adjusted 30-day mortality (4.3% after enrollment vs 4.5% before enrollment; relative risk [RR], 0.96 [95% CI, 0.89 to 1.03]), serious complications (11.1% after enrollment vs 11.0% before enrollment; RR, 0.96 [95% CI, 0.91 to 1.00]), reoperations (0.49% after enrollment vs 0.45% before enrollment; RR, 0.97 [95% CI, 0.77 to 1.16]), or readmissions (13.3% after enrollment vs 12.8% before enrollment; RR, 0.99 [95% CI, 0.96 to 1.03]). There were also no differences at 3 years after (vs before) enrollment in mean total Medicare payments ($40 [95% CI, -$268 to $348]), or payments for the index admission (-$11 [95% CI, -$278 to $257]), hospital readmission ($245 [95% CI, -$231 to $721]), or outliers (-$86 [95% CI, -$1666 to $1495]). CONCLUSIONS AND RELEVANCE: With time, hospitals had progressively better surgical outcomes but enrollment in a national quality reporting program was not associated with the improved outcomes or lower Medicare payments among surgical patients. Feedback on outcomes alone may not be sufficient to improve surgical outcomes.
Authors: S N Weingart; L I Iezzoni; R B Davis; R H Palmer; M Cahalane; M B Hamel; K Mukamal; R S Phillips; D T Davies; N J Banks Journal: Med Care Date: 2000-08 Impact factor: 2.983
Authors: William R Best; Shukri F Khuri; Maureen Phelan; Kwan Hur; William G Henderson; John G Demakis; Jennifer Daley Journal: J Am Coll Surg Date: 2002-03 Impact factor: 6.113
Authors: Aaron S Fink; Darrell A Campbell; Robert M Mentzer; William G Henderson; Jennifer Daley; Janet Bannister; Kwan Hur; Shukri F Khuri Journal: Ann Surg Date: 2002-09 Impact factor: 12.969
Authors: John D Birkmeyer; Therese A Stukel; Andrea E Siewers; Philip P Goodney; David E Wennberg; F Lee Lucas Journal: N Engl J Med Date: 2003-11-27 Impact factor: 91.245
Authors: K John McConnell; Stephanie Renfro; Benjamin K S Chan; Thomas H A Meath; Aaron Mendelson; Deborah Cohen; Jeanette Waxmonsky; Dennis McCarty; Neal Wallace; Richard C Lindrooth Journal: JAMA Intern Med Date: 2017-04-01 Impact factor: 21.873
Authors: Donald S Likosky; Steven D Harrington; Lourdes Cabrera; Alphonse DeLucia; Carol E Chenoweth; Sarah L Krein; Dylan Thibault; Min Zhang; Roland A Matsouaka; Raymond J Strobel; Richard L Prager Journal: Circ Cardiovasc Qual Outcomes Date: 2018-11
Authors: William B. Lyman; Michael Passeri; Keith Murphy; Allyson Cochran; David A. Iannitti; John B. Martinie; Erin H. Baker; Brent D. Matthews; Dionisios Vrochides Journal: Can J Surg Date: 2020-03-13 Impact factor: 2.089
Authors: Peter A Soden; Sara L Zettervall; Klaas H J Ultee; Jeremy D Darling; John C McCallum; Allen D Hamdan; Mark C Wyers; Marc L Schermerhorn Journal: J Vasc Surg Date: 2016-07-25 Impact factor: 4.268
Authors: Christina M Papageorge; Qianqian Zhao; Eugene F Foley; Bruce A Harms; Charles P Heise; Evie H Carchman; Gregory D Kennedy Journal: J Surg Res Date: 2016-04-22 Impact factor: 2.192