Bradley N Reames1, Robert W Krell1, Darrell A Campbell1, Justin B Dimick2. 1. Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor. 2. Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor2Surgical Innovation Editor, JAMA Surgery.
Abstract
IMPORTANCE: Previous studies of checklist-based quality improvement interventions have reported mixed results. OBJECTIVE: To evaluate whether implementation of a checklist-based quality improvement intervention--Keystone Surgery--was associated with improved outcomes in patients in a large statewide population undergoing general surgery. DESIGN, SETTING, AND EXPOSURES: A retrospective longitudinal study examined surgical outcomes in 64,891 Michigan patients in 29 hospitals using Michigan Surgical Quality Collaborative clinical registry data from 2006 through 2010. Multivariable logistic regression and difference-in-differences analytic approaches were used to evaluate whether Keystone Surgery program implementation was associated with improved surgical outcomes following general surgery procedures, apart from existing temporal trends toward improved outcomes during the study period. MAIN OUTCOMES AND MEASURES: Risk-adjusted rates of superficial surgical site infection, wound complication, any complication, and 30-day mortality. RESULTS: Implementation of Keystone Surgery in 14 participating centers was not associated with improvements in surgical outcomes during the study period. Adjusted rates of superficial surgical site infection (3.2% vs 3.2%, P=.91), wound complication (5.9% vs 6.5%, P=.30), any complication (12.4% vs 13.2%, P=.26), and 30-day mortality (2.1% vs 1.9%, P=.32) at participating hospitals were similar before and after implementation. Difference-in-differences analysis accounting for trends in 15 nonparticipating centers and sensitivity analysis excluding patients receiving surgery in the first 6 or 12 months after program implementation yielded similar results. CONCLUSIONS AND RELEVANCE: Implementation of a checklist-based quality improvement intervention did not affect rates of adverse surgical outcomes among patients undergoing general surgery in participating Michigan hospitals. Additional research is needed to understand why this program was not successful prior to further dissemination and implementation of this model to other populations.
IMPORTANCE: Previous studies of checklist-based quality improvement interventions have reported mixed results. OBJECTIVE: To evaluate whether implementation of a checklist-based quality improvement intervention--Keystone Surgery--was associated with improved outcomes in patients in a large statewide population undergoing general surgery. DESIGN, SETTING, AND EXPOSURES: A retrospective longitudinal study examined surgical outcomes in 64,891 Michigan patients in 29 hospitals using Michigan Surgical Quality Collaborative clinical registry data from 2006 through 2010. Multivariable logistic regression and difference-in-differences analytic approaches were used to evaluate whether Keystone Surgery program implementation was associated with improved surgical outcomes following general surgery procedures, apart from existing temporal trends toward improved outcomes during the study period. MAIN OUTCOMES AND MEASURES: Risk-adjusted rates of superficial surgical site infection, wound complication, any complication, and 30-day mortality. RESULTS: Implementation of Keystone Surgery in 14 participating centers was not associated with improvements in surgical outcomes during the study period. Adjusted rates of superficial surgical site infection (3.2% vs 3.2%, P=.91), wound complication (5.9% vs 6.5%, P=.30), any complication (12.4% vs 13.2%, P=.26), and 30-day mortality (2.1% vs 1.9%, P=.32) at participating hospitals were similar before and after implementation. Difference-in-differences analysis accounting for trends in 15 nonparticipating centers and sensitivity analysis excluding patients receiving surgery in the first 6 or 12 months after program implementation yielded similar results. CONCLUSIONS AND RELEVANCE: Implementation of a checklist-based quality improvement intervention did not affect rates of adverse surgical outcomes among patients undergoing general surgery in participating Michigan hospitals. Additional research is needed to understand why this program was not successful prior to further dissemination and implementation of this model to other populations.
Authors: Julia Neily; Peter D Mills; Yinong Young-Xu; Brian T Carney; Priscilla West; David H Berger; Lisa M Mazzia; Douglas E Paull; James P Bagian Journal: JAMA Date: 2010-10-20 Impact factor: 56.272
Authors: Shawn S Forbes; Wesley J Stephen; William L Harper; Mark Loeb; Rhonda Smith; Emily P Christoffersen; Richard F McLean Journal: J Am Coll Surg Date: 2008-05-19 Impact factor: 6.113
Authors: Traci L Hedrick; James A Heckman; Robert L Smith; Robert G Sawyer; Charles M Friel; Eugene F Foley Journal: J Am Coll Surg Date: 2007-09 Impact factor: 6.113
Authors: Christian D Helfrich; Laura J Damschroder; Hildi J Hagedorn; Ginger S Daggett; Anju Sahay; Mona Ritchie; Teresa Damush; Marylou Guihan; Philip M Ullrich; Cheryl B Stetler Journal: Implement Sci Date: 2010-10-25 Impact factor: 7.327
Authors: Carrie H Colla; David E Wennberg; Ellen Meara; Jonathan S Skinner; Daniel Gottlieb; Valerie A Lewis; Christopher M Snyder; Elliott S Fisher Journal: JAMA Date: 2012-09-12 Impact factor: 56.272
Authors: Shukri F Khuri; William G Henderson; Jennifer Daley; Olga Jonasson; R Scott Jones; Darrell A Campbell; Aaron S Fink; Robert M Mentzer; Janet E Steeger Journal: J Am Coll Surg Date: 2007-06 Impact factor: 6.113
Authors: Caroline P Thirukumaran; Brian E McGarry; Laurent G Glance; Meiling Ying; Benjamin F Ricciardi; Xueya Cai; Yue Li Journal: J Bone Joint Surg Am Date: 2020-01-02 Impact factor: 6.558