Robert D Becher1, Michael P DeWane, Nitin Sukumar, Marilyn J Stolar, Thomas M Gill, Adrian A Maung, Kevin M Schuster, Kimberly A Davis. 1. From the Section of General Surgery, Trauma, and Surgical Critical Care, Department of Surgery (R.D.B., M.P.D., A.A.M., K.M.S., K.A.D.), Yale School of Medicine; Yale Center for Analytical Sciences (N.S., M.J.S.), Yale School of Public Health; and Section of Geriatrics, Department of Internal Medicine (T.M.G.), Yale School of Medicine, New Haven, Connecticut.
Abstract
BACKGROUND: Expected performance rates for various outcome metrics are a hallmark of hospital quality indicators used by Agency of Healthcare Research and Quality, Center for Medicare and Medicaid Services, and National Quality Forum. The identification of outlier hospitals with above- and below-expected mortality for emergency general surgery (EGS) operations is therefore of great value for EGS quality improvement initiatives. The aim of this study was to determine hospital variation in mortality after EGS operations, and compare characteristics between outlier hospitals. METHODS: Using data from the California State Inpatient Database (2010-2011), we identified patients who underwent one of eight common EGS operations. Expected mortality was obtained from a Bayesian model, adjusting for both patient- and hospital-level variables. A hospital-level standardized mortality ratio (SMR) was constructed (ratio of observed to expected deaths). Only hospitals performing three or more of each operation were included. An "outlier" hospital was defined as having an SMR with 80% confidence interval that did not cross 1.0. High- and low-mortality SMR outliers were compared. RESULTS: There were 140,333 patients included from 220 hospitals. Standardized mortality ratio varied from a high of 2.6 (mortality, 160% higher than expected) to a low of 0.2 (mortality, 80% lower than expected); 12 hospitals were high SMR outliers, and 28 were low SMR outliers. Standardized mortality was over three times worse in the high SMR outliers compared with the low SMR outliers (1.7 vs. 0.5; p < 0.001). Hospital-, patient-, and operative-level characteristics were equivalent in each outlier group. CONCLUSION: There exists significant hospital variation in standardized mortality after EGS operations. High SMR outliers have significant excess mortality, while low SMR outliers have superior EGS survival. Common hospital-level characteristics do not explain the wide gap between underperforming and overperforming outlier institutions. These findings suggest that SMR can help guide assessment of EGS performance across hospitals; further research is essential to identify and define the hospital processes of care which translate into optimal EGS outcomes. LEVEL OF EVIDENCE: Epidemiologic Study, level III.
BACKGROUND: Expected performance rates for various outcome metrics are a hallmark of hospital quality indicators used by Agency of Healthcare Research and Quality, Center for Medicare and Medicaid Services, and National Quality Forum. The identification of outlier hospitals with above- and below-expected mortality for emergency general surgery (EGS) operations is therefore of great value for EGS quality improvement initiatives. The aim of this study was to determine hospital variation in mortality after EGS operations, and compare characteristics between outlier hospitals. METHODS: Using data from the California State Inpatient Database (2010-2011), we identified patients who underwent one of eight common EGS operations. Expected mortality was obtained from a Bayesian model, adjusting for both patient- and hospital-level variables. A hospital-level standardized mortality ratio (SMR) was constructed (ratio of observed to expected deaths). Only hospitals performing three or more of each operation were included. An "outlier" hospital was defined as having an SMR with 80% confidence interval that did not cross 1.0. High- and low-mortality SMR outliers were compared. RESULTS: There were 140,333 patients included from 220 hospitals. Standardized mortality ratio varied from a high of 2.6 (mortality, 160% higher than expected) to a low of 0.2 (mortality, 80% lower than expected); 12 hospitals were high SMR outliers, and 28 were low SMR outliers. Standardized mortality was over three times worse in the high SMR outliers compared with the low SMR outliers (1.7 vs. 0.5; p < 0.001). Hospital-, patient-, and operative-level characteristics were equivalent in each outlier group. CONCLUSION: There exists significant hospital variation in standardized mortality after EGS operations. High SMR outliers have significant excess mortality, while low SMR outliers have superior EGS survival. Common hospital-level characteristics do not explain the wide gap between underperforming and overperforming outlier institutions. These findings suggest that SMR can help guide assessment of EGS performance across hospitals; further research is essential to identify and define the hospital processes of care which translate into optimal EGS outcomes. LEVEL OF EVIDENCE: Epidemiologic Study, level III.
Authors: Robert D Becher; J Jason Hoth; Preston R Miller; Nathan T Mowery; Michael C Chang; J Wayne Meredith Journal: Am Surg Date: 2011-07 Impact factor: 0.688
Authors: Harlan M Krumholz; Ralph G Brindis; John E Brush; David J Cohen; Andrew J Epstein; Karen Furie; George Howard; Eric D Peterson; Saif S Rathore; Sidney C Smith; John A Spertus; Yun Wang; Sharon-Lise T Normand Journal: Circulation Date: 2005-12-19 Impact factor: 29.690
Authors: Jeffrey H Silber; Ville A Satopää; Nabanita Mukherjee; Veronika Rockova; Wei Wang; Alexander S Hill; Orit Even-Shoshan; Paul R Rosenbaum; Edward I George Journal: Health Serv Res Date: 2016-03-14 Impact factor: 3.402
Authors: Shahid Shafi; Michel Aboutanos; Carlos Vidal-Ribas Brown; David Ciesla; Mitchell J Cohen; Marie L Crandall; Kenji Inaba; Preston R Miller; Nathan T Mowery Journal: J Trauma Acute Care Surg Date: 2014-03 Impact factor: 3.313
Authors: Harlan M Krumholz; Zhenqiu Lin; Patricia S Keenan; Jersey Chen; Joseph S Ross; Elizabeth E Drye; Susannah M Bernheim; Yun Wang; Elizabeth H Bradley; Lein F Han; Sharon-Lise T Normand Journal: JAMA Date: 2013-02-13 Impact factor: 56.272
Authors: Robert D Becher; Nitin Sukumar; Michael P DeWane; Marilyn J Stolar; Thomas M Gill; Kevin M Schuster; Adrian A Maung; Cheryl K Zogg; Kimberly A Davis Journal: J Am Coll Surg Date: 2020-02-04 Impact factor: 6.113