Allan J Walkey1, Meng-Shiou Shieh2,3, Vincent X Liu4, Peter K Lindenauer2,3. 1. Department of Medicine, Division of Pulmonary, Allergy and Critical Care, Center for Implementation and Improvement Sciences, Boston University School of Medicine, Boston, MA. 2. Institute for Healthcare Delivery and Population Science and Department of Medicine, University of Massachusetts Medical School - Baystate, Springfield, MA. 3. Department of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA. 4. Kaiser Permanente Division of Research, Oakland, CA.
Abstract
OBJECTIVES: Sepsis care is becoming a more common target for hospital performance measurement, but few studies have evaluated the acceptability of sepsis or septic shock mortality as a potential performance measure. In the absence of a gold standard to identify septic shock in claims data, we assessed agreement and stability of hospital mortality performance under different case definitions. DESIGN: Retrospective cohort study. SETTING: U.S. acute care hospitals. PATIENTS: Hospitalized with septic shock at admission, identified by either implicit diagnosis criteria (charges for antibiotics, cultures, and vasopressors) or by explicit International Classification of Diseases, 9th revision, codes. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We used hierarchical logistic regression models to determine hospital risk-standardized mortality rates and hospital performance outliers. We assessed agreement in hospital mortality rankings when septic shock cases were identified by either explicit International Classification of Diseases, 9th revision, codes or implicit diagnosis criteria. Kappa statistics and intraclass correlation coefficients were used to assess agreement in hospital risk-standardized mortality and hospital outlier status, respectively. Fifty-six thousand six-hundred seventy-three patients in 308 hospitals fulfilled at least one case definition for septic shock, whereas 19,136 (33.8%) met both the explicit International Classification of Diseases, 9th revision, and implicit septic shock definition. Hospitals varied widely in risk-standardized septic shock mortality (interquartile range of implicit diagnosis mortality: 25.4-33.5%; International Classification of Diseases, 9th revision, diagnosis: 30.2-38.0%). The median absolute difference in hospital ranking between septic shock cohorts defined by International Classification of Diseases, 9th revision, versus implicit criteria was 37 places (interquartile range, 16-70), with an intraclass correlation coefficient of 0.72, p value of less than 0.001; agreement between case definitions for identification of outlier hospitals was moderate (kappa, 0.44 [95% CI, 0.30-0.58]). CONCLUSIONS: Risk-standardized septic shock mortality rates varied considerably between hospitals, suggesting that septic shock is an important performance target. However, efforts to profile hospital performance were sensitive to septic shock case definitions, suggesting that septic shock mortality is not currently ready for widespread use as a hospital quality measure.
OBJECTIVES:Sepsis care is becoming a more common target for hospital performance measurement, but few studies have evaluated the acceptability of sepsis or septic shock mortality as a potential performance measure. In the absence of a gold standard to identify septic shock in claims data, we assessed agreement and stability of hospital mortality performance under different case definitions. DESIGN: Retrospective cohort study. SETTING: U.S. acute care hospitals. PATIENTS: Hospitalized with septic shock at admission, identified by either implicit diagnosis criteria (charges for antibiotics, cultures, and vasopressors) or by explicit International Classification of Diseases, 9th revision, codes. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We used hierarchical logistic regression models to determine hospital risk-standardized mortality rates and hospital performance outliers. We assessed agreement in hospital mortality rankings when septic shock cases were identified by either explicit International Classification of Diseases, 9th revision, codes or implicit diagnosis criteria. Kappa statistics and intraclass correlation coefficients were used to assess agreement in hospital risk-standardized mortality and hospital outlier status, respectively. Fifty-six thousand six-hundred seventy-three patients in 308 hospitals fulfilled at least one case definition for septic shock, whereas 19,136 (33.8%) met both the explicit International Classification of Diseases, 9th revision, and implicit septic shock definition. Hospitals varied widely in risk-standardized septic shock mortality (interquartile range of implicit diagnosis mortality: 25.4-33.5%; International Classification of Diseases, 9th revision, diagnosis: 30.2-38.0%). The median absolute difference in hospital ranking between septic shock cohorts defined by International Classification of Diseases, 9th revision, versus implicit criteria was 37 places (interquartile range, 16-70), with an intraclass correlation coefficient of 0.72, p value of less than 0.001; agreement between case definitions for identification of outlier hospitals was moderate (kappa, 0.44 [95% CI, 0.30-0.58]). CONCLUSIONS: Risk-standardized septic shock mortality rates varied considerably between hospitals, suggesting that septic shock is an important performance target. However, efforts to profile hospital performance were sensitive to septic shock case definitions, suggesting that septic shock mortality is not currently ready for widespread use as a hospital quality measure.
Authors: Tara Lagu; Michael B Rothberg; Brian H Nathanson; Penelope S Pekow; Jay S Steingrub; Peter K Lindenauer Journal: J Crit Care Date: 2012-02-01 Impact factor: 3.425
Authors: Derek C Angus; Christopher W Seymour; Craig M Coopersmith; Clifford S Deutschman; Michael Klompas; Mitchell M Levy; Gregory S Martin; Tiffany M Osborn; Chanu Rhee; R Scott Watson Journal: Crit Care Med Date: 2016-03 Impact factor: 7.598
Authors: Ithan D Peltan; Kristina H Mitchell; Kristina E Rudd; Blake A Mann; David J Carlbom; Catherine L Hough; Thomas D Rea; Samuel M Brown Journal: Crit Care Med Date: 2017-06 Impact factor: 7.598
Authors: Peter K Lindenauer; Sharon-Lise T Normand; Elizabeth E Drye; Zhenqiu Lin; Katherine Goodrich; Mayur M Desai; Dale W Bratzler; Walter J O'Donnell; Mark L Metersky; Harlan M Krumholz Journal: J Hosp Med Date: 2011-01-05 Impact factor: 2.960
Authors: Sameer S Kadri; Chanu Rhee; Jeffrey R Strich; Megan K Morales; Samuel Hohmann; Jonathan Menchaca; Anthony F Suffredini; Robert L Danner; Michael Klompas Journal: Chest Date: 2016-07-22 Impact factor: 9.410
Authors: Robert L McNamara; Yongfei Wang; Chohreh Partovian; Julia Montague; Purav Mody; Elizabeth Eddy; Harlan M Krumholz; Susannah M Bernheim Journal: Med Care Date: 2015-09 Impact factor: 2.983
Authors: Chanu Rhee; Maximilian S Jentzsch; Sameer S Kadri; Christopher W Seymour; Derek C Angus; David J Murphy; Greg S Martin; Raymund B Dantes; Lauren Epstein; Anthony E Fiore; John A Jernigan; Robert L Danner; David K Warren; Edward J Septimus; Jason Hickok; Russell E Poland; Robert Jin; David Fram; Richard Schaaf; Rui Wang; Michael Klompas Journal: Crit Care Med Date: 2019-04 Impact factor: 7.598
Authors: Chanu Rhee; Zhonghe Li; Rui Wang; Yue Song; Sameer S Kadri; Edward J Septimus; Huai-Chun Chen; David Fram; Robert Jin; Russell Poland; Kenneth Sands; Michael Klompas Journal: Open Forum Infect Dis Date: 2020-06-25 Impact factor: 3.835
Authors: Chanu Rhee; Rui Wang; Yue Song; Zilu Zhang; Sameer S Kadri; Edward J Septimus; David Fram; Robert Jin; Russell E Poland; Jason Hickok; Kenneth Sands; Michael Klompas Journal: Crit Care Explor Date: 2019-10-14
Authors: Kelly J Thomas Craig; Mollie M McKillop; Hu T Huang; Judy George; Ekta S Punwani; Kyu B Rhee Journal: BMC Health Serv Res Date: 2020-07-10 Impact factor: 2.655