Hallie C Prescott1,2, Tara M Cope3, Foster C Gesten3, Tatiana A Ledneva3, Marcus E Friedrich3, Theodore J Iwashyna1,2, Tiffany M Osborn4, Christopher W Seymour5,6, Mitchell M Levy7. 1. Department of Internal Medicine, University of Michigan, Ann Arbor, MI. 2. VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI. 3. Former affiliation: New York State Department of Health, Albany, NY. 4. Departments of Surgery and Emergency Medicine, Washington University, St. Louis, MO. 5. Departments of Critical Care and Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA. 6. Clinical Research, Investigation, and Systems Modeling of Acute illness (CRISMA) Center, Pittsburgh, PA. 7. Department of Medicine, Brown University, Providence, RI.
Abstract
OBJECTIVES: Under "Rory's Regulations," New York State Article 28 acute care hospitals were mandated to implement sepsis protocols and report patient-level data. This study sought to determine how well cases reported under state mandate align with discharge records in a statewide administrative database. DESIGN: Observational cohort study. SETTING: First 27 months of mandated sepsis reporting (April 1, 2014, to June 30, 2016). PATIENTS: Hospitalizations with sepsis at New York State Article 28 acute care hospitals. INTERVENTION: Sepsis regulations with mandated reporting. MEASUREMENTS AND MAIN RESULTS: We compared cases reported to the New York State Department of Health Sepsis Clinical Database with discharge records in the Statewide Planning and Research Cooperative System database. We classified discharges as 1) "coded sepsis discharges"-a diagnosis code for severe sepsis or septic shock and 2) "possible sepsis discharges," using Dombrovskiy and Angus criteria. Of 111,816 sepsis cases reported to the New York State Department of Health Sepsis Clinical Database, 105,722 (94.5%) were matched to discharge records in Statewide Planning and Research Cooperative System. The percentage of coded sepsis discharges reported increased from 67.5% in the first quarter to 81.3% in the final quarter of the study period (mean, 77.7%). Accounting for unmatched cases, as many as 82.7% of coded sepsis discharges were potentially reported, whereas at least 17.3% were unreported. Compared with unreported discharges, reported discharges had higher rates of acute organ dysfunction (e.g., cardiovascular dysfunction 63.0% vs 51.8%; p < 0.001) and higher in-hospital mortality (30.2% vs 26.1%; p < 0.001). Hospital characteristics (e.g., number of beds, teaching status, volume of sepsis cases) were similar between hospitals with a higher versus lower percent of discharges reported, p values greater than 0.05 for all. Hospitals' percent of discharges reported was not correlated with risk-adjusted mortality of their submitted cases (Pearson correlation coefficient 0.11; p = 0.17). CONCLUSIONS: Approximately four of five discharges with a diagnosis code of severe sepsis or septic shock in the Statewide Planning and Research Cooperative System data were reported in the New York State Department of Health Sepsis Clinical Database. Incomplete reporting appears to be driven more by underrecognition than attempts to game the system, with minimal bias to risk-adjusted hospital performance measurement.
OBJECTIVES: Under "Rory's Regulations," New York State Article 28 acute care hospitals were mandated to implement sepsis protocols and report patient-level data. This study sought to determine how well cases reported under state mandate align with discharge records in a statewide administrative database. DESIGN: Observational cohort study. SETTING: First 27 months of mandated sepsis reporting (April 1, 2014, to June 30, 2016). PATIENTS: Hospitalizations with sepsis at New York State Article 28 acute care hospitals. INTERVENTION: Sepsis regulations with mandated reporting. MEASUREMENTS AND MAIN RESULTS: We compared cases reported to the New York State Department of Health Sepsis Clinical Database with discharge records in the Statewide Planning and Research Cooperative System database. We classified discharges as 1) "coded sepsis discharges"-a diagnosis code for severe sepsis or septic shock and 2) "possible sepsis discharges," using Dombrovskiy and Angus criteria. Of 111,816 sepsis cases reported to the New York State Department of Health Sepsis Clinical Database, 105,722 (94.5%) were matched to discharge records in Statewide Planning and Research Cooperative System. The percentage of coded sepsis discharges reported increased from 67.5% in the first quarter to 81.3% in the final quarter of the study period (mean, 77.7%). Accounting for unmatched cases, as many as 82.7% of coded sepsis discharges were potentially reported, whereas at least 17.3% were unreported. Compared with unreported discharges, reported discharges had higher rates of acute organ dysfunction (e.g., cardiovascular dysfunction 63.0% vs 51.8%; p < 0.001) and higher in-hospital mortality (30.2% vs 26.1%; p < 0.001). Hospital characteristics (e.g., number of beds, teaching status, volume of sepsis cases) were similar between hospitals with a higher versus lower percent of discharges reported, p values greater than 0.05 for all. Hospitals' percent of discharges reported was not correlated with risk-adjusted mortality of their submitted cases (Pearson correlation coefficient 0.11; p = 0.17). CONCLUSIONS: Approximately four of five discharges with a diagnosis code of severe sepsis or septic shock in the Statewide Planning and Research Cooperative System data were reported in the New York State Department of Health Sepsis Clinical Database. Incomplete reporting appears to be driven more by underrecognition than attempts to game the system, with minimal bias to risk-adjusted hospital performance measurement.
Authors: Mitchell M Levy; Mitchell P Fink; John C Marshall; Edward Abraham; Derek Angus; Deborah Cook; Jonathan Cohen; Steven M Opal; Jean-Louis Vincent; Graham Ramsay Journal: Crit Care Med Date: 2003-04 Impact factor: 7.598
Authors: Vincent Liu; Gabriel J Escobar; John D Greene; Jay Soule; Alan Whippy; Derek C Angus; Theodore J Iwashyna Journal: JAMA Date: 2014-07-02 Impact factor: 56.272
Authors: Vincent X Liu; John W Morehouse; Gregory P Marelich; Jay Soule; Thomas Russell; Melinda Skeath; Carmen Adams; Gabriel J Escobar; Alan Whippy Journal: Am J Respir Crit Care Med Date: 2016-06-01 Impact factor: 21.405
Authors: Christopher W Seymour; Jeremy M Kahn; Colin R Cooke; Timothy R Watkins; Susan R Heckbert; Thomas D Rea Journal: JAMA Date: 2010-08-18 Impact factor: 56.272
Authors: R P Dellinger; Mitchell M Levy; Andrew Rhodes; Djillali Annane; Herwig Gerlach; Steven M Opal; Jonathan E Sevransky; Charles L Sprung; Ivor S Douglas; Roman Jaeschke; Tiffany M Osborn; Mark E Nunnally; Sean R Townsend; Konrad Reinhart; Ruth M Kleinpell; Derek C Angus; Clifford S Deutschman; Flavia R Machado; Gordon D Rubenfeld; Steven Webb; Richard J Beale; Jean-Louis Vincent; Rui Moreno Journal: Intensive Care Med Date: 2013-01-30 Impact factor: 17.440
Authors: Chanu Rhee; Sameer S Kadri; Robert L Danner; Anthony F Suffredini; Anthony F Massaro; Barrett T Kitch; Grace Lee; Michael Klompas Journal: Crit Care Date: 2016-04-06 Impact factor: 9.097
Authors: Jeremy M Kahn; Billie S Davis; Jonathan G Yabes; Chung-Chou H Chang; David H Chong; Tina Batra Hershey; Grant R Martsolf; Derek C Angus Journal: JAMA Date: 2019-07-16 Impact factor: 56.272
Authors: Erin F Carlton; John P Donnelly; Matthew K Hensley; Timothy T Cornell; Hallie C Prescott Journal: Crit Care Med Date: 2020-05 Impact factor: 7.598
Authors: John Karlsson Valik; Logan Ward; Hideyuki Tanushi; Kajsa Müllersdorf; Anders Ternhag; Ewa Aufwerber; Anna Färnert; Anders F Johansson; Mads Lause Mogensen; Brian Pickering; Hercules Dalianis; Aron Henriksson; Vitaly Herasevich; Pontus Nauclér Journal: BMJ Qual Saf Date: 2020-02-06 Impact factor: 7.035
Authors: Xiao Qing Wang; Brenda M Vincent; Wyndy L Wiitala; Kaitlyn A Luginbill; Elizabeth M Viglianti; Hallie C Prescott; Theodore J Iwashyna Journal: BMC Med Res Methodol Date: 2019-05-08 Impact factor: 4.615
Authors: Mark E Nunnally; Ricard Ferrer; Greg S Martin; Ignacio Martin-Loeches; Flavia R Machado; Daniel De Backer; Craig M Coopersmith; Clifford S Deutschman Journal: Intensive Care Med Exp Date: 2021-07-02
Authors: Donald S Bourne; Billie S Davis; Kristin H Gigli; Chung-Chou H Chang; Jonathan G Yabes; Grant R Martsolf; Jeremy M Kahn Journal: Crit Care Med Date: 2020-10 Impact factor: 9.296