OBJECTIVES: Recent sepsis studies have defined patients as "infected" using a combination of culture and antibiotic orders rather than billing data. However, the accuracy of these definitions is unclear. We aimed to compare the accuracy of different established criteria for identifying infected patients using detailed chart review. DESIGN: Retrospective observational study. SETTING: Six hospitals from three health systems in Illinois. PATIENTS: Adult admissions with blood culture or antibiotic orders, or Angus International Classification of Diseases infection codes and death were eligible for study inclusion as potentially infected patients. Nine-hundred to 1,000 of these admissions were randomly selected from each health system for chart review, and a proportional number of patients who did not meet chart review eligibility criteria were also included and deemed not infected. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The accuracy of published billing code criteria by Angus et al and electronic health record criteria by Rhee et al and Seymour et al (Sepsis-3) was determined using the manual chart review results as the gold standard. A total of 5,215 patients were included, with 2,874 encounters analyzed via chart review and a proportional 2,341 added who did not meet chart review eligibility criteria. In the study cohort, 27.5% of admissions had at least one infection. This was most similar to the percentage of admissions with blood culture orders (26.8%), Angus infection criteria (28.7%), and the Sepsis-3 criteria (30.4%). Sepsis-3 criteria was the most sensitive (81%), followed by Angus (77%) and Rhee (52%), while Rhee (97%) and Angus (90%) were more specific than the Sepsis-3 criteria (89%). Results were similar for patients with organ dysfunction during their admission. CONCLUSIONS: Published criteria have a wide range of accuracy for identifying infected patients, with the Sepsis-3 criteria being the most sensitive and Rhee criteria being the most specific. These findings have important implications for studies investigating the burden of sepsis on a local and national level.
OBJECTIVES: Recent sepsis studies have defined patients as "infected" using a combination of culture and antibiotic orders rather than billing data. However, the accuracy of these definitions is unclear. We aimed to compare the accuracy of different established criteria for identifying infected patients using detailed chart review. DESIGN: Retrospective observational study. SETTING: Six hospitals from three health systems in Illinois. PATIENTS: Adult admissions with blood culture or antibiotic orders, or Angus International Classification of Diseases infection codes and death were eligible for study inclusion as potentially infected patients. Nine-hundred to 1,000 of these admissions were randomly selected from each health system for chart review, and a proportional number of patients who did not meet chart review eligibility criteria were also included and deemed not infected. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The accuracy of published billing code criteria by Angus et al and electronic health record criteria by Rhee et al and Seymour et al (Sepsis-3) was determined using the manual chart review results as the gold standard. A total of 5,215 patients were included, with 2,874 encounters analyzed via chart review and a proportional 2,341 added who did not meet chart review eligibility criteria. In the study cohort, 27.5% of admissions had at least one infection. This was most similar to the percentage of admissions with blood culture orders (26.8%), Angus infection criteria (28.7%), and the Sepsis-3 criteria (30.4%). Sepsis-3 criteria was the most sensitive (81%), followed by Angus (77%) and Rhee (52%), while Rhee (97%) and Angus (90%) were more specific than the Sepsis-3 criteria (89%). Results were similar for patients with organ dysfunction during their admission. CONCLUSIONS: Published criteria have a wide range of accuracy for identifying infected patients, with the Sepsis-3 criteria being the most sensitive and Rhee criteria being the most specific. These findings have important implications for studies investigating the burden of sepsis on a local and national level.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Matthew M Churpek; Ashley Snyder; Xuan Han; Sarah Sokol; Natasha Pettit; Michael D Howell; Dana P Edelson Journal: Am J Respir Crit Care Med Date: 2017-04-01 Impact factor: 21.405
Authors: Christopher W Seymour; Foster Gesten; Hallie C Prescott; Marcus E Friedrich; Theodore J Iwashyna; Gary S Phillips; Stanley Lemeshow; Tiffany Osborn; Kathleen M Terry; Mitchell M Levy Journal: N Engl J Med Date: 2017-05-21 Impact factor: 91.245
Authors: Chanu Rhee; Raymund Dantes; Lauren Epstein; David J Murphy; Christopher W Seymour; Theodore J Iwashyna; Sameer S Kadri; Derek C Angus; Robert L Danner; Anthony E Fiore; John A Jernigan; Greg S Martin; Edward Septimus; David K Warren; Anita Karcz; Christina Chan; John T Menchaca; Rui Wang; Susan Gruber; Michael Klompas Journal: JAMA Date: 2017-10-03 Impact factor: 56.272
Authors: Steven W Thiel; Jamie M Rosini; William Shannon; Joshua A Doherty; Scott T Micek; Marin H Kollef Journal: J Hosp Med Date: 2010-01 Impact factor: 2.960
Authors: Vincent X Liu; Yun Lu; Kyle A Carey; Emily R Gilbert; Majid Afshar; Mary Akel; Nirav S Shah; John Dolan; Christopher Winslow; Patricia Kipnis; Dana P Edelson; Gabriel J Escobar; Matthew M Churpek Journal: JAMA Netw Open Date: 2020-05-01
Authors: Kristina E Rudd; Sarah Charlotte Johnson; Kareha M Agesa; Katya Anne Shackelford; Derrick Tsoi; Daniel Rhodes Kievlan; Danny V Colombara; Kevin S Ikuta; Niranjan Kissoon; Simon Finfer; Carolin Fleischmann-Struzek; Flavia R Machado; Konrad K Reinhart; Kathryn Rowan; Christopher W Seymour; R Scott Watson; T Eoin West; Fatima Marinho; Simon I Hay; Rafael Lozano; Alan D Lopez; Derek C Angus; Christopher J L Murray; Mohsen Naghavi Journal: Lancet Date: 2020-01-18 Impact factor: 202.731
Authors: Fereshteh S Bashiri; John R Caskey; Anoop Mayampurath; Nicole Dussault; Jay Dumanian; Sivasubramanium V Bhavani; Kyle A Carey; Emily R Gilbert; Christopher J Winslow; Nirav S Shah; Dana P Edelson; Majid Afshar; Matthew M Churpek Journal: J Am Med Inform Assoc Date: 2022-09-12 Impact factor: 7.942
Authors: Zachary T Aldewereld; Li Ang Zhang; Alisa Urbano; Robert S Parker; David Swigon; Ipsita Banerjee; Hernando Gómez; Gilles Clermont Journal: Front Med (Lausanne) Date: 2022-05-19
Authors: David E Arnolds; Kyle A Carey; Lena Braginsky; Roxane Holt; Dana P Edelson; Barbara M Scavone; Matthew Churpek Journal: BMC Pregnancy Childbirth Date: 2022-04-06 Impact factor: 3.007