Christopher W Seymour1, Vincent X Liu2, Theodore J Iwashyna3, Frank M Brunkhorst4, Thomas D Rea5, André Scherag6, Gordon Rubenfeld7, Jeremy M Kahn1, Manu Shankar-Hari8, Mervyn Singer9, Clifford S Deutschman10, Gabriel J Escobar3, Derek C Angus1. 1. Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania2Clinical Research, Investigation, and Systems Modeling of Acute Illness (CRISMA) Center, Pittsburgh, Pennsylvania. 2. Division of Research, Kaiser Permanente, Oakland, California. 3. Department of Internal Medicine, University of Michigan, Ann Arbor5Veterans Affairs Center for Clinical Management Research, Ann Arbor, Michigan6Australia and New Zealand Intensive Care Research Centre, Department of Epidemiology and Preventive Medicine. 4. Center for Clinical Studies, Jena University Hospital, Jena, Germany. 5. Division of General Internal Medicine, University of Washington, Seattle. 6. Research Group Clinical Epidemiology, Integrated Research and Treatment Center, Center for Sepsis Control and Care, Jena University Hospital, Jena, Germany. 7. Trauma, Emergency, and Critical Care Program, Sunnybrook Health Sciences Centre; Interdepartmental Division of Critical Care, University of Toronto, Toronto, Ontario, Canada. 8. Critical Care Medicine, Guy's and St Thomas' NHS Foundation Trust, London, England. 9. Bloomsbury Institute of Intensive Care Medicine, University College London, London, England. 10. Feinstein Institute for Medical Research, Hofstra-North Shore-Long Island Jewish School of Medicine, Steven and Alexandra Cohen Children's Medical Center, New Hyde Park, New York.
Abstract
IMPORTANCE: The Third International Consensus Definitions Task Force defined sepsis as "life-threatening organ dysfunction due to a dysregulated host response to infection." The performance of clinical criteria for this sepsis definition is unknown. OBJECTIVE: To evaluate the validity of clinical criteria to identify patients with suspected infection who are at risk of sepsis. DESIGN, SETTINGS, AND POPULATION: Among 1.3 million electronic health record encounters from January 1, 2010, to December 31, 2012, at 12 hospitals in southwestern Pennsylvania, we identified those with suspected infection in whom to compare criteria. Confirmatory analyses were performed in 4 data sets of 706,399 out-of-hospital and hospital encounters at 165 US and non-US hospitals ranging from January 1, 2008, until December 31, 2013. EXPOSURES: Sequential [Sepsis-related] Organ Failure Assessment (SOFA) score, systemic inflammatory response syndrome (SIRS) criteria, Logistic Organ Dysfunction System (LODS) score, and a new model derived using multivariable logistic regression in a split sample, the quick Sequential [Sepsis-related] Organ Failure Assessment (qSOFA) score (range, 0-3 points, with 1 point each for systolic hypotension [≤100 mm Hg], tachypnea [≥22/min], or altered mentation). MAIN OUTCOMES AND MEASURES: For construct validity, pairwise agreement was assessed. For predictive validity, the discrimination for outcomes (primary: in-hospital mortality; secondary: in-hospital mortality or intensive care unit [ICU] length of stay ≥3 days) more common in sepsis than uncomplicated infection was determined. Results were expressed as the fold change in outcome over deciles of baseline risk of death and area under the receiver operating characteristic curve (AUROC). RESULTS: In the primary cohort, 148,907 encounters had suspected infection (n = 74,453 derivation; n = 74,454 validation), of whom 6347 (4%) died. Among ICU encounters in the validation cohort (n = 7932 with suspected infection, of whom 1289 [16%] died), the predictive validity for in-hospital mortality was lower for SIRS (AUROC = 0.64; 95% CI, 0.62-0.66) and qSOFA (AUROC = 0.66; 95% CI, 0.64-0.68) vs SOFA (AUROC = 0.74; 95% CI, 0.73-0.76; P < .001 for both) or LODS (AUROC = 0.75; 95% CI, 0.73-0.76; P < .001 for both). Among non-ICU encounters in the validation cohort (n = 66 522 with suspected infection, of whom 1886 [3%] died), qSOFA had predictive validity (AUROC = 0.81; 95% CI, 0.80-0.82) that was greater than SOFA (AUROC = 0.79; 95% CI, 0.78-0.80; P < .001) and SIRS (AUROC = 0.76; 95% CI, 0.75-0.77; P < .001). Relative to qSOFA scores lower than 2, encounters with qSOFA scores of 2 or higher had a 3- to 14-fold increase in hospital mortality across baseline risk deciles. Findings were similar in external data sets and for the secondary outcome. CONCLUSIONS AND RELEVANCE: Among ICU encounters with suspected infection, the predictive validity for in-hospital mortality of SOFA was not significantly different than the more complex LODS but was statistically greater than SIRS and qSOFA, supporting its use in clinical criteria for sepsis. Among encounters with suspected infection outside of the ICU, the predictive validity for in-hospital mortality of qSOFA was statistically greater than SOFA and SIRS, supporting its use as a prompt to consider possible sepsis.
IMPORTANCE: The Third International Consensus Definitions Task Force defined sepsis as "life-threatening organ dysfunction due to a dysregulated host response to infection." The performance of clinical criteria for this sepsis definition is unknown. OBJECTIVE: To evaluate the validity of clinical criteria to identify patients with suspected infection who are at risk of sepsis. DESIGN, SETTINGS, AND POPULATION: Among 1.3 million electronic health record encounters from January 1, 2010, to December 31, 2012, at 12 hospitals in southwestern Pennsylvania, we identified those with suspected infection in whom to compare criteria. Confirmatory analyses were performed in 4 data sets of 706,399 out-of-hospital and hospital encounters at 165 US and non-US hospitals ranging from January 1, 2008, until December 31, 2013. EXPOSURES: Sequential [Sepsis-related] Organ Failure Assessment (SOFA) score, systemic inflammatory response syndrome (SIRS) criteria, Logistic Organ Dysfunction System (LODS) score, and a new model derived using multivariable logistic regression in a split sample, the quick Sequential [Sepsis-related] Organ Failure Assessment (qSOFA) score (range, 0-3 points, with 1 point each for systolic hypotension [≤100 mm Hg], tachypnea [≥22/min], or altered mentation). MAIN OUTCOMES AND MEASURES: For construct validity, pairwise agreement was assessed. For predictive validity, the discrimination for outcomes (primary: in-hospital mortality; secondary: in-hospital mortality or intensive care unit [ICU] length of stay ≥3 days) more common in sepsis than uncomplicated infection was determined. Results were expressed as the fold change in outcome over deciles of baseline risk of death and area under the receiver operating characteristic curve (AUROC). RESULTS: In the primary cohort, 148,907 encounters had suspected infection (n = 74,453 derivation; n = 74,454 validation), of whom 6347 (4%) died. Among ICU encounters in the validation cohort (n = 7932 with suspected infection, of whom 1289 [16%] died), the predictive validity for in-hospital mortality was lower for SIRS (AUROC = 0.64; 95% CI, 0.62-0.66) and qSOFA (AUROC = 0.66; 95% CI, 0.64-0.68) vs SOFA (AUROC = 0.74; 95% CI, 0.73-0.76; P < .001 for both) or LODS (AUROC = 0.75; 95% CI, 0.73-0.76; P < .001 for both). Among non-ICU encounters in the validation cohort (n = 66 522 with suspected infection, of whom 1886 [3%] died), qSOFA had predictive validity (AUROC = 0.81; 95% CI, 0.80-0.82) that was greater than SOFA (AUROC = 0.79; 95% CI, 0.78-0.80; P < .001) and SIRS (AUROC = 0.76; 95% CI, 0.75-0.77; P < .001). Relative to qSOFA scores lower than 2, encounters with qSOFA scores of 2 or higher had a 3- to 14-fold increase in hospital mortality across baseline risk deciles. Findings were similar in external data sets and for the secondary outcome. CONCLUSIONS AND RELEVANCE: Among ICU encounters with suspected infection, the predictive validity for in-hospital mortality of SOFA was not significantly different than the more complex LODS but was statistically greater than SIRS and qSOFA, supporting its use in clinical criteria for sepsis. Among encounters with suspected infection outside of the ICU, the predictive validity for in-hospital mortality of qSOFA was statistically greater than SOFA and SIRS, supporting its use as a prompt to consider possible sepsis.
Authors: Mitchell M Levy; Mitchell P Fink; John C Marshall; Edward Abraham; Derek Angus; Deborah Cook; Jonathan Cohen; Steven M Opal; Jean-Louis Vincent; Graham Ramsay Journal: Crit Care Med Date: 2003-04 Impact factor: 7.598
Authors: Nathan I Shapiro; Richard E Wolfe; Richard B Moore; Eric Smith; Elizabeth Burdick; David W Bates Journal: Crit Care Med Date: 2003-03 Impact factor: 7.598
Authors: Kirsi-Maija Kaukonen; Michael Bailey; David Pilcher; D Jamie Cooper; Rinaldo Bellomo Journal: N Engl J Med Date: 2015-03-17 Impact factor: 91.245
Authors: Christopher W Seymour; Jeremy M Kahn; Colin R Cooke; Timothy R Watkins; Susan R Heckbert; Thomas D Rea Journal: JAMA Date: 2010-08-18 Impact factor: 56.272
Authors: Maurizio Cecconi; Daniel De Backer; Massimo Antonelli; Richard Beale; Jan Bakker; Christoph Hofer; Roman Jaeschke; Alexandre Mebazaa; Michael R Pinsky; Jean Louis Teboul; Jean Louis Vincent; Andrew Rhodes Journal: Intensive Care Med Date: 2014-11-13 Impact factor: 17.440
Authors: John P Donnelly; Monika M Safford; Nathan I Shapiro; John W Baddley; Henry E Wang Journal: Lancet Infect Dis Date: 2017-03-04 Impact factor: 25.071
Authors: Eleanor A Fallon; Bethany M Biron-Girard; Chun-Shiang Chung; Joanne Lomas-Neira; Daithi S Heffernan; Sean F Monaghan; Alfred Ayala Journal: J Leukoc Biol Date: 2018-02-02 Impact factor: 4.962
Authors: Annette Ilg; Ari Moskowitz; Varun Konanki; Parth V Patel; Maureen Chase; Anne V Grossestreuer; Michael W Donnino Journal: Ann Emerg Med Date: 2018-08-02 Impact factor: 5.721
Authors: Anders Perner; Anthony C Gordon; Daniel De Backer; George Dimopoulos; James A Russell; Jeffrey Lipman; Jens-Ulrik Jensen; John Myburgh; Mervyn Singer; Rinaldo Bellomo; Timothy Walsh Journal: Intensive Care Med Date: 2016-10-01 Impact factor: 17.440
Authors: Chanu Rhee; Raymund Dantes; Lauren Epstein; David J Murphy; Christopher W Seymour; Theodore J Iwashyna; Sameer S Kadri; Derek C Angus; Robert L Danner; Anthony E Fiore; John A Jernigan; Greg S Martin; Edward Septimus; David K Warren; Anita Karcz; Christina Chan; John T Menchaca; Rui Wang; Susan Gruber; Michael Klompas Journal: JAMA Date: 2017-10-03 Impact factor: 56.272