Christopher Aakre1, Pablo Moreno Franco2, Micaela Ferreyra3, Jaben Kitson4, Man Li4, Vitaly Herasevich5. 1. Division of General Internal Medicine, Department of Internal Medicine, Mayo Clinic, 200 First St SW, Rochester, MN 55905, USA. Electronic address: aakre.christopher@mayo.edu. 2. Department of Critical Care, Mayo Clinic,4500 San Pablo Rd S, Jacksonville, FL 32224, USA; Department of Transplant, Mayo Clinic, 4500 San Pablo Rd S, Jacksonville, FL 32224, USA. 3. Department of Transplant, Mayo Clinic, 4500 San Pablo Rd S, Jacksonville, FL 32224, USA. 4. Department of Information Technology, Mayo Clinic, 200 First St SW, Rochester, MN 55905, USA; Multidisciplinary Epidemiology and Translation Research in Intensive Care (METRIC), Mayo Clinic, 200 First St SW, Rochester, MN 55905, USA. 5. Multidisciplinary Epidemiology and Translation Research in Intensive Care (METRIC), Mayo Clinic, 200 First St SW, Rochester, MN 55905, USA; Department of Anesthesiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905, USA.
Abstract
OBJECTIVES: We created an algorithm for automated Sequential Organ Failure Assessment (SOFA) score calculation within the Electronic Health Record (EHR) to facilitate detection of sepsis based on the Third International Consensus Definitions for Sepsis and Septic Shock (SEPSIS-3) clinical definition. We evaluated the accuracy of near real-time and daily automated SOFA score calculation compared with manual score calculation. METHODS: Automated SOFA scoring computer programs were developed using available EHR data sources and integrated into a critical care focused patient care dashboard at Mayo Clinic in Rochester, Minnesota. We prospectively compared the accuracy of automated versus manual calculation for a sample of patients admitted to the medical intensive care unit at Mayo Clinic Hospitals in Rochester, Minnesota and Jacksonville, Florida. Agreement was calculated with Cohen's kappa statistic. Reason for discrepancy was tabulated during manual review. RESULTS: Random spot check comparisons were performed 134 times on 27 unique patients, and daily SOFA score comparisons were performed for 215 patients over a total of 1206 patient days. Agreement between automatically scored and manually scored SOFA components for both random spot checks (696 pairs, κ=0.89) and daily calculation (5972 pairs, κ=0.89) was high. The most common discrepancies were in the respiratory component (inaccurate fraction of inspired oxygen retrieval; 200/1206) and creatinine (normal creatinine in patients with no urine output on dialysis; 128/1094). 147 patients were at risk of developing sepsis after intensive care unit admission, 10 later developed sepsis confirmed by chart review. All were identified before onset of sepsis with the ΔSOFA≥2 point criterion and 46 patients were false-positives. CONCLUSIONS: Near real-time automated SOFA scoring was found to have strong agreement with manual score calculation and may be useful for the detection of sepsis utilizing the new SEPSIS-3 definition.
OBJECTIVES: We created an algorithm for automated Sequential Organ Failure Assessment (SOFA) score calculation within the Electronic Health Record (EHR) to facilitate detection of sepsis based on the Third International Consensus Definitions for Sepsis and Septic Shock (SEPSIS-3) clinical definition. We evaluated the accuracy of near real-time and daily automated SOFA score calculation compared with manual score calculation. METHODS: Automated SOFA scoring computer programs were developed using available EHR data sources and integrated into a critical care focused patient care dashboard at Mayo Clinic in Rochester, Minnesota. We prospectively compared the accuracy of automated versus manual calculation for a sample of patients admitted to the medical intensive care unit at Mayo Clinic Hospitals in Rochester, Minnesota and Jacksonville, Florida. Agreement was calculated with Cohen's kappa statistic. Reason for discrepancy was tabulated during manual review. RESULTS: Random spot check comparisons were performed 134 times on 27 unique patients, and daily SOFA score comparisons were performed for 215 patients over a total of 1206 patient days. Agreement between automatically scored and manually scored SOFA components for both random spot checks (696 pairs, κ=0.89) and daily calculation (5972 pairs, κ=0.89) was high. The most common discrepancies were in the respiratory component (inaccurate fraction of inspired oxygen retrieval; 200/1206) and creatinine (normal creatinine in patients with no urine output on dialysis; 128/1094). 147 patients were at risk of developing sepsis after intensive care unit admission, 10 later developed sepsis confirmed by chart review. All were identified before onset of sepsis with the ΔSOFA≥2 point criterion and 46 patients were false-positives. CONCLUSIONS: Near real-time automated SOFA scoring was found to have strong agreement with manual score calculation and may be useful for the detection of sepsis utilizing the new SEPSIS-3 definition.
Authors: Yub Raj Sedhai; Mengdan Yuan; Scott W Ketcham; Ivan Co; Dru D Claar; Jakob I McSparron; Hallie C Prescott; Michael W Sjoding Journal: Ann Am Thorac Soc Date: 2021-07
Authors: Luis E Huerta; Jonathan P Wanderer; Jesse M Ehrenfeld; Robert E Freundlich; Todd W Rice; Matthew W Semler Journal: J Med Syst Date: 2018-09-14 Impact factor: 4.460
Authors: Edward J Schenck; Katherine L Hoffman; Clara Oromendia; Elizabeth Sanchez; Eli J Finkelsztein; Kyung Sook Hong; Joseph Kabariti; Lisa K Torres; John S Harrington; Ilias I Siempos; Augustine M K Choi; Thomas R Campion Journal: Ann Am Thorac Soc Date: 2021-11
Authors: Samuel A P Short; Shruti Gupta; Samantha K Brenner; Salim S Hayek; Anand Srivastava; Shahzad Shaefi; Harkarandeep Singh; Benjamin Wu; Aranya Bagchi; Hanny Al-Samkari; Rajany Dy; Katherine Wilkinson; Neil A Zakai; David E Leaf Journal: Crit Care Med Date: 2021-05-01 Impact factor: 7.598
Authors: Jacob C Jentzer; Courtney Bennett; Brandon M Wiley; Dennis H Murphree; Mark T Keegan; Ognjen Gajic; R Scott Wright; Gregory W Barsness Journal: J Am Heart Assoc Date: 2018-03-10 Impact factor: 5.501
Authors: John Karlsson Valik; Logan Ward; Hideyuki Tanushi; Kajsa Müllersdorf; Anders Ternhag; Ewa Aufwerber; Anna Färnert; Anders F Johansson; Mads Lause Mogensen; Brian Pickering; Hercules Dalianis; Aron Henriksson; Vitaly Herasevich; Pontus Nauclér Journal: BMJ Qual Saf Date: 2020-02-06 Impact factor: 7.035
Authors: Saraschandra Vallabhajosyula; Jacob C Jentzer; Aditya A Kotecha; Dennis H Murphree; Erin F Barreto; Ashish K Khanna; Vivek N Iyer Journal: Ann Intensive Care Date: 2018-11-22 Impact factor: 6.925
Authors: Benjamin Brueske; Mandeep S Sidhu; Joshua Schulman-Marcus; Kianoush B Kashani; Gregory W Barsness; Jacob C Jentzer Journal: J Am Heart Assoc Date: 2019-04-02 Impact factor: 5.501
Authors: Shruti Gupta; Wei Wang; Salim S Hayek; Lili Chan; Kusum S Mathews; Michal L Melamed; Samantha K Brenner; Amanda Leonberg-Yoo; Edward J Schenck; Jared Radbel; Jochen Reiser; Anip Bansal; Anand Srivastava; Yan Zhou; Diana Finkel; Adam Green; Mary Mallappallil; Anthony J Faugno; Jingjing Zhang; Juan Carlos Q Velez; Shahzad Shaefi; Chirag R Parikh; David M Charytan; Ambarish M Athavale; Allon N Friedman; Roberta E Redfern; Samuel A P Short; Simon Correa; Kapil K Pokharel; Andrew J Admon; John P Donnelly; Hayley B Gershengorn; David J Douin; Matthew W Semler; Miguel A Hernán; David E Leaf Journal: JAMA Intern Med Date: 2021-01-01 Impact factor: 21.873