Antje Wulff1, Sara Montag2, Nicole Rübsamen3, Friederike Dziuba4, Michael Marschollek5, Philipp Beerbaum4, André Karch3, Thomas Jack4. 1. Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Karl-Wiechert-Allee 3, 30625, Hannover, Germany. antje.wulff@plri.de. 2. Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Karl-Wiechert-Allee 3, 30625, Hannover, Germany. sara.montag@elisabethgruppe.de. 3. Institute of Epidemiology and Social Medicine, University of Muenster, Domagkstr. 3, 48149, Muenster, Germany. 4. Department of Pediatric Cardiology and Intensive Care Medicine, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany. 5. Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Karl-Wiechert-Allee 3, 30625, Hannover, Germany.
Abstract
BACKGROUND: Systemic inflammatory response syndrome (SIRS) is defined as a non-specific inflammatory process in the absence of infection. SIRS increases susceptibility for organ dysfunction, and frequently affects the clinical outcome of affected patients. We evaluated a knowledge-based, interoperable clinical decision-support system (CDSS) for SIRS detection on a pediatric intensive care unit (PICU). METHODS: The CDSS developed retrieves routine data, previously transformed into an interoperable format, by using model-based queries and guideline- and knowledge-based rules. We evaluated the CDSS in a prospective diagnostic study from 08/2018-03/2019. 168 patients from a pediatric intensive care unit of a tertiary university hospital, aged 0 to 18 years, were assessed for SIRS by the CDSS and by physicians during clinical routine. Sensitivity and specificity (when compared to the reference standard) with 95% Wald confidence intervals (CI) were estimated on the level of patients and patient-days. RESULTS: Sensitivity and specificity was 91.7% (95% CI 85.5-95.4%) and 54.1% (95% CI 45.4-62.5%) on patient level, and 97.5% (95% CI 95.1-98.7%) and 91.5% (95% CI 89.3-93.3%) on the level of patient-days. Physicians' SIRS recognition during clinical routine was considerably less accurate (sensitivity of 62.0% (95% CI 56.8-66.9%)/specificity of 83.3% (95% CI 80.4-85.9%)) when measurd on the level of patient-days. Evaluation revealed valuable insights for the general design of the CDSS as well as specific rule modifications. Despite a lower than expected specificity, diagnostic accuracy was higher than the one in daily routine ratings, thus, demonstrating high potentials of using our CDSS to help to detect SIRS in clinical routine. CONCLUSIONS: We successfully evaluated an interoperable CDSS for SIRS detection in PICU. Our study demonstrated the general feasibility and potentials of the implemented algorithms but also some limitations. In the next step, the CDSS will be optimized to overcome these limitations and will be evaluated in a multi-center study. TRIAL REGISTRATION: NCT03661450 (ClinicalTrials.gov); registered September 7, 2018.
BACKGROUND: Systemic inflammatory response syndrome (SIRS) is defined as a non-specific inflammatory process in the absence of infection. SIRS increases susceptibility for organ dysfunction, and frequently affects the clinical outcome of affected patients. We evaluated a knowledge-based, interoperable clinical decision-support system (CDSS) for SIRS detection on a pediatric intensive care unit (PICU). METHODS: The CDSS developed retrieves routine data, previously transformed into an interoperable format, by using model-based queries and guideline- and knowledge-based rules. We evaluated the CDSS in a prospective diagnostic study from 08/2018-03/2019. 168 patients from a pediatric intensive care unit of a tertiary university hospital, aged 0 to 18 years, were assessed for SIRS by the CDSS and by physicians during clinical routine. Sensitivity and specificity (when compared to the reference standard) with 95% Wald confidence intervals (CI) were estimated on the level of patients and patient-days. RESULTS: Sensitivity and specificity was 91.7% (95% CI 85.5-95.4%) and 54.1% (95% CI 45.4-62.5%) on patient level, and 97.5% (95% CI 95.1-98.7%) and 91.5% (95% CI 89.3-93.3%) on the level of patient-days. Physicians' SIRS recognition during clinical routine was considerably less accurate (sensitivity of 62.0% (95% CI 56.8-66.9%)/specificity of 83.3% (95% CI 80.4-85.9%)) when measurd on the level of patient-days. Evaluation revealed valuable insights for the general design of the CDSS as well as specific rule modifications. Despite a lower than expected specificity, diagnostic accuracy was higher than the one in daily routine ratings, thus, demonstrating high potentials of using our CDSS to help to detect SIRS in clinical routine. CONCLUSIONS: We successfully evaluated an interoperable CDSS for SIRS detection in PICU. Our study demonstrated the general feasibility and potentials of the implemented algorithms but also some limitations. In the next step, the CDSS will be optimized to overcome these limitations and will be evaluated in a multi-center study. TRIAL REGISTRATION: NCT03661450 (ClinicalTrials.gov); registered September 7, 2018.
Entities:
Keywords:
Clinical decision support systems; Diagnostic study; Pediatric intensive care units; Systemic inflammatory response syndrome
Authors: Manu Shankar-Hari; Gary S Phillips; Mitchell L Levy; Christopher W Seymour; Vincent X Liu; Clifford S Deutschman; Derek C Angus; Gordon D Rubenfeld; Mervyn Singer Journal: JAMA Date: 2016-02-23 Impact factor: 56.272
Authors: Martin Boehne; Michael Sasse; André Karch; Friederike Dziuba; Alexander Horke; Torsten Kaussen; Rafael Mikolajczyk; Philipp Beerbaum; Thomas Jack Journal: J Card Surg Date: 2016-12-07 Impact factor: 1.620
Authors: Niranjan Kissoon; Konrad Reinhart; Ron Daniels; Machado Flavia R Machado; Raymond D Schachter; Simon Finfer Journal: Pediatr Crit Care Med Date: 2017-12 Impact factor: 3.624
Authors: Carolin Fleischmann-Struzek; David M Goldfarb; Peter Schlattmann; Luregn J Schlapbach; Konrad Reinhart; Niranjan Kissoon Journal: Lancet Respir Med Date: 2018-03 Impact factor: 30.700
Authors: Paul Sabharwal; Jillian H Hurst; Rohit Tejwani; Kevin T Hobbs; Jonathan C Routh; Benjamin A Goldstein Journal: BMC Med Inform Decis Mak Date: 2022-03-29 Impact factor: 2.796