Su Min Seo1, Ihn Sook Jeong2. 1. Infection Control Unit, Dongeui Medical Center, Busan, Korea. 2. College of Nursing, Pusan National University, Yangsan, Korea. jeongis@pusan.ac.kr.
Abstract
PURPOSE: This study was aimed to evaluate the external validity of a carbapenem-resistant Enterobacteriaceae (CRE) acquisition risk prediction model (the CREP-model) in a medium-sized hospital. METHODS: This retrospective cohort study included 613 patients (CRE group: 69, no-CRE group: 544) admitted to the intensive care units of a 453-beds secondary referral general hospital from March 1, 2017 to September 30, 2019 in South Korea. The performance of the CREP-model was analyzed with calibration, discrimination, and clinical usefulness. RESULTS: The results showed that those higher in age had lower presence of multidrug resistant organisms (MDROs), cephalosporin use ≥ 15 days, Acute Physiology and Chronic Health Evaluation II (APACHE II) score ≥ 21 points, and lower CRE acquisition rates than those of CREP-model development subjects. The calibration-in-the-large was 0.12 (95% CI: - 0.16~0.39), while the calibration slope was 0.87 (95% CI: 0.63~1.12), and the concordance statistic was .71 (95% CI: .63~.78). At the predicted risk of .10, the sensitivity, specificity, and correct classification rates were 43.5%, 84.2%, and 79.6%, respectively. The net true positive according to the CREP-model were 3 per 100 subjects. After adjusting the predictors' cutting points, the concordance statistic increased to .84 (95% CI: .79~.89), and the sensitivity and net true positive was improved to 75.4%. and 6 per 100 subjects, respectively. CONCLUSION: The CREP-model's discrimination and clinical usefulness are low in a medium sized general hospital but are improved after adjusting for the predictors. Therefore, we suggest that institutions should only use the CREP-model after assessing the distribution of the predictors and adjusting their cutting points.
PURPOSE: This study was aimed to evaluate the external validity of a carbapenem-resistant Enterobacteriaceae (CRE) acquisition risk prediction model (the CREP-model) in a medium-sized hospital. METHODS: This retrospective cohort study included 613 patients (CRE group: 69, no-CRE group: 544) admitted to the intensive care units of a 453-beds secondary referral general hospital from March 1, 2017 to September 30, 2019 in South Korea. The performance of the CREP-model was analyzed with calibration, discrimination, and clinical usefulness. RESULTS: The results showed that those higher in age had lower presence of multidrug resistant organisms (MDROs), cephalosporin use ≥ 15 days, Acute Physiology and Chronic Health Evaluation II (APACHE II) score ≥ 21 points, and lower CRE acquisition rates than those of CREP-model development subjects. The calibration-in-the-large was 0.12 (95% CI: - 0.16~0.39), while the calibration slope was 0.87 (95% CI: 0.63~1.12), and the concordance statistic was .71 (95% CI: .63~.78). At the predicted risk of .10, the sensitivity, specificity, and correct classification rates were 43.5%, 84.2%, and 79.6%, respectively. The net true positive according to the CREP-model were 3 per 100 subjects. After adjusting the predictors' cutting points, the concordance statistic increased to .84 (95% CI: .79~.89), and the sensitivity and net true positive was improved to 75.4%. and 6 per 100 subjects, respectively. CONCLUSION: The CREP-model's discrimination and clinical usefulness are low in a medium sized general hospital but are improved after adjusting for the predictors. Therefore, we suggest that institutions should only use the CREP-model after assessing the distribution of the predictors and adjusting their cutting points.
Authors: Thomas P A Debray; Yvonne Vergouwe; Hendrik Koffijberg; Daan Nieboer; Ewout W Steyerberg; Karel G M Moons Journal: J Clin Epidemiol Date: 2014-08-30 Impact factor: 6.437
Authors: S E Bleeker; H A Moll; E W Steyerberg; A R T Donders; G Derksen-Lubsen; D E Grobbee; K G M Moons Journal: J Clin Epidemiol Date: 2003-09 Impact factor: 6.437