Rachel J Bystritsky1, Alex Beltran2, Albert T Young3, Andrew Wong3, Xiao Hu2, Sarah B Doernberg1. 1. Department of Medicine, Infectious Diseases, University of California-San Francisco, San Francisco, California. 2. Department of Bioengineering, University of California-San Francisco, San Francisco, California. 3. School of Medicine, University of California-San Francisco, San Francisco, California.
Abstract
OBJECTIVE: A significant proportion of inpatient antimicrobial prescriptions are inappropriate. Post-prescription review with feedback has been shown to be an effective means of reducing inappropriate antimicrobial use. However, implementation is resource intensive. Our aim was to evaluate the performance of traditional statistical models and machine-learning models designed to predict which patients receiving broad-spectrum antibiotics require a stewardship intervention. METHODS: We performed a single-center retrospective cohort study of inpatients who received an antimicrobial tracked by the antimicrobial stewardship program. Data were extracted from the electronic medical record and were used to develop logistic regression and boosted-tree models to predict whether antibiotic therapy required stewardship intervention on any given day as compared to the criterion standard of note left by the antimicrobial stewardship team in the patient's chart. We measured the performance of these models using area under the receiver operating characteristic curves (AUROC), and we evaluated it using a hold-out validation cohort. RESULTS: Both the logistic regression and boosted-tree models demonstrated fair discriminatory power with AUROCs of 0.73 (95% confidence interval [CI], 0.69-0.77) and 0.75 (95% CI, 0.72-0.79), respectively (P = .07). Both models demonstrated good calibration. The number of patients that would need to be reviewed to identify 1 patient who required stewardship intervention was high for both models (41.7-45.5 for models tuned to a sensitivity of 85%). CONCLUSIONS: Complex models can be developed to predict which patients require a stewardship intervention. However, further work is required to develop models with adequate discriminatory power to be applicable to real-world antimicrobial stewardship practice.
OBJECTIVE: A significant proportion of inpatient antimicrobial prescriptions are inappropriate. Post-prescription review with feedback has been shown to be an effective means of reducing inappropriate antimicrobial use. However, implementation is resource intensive. Our aim was to evaluate the performance of traditional statistical models and machine-learning models designed to predict which patients receiving broad-spectrum antibiotics require a stewardship intervention. METHODS: We performed a single-center retrospective cohort study of inpatients who received an antimicrobial tracked by the antimicrobial stewardship program. Data were extracted from the electronic medical record and were used to develop logistic regression and boosted-tree models to predict whether antibiotic therapy required stewardship intervention on any given day as compared to the criterion standard of note left by the antimicrobial stewardship team in the patient's chart. We measured the performance of these models using area under the receiver operating characteristic curves (AUROC), and we evaluated it using a hold-out validation cohort. RESULTS: Both the logistic regression and boosted-tree models demonstrated fair discriminatory power with AUROCs of 0.73 (95% confidence interval [CI], 0.69-0.77) and 0.75 (95% CI, 0.72-0.79), respectively (P = .07). Both models demonstrated good calibration. The number of patients that would need to be reviewed to identify 1 patient who required stewardship intervention was high for both models (41.7-45.5 for models tuned to a sensitivity of 85%). CONCLUSIONS: Complex models can be developed to predict which patients require a stewardship intervention. However, further work is required to develop models with adequate discriminatory power to be applicable to real-world antimicrobial stewardship practice.
Authors: Katherine E Goodman; Emily L Heil; Kimberly C Claeys; Mary Banoub; Jacqueline T Bork Journal: Open Forum Infect Dis Date: 2022-06-10 Impact factor: 4.423
Authors: Essam M Abdelfattah; Pius S Ekong; Emmanuel Okello; Deniece R Williams; Betsy M Karle; Terry W Lehenbauer; Sharif S Aly Journal: Antibiotics (Basel) Date: 2022-01-27