I-Min Chiu1,2, Chi-Yung Cheng1,2, Wun-Huei Zeng2, Ying-Hsien Huang3, Chun-Hung Richard Lin2. 1. Department of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung 833, Taiwan. 2. Department of Computer Science and Engineering, National Sun Yat-Sen University, Kaohsiung 804, Taiwan. 3. Department of Pediatrics, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung 833, Taiwan.
Abstract
BACKGROUND: The aim of this study was to develop and evaluate a machine learning (ML) model to predict invasive bacterial infections (IBIs) in young febrile infants visiting the emergency department (ED). METHODS: This retrospective study was conducted in the EDs of three medical centers across Taiwan from 2011 to 2018. We included patients age in 0-60 days who were visiting the ED with clinical symptoms of fever. We developed three different ML algorithms, including logistic regression (LR), supportive vector machine (SVM), and extreme gradient boosting (XGboost), comparing their performance at predicting IBIs to a previous validated score system (IBI score). RESULTS: During the study period, 4211 patients were included, where 126 (3.1%) had IBI. A total of eight, five, and seven features were used in the LR, SVM, and XGboost through the feature selection process, respectively. The ML models can achieve a better AUROC value when predicting IBIs in young infants compared with the IBI score (LR: 0.85 vs. SVM: 0.84 vs. XGBoost: 0.85 vs. IBI score: 0.70, p-value < 0.001). Using a cost sensitive learning algorithm, all ML models showed better specificity in predicting IBIs at a 90% sensitivity level compared to an IBI score > 2 (LR: 0.59 vs. SVM: 0.60 vs. XGBoost: 0.57 vs. IBI score >2: 0.43, p-value < 0.001). CONCLUSIONS: All ML models developed in this study outperformed the traditional scoring system in stratifying low-risk febrile infants after the standardized sensitivity level.
BACKGROUND: The aim of this study was to develop and evaluate a machine learning (ML) model to predict invasive bacterial infections (IBIs) in young febrile infants visiting the emergency department (ED). METHODS: This retrospective study was conducted in the EDs of three medical centers across Taiwan from 2011 to 2018. We included patients age in 0-60 days who were visiting the ED with clinical symptoms of fever. We developed three different ML algorithms, including logistic regression (LR), supportive vector machine (SVM), and extreme gradient boosting (XGboost), comparing their performance at predicting IBIs to a previous validated score system (IBI score). RESULTS: During the study period, 4211 patients were included, where 126 (3.1%) had IBI. A total of eight, five, and seven features were used in the LR, SVM, and XGboost through the feature selection process, respectively. The ML models can achieve a better AUROC value when predicting IBIs in young infants compared with the IBI score (LR: 0.85 vs. SVM: 0.84 vs. XGBoost: 0.85 vs. IBI score: 0.70, p-value < 0.001). Using a cost sensitive learning algorithm, all ML models showed better specificity in predicting IBIs at a 90% sensitivity level compared to an IBI score > 2 (LR: 0.59 vs. SVM: 0.60 vs. XGBoost: 0.57 vs. IBI score >2: 0.43, p-value < 0.001). CONCLUSIONS: All ML models developed in this study outperformed the traditional scoring system in stratifying low-risk febrile infants after the standardized sensitivity level.
Authors: Alan R Schroeder; Mark W Shen; Eric A Biondi; Michael Bendel-Stenzel; Clifford N Chen; Jason French; Vivian Lee; Rianna C Evans; Karen E Jerardi; Matt Mischler; Kelly E Wood; Pearl W Chang; Heidi K Roman; Tara L Greenhow Journal: Arch Dis Child Date: 2015-07-15 Impact factor: 3.791
Authors: Paul L Aronson; Veronika Shabanova; Eugene D Shapiro; Marie E Wang; Lise E Nigrovic; Christopher M Pruitt; Adrienne G DePorre; Rianna C Leazer; Sanyukta Desai; Laura F Sartori; Richard D Marble; Sahar N Rooholamini; Russell J McCulloh; Christopher Woll; Fran Balamuth; Elizabeth R Alpern; Samir S Shah; Derek J Williams; Whitney L Browning; Nipam Shah; Mark I Neuman Journal: Pediatrics Date: 2019-06-05 Impact factor: 7.124
Authors: Alison W A Talbert; Michael Mwaniki; Salim Mwarumba; Charles R J C Newton; James A Berkley Journal: Pediatr Infect Dis J Date: 2010-10 Impact factor: 2.129
Authors: Roberto Velasco; Helvia Benito; Rebeca Mozún; Juan E Trujillo; Pedro A Merino; Santiago Mintegi; San Tiago Journal: Pediatr Infect Dis J Date: 2015-01 Impact factor: 2.129
Authors: R Andrew Taylor; Joseph R Pare; Arjun K Venkatesh; Hani Mowafi; Edward R Melnick; William Fleischman; M Kennedy Hall Journal: Acad Emerg Med Date: 2016-02-13 Impact factor: 3.451
Authors: Steven Horng; David A Sontag; Yoni Halpern; Yacine Jernite; Nathan I Shapiro; Larry A Nathanson Journal: PLoS One Date: 2017-04-06 Impact factor: 3.240