Jonathan Rubin1, Cristhian Potes2, Minnan Xu-Wilson2, Junzi Dong2, Asif Rahman2, Hiep Nguyen3, David Moromisato3. 1. Philips Research North America, Cambridge, MA, United States. Electronic address: Jonathan.Rubin@philips.com. 2. Philips Research North America, Cambridge, MA, United States. 3. Cardon Children's Medical Center, Banner Health System, Mesa, AZ, United States.
Abstract
BACKGROUND: Early deterioration indicators have the potential to alert hospital care staff in advance of adverse events, such as patients requiring an increased level of care, or the need for rapid response teams to be called. Our work focuses on the problem of predicting the transfer of pediatric patients from the general ward of a hospital to the pediatric intensive care unit. OBJECTIVES: The development of a data-driven pediatric early deterioration indicator for use by clinicians with the purpose of predicting encounters where transfer from the general ward to the PICU is likely. METHODS: Using data collected over 5.5 years from the electronic health records of two medical facilities, we develop machine learning classifiers based on adaptive boosting and gradient tree boosting. We further combine these learned classifiers into an ensemble model and compare its performance to a modified pediatric early warning score (PEWS) baseline that relies on expert defined guidelines. To gauge model generalizability, we perform an inter-facility evaluation where we train our algorithm on data from one facility and perform evaluation on a hidden test dataset from a separate facility. RESULTS: We show that improvements are witnessed over the modified PEWS baseline in accuracy (0.77 vs. 0.69), sensitivity (0.80 vs. 0.68), specificity (0.74 vs. 0.70) and AUROC (0.85 vs. 0.73). CONCLUSIONS: Data-driven, machine learning algorithms can improve PICU transfer prediction accuracy compared to expertly defined systems, such as a modified PEWS, but care must be taken in the training of such approaches to avoid inadvertently introducing bias into the outcomes of these systems.
BACKGROUND: Early deterioration indicators have the potential to alert hospital care staff in advance of adverse events, such as patients requiring an increased level of care, or the need for rapid response teams to be called. Our work focuses on the problem of predicting the transfer of pediatric patients from the general ward of a hospital to the pediatric intensive care unit. OBJECTIVES: The development of a data-driven pediatric early deterioration indicator for use by clinicians with the purpose of predicting encounters where transfer from the general ward to the PICU is likely. METHODS: Using data collected over 5.5 years from the electronic health records of two medical facilities, we develop machine learning classifiers based on adaptive boosting and gradient tree boosting. We further combine these learned classifiers into an ensemble model and compare its performance to a modified pediatric early warning score (PEWS) baseline that relies on expert defined guidelines. To gauge model generalizability, we perform an inter-facility evaluation where we train our algorithm on data from one facility and perform evaluation on a hidden test dataset from a separate facility. RESULTS: We show that improvements are witnessed over the modified PEWS baseline in accuracy (0.77 vs. 0.69), sensitivity (0.80 vs. 0.68), specificity (0.74 vs. 0.70) and AUROC (0.85 vs. 0.73). CONCLUSIONS: Data-driven, machine learning algorithms can improve PICU transfer prediction accuracy compared to expertly defined systems, such as a modified PEWS, but care must be taken in the training of such approaches to avoid inadvertently introducing bias into the outcomes of these systems.
Authors: Anoop Mayampurath; L Nelson Sanchez-Pinto; Emma Hegermiller; Amarachi Erondu; Kyle Carey; Priti Jani; Robert Gibbons; Dana Edelson; Matthew M Churpek Journal: Pediatr Crit Care Med Date: 2022-04-21 Impact factor: 3.971
Authors: Santiago Romero-Brufau; Daniel Whitford; Matthew G Johnson; Joel Hickman; Bruce W Morlan; Terry Therneau; James Naessens; Jeanne M Huddleston Journal: J Am Med Inform Assoc Date: 2021-06-12 Impact factor: 4.497
Authors: Jessica M Schwartz; Amanda J Moy; Sarah C Rossetti; Noémie Elhadad; Kenrick D Cato Journal: J Am Med Inform Assoc Date: 2021-03-01 Impact factor: 4.497
Authors: Tyler J Gorham; Steve Rust; Laura Rust; Stacy Kuehn; Jing Yang; James Shuhan Lin; Jeffrey Hoffman; Yungui Huang; Simon Lin; Richard McClead; Richard Brilli; Ryan Bode; Tensing Maa Journal: Pediatr Qual Saf Date: 2020-03-20
Authors: Arash Kia; Prem Timsina; Himanshu N Joshi; Eyal Klang; Rohit R Gupta; Robert M Freeman; David L Reich; Max S Tomlinson; Joel T Dudley; Roopa Kohli-Seth; Madhu Mazumdar; Matthew A Levin Journal: J Clin Med Date: 2020-01-27 Impact factor: 4.241
Authors: Anoop Mayampurath; Priti Jani; Yangyang Dai; Robert Gibbons; Dana Edelson; Matthew M Churpek Journal: Pediatr Crit Care Med Date: 2020-09 Impact factor: 3.971