Sean Barnes1, Eric Hamrock2, Matthew Toerper3, Sauleh Siddiqui4, Scott Levin5. 1. Department of Decision, Operations & Information Technologies, Robert H. Smith School of Business, 4352 Van Munching Hall, University of Maryland, College Park, MD 20742, USA sbarnes@rhsmith.umd.edu. 2. Department of Operations Integration, Johns Hopkins Health System, Baltimore, MD, USA. 3. Department of Emergency Medicine, Johns Hopkins Hospital, Baltimore, MD, USA. 4. Departments of Civil Engineering and Applied Mathematics & Statistics, Johns Hopkins Systems Institute, Johns Hopkins University, Baltimore, MD, USA. 5. Department of Emergency Medicine and Civil Engineering, Johns Hopkins Systems Institute, Johns Hopkins University, Baltimore, MD, USA.
Abstract
OBJECTIVE: Hospitals are challenged to provide timely patient care while maintaining high resource utilization. This has prompted hospital initiatives to increase patient flow and minimize nonvalue added care time. Real-time demand capacity management (RTDC) is one such initiative whereby clinicians convene each morning to predict patients able to leave the same day and prioritize their remaining tasks for early discharge. Our objective is to automate and improve these discharge predictions by applying supervised machine learning methods to readily available health information. MATERIALS AND METHODS: The authors use supervised machine learning methods to predict patients' likelihood of discharge by 2 p.m. and by midnight each day for an inpatient medical unit. Using data collected over 8000 patient stays and 20 000 patient days, the predictive performance of the model is compared to clinicians using sensitivity, specificity, Youden's Index (i.e., sensitivity + specificity - 1), and aggregate accuracy measures. RESULTS: The model compared to clinician predictions demonstrated significantly higher sensitivity (P < .01), lower specificity (P < .01), and a comparable Youden Index (P > .10). Early discharges were less predictable than midnight discharges. The model was more accurate than clinicians in predicting the total number of daily discharges and capable of ranking patients closest to future discharge. CONCLUSIONS: There is potential to use readily available health information to predict daily patient discharges with accuracies comparable to clinician predictions. This approach may be used to automate and support daily RTDC predictions aimed at improving patient flow.
OBJECTIVE: Hospitals are challenged to provide timely patient care while maintaining high resource utilization. This has prompted hospital initiatives to increase patient flow and minimize nonvalue added care time. Real-time demand capacity management (RTDC) is one such initiative whereby clinicians convene each morning to predict patients able to leave the same day and prioritize their remaining tasks for early discharge. Our objective is to automate and improve these discharge predictions by applying supervised machine learning methods to readily available health information. MATERIALS AND METHODS: The authors use supervised machine learning methods to predict patients' likelihood of discharge by 2 p.m. and by midnight each day for an inpatient medical unit. Using data collected over 8000 patient stays and 20 000 patient days, the predictive performance of the model is compared to clinicians using sensitivity, specificity, Youden's Index (i.e., sensitivity + specificity - 1), and aggregate accuracy measures. RESULTS: The model compared to clinician predictions demonstrated significantly higher sensitivity (P < .01), lower specificity (P < .01), and a comparable Youden Index (P > .10). Early discharges were less predictable than midnight discharges. The model was more accurate than clinicians in predicting the total number of daily discharges and capable of ranking patients closest to future discharge. CONCLUSIONS: There is potential to use readily available health information to predict daily patient discharges with accuracies comparable to clinician predictions. This approach may be used to automate and support daily RTDC predictions aimed at improving patient flow.
Authors: Nathan R Hoot; Larry J Leblanc; Ian Jones; Scott R Levin; Chuan Zhou; Cynthia S Gadd; Dominik Aronsky Journal: J Am Med Inform Assoc Date: 2009-03-04 Impact factor: 4.497
Authors: Ray Lucas; Heather Farley; Joseph Twanmoh; Andrej Urumov; Nils Olsen; Bruce Evans; Hamed Kabiri Journal: Acad Emerg Med Date: 2009-07 Impact factor: 3.451
Authors: Melissa L McCarthy; Scott L Zeger; Ru Ding; Dominik Aronsky; Nathan R Hoot; Gabor D Kelen Journal: Acad Emerg Med Date: 2008-04 Impact factor: 3.451
Authors: Donald B Chalfin; Stephen Trzeciak; Antonios Likourezos; Brigitte M Baumann; R Phillip Dellinger Journal: Crit Care Med Date: 2007-06 Impact factor: 7.598
Authors: Diego A Martinez; Erin M Kane; Mehdi Jalalpour; James Scheulen; Hetal Rupani; Rohit Toteja; Charles Barbara; Bree Bush; Scott R Levin Journal: J Med Syst Date: 2018-06-18 Impact factor: 4.460
Authors: Catherine Lee; Brian L Lawson; Ariana J Mann; Vincent X Liu; Laura C Myers; Alejandro Schuler; Gabriel J Escobar Journal: J Am Med Inform Assoc Date: 2022-05-11 Impact factor: 7.942
Authors: Christopher Nielson; Martin G Seneviratne; Joseph R Ledsam; Shakir Mohamed; Nenad Tomašev; Natalie Harris; Sebastien Baur; Anne Mottram; Xavier Glorot; Jack W Rae; Michal Zielinski; Harry Askham; Andre Saraiva; Valerio Magliulo; Clemens Meyer; Suman Ravuri; Ivan Protsyuk; Alistair Connell; Cían O Hughes; Alan Karthikesalingam; Julien Cornebise; Hugh Montgomery; Geraint Rees; Chris Laing; Clifton R Baker; Thomas F Osborne; Ruth Reeves; Demis Hassabis; Dominic King; Mustafa Suleyman; Trevor Back Journal: Nat Protoc Date: 2021-05-05 Impact factor: 13.491
Authors: Dominic Jones; Allan Cameron; David J Lowe; Suzanne M Mason; Colin A O'Keeffe; Eilidh Logan Journal: BMJ Open Date: 2019-08-10 Impact factor: 2.692
Authors: Chimdimma Noelyn Onah; Richard Allmendinger; Julia Handl; Ken W Dunn Journal: Int J Environ Res Public Health Date: 2021-01-18 Impact factor: 3.390
Authors: Kyan C Safavi; Taghi Khaniyev; Martin Copenhaver; Mark Seelen; Ana Cecilia Zenteno Langle; Jonathan Zanger; Bethany Daily; Retsef Levi; Peter Dunn Journal: JAMA Netw Open Date: 2019-12-02