Michaela A C Vollmer1, Ben Glampson2, Thomas Mellan3, Swapnil Mishra3, Luca Mercuri2, Ceire Costello3, Robert Klaber2, Graham Cooke2, Seth Flaxman4, Samir Bhatt3,5. 1. MRC Centre for Global Infectious Disease Analysis, Department of Infectious Disease Epidemiology, Imperial College London, London, UK. m.vollmer@imperial.ac.uk. 2. Imperial College Healthcare NHS Trust, London, UK. 3. MRC Centre for Global Infectious Disease Analysis, Department of Infectious Disease Epidemiology, Imperial College London, London, UK. 4. Department of Mathematics and Data Science Institute, Imperial College London, London, UK. 5. Big Data Institute, Nuffield Department of Medicine, University of Oxford, Oxford, UK.
Abstract
BACKGROUND: There were 25.6 million attendances at Emergency Departments (EDs) in England in 2019 corresponding to an increase of 12 million attendances over the past ten years. The steadily rising demand at EDs creates a constant challenge to provide adequate quality of care while maintaining standards and productivity. Managing hospital demand effectively requires an adequate knowledge of the future rate of admission. We develop a novel predictive framework to understand the temporal dynamics of hospital demand. METHODS: We compare and combine state-of-the-art forecasting methods to predict hospital demand 1, 3 or 7 days into the future. In particular, our analysis compares machine learning algorithms to more traditional linear models as measured in a mean absolute error (MAE) and we consider two different hyperparameter tuning methods, enabling a faster deployment of our models without compromising performance. We believe our framework can readily be used to forecast a wide range of policy relevant indicators. RESULTS: We find that linear models often outperform machine learning methods and that the quality of our predictions for any of the forecasting horizons of 1, 3 or 7 days are comparable as measured in MAE. Our approach is able to predict attendances at these emergency departments one day in advance up to a mean absolute error of ±14 and ±10 patients corresponding to a mean absolute percentage error of 6.8% and 8.6% respectively. CONCLUSIONS: Simple linear methods like generalized linear models are often better or at least as good as ensemble learning methods like the gradient boosting or random forest algorithm. However, though sophisticated machine learning methods are not necessarily better than linear models, they improve the diversity of model predictions so that stacked predictions can be more robust than any single model including the best performing one.
BACKGROUND: There were 25.6 million attendances at Emergency Departments (EDs) in England in 2019 corresponding to an increase of 12 million attendances over the past ten years. The steadily rising demand at EDs creates a constant challenge to provide adequate quality of care while maintaining standards and productivity. Managing hospital demand effectively requires an adequate knowledge of the future rate of admission. We develop a novel predictive framework to understand the temporal dynamics of hospital demand. METHODS: We compare and combine state-of-the-art forecasting methods to predict hospital demand 1, 3 or 7 days into the future. In particular, our analysis compares machine learning algorithms to more traditional linear models as measured in a mean absolute error (MAE) and we consider two different hyperparameter tuning methods, enabling a faster deployment of our models without compromising performance. We believe our framework can readily be used to forecast a wide range of policy relevant indicators. RESULTS: We find that linear models often outperform machine learning methods and that the quality of our predictions for any of the forecasting horizons of 1, 3 or 7 days are comparable as measured in MAE. Our approach is able to predict attendances at these emergency departments one day in advance up to a mean absolute error of ±14 and ±10 patients corresponding to a mean absolute percentage error of 6.8% and 8.6% respectively. CONCLUSIONS: Simple linear methods like generalized linear models are often better or at least as good as ensemble learning methods like the gradient boosting or random forest algorithm. However, though sophisticated machine learning methods are not necessarily better than linear models, they improve the diversity of model predictions so that stacked predictions can be more robust than any single model including the best performing one.
Entities:
Keywords:
Emergency department demand; Ensemble predictions; Machine learning; Time series analysis
Authors: Robert Champion; Leigh D Kinsman; Geraldine A Lee; Kevin A Masman; Elizabeth A May; Terence M Mills; Michael D Taylor; Paulett R Thomas; Ruth J Williams Journal: Aust Health Rev Date: 2007-02 Impact factor: 1.990
Authors: Spencer S Jones; Alun Thomas; R Scott Evans; Shari J Welch; Peter J Haug; Gregory L Snow Journal: Acad Emerg Med Date: 2008-02 Impact factor: 3.451
Authors: Nathan R Hoot; Larry J LeBlanc; Ian Jones; Scott R Levin; Chuan Zhou; Cynthia S Gadd; Dominik Aronsky Journal: Ann Emerg Med Date: 2008-04-03 Impact factor: 5.721
Authors: Samir Bhatt; Ewan Cameron; Seth R Flaxman; Daniel J Weiss; David L Smith; Peter W Gething Journal: J R Soc Interface Date: 2017-09 Impact factor: 4.118
Authors: Melissa L McCarthy; Scott L Zeger; Ru Ding; Dominik Aronsky; Nathan R Hoot; Gabor D Kelen Journal: Acad Emerg Med Date: 2008-04 Impact factor: 3.451
Authors: Jeremy Ginsberg; Matthew H Mohebbi; Rajan S Patel; Lynnette Brammer; Mark S Smolinski; Larry Brilliant Journal: Nature Date: 2009-02-19 Impact factor: 49.962
Authors: Sophie Meakin; Sam Abbott; Nikos Bosse; James Munday; Hugo Gruson; Joel Hellewell; Katharine Sherratt; Sebastian Funk Journal: BMC Med Date: 2022-02-21 Impact factor: 8.775
Authors: Sophie Meakin; Sam Abbott; Nikos Bosse; James Munday; Hugo Gruson; Joel Hellewell; Katherine Sherratt; Sebastian Funk Journal: medRxiv Date: 2022-01-19
Authors: Michaela A C Vollmer; Sreejith Radhakrishnan; Mara D Kont; Seth Flaxman; Samir Bhatt; Ceire Costelloe; Kate Honeyford; Paul Aylin; Graham Cooke; Julian Redhead; Alison Sanders; Helen Mangan; Peter J White; Neil Ferguson; Katharina Hauck; Shevanthi Nayagam; Pablo N Perez-Guzman Journal: BMC Health Serv Res Date: 2021-09-23 Impact factor: 2.655