David S Lindberg1, Mattia Prosperi2, Ragnhildur I Bjarnadottir3, Jaime Thomas4, Marsha Crane4, Zhaoyi Chen5, Kristen Shear3, Laurence M Solberg6, Urszula Alina Snigurska3, Yonghui Wu5, Yunpeng Xia3, Robert J Lucero3. 1. Department of Statistics, College of Liberal Arts and Sciences, University of Florida, United States. Electronic address: dlindberg@ufl.edu. 2. Department of Epidemiology, College of Public Health and Health Professions and College of Medicine, University of Florida, United States. 3. Department of Family, Community, and Health Systems Science, College of Nursing, University of Florida, United States. 4. UF Health-Shands Hospital, United States. 5. Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, United States. 6. Department of Family, Community, and Health Systems Science, College of Nursing, University of Florida, United States; NF/SG VAHS, Geriatrics Research, Education, and Clinical Center (GRECC) Gainesville, Florida, United States.
Abstract
BACKGROUND: Inpatient falls, many resulting in injury or death, are a serious problem in hospital settings. Existing falls risk assessment tools, such as the Morse Fall Scale, give a risk score based on a set of factors, but don't necessarily signal which factors are most important for predicting falls. Artificial intelligence (AI) methods provide an opportunity to improve predictive performance while also identifying the most important risk factors associated with hospital-acquired falls. We can glean insight into these risk factors by applying classification tree, bagging, random forest, and adaptive boosting methods applied to Electronic Health Record (EHR) data. OBJECTIVE: The purpose of this study was to use tree-based machine learning methods to determine the most important predictors of inpatient falls, while also validating each via cross-validation. MATERIALS AND METHODS: A case-control study was designed using EHR and electronic administrative data collected between January 1, 2013 to October 31, 2013 in 14 medical surgical units. The data contained 38 predictor variables which comprised of patient characteristics, admission information, assessment information, clinical data, and organizational characteristics. Classification tree, bagging, random forest, and adaptive boosting methods were used to identify the most important factors of inpatient fall-risk through variable importance measures. Sensitivity, specificity, and area under the ROC curve were computed via ten-fold cross validation and compared via pairwise t-tests. These methods were also compared to a univariate logistic regression of the Morse Fall Scale total score. RESULTS: In terms of AUROC, bagging (0.89), random forest (0.90), and boosting (0.89) all outperformed the Morse Fall Scale (0.86) and the classification tree (0.85), but no differences were measured between bagging, random forest, and adaptive boosting, at a p-value of 0.05. History of Falls, Age, Morse Fall Scale total score, quality of gait, unit type, mental status, and number of high fall risk increasing drugs (FRIDs) were considered the most important features for predicting inpatient fall risk. CONCLUSIONS: Machine learning methods have the potential to identify the most relevant and novel factors for the detection of hospitalized patients at risk of falling, which would improve the quality of patient care, and to more fully support healthcare provider and organizational leadership decision-making. Nurses would be able to enhance their judgement to caring for patients at risk for falls. Our study may also serve as a reference for the development of AI-based prediction models of other iatrogenic conditions. To our knowledge, this is the first study to report the importance of patient, clinical, and organizational features based on the use of AI approaches.
BACKGROUND: Inpatient falls, many resulting in injury or death, are a serious problem in hospital settings. Existing falls risk assessment tools, such as the Morse Fall Scale, give a risk score based on a set of factors, but don't necessarily signal which factors are most important for predicting falls. Artificial intelligence (AI) methods provide an opportunity to improve predictive performance while also identifying the most important risk factors associated with hospital-acquired falls. We can glean insight into these risk factors by applying classification tree, bagging, random forest, and adaptive boosting methods applied to Electronic Health Record (EHR) data. OBJECTIVE: The purpose of this study was to use tree-based machine learning methods to determine the most important predictors of inpatient falls, while also validating each via cross-validation. MATERIALS AND METHODS: A case-control study was designed using EHR and electronic administrative data collected between January 1, 2013 to October 31, 2013 in 14 medical surgical units. The data contained 38 predictor variables which comprised of patient characteristics, admission information, assessment information, clinical data, and organizational characteristics. Classification tree, bagging, random forest, and adaptive boosting methods were used to identify the most important factors of inpatient fall-risk through variable importance measures. Sensitivity, specificity, and area under the ROC curve were computed via ten-fold cross validation and compared via pairwise t-tests. These methods were also compared to a univariate logistic regression of the Morse Fall Scale total score. RESULTS: In terms of AUROC, bagging (0.89), random forest (0.90), and boosting (0.89) all outperformed the Morse Fall Scale (0.86) and the classification tree (0.85), but no differences were measured between bagging, random forest, and adaptive boosting, at a p-value of 0.05. History of Falls, Age, Morse Fall Scale total score, quality of gait, unit type, mental status, and number of high fall risk increasing drugs (FRIDs) were considered the most important features for predicting inpatient fall risk. CONCLUSIONS: Machine learning methods have the potential to identify the most relevant and novel factors for the detection of hospitalized patients at risk of falling, which would improve the quality of patient care, and to more fully support healthcare provider and organizational leadership decision-making. Nurses would be able to enhance their judgement to caring for patients at risk for falls. Our study may also serve as a reference for the development of AI-based prediction models of other iatrogenic conditions. To our knowledge, this is the first study to report the importance of patient, clinical, and organizational features based on the use of AI approaches.
Authors: Brian J Douthit; Rachel L Walden; Kenrick Cato; Cynthia P Coviak; Christopher Cruz; Fabio D'Agostino; Thompson Forbes; Grace Gao; Theresa A Kapetanovic; Mikyoung A Lee; Lisiane Pruinelli; Mary A Schultz; Ann Wieben; Alvin D Jeffery Journal: Appl Clin Inform Date: 2022-02-09 Impact factor: 2.342
Authors: Maame Yaa A B Yiadom; Wu Gong; Brian W Patterson; Christopher W Baugh; Angela M Mills; Nicholas Gavin; Seth R Podolsky; Gilberto Salazar; Bryn E Mumma; Mary Tanski; Kelsea Hadley; Caitlin Azzo; Stephen C Dorner; Alexander Ulintz; Dandan Liu Journal: J Am Heart Assoc Date: 2022-05-02 Impact factor: 6.106
Authors: John L Jefferies; Alison K Spencer; Heather A Lau; Matthew W Nelson; Joseph D Giuliano; Joseph W Zabinski; Costas Boussios; Gary Curhan; Richard E Gliklich; David G Warnock Journal: Orphanet J Rare Dis Date: 2021-12-20 Impact factor: 4.123