OBJECTIVE: Mental or substance use disorders (M/SUD) are major contributors of disease burden with high risk for hospital readmissions. We sought to develop and evaluate a readmission model using a machine learning (ML) approach. METHODS: We analyzed patients with continuous enrollment for three years and at least one episode of M/SUD as the primary reason for hospital admission. The outcome was readmission within 30-days from discharge. Model performance was evaluated using the Area under the Receiver Operating Characteristic (AUROC). We compared the AUROCs of an extreme gradient boosted tree (XGBoost) model to generalized linear model with elastic net regularization (GLMNet). RESULTS: We analyzed 65,426 unique patients and 97,688 admissions. Patients with mental disorders accounted for 66 % (13.2 % readmission rate) and substance use disorders, 34 % (22.3 % readmission rate). Among all those who had readmissions, 70.7 %, 17.0 %, and 12.4 % had 1, 2, or 3+ readmissions, respectively. Previous hospitalizations, hospital utilization, discharge disposition, diagnosis category, and comorbidity were among the highest important features in the XGBoost model. The XGBoost model AUROC was 0.737 (95 % CI: 0.732 to 0.742) versus the GLMNet 0.697 (95 % CI: 0.690 to 0.703). The AUROC of the final XGBoost model on the testing set was 0.738 (95 % CI: 0.730 to 0.748), higher than published readmission models for mental health patients. CONCLUSIONS: The XGBoost model has a better performance than GLMNet and previously published models in predicting readmissions in mental health patients. Our model may be further tested to aid targeted demographic initiatives to reduce M/SUDs readmissions and benchmarking.
OBJECTIVE: Mental or substance use disorders (M/SUD) are major contributors of disease burden with high risk for hospital readmissions. We sought to develop and evaluate a readmission model using a machine learning (ML) approach. METHODS: We analyzed patients with continuous enrollment for three years and at least one episode of M/SUD as the primary reason for hospital admission. The outcome was readmission within 30-days from discharge. Model performance was evaluated using the Area under the Receiver Operating Characteristic (AUROC). We compared the AUROCs of an extreme gradient boosted tree (XGBoost) model to generalized linear model with elastic net regularization (GLMNet). RESULTS: We analyzed 65,426 unique patients and 97,688 admissions. Patients with mental disorders accounted for 66 % (13.2 % readmission rate) and substance use disorders, 34 % (22.3 % readmission rate). Among all those who had readmissions, 70.7 %, 17.0 %, and 12.4 % had 1, 2, or 3+ readmissions, respectively. Previous hospitalizations, hospital utilization, discharge disposition, diagnosis category, and comorbidity were among the highest important features in the XGBoost model. The XGBoost model AUROC was 0.737 (95 % CI: 0.732 to 0.742) versus the GLMNet 0.697 (95 % CI: 0.690 to 0.703). The AUROC of the final XGBoost model on the testing set was 0.738 (95 % CI: 0.730 to 0.748), higher than published readmission models for mental health patients. CONCLUSIONS: The XGBoost model has a better performance than GLMNet and previously published models in predicting readmissions in mental health patients. Our model may be further tested to aid targeted demographic initiatives to reduce M/SUDs readmissions and benchmarking.
Authors: Ozge Yasar; Patrick Long; Brett Harder; Hanna Marshall; Sanjay Bhasin; Suyin Lee; Mark Delegge; Stephanie Roy; Orla Doyle; Nadea Leavitt; John Rigg Journal: BMJ Health Care Inform Date: 2022-03