Suzanne S Sullivan1, Sharon Hewner, Varun Chandola, Bonnie L Westra. 1. Suzanne S. Sullivan, PhD, MBA, RN, CHPN, is Assistant Professor, University at Buffalo, New York. This study is part of her PhD dissertation research under the supervision of Sharon Hewner, PhD, RN, FAAN, at the University at Buffalo. Sharon Hewner, PhD, RN, FAAN, is Associate Professor, School of Nursing, University at Buffalo, New York. Varun Chandola, PhD, is Assistant Professor, Department of Computer Science and Engineering, University at Buffalo, New York. She was an official consultant and served on the dissertation committee of Suzanne Sullivan. Bonnie L. Westra, PhD, RN, FAAN, FACMI, is Associate Professor, School of Nursing, University of Minnesota, Minneapolis. She was an official sponsor and collaborator on this NINR F31-funded study.
Abstract
BACKGROUND: Newer analytic approaches for developing predictive models provide a method of creating decision support to translate findings into practice. OBJECTIVES: The aim of this study was to develop and validate a clinically interpretable predictive model for 12-month mortality risk among community-dwelling older adults. This is done by using routinely collected nursing assessment data to aide homecare nurses in identifying older adults who are at risk for decline, providing an opportunity to develop care plans that support patient and family goals for care. METHODS: A retrospective secondary analysis of Medicare and Medicaid data of 635,590 Outcome and Assessment Information Set (OASIS-C) start-of-care assessments from January 1, 2012, to December 31, 2012, was linked to the Master Beneficiary Summary File (2012-2013) for date of death. The decision tree was benchmarked against gold standards for predictive modeling, logistic regression, and artificial neural network (ANN). The models underwent k-fold cross-validation and were compared using area under the curve (AUC) and other data science metrics, including Matthews correlation coefficient (MCC). RESULTS: Decision tree variables associated with 12-month mortality risk included OASIS items: age, (M1034) overall status, (M1800-M1890) activities of daily living total score, cancer, frailty, (M1410) oxygen, and (M2020) oral medication management. The final models had good discrimination: decision tree, AUC = .71, 95% confidence interval (CI) [.705, .712], sensitivity = .73, specificity = .58, MCC = .31; ANN, AUC = .74, 95% CI [.74, .74], sensitivity = .68, specificity = .68, MCC = .35; and logistic regression, AUC = .74, 95% CI [.735, .742], sensitivity = .64, specificity = .70, MCC = .35. DISCUSSION: The AUC and 95% CI for the decision tree are slightly less accurate than logistic regression and ANN; however, the decision tree was more accurate in detecting mortality. The OASIS data set was useful to predict 12-month mortality risk. The decision tree is an interpretable predictive model developed from routinely collected nursing data that may be incorporated into a decision support tool to identify older adults at risk for death.
BACKGROUND: Newer analytic approaches for developing predictive models provide a method of creating decision support to translate findings into practice. OBJECTIVES: The aim of this study was to develop and validate a clinically interpretable predictive model for 12-month mortality risk among community-dwelling older adults. This is done by using routinely collected nursing assessment data to aide homecare nurses in identifying older adults who are at risk for decline, providing an opportunity to develop care plans that support patient and family goals for care. METHODS: A retrospective secondary analysis of Medicare and Medicaid data of 635,590 Outcome and Assessment Information Set (OASIS-C) start-of-care assessments from January 1, 2012, to December 31, 2012, was linked to the Master Beneficiary Summary File (2012-2013) for date of death. The decision tree was benchmarked against gold standards for predictive modeling, logistic regression, and artificial neural network (ANN). The models underwent k-fold cross-validation and were compared using area under the curve (AUC) and other data science metrics, including Matthews correlation coefficient (MCC). RESULTS: Decision tree variables associated with 12-month mortality risk included OASIS items: age, (M1034) overall status, (M1800-M1890) activities of daily living total score, cancer, frailty, (M1410) oxygen, and (M2020) oral medication management. The final models had good discrimination: decision tree, AUC = .71, 95% confidence interval (CI) [.705, .712], sensitivity = .73, specificity = .58, MCC = .31; ANN, AUC = .74, 95% CI [.74, .74], sensitivity = .68, specificity = .68, MCC = .35; and logistic regression, AUC = .74, 95% CI [.735, .742], sensitivity = .64, specificity = .70, MCC = .35. DISCUSSION: The AUC and 95% CI for the decision tree are slightly less accurate than logistic regression and ANN; however, the decision tree was more accurate in detecting mortality. The OASIS data set was useful to predict 12-month mortality risk. The decision tree is an interpretable predictive model developed from routinely collected nursing data that may be incorporated into a decision support tool to identify older adults at risk for death.
Authors: M Cardona-Morrell; Jch Kim; R M Turner; M Anstey; I A Mitchell; K Hillman Journal: Int J Qual Health Care Date: 2016-06-27 Impact factor: 2.038
Authors: Karen Bandeen-Roche; Christopher L Seplaki; Jin Huang; Brian Buta; Rita R Kalyani; Ravi Varadhan; Qian-Li Xue; Jeremy D Walston; Judith D Kasper Journal: J Gerontol A Biol Sci Med Sci Date: 2015-08-21 Impact factor: 6.053
Authors: Catherine L Auriemma; Christina A Nguyen; Rachel Bronheim; Saida Kent; Shrivatsa Nadiger; Dustin Pardo; Scott D Halpern Journal: JAMA Intern Med Date: 2014-07 Impact factor: 21.873
Authors: Wei Luo; Dinh Phung; Truyen Tran; Sunil Gupta; Santu Rana; Chandan Karmakar; Alistair Shilton; John Yearwood; Nevenka Dimitrova; Tu Bao Ho; Svetha Venkatesh; Michael Berk Journal: J Med Internet Res Date: 2016-12-16 Impact factor: 5.428