Ravi Garg1, Shyam Prabhakaran1, Jane L Holl1, Yuan Luo2, Roland Faigle3, Konrad Kording4, Andrew M Naidech5. 1. Center for Healthcare Studies, Northwestern University, Chicago, Illinois. 2. Department of Preventive Medicine, Northwestern University, Chicago, Illinois. 3. Department of Neurology, Johns Hopkins University, Baltimore, Maryland. 4. Department of Neuroscience, University of Pennsylvania, Pennsylvania. 5. Center for Healthcare Studies, Northwestern University, Chicago, Illinois. Electronic address: a-naidech@northwestern.edu.
Abstract
BACKGROUND: Gastrostomy placement after intracerebral hemorrhage indicates the need for continued medical care and predicts patient dependence. Our objective was to determine the optimal machine learning technique to predict gastrostomy. METHODS: We included 531 patients in a derivation cohort and 189 patients from another institution for testing. We derived and tested predictions of the likelihood of gastrostomy placement with logistic regression using the GRAVo score (composed of Glasgow Coma Scale ≤12, age >50 years, black race, and hematoma volume >30 mL), compared to other machine learning techniques (kth nearest neighbor, support vector machines, random forests, extreme gradient boosting, gradient boosting machine, stacking). Receiver Operating Curves (Area Under the Curve, [AUC]) between logistic regression (the technique used in GRAVo score development) and other machine learning techniques were compared. Another institution provided an external test data set. RESULTS: In the external test data set, logistic regression using the GRAVo score components predicted gastrostomy (P < 0.001), however, with a lower AUC (0.66) than kth nearest neighbors (AUC 0.73), random forests (AUC 0.74), Gradient boosting machine (AUC 0.77), extreme gradient boosting (AUC 0.77), (P < 0.01 for all compared to logistic regression). Results from the internal test set were similar. CONCLUSIONS: Machine learning techniques other than logistic regression (eg, random forests, extreme gradient boost, and kth nearest neighbors) were significantly more accurate for predicting gastrostomy using the same independent variables. Machine learning techniques may assist clinicians in identifying patients likely to need interventions.
BACKGROUND: Gastrostomy placement after intracerebral hemorrhage indicates the need for continued medical care and predicts patient dependence. Our objective was to determine the optimal machine learning technique to predict gastrostomy. METHODS: We included 531 patients in a derivation cohort and 189 patients from another institution for testing. We derived and tested predictions of the likelihood of gastrostomy placement with logistic regression using the GRAVo score (composed of Glasgow Coma Scale ≤12, age >50 years, black race, and hematoma volume >30 mL), compared to other machine learning techniques (kth nearest neighbor, support vector machines, random forests, extreme gradient boosting, gradient boosting machine, stacking). Receiver Operating Curves (Area Under the Curve, [AUC]) between logistic regression (the technique used in GRAVo score development) and other machine learning techniques were compared. Another institution provided an external test data set. RESULTS: In the external test data set, logistic regression using the GRAVo score components predicted gastrostomy (P < 0.001), however, with a lower AUC (0.66) than kth nearest neighbors (AUC 0.73), random forests (AUC 0.74), Gradient boosting machine (AUC 0.77), extreme gradient boosting (AUC 0.77), (P < 0.01 for all compared to logistic regression). Results from the internal test set were similar. CONCLUSIONS: Machine learning techniques other than logistic regression (eg, random forests, extreme gradient boost, and kth nearest neighbors) were significantly more accurate for predicting gastrostomy using the same independent variables. Machine learning techniques may assist clinicians in identifying patients likely to need interventions.
Authors: Lewis B Morgenstern; J Claude Hemphill; Craig Anderson; Kyra Becker; Joseph P Broderick; E Sander Connolly; Steven M Greenberg; James N Huang; R Loch MacDonald; Steven R Messé; Pamela H Mitchell; Magdy Selim; Rafael J Tamargo Journal: Stroke Date: 2010-07-22 Impact factor: 7.914
Authors: Bharath Ambale-Venkatesh; Xiaoying Yang; Colin O Wu; Kiang Liu; W Gregory Hundley; Robyn McClelland; Antoinette S Gomes; Aaron R Folsom; Steven Shea; Eliseo Guallar; David A Bluemke; João A C Lima Journal: Circ Res Date: 2017-08-09 Impact factor: 17.367
Authors: Roland Faigle; Elisabeth B Marsh; Rafael H Llinas; Victor C Urrutia; Rebecca F Gottesman Journal: Stroke Date: 2014-12-02 Impact factor: 7.914
Authors: Hamed Asadi; Hong Kuan Kok; Seamus Looby; Paul Brennan; Alan O'Hare; John Thornton Journal: World Neurosurg Date: 2016-09-28 Impact factor: 2.104
Authors: Perry H Dubin; Amelia K Boehme; James E Siegler; Amir Shaban; Jenifer Juengling; Karen C Albright; Sheryl Martin-Schild Journal: Stroke Date: 2013-08-20 Impact factor: 7.914
Authors: Diana Crisan; Amir Shaban; Amelia Boehme; Perry Dubin; Jenifer Juengling; Laurie A Schluter; Karen C Albright; T Mark Beasley; Sheryl Martin-Schild Journal: Ann Rehabil Med Date: 2014-08-28