Jennifer N Cooper1, Peter C Minneci2, Katherine J Deans2. 1. Center for Surgical Outcomes Research and Center for Innovation in Pediatric Practice, The Research Institute at Nationwide Children's Hospital, Columbus, Ohio. Electronic address: jennifer.cooper@nationwidechildrens.org. 2. Center for Surgical Outcomes Research and Center for Innovation in Pediatric Practice, The Research Institute at Nationwide Children's Hospital, Columbus, Ohio; Department of Surgery, Nationwide Children's Hospital, Columbus, Ohio.
Abstract
BACKGROUND: The variable risks associated with neonatal surgery present a challenge to accurate mortality prediction. We aimed to apply superlearning, an ensemble machine learning method, to the prediction of 30-day neonatal postoperative mortality. MATERIALS AND METHODS: We included neonates in the 2012-2014 National Surgical Quality Improvement Program Pediatric. Patients treated in 2012-13 were used in model development (n = 6499), and patients treated in 2014 formed the validation sample (n = 3552). Our superlearner algorithm included 14 regression and machine learning algorithms and included all preoperative patient demographic and clinical characteristics, including indicator variables for surgical procedures. Performance was evaluated using mean squared error and measures of discrimination and calibration. RESULTS: The superlearner out-performed all individual algorithms with regard to cross-validated mean squared error. It showed excellent discrimination, with an area under the receiver-operating characteristic curve of 0.91 in development and 0.87 in validation. The superlearner showed good calibration in development but not in validation (Cox calibration test P = 0.06 and P < 0.001, respectively). Performance was improved when the superlearner was fit using only variables strongly associated with mortality in bivariate analysis (area under the receiver-operating characteristic curve 0.89, calibration test P = 0.63 in validation). CONCLUSIONS: Superlearning provided improved or equivalent performance compared with individual regression and machine learning algorithms for predicting neonatal surgical mortality. This method should be considered for prediction in large data sets whenever complex mechanisms make parametric modeling assumptions unrealistic.
BACKGROUND: The variable risks associated with neonatal surgery present a challenge to accurate mortality prediction. We aimed to apply superlearning, an ensemble machine learning method, to the prediction of 30-day neonatal postoperative mortality. MATERIALS AND METHODS: We included neonates in the 2012-2014 National Surgical Quality Improvement Program Pediatric. Patients treated in 2012-13 were used in model development (n = 6499), and patients treated in 2014 formed the validation sample (n = 3552). Our superlearner algorithm included 14 regression and machine learning algorithms and included all preoperative patient demographic and clinical characteristics, including indicator variables for surgical procedures. Performance was evaluated using mean squared error and measures of discrimination and calibration. RESULTS: The superlearner out-performed all individual algorithms with regard to cross-validated mean squared error. It showed excellent discrimination, with an area under the receiver-operating characteristic curve of 0.91 in development and 0.87 in validation. The superlearner showed good calibration in development but not in validation (Cox calibration test P = 0.06 and P < 0.001, respectively). Performance was improved when the superlearner was fit using only variables strongly associated with mortality in bivariate analysis (area under the receiver-operating characteristic curve 0.89, calibration test P = 0.63 in validation). CONCLUSIONS: Superlearning provided improved or equivalent performance compared with individual regression and machine learning algorithms for predicting neonatal surgical mortality. This method should be considered for prediction in large data sets whenever complex mechanisms make parametric modeling assumptions unrealistic.
Authors: Leila R Zelnick; Michael G Shlipak; Elsayed Z Soliman; Amanda Anderson; Robert Christenson; James Lash; Rajat Deo; Panduranga Rao; Farsad Afshinnia; Jing Chen; Jiang He; Stephen Seliger; Raymond Townsend; Debbie L Cohen; Alan Go; Nisha Bansal Journal: Clin J Am Soc Nephrol Date: 2021-07-12 Impact factor: 10.614
Authors: Jenny Alderden; Susan M Kennerly; Andrew Wilson; Jonathan Dimas; Casey McFarland; David Y Yap; Lucy Zhao; Tracey L Yap Journal: Comput Inform Nurs Date: 2022-10-01 Impact factor: 2.146