Matthew Shew1, Jacob New2, Andrés M Bur1. 1. 1 Department of Otolaryngology-Head and Neck Surgery, School of Medicine, University of Kansas, Kansas City, Kansas, USA. 2. 2 School of Medicine, University of Kansas, Kansas City, Kansas, USA.
Abstract
OBJECTIVE: To apply a novel methodology with machine learning (ML) to a large national cancer registry to help identify patients who are high risk for delayed adjuvant radiation. STUDY DESIGN: Observational cohort study. SETTING: National Cancer Database (NCDB). SUBJECTS AND METHODS: A total of 76,573 patients were identified from the NCDB who had invasive head and neck cancer and underwent surgery, followed by radiation. The model was constructed from 80% of the patient data and subsequently evaluated and scored with the remaining 20%. Permutation feature importance analysis was used to understand the weighted model construction. RESULTS: A total of 76,573 patients met inclusion and exclusion criteria. Our ML model was able to predict whether patients would start adjuvant therapy beyond 50 days after surgery with an overall accuracy of 64.41% and a precision of 58.5%. The 2 most important variables used to build the model were treating facility and urban versus rural demographics. CONCLUSION: Statistics can provide inferences within an overall system, while ML is a novel methodology that can make predictions. We can identify patients who are "high risk" for delayed radiation using information from >75,000 patient experiences, which has the potential for a direct impact on clinical care. Our inability to achieve greater accuracy is due to limitations of the data captured by the NCDB, and we need to continue to identify new variables that are correlated with delayed radiation therapy. ML will prove to be a valuable clinical tool in years to come, but its utility is limited by available data.
OBJECTIVE: To apply a novel methodology with machine learning (ML) to a large national cancer registry to help identify patients who are high risk for delayed adjuvant radiation. STUDY DESIGN: Observational cohort study. SETTING: National Cancer Database (NCDB). SUBJECTS AND METHODS: A total of 76,573 patients were identified from the NCDB who had invasive head and neck cancer and underwent surgery, followed by radiation. The model was constructed from 80% of the patient data and subsequently evaluated and scored with the remaining 20%. Permutation feature importance analysis was used to understand the weighted model construction. RESULTS: A total of 76,573 patients met inclusion and exclusion criteria. Our ML model was able to predict whether patients would start adjuvant therapy beyond 50 days after surgery with an overall accuracy of 64.41% and a precision of 58.5%. The 2 most important variables used to build the model were treating facility and urban versus rural demographics. CONCLUSION: Statistics can provide inferences within an overall system, while ML is a novel methodology that can make predictions. We can identify patients who are "high risk" for delayed radiation using information from >75,000 patient experiences, which has the potential for a direct impact on clinical care. Our inability to achieve greater accuracy is due to limitations of the data captured by the NCDB, and we need to continue to identify new variables that are correlated with delayed radiation therapy. ML will prove to be a valuable clinical tool in years to come, but its utility is limited by available data.
Authors: Evan M Graboyes; Chanita Hughes Halbert; Hong Li; Graham W Warren; Anthony J Alberg; Elizabeth A Calhoun; Brian Nussenbaum; Courtney H Marsh; Jessica McCay; Terry A Day; John M Kaczmar; Anand K Sharma; David M Neskey; Katherine R Sterba Journal: JCO Oncol Pract Date: 2020-08-27
Authors: Dylan A Levy; Hong Li; Katherine R Sterba; Chanita Hughes-Halbert; Graham W Warren; Brian Nussenbaum; Anthony J Alberg; Terry A Day; Evan M Graboyes Journal: JAMA Otolaryngol Head Neck Surg Date: 2020-05-01 Impact factor: 6.223