Nicola Schieda1, Kathleen Nguyen2, Rebecca E Thornhill2, Matthew D F McInnes2, Mark Wu2, Nick James3. 1. Department of Medical Imaging, The Ottawa Hospital, 1053 Carling Avenue, Room C159, Ottawa, ON, K1Y 4E9, Canada. nschieda@toh.ca. 2. Department of Medical Imaging, The Ottawa Hospital, 1053 Carling Avenue, Room C159, Ottawa, ON, K1Y 4E9, Canada. 3. Software Solutions, The Ottawa Hospital, Ottawa, Canada.
Abstract
OBJECTIVE: To compare machine learning (ML) of texture analysis (TA) features for classification of solid renal masses on non-contrast-enhanced CT (NCCT), corticomedullary (CM) and nephrographic (NG) phase contrast-enhanced (CE) CT. MATERIALS AND METHODS: With IRB approval, we retrospectively identified 177 consecutive solid renal masses (116 renal cell carcinoma [RCC]; 51 clear cell [cc], 40 papillary, 25 chromophobe and 61 benign tumors; 49 oncocytomas and 12 fat-poor angiomyolipomas) with renal protocol CT between 2012 and 2017. Tumors were independently segmented by two blinded radiologists. Twenty-five 2-dimensional TA features were extracted from each phase. Diagnostic accuracy for 1) RCC versus benign tumor and 2) cc-RCC versus other tumor was assessed using XGBoost. RESULTS: ML of texture analysis features on different phases achieved mean area under the ROC curve (AUC [SD]), sensitivity/specificity for 1) RCC vs benign = 0.70(0.19), 96%/32% on CM-CECT and 0.71(0.14), 83%/58% on NG-CECT and; 2) cc-RCC vs other = 0.77(0.12), 49%/90% on CM-CECT and 0.71(0.16), 22%/94% on NG-CECT. There was no difference in AUC comparing CECT to NCCT (p = 0.058-0.54) and no improvement when combining data across all three phases compared single-phase assessment (p = 0.39-0.68) for either outcome. AUCs decreased when ML models were trained with one phase and tested on a different phase for both outcomes (RCC;p = 0.045-0.106, cc-RCC; < 0.001). CONCLUSION: Accuracy of machine learning classification of renal masses using texture analysis features did not depend on phase; however, models trained using one phase performed worse when tested on another phase particularly when associating NCCT and CECT. These findings have implications for large registries which use varying CT protocols to study renal masses.
OBJECTIVE: To compare machine learning (ML) of texture analysis (TA) features for classification of solid renal masses on non-contrast-enhanced CT (NCCT), corticomedullary (CM) and nephrographic (NG) phase contrast-enhanced (CE) CT. MATERIALS AND METHODS: With IRB approval, we retrospectively identified 177 consecutive solid renal masses (116 renal cell carcinoma [RCC]; 51 clear cell [cc], 40 papillary, 25 chromophobe and 61 benign tumors; 49 oncocytomas and 12 fat-poor angiomyolipomas) with renal protocol CT between 2012 and 2017. Tumors were independently segmented by two blinded radiologists. Twenty-five 2-dimensional TA features were extracted from each phase. Diagnostic accuracy for 1) RCC versus benign tumor and 2) cc-RCC versus other tumor was assessed using XGBoost. RESULTS: ML of texture analysis features on different phases achieved mean area under the ROC curve (AUC [SD]), sensitivity/specificity for 1) RCC vs benign = 0.70(0.19), 96%/32% on CM-CECT and 0.71(0.14), 83%/58% on NG-CECT and; 2) cc-RCC vs other = 0.77(0.12), 49%/90% on CM-CECT and 0.71(0.16), 22%/94% on NG-CECT. There was no difference in AUC comparing CECT to NCCT (p = 0.058-0.54) and no improvement when combining data across all three phases compared single-phase assessment (p = 0.39-0.68) for either outcome. AUCs decreased when ML models were trained with one phase and tested on a different phase for both outcomes (RCC;p = 0.045-0.106, cc-RCC; < 0.001). CONCLUSION: Accuracy of machine learning classification of renal masses using texture analysis features did not depend on phase; however, models trained using one phase performed worse when tested on another phase particularly when associating NCCT and CECT. These findings have implications for large registries which use varying CT protocols to study renal masses.
Authors: Christoph A Karlo; Pier Luigi Di Paolo; Joshua Chaim; A Ari Hakimi; Irina Ostrovnaya; Paul Russo; Hedvig Hricak; Robert Motzer; James J Hsieh; Oguz Akin Journal: Radiology Date: 2013-10-28 Impact factor: 11.105
Authors: Taryn Hodgdon; Matthew D F McInnes; Nicola Schieda; Trevor A Flood; Leslie Lamb; Rebecca E Thornhill Journal: Radiology Date: 2015-04-23 Impact factor: 11.105
Authors: Andrea S Kierans; Henry Rusinek; Andrew Lee; Mohammed B Shaikh; Michael Triolo; William C Huang; Hersh Chandarana Journal: AJR Am J Roentgenol Date: 2014-12 Impact factor: 3.959
Authors: Nicola Schieda; Robert S Lim; Satheesh Krishna; Matthew D F McInnes; Trevor A Flood; Rebecca E Thornhill Journal: AJR Am J Roentgenol Date: 2018-03-16 Impact factor: 3.959
Authors: Kohei Sasaguri; Naoki Takahashi; Daniel Gomez-Cardona; Shuai Leng; Grant D Schmit; Rickey E Carter; Bradley C Leibovich; Akira Kawashima Journal: AJR Am J Roentgenol Date: 2015-11 Impact factor: 3.959
Authors: Meghan G Lubner; Andrew D Smith; Kumar Sandrasegaran; Dushyant V Sahani; Perry J Pickhardt Journal: Radiographics Date: 2017 Sep-Oct Impact factor: 5.333
Authors: Camila Lopes Vendrami; Yuri S Velichko; Frank H Miller; Argha Chatterjee; Carolina Parada Villavicencio; Vahid Yaghmai; Robert J McCarthy Journal: AJR Am J Roentgenol Date: 2018-09-21 Impact factor: 3.959