Ilke Tunali1,2, Lawrence O Hall3, Sandy Napel4, Dmitry Cherezov3, Albert Guvenis2, Robert J Gillies1, Matthew B Schabath5. 1. Department of Cancer Physiology, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, 33612, USA. 2. Institute of Biomedical Engineering, Bogazici University, Istanbul, 34684, Turkey. 3. Department of Computer Science and Engineering, University of South Florida, Tampa, FL, 33620, USA. 4. Department of Radiology, Stanford University School of Medicine, Stanford, CA, 94305, USA. 5. Department of Cancer Epidemiology, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, 33612, USA.
Abstract
PURPOSE: Recent efforts have demonstrated that radiomic features extracted from the peritumoral region, the area surrounding the tumor parenchyma, have clinical utility in various cancer types. However, as like any radiomic features, peritumoral features could also be unstable and/or nonreproducible. Hence, the purpose of this study was to assess the stability and reproducibility of computed tomography (CT) radiomic features extracted from the peritumoral regions of lung lesions where stability was defined as the consistency of a feature by different segmentations, and reproducibility was defined as the consistency of a feature to different image acquisitions. METHODS: Stability was measured utilizing the "moist run" dataset and reproducibility was measured utilizing the Reference Image Database to Evaluate Therapy Response test-retest dataset. Peritumoral radiomic features were extracted from incremental distances of 3-12 mm outside the tumor segmentation. A total of 264 statistical, histogram, and texture radiomic features were assessed from the selected peritumoral region-of-interests (ROIs). All features (except wavelet texture features) were extracted using standardized algorithms defined by the Image Biomarker Standardisation Initiative. Stability and reproducibility of features were assessed using the concordance correlation coefficient. The clinical utility of stable and reproducible peritumoral features was tested in three previously published lung cancer datasets using overall survival as the endpoint. RESULTS: Features found to be stable and reproducible, regardless of the peritumoral distances, included statistical, histogram, and a subset of texture features suggesting that these features are less affected by changes (e.g., size or shape) of the peritumoral region due to different segmentations and image acquisitions. The stability and reproducibility of Laws and wavelet texture features were inconsistent across all peritumoral distances. The analyses also revealed that a subset of features were consistently stable irrespective of the initial parameters (e.g., seed point) for a given segmentation algorithm. No significant differences were found in stability for features that were extracted from ROIs bounded by a lung parenchyma mask versus ROIs that were not bounded by a lung parenchyma mask (i.e., peritumoral regions that extended outside of lung parenchyma). After testing the clinical utility of peritumoral features, stable and reproducible features were shown to be more likely to create repeatable models than unstable and nonreproducible features. CONCLUSIONS: This study identified a subset of stable and reproducible CT radiomic features extracted from the peritumoral region of lung lesions. The stable and reproducible features identified in this study could be applied to a feature selection pipeline for CT radiomic analyses. According to our findings, top performing features in survival models were more likely to be stable and reproducible hence, it may be best practice to utilize them to achieve repeatable studies and reduce the chance of overfitting.
PURPOSE: Recent efforts have demonstrated that radiomic features extracted from the peritumoral region, the area surrounding the tumor parenchyma, have clinical utility in various cancer types. However, as like any radiomic features, peritumoral features could also be unstable and/or nonreproducible. Hence, the purpose of this study was to assess the stability and reproducibility of computed tomography (CT) radiomic features extracted from the peritumoral regions of lung lesions where stability was defined as the consistency of a feature by different segmentations, and reproducibility was defined as the consistency of a feature to different image acquisitions. METHODS: Stability was measured utilizing the "moist run" dataset and reproducibility was measured utilizing the Reference Image Database to Evaluate Therapy Response test-retest dataset. Peritumoral radiomic features were extracted from incremental distances of 3-12 mm outside the tumor segmentation. A total of 264 statistical, histogram, and texture radiomic features were assessed from the selected peritumoral region-of-interests (ROIs). All features (except wavelet texture features) were extracted using standardized algorithms defined by the Image Biomarker Standardisation Initiative. Stability and reproducibility of features were assessed using the concordance correlation coefficient. The clinical utility of stable and reproducible peritumoral features was tested in three previously published lung cancer datasets using overall survival as the endpoint. RESULTS: Features found to be stable and reproducible, regardless of the peritumoral distances, included statistical, histogram, and a subset of texture features suggesting that these features are less affected by changes (e.g., size or shape) of the peritumoral region due to different segmentations and image acquisitions. The stability and reproducibility of Laws and wavelet texture features were inconsistent across all peritumoral distances. The analyses also revealed that a subset of features were consistently stable irrespective of the initial parameters (e.g., seed point) for a given segmentation algorithm. No significant differences were found in stability for features that were extracted from ROIs bounded by a lung parenchyma mask versus ROIs that were not bounded by a lung parenchyma mask (i.e., peritumoral regions that extended outside of lung parenchyma). After testing the clinical utility of peritumoral features, stable and reproducible features were shown to be more likely to create repeatable models than unstable and nonreproducible features. CONCLUSIONS: This study identified a subset of stable and reproducible CT radiomic features extracted from the peritumoral region of lung lesions. The stable and reproducible features identified in this study could be applied to a feature selection pipeline for CT radiomic analyses. According to our findings, top performing features in survival models were more likely to be stable and reproducible hence, it may be best practice to utilize them to achieve repeatable studies and reduce the chance of overfitting.
Authors: Yuhua Gu; Virendra Kumar; Lawrence O Hall; Dmitry B Goldgof; Ching-Yen Li; René Korn; Claus Bendtsen; Emmanuel Rios Velazquez; Andre Dekker; Hugo Aerts; Philippe Lambin; Xiuli Li; Jie Tian; Robert A Gatenby; Robert J Gillies Journal: Pattern Recognit Date: 2013-03-01 Impact factor: 7.740
Authors: Olya Grove; Anders E Berglund; Matthew B Schabath; Hugo J W L Aerts; Andre Dekker; Hua Wang; Emmanuel Rios Velazquez; Philippe Lambin; Yuhua Gu; Yoganand Balagurunathan; Edward Eikman; Robert A Gatenby; Steven Eschrich; Robert J Gillies Journal: PLoS One Date: 2015-03-04 Impact factor: 3.240
Authors: M B Schabath; E A Welsh; W J Fulp; L Chen; J K Teer; Z J Thompson; B E Engel; M Xie; A E Berglund; B C Creelan; S J Antonia; J E Gray; S A Eschrich; D-T Chen; W D Cress; E B Haura; A A Beg Journal: Oncogene Date: 2015-10-19 Impact factor: 9.867
Authors: Ilke Tunali; Olya Stringfield; Albert Guvenis; Hua Wang; Ying Liu; Yoganand Balagurunathan; Philippe Lambin; Robert J Gillies; Matthew B Schabath Journal: Oncotarget Date: 2017-10-06
Authors: Chintan Parmar; Ralph T H Leijenaar; Patrick Grossmann; Emmanuel Rios Velazquez; Johan Bussink; Derek Rietveld; Michelle M Rietbergen; Benjamin Haibe-Kains; Philippe Lambin; Hugo J W L Aerts Journal: Sci Rep Date: 2015-06-05 Impact factor: 4.379
Authors: Tai H Dou; Thibaud P Coroller; Joost J M van Griethuysen; Raymond H Mak; Hugo J W L Aerts Journal: PLoS One Date: 2018-11-02 Impact factor: 3.240
Authors: Jaileene Pérez-Morales; Hong Lu; Wei Mu; Ilke Tunali; Tugce Kutuk; Steven A Eschrich; Yoganand Balagurunathan; Robert J Gillies; Matthew B Schabath Journal: Cancer Biomark Date: 2022 Impact factor: 3.828
Authors: Diem Vuong; Stephanie Tanadini-Lang; Ze Wu; Robert Marks; Jan Unkelbach; Sven Hillinger; Eric Innocents Eboulet; Sandra Thierstein; Solange Peters; Miklos Pless; Matthias Guckenberger; Marta Bogowicz Journal: Front Oncol Date: 2020-12-08 Impact factor: 6.244