Joseph J Foy1, Samuel G Armato1, Hania A Al-Hallaq2. 1. The University of Chicago, Department of Radiology, Chicago, Illinois, United States. 2. The University of Chicago, Department of Radiation and Cellular Oncology, Chicago, Illinois, United States.
Abstract
Purpose: While radiomics feature values can differ when extracted using different radiomics software, the effects of these variations when applied to a particular clinical task are currently unknown. The goal of our study was to use various radiomics software packages to classify patients with radiation pneumonitis (RP) and to quantify the variation in classification ability among packages. Approach: A database of serial thoracic computed tomography scans was obtained from 105 patients with esophageal cancer. Patients were treated with radiation therapy (RT), resulting in 20 patients developing RP grade ≥ 2 . Regions of interest (ROIs) were randomly placed in the lung volume of the pre-RT scan within high-dose regions ( ≥ 30 Gy ), and corresponding ROIs were anatomically matched in the post-RT scan. Three radiomics packages were compared: A1 (in-house), IBEX v1.0 beta, and PyRadiomics v.2.0.0. Radiomics features robust to deformable registration and common among radiomics packages were calculated: four first-order and four gray-level co-occurrence matrix features. Differences in feature values between time points were calculated for each feature, and logistic regression was used in conjunction with analysis of variance to classify patients with and without RP ( p < 0.006 ). Classification ability for each package was assessed using receiver operating characteristic (ROC) analysis and compared using the area under the ROC curve (AUC). Results: Of the eight radiomics features, five were significantly correlated with RP status for all three packages, whereas one feature was not significantly correlated with RP for all three packages. The remaining two features differed in whether or not they were significantly associated with RP status among the packages. Seven of the eight features agreed among the packages in whether the AUC value was significantly > 0.5 . Conclusions: Radiomics features extracted using different software packages can result in differences in classification ability.
Purpose: While radiomics feature values can differ when extracted using different radiomics software, the effects of these variations when applied to a particular clinical task are currently unknown. The goal of our study was to use various radiomics software packages to classify patients with radiation pneumonitis (RP) and to quantify the variation in classification ability among packages. Approach: A database of serial thoracic computed tomography scans was obtained from 105 patients with esophageal cancer. Patients were treated with radiation therapy (RT), resulting in 20 patients developing RP grade ≥ 2 . Regions of interest (ROIs) were randomly placed in the lung volume of the pre-RT scan within high-dose regions ( ≥ 30 Gy ), and corresponding ROIs were anatomically matched in the post-RT scan. Three radiomics packages were compared: A1 (in-house), IBEX v1.0 beta, and PyRadiomics v.2.0.0. Radiomics features robust to deformable registration and common among radiomics packages were calculated: four first-order and four gray-level co-occurrence matrix features. Differences in feature values between time points were calculated for each feature, and logistic regression was used in conjunction with analysis of variance to classify patients with and without RP ( p < 0.006 ). Classification ability for each package was assessed using receiver operating characteristic (ROC) analysis and compared using the area under the ROC curve (AUC). Results: Of the eight radiomics features, five were significantly correlated with RP status for all three packages, whereas one feature was not significantly correlated with RP for all three packages. The remaining two features differed in whether or not they were significantly associated with RP status among the packages. Seven of the eight features agreed among the packages in whether the AUC value was significantly > 0.5 . Conclusions: Radiomics features extracted using different software packages can result in differences in classification ability.
Authors: Matthew J Nyflot; Fei Yang; Darrin Byrd; Stephen R Bowen; George A Sandison; Paul E Kinahan Journal: J Med Imaging (Bellingham) Date: 2015-08-05
Authors: Martin Vallières; Alex Zwanenburg; Bodgan Badic; Catherine Cheze Le Rest; Dimitris Visvikis; Mathieu Hatt Journal: J Nucl Med Date: 2017-11-24 Impact factor: 10.057
Authors: Joseph J Foy; Kayla R Robinson; Hui Li; Maryellen L Giger; Hania Al-Hallaq; Samuel G Armato Journal: J Med Imaging (Bellingham) Date: 2018-12-04
Authors: Joost J M van Griethuysen; Andriy Fedorov; Chintan Parmar; Ahmed Hosny; Nicole Aucoin; Vivek Narayan; Regina G H Beets-Tan; Jean-Christophe Fillion-Robin; Steve Pieper; Hugo J W L Aerts Journal: Cancer Res Date: 2017-11-01 Impact factor: 12.701
Authors: Kathryn E Keenan; Jana G Delfino; Kalina V Jordanova; Megan E Poorman; Prathyush Chirra; Akshay S Chaudhari; Bettina Baessler; Jessica Winfield; Satish E Viswanath; Nandita M deSouza Journal: Med Phys Date: 2021-09-29 Impact factor: 4.506