Wenbing Lv1, Qingyu Yuan2, Quanshi Wang2, Jianhua Ma3, Jun Jiang1, Wei Yang1, Qianjin Feng1, Wufan Chen1, Arman Rahmim4,5, Lijun Lu6. 1. School of Biomedical Engineering and Guangdong Provincal Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Baiyun District, Guangzhou, Guangdong, 510515, China. 2. Nanfang PET Center, Nanfang Hospital, Southern Medical University, 1023 Shatai Road, Baiyun District, Guangzhou, Guangdong, 510515, China. 3. School of Biomedical Engineering and Guangdong Provincal Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Baiyun District, Guangzhou, Guangdong, 510515, China. jhma@smu.edu.cn. 4. Department of Radiology, Johns Hopkins University, 601 N. Caroline St, Baltimore, MD, 21287, USA. 5. Department of Electrical and Computer Engineering, Johns Hopkins University, 3101 Wyman Park Drive, Baltimore, MD, 21218, USA. 6. School of Biomedical Engineering and Guangdong Provincal Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Baiyun District, Guangzhou, Guangdong, 510515, China. ljlubme@gmail.com.
Abstract
OBJECTIVES: To investigate the impact of parameter settings as used for the generation of radiomics features on their robustness and disease differentiation (nasopharyngeal carcinoma (NPC) versus chronic nasopharyngitis (CN) in FDG PET/CT imaging). METHODS: We studied 106 patients (69/37 NPC/CN, pathology confirmed), and extracted 57 radiomics features under different parameter settings. Robustness was assessed by the intra-class correlation coefficient (ICC). Logistic regression with leave-one-out cross validation was used to generate classification probabilities, and diagnostic performance was assessed by the area under the receiver operating characteristic curve (AUC). RESULTS: Varying averaging strategies and symmetry, 4/26 GLCM features showed poor range of pairwise ICCs of 0.02-0.98, while depicting good AUCs of 0.82-0.91. Varying distances, 5/26 GLCM features showed ICCs of 0.82-0.99 while corresponding AUCs were 0.52-0.91. 6/13 GLRLM features showed both high AUC (0.81-0.89) and high ICC (0.85-0.99) regarding to averaging strategies. 7/13 GLSZM features showed AUCs of 0.81-0.90 while having ICCs of 0.01-0.99 under different neighbourhoods. 2/5 NGTDM features showed AUCs of 0.81-0.85 while having ICCs of 0.19-0.89 for different window sizes. Differentiating a subset of NPC (stages I-II) form CN, both SumEntropy and SZLGE achieved significantly higher AUCs than metabolically active tumour volume (AUC: 0.91 vs. 0.72, p<0.01). CONCLUSIONS: Radiomics features depicting poor absolute-scale robustness regarding to parameter settings can still lead to good diagnostic performance. As such, robustness of radiomics features should not be overemphasized for removal of features towards assessment of clinical tasks. For differentiating NPC from CN, some radiomics features (e.g. SumEntropy, SZLGE, LGZE) outperformed conventional metrics. KEY POINTS: • Poor robustness did not necessarily translate into poor differentiation performance. • Absolute-scale robustness of radiomics features should not be overemphasized. • Radiomics features SumEntropy, SZLGE and LGZE outperformed conventional metrics.
OBJECTIVES: To investigate the impact of parameter settings as used for the generation of radiomics features on their robustness and disease differentiation (nasopharyngeal carcinoma (NPC) versus chronic nasopharyngitis (CN) in FDG PET/CT imaging). METHODS: We studied 106 patients (69/37 NPC/CN, pathology confirmed), and extracted 57 radiomics features under different parameter settings. Robustness was assessed by the intra-class correlation coefficient (ICC). Logistic regression with leave-one-out cross validation was used to generate classification probabilities, and diagnostic performance was assessed by the area under the receiver operating characteristic curve (AUC). RESULTS: Varying averaging strategies and symmetry, 4/26 GLCM features showed poor range of pairwise ICCs of 0.02-0.98, while depicting good AUCs of 0.82-0.91. Varying distances, 5/26 GLCM features showed ICCs of 0.82-0.99 while corresponding AUCs were 0.52-0.91. 6/13 GLRLM features showed both high AUC (0.81-0.89) and high ICC (0.85-0.99) regarding to averaging strategies. 7/13 GLSZM features showed AUCs of 0.81-0.90 while having ICCs of 0.01-0.99 under different neighbourhoods. 2/5 NGTDM features showed AUCs of 0.81-0.85 while having ICCs of 0.19-0.89 for different window sizes. Differentiating a subset of NPC (stages I-II) form CN, both SumEntropy and SZLGE achieved significantly higher AUCs than metabolically active tumour volume (AUC: 0.91 vs. 0.72, p<0.01). CONCLUSIONS: Radiomics features depicting poor absolute-scale robustness regarding to parameter settings can still lead to good diagnostic performance. As such, robustness of radiomics features should not be overemphasized for removal of features towards assessment of clinical tasks. For differentiating NPC from CN, some radiomics features (e.g. SumEntropy, SZLGE, LGZE) outperformed conventional metrics. KEY POINTS: • Poor robustness did not necessarily translate into poor differentiation performance. • Absolute-scale robustness of radiomics features should not be overemphasized. • Radiomics features SumEntropy, SZLGE and LGZE outperformed conventional metrics.
Authors: Marco Gerlinger; Andrew J Rowan; Stuart Horswell; James Larkin; David Endesfelder; Eva Gronroos; Pierre Martinez; Nicholas Matthews; Aengus Stewart; Charles Swanton; M Math; Patrick Tarpey; Ignacio Varela; Benjamin Phillimore; Sharmin Begum; Neil Q McDonald; Adam Butler; David Jones; Keiran Raine; Calli Latimer; Claudio R Santos; Mahrokh Nohadani; Aron C Eklund; Bradley Spencer-Dene; Graham Clark; Lisa Pickering; Gordon Stamp; Martin Gore; Zoltan Szallasi; Julian Downward; P Andrew Futreal Journal: N Engl J Med Date: 2012-03-08 Impact factor: 91.245
Authors: Ralph T H Leijenaar; Georgi Nalbantov; Sara Carvalho; Wouter J C van Elmpt; Esther G C Troost; Ronald Boellaard; Hugo J W L Aerts; Robert J Gillies; Philippe Lambin Journal: Sci Rep Date: 2015-08-05 Impact factor: 4.379
Authors: Ji Eun Park; Donghyun Kim; Ho Sung Kim; Seo Young Park; Jung Youn Kim; Se Jin Cho; Jae Ho Shin; Jeong Hoon Kim Journal: Eur Radiol Date: 2019-07-26 Impact factor: 5.315