Jing Zhao1, Yingqian Huang1, Yukun Song2, Dingxiang Xie1, Manshi Hu1, Haishan Qiu1, Jianping Chu3. 1. Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, 58, The Second Zhongshan Road, Guangzhou, 510080, Guangdong, China. 2. Department of Radiology, The First Affiliated Hospital of Xiamen University, Xiamen, 361003, China. 3. Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, 58, The Second Zhongshan Road, Guangzhou, 510080, Guangdong, China. truechu@hotmail.com.
Abstract
OBJECTIVES: To assess the diagnostic accuracy of machine learning (ML) in predicting isocitrate dehydrogenase (IDH) mutations in patients with glioma and to identify potential covariates that could influence the diagnostic performance of ML. METHODS: A systematic search of PubMed, Web of Science, and the Cochrane library up to 1 August 2019 was conducted to collect all the articles investigating the diagnostic performance of ML for prediction of IDH mutation in glioma. The search strategy combined synonyms for 'machine learning', 'glioma', and 'IDH'. Pooled sensitivity, specificity, and their 95% confidence intervals (CIs) were calculated, and the area under the receiver operating characteristic curve (AUC) was obtained. RESULTS: Nine original articles assessing a total of 996 patients with glioma were included. Among these studies, five divided the participants into training and validation sets, while the remaining four studies only had a training set. The AUC of ML for predicting IDH mutation in the training and validation sets was 93% (95% CI 91-95%) and 89% (95% CI 86-92%), respectively. The pooled sensitivity and specificity were, respectively, 87% (95% CI 82-91%) and 88% (95% CI 83-92%) in the training set and 87% (95% CI 76-93%) and 90% (95% CI 72-97%) in the validation set. In subgroup analyses in the training set, the combined use of clinical and imaging features with ML yielded higher sensitivity (90% vs. 83%) and specificity (90% vs. 82%) than the use of imaging features alone. In addition, ML performed better for high-grade gliomas than for low-grade gliomas, and ML that used conventional MRI sequences demonstrated higher specificity for predicting IDH mutation than ML using conventional and advanced MRI sequences. CONCLUSIONS: ML demonstrated an excellent diagnostic performance in predicting IDH mutation of glioma. Clinical information, MRI sequences, and glioma grade were the main factors influencing diagnostic specificity. KEY POINTS: • Machine learning demonstrated an excellent diagnostic performance for prediction of IDH mutation in glioma (the pooled sensitivity and specificity were 88% and 87%, respectively). • Machine learning that used conventional MRI sequences demonstrated higher specificity in predicting IDH mutation than that based on conventional and advanced MRI sequences (89% vs. 85%). • Integration of clinical and imaging features in machine learning yielded a higher sensitivity (90% vs. 83%) and specificity (90% vs. 82%) than that achieved by using imaging features alone.
OBJECTIVES: To assess the diagnostic accuracy of machine learning (ML) in predicting isocitrate dehydrogenase (IDH) mutations in patients with glioma and to identify potential covariates that could influence the diagnostic performance of ML. METHODS: A systematic search of PubMed, Web of Science, and the Cochrane library up to 1 August 2019 was conducted to collect all the articles investigating the diagnostic performance of ML for prediction of IDH mutation in glioma. The search strategy combined synonyms for 'machine learning', 'glioma', and 'IDH'. Pooled sensitivity, specificity, and their 95% confidence intervals (CIs) were calculated, and the area under the receiver operating characteristic curve (AUC) was obtained. RESULTS: Nine original articles assessing a total of 996 patients with glioma were included. Among these studies, five divided the participants into training and validation sets, while the remaining four studies only had a training set. The AUC of ML for predicting IDH mutation in the training and validation sets was 93% (95% CI 91-95%) and 89% (95% CI 86-92%), respectively. The pooled sensitivity and specificity were, respectively, 87% (95% CI 82-91%) and 88% (95% CI 83-92%) in the training set and 87% (95% CI 76-93%) and 90% (95% CI 72-97%) in the validation set. In subgroup analyses in the training set, the combined use of clinical and imaging features with ML yielded higher sensitivity (90% vs. 83%) and specificity (90% vs. 82%) than the use of imaging features alone. In addition, ML performed better for high-grade gliomas than for low-grade gliomas, and ML that used conventional MRI sequences demonstrated higher specificity for predicting IDH mutation than ML using conventional and advanced MRI sequences. CONCLUSIONS: ML demonstrated an excellent diagnostic performance in predicting IDH mutation of glioma. Clinical information, MRI sequences, and glioma grade were the main factors influencing diagnostic specificity. KEY POINTS: • Machine learning demonstrated an excellent diagnostic performance for prediction of IDH mutation in glioma (the pooled sensitivity and specificity were 88% and 87%, respectively). • Machine learning that used conventional MRI sequences demonstrated higher specificity in predicting IDH mutation than that based on conventional and advanced MRI sequences (89% vs. 85%). • Integration of clinical and imaging features in machine learning yielded a higher sensitivity (90% vs. 83%) and specificity (90% vs. 82%) than that achieved by using imaging features alone.
Authors: Evi J van Kempen; Max Post; Manoj Mannil; Benno Kusters; Mark Ter Laan; Frederick J A Meijer; Dylan J H A Henssen Journal: Cancers (Basel) Date: 2021-05-26 Impact factor: 6.639
Authors: Akifumi Hagiwara; Hiroyuki Tatekawa; Jingwen Yao; Catalina Raymond; Richard Everson; Kunal Patel; Sergey Mareninov; William H Yong; Noriko Salamon; Whitney B Pope; Phioanh L Nghiemphu; Linda M Liau; Timothy F Cloughesy; Benjamin M Ellingson Journal: Sci Rep Date: 2022-01-20 Impact factor: 4.379