Suyon Chang1,2, Kyunghwa Han2, Young Joo Suh3, Byoung Wook Choi2. 1. Department of Radiology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea. 2. Department of Radiology, Severance Hospital, Research Institute of Radiological Science, Center for Clinical Imaging Data Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Korea. 3. Department of Radiology, Severance Hospital, Research Institute of Radiological Science, Center for Clinical Imaging Data Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Korea. rongzusuh@gmail.com.
Abstract
OBJECTIVES: To evaluate the quality of radiomics studies using cardiac magnetic resonance imaging (CMR) according to the radiomics quality score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) guidelines, and the standards defined by the Image Biomarker Standardization Initiative (IBSI) and identify areas needing improvement. MATERIALS AND METHODS: PubMed and Embase were searched to identify radiomics studies using CMR until March 10, 2021. Of the 259 identified articles, 32 relevant original research articles were included. Studies were scored according to the RQS, TRIPOD guidelines, and IBSI standards by two cardiac radiologists. RESULTS: The mean RQS was 14.3% of the maximum (5.16 out of 36). RQS were low for the demonstration of validation (-60.6%), calibration statistics (1.6%), potential clinical utility (3.1%), and open science (3.1%) items. No study conducted a phantom study or cost-effectiveness analysis. The adherence to TRIPOD guidelines was 55.9%. Studies were deficient in reporting title (3.1%), stating objective in abstract and introduction (6.3% and 9.4%), missing data (0%), discrimination/calibration (3.1%), and how to use the prediction model (3.1%). According to the IBSI standards, non-uniformity correction, image interpolation, grey-level discretization, and signal intensity normalization were performed in two (6.3%), four (12.5%), six (18.8%), and twelve (37.5%) studies, respectively. CONCLUSION: The quality of radiomics studies using CMR is suboptimal. Improvements are needed in the areas of validation, calibration, clinical utility, and open science. Complete reporting of study objectives, missing data, discrimination/calibration, how to use the prediction model, and preprocessing steps are necessary. KEY POINTS: • The quality of science in radiomics studies using CMR is currently inadequate. • RQS were low for validation, calibration, clinical utility, and open science; no study conducted a phantom study or cost-effectiveness analysis. • In stating the study objective, missing data, discrimination/calibration, how to use the prediction model, and preprocessing steps, improvements are needed.
OBJECTIVES: To evaluate the quality of radiomics studies using cardiac magnetic resonance imaging (CMR) according to the radiomics quality score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) guidelines, and the standards defined by the Image Biomarker Standardization Initiative (IBSI) and identify areas needing improvement. MATERIALS AND METHODS: PubMed and Embase were searched to identify radiomics studies using CMR until March 10, 2021. Of the 259 identified articles, 32 relevant original research articles were included. Studies were scored according to the RQS, TRIPOD guidelines, and IBSI standards by two cardiac radiologists. RESULTS: The mean RQS was 14.3% of the maximum (5.16 out of 36). RQS were low for the demonstration of validation (-60.6%), calibration statistics (1.6%), potential clinical utility (3.1%), and open science (3.1%) items. No study conducted a phantom study or cost-effectiveness analysis. The adherence to TRIPOD guidelines was 55.9%. Studies were deficient in reporting title (3.1%), stating objective in abstract and introduction (6.3% and 9.4%), missing data (0%), discrimination/calibration (3.1%), and how to use the prediction model (3.1%). According to the IBSI standards, non-uniformity correction, image interpolation, grey-level discretization, and signal intensity normalization were performed in two (6.3%), four (12.5%), six (18.8%), and twelve (37.5%) studies, respectively. CONCLUSION: The quality of radiomics studies using CMR is suboptimal. Improvements are needed in the areas of validation, calibration, clinical utility, and open science. Complete reporting of study objectives, missing data, discrimination/calibration, how to use the prediction model, and preprocessing steps are necessary. KEY POINTS: • The quality of science in radiomics studies using CMR is currently inadequate. • RQS were low for validation, calibration, clinical utility, and open science; no study conducted a phantom study or cost-effectiveness analysis. • In stating the study objective, missing data, discrimination/calibration, how to use the prediction model, and preprocessing steps, improvements are needed.
Authors: B Pinamonti; E Picano; E M Ferdeghini; F Lattanzi; G Slavich; L Landini; F Camerini; A Benassi; A Distante; A L'Abbate Journal: J Am Coll Cardiol Date: 1989-09 Impact factor: 24.094
Authors: Daniel R Messroghli; James C Moon; Vanessa M Ferreira; Lars Grosse-Wortmann; Taigang He; Peter Kellman; Julia Mascherbauer; Reza Nezafat; Michael Salerno; Erik B Schelbert; Andrew J Taylor; Richard Thompson; Martin Ugander; Ruud B van Heeswijk; Matthias G Friedrich Journal: J Cardiovasc Magn Reson Date: 2017-10-09 Impact factor: 5.364