Wei Li1, Lv Li1, Bo-Wen Zhuang1, Si-Min Ruan1, Hang-Tong Hu1, Yang Huang1, Man-Xia Lin1, Xiao-Yan Xie1, Ming Kuang1,2, Ming-De Lu1,2, Li-Da Chen3, Wei Wang4. 1. Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080, People's Republic of China. 2. Departments of Hepatobiliary Surgery, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China. 3. Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080, People's Republic of China. chenlda@mail.sysu.edu.cn. 4. Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080, People's Republic of China. wangw73@mail.sysu.edu.cn.
Abstract
OBJECTIVES: To investigate the inter-reader agreement of contrast-enhanced ultrasound (CEUS) of Liver Imaging Reporting and Data System version 2017 (LI-RADS v2017) categories among radiologists with different levels of experience. MATERIALS AND METHODS: From January 2014 to December 2014, a total of 326 patients at high risk of hepatocellular carcinoma (HCC) who underwent CEUS were included in this retrospective study. All lesions were classified according to LI-RADS v2017 by six radiologists with different levels of experiences: two residents, two fellows, and two specialists. Kappa coefficient was used to assess consistency of LI-RADS categories and major features among radiologists with different levels of experience. The diagnostic performance of HCC was described by accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the curve (AUC). RESULTS: Inter-reader agreement among radiologists of different experience levels was substantial agreement for arterial phase hyperenhancement, washout appearance, and early or late washout. Inter-reader agreement for LI-RADS categories was moderate to substantial. When LR-5 was used as criteria to determinate HCC, the AUC of LI-RADS for HCC was 0.67 for residents, 0.72 for fellows, and 0.78 for specialist radiologists. When compared between residents and specialists, accuracy, sensitivity, and AUC were significantly different (all p < 0.05). However, there were no significant differences in specificity, PPV, and NPV between the two groups. CONCLUSION: CEUS LI-RADS showed good diagnostic consistency among radiologists with different levels of experience, and consistency increased with experience levels. KEY POINTS: • The inter-reader agreement for LI-RADS categories was moderate to substantial agreement (κ, 0.60-0.80). • When compared between residents and specialists, accuracy, sensitivity, and AUC showed significantly different (all p < 0.05). However, there were no significant differences for specificity, PPV, and NPV between these two groups. • Among the radiologists with more than 1 year of experience, there was no significant difference in the diagnostic performance of HCC, suggesting that CEUS LI-RADS is a good standardized categorization system for high-risk patients.
OBJECTIVES: To investigate the inter-reader agreement of contrast-enhanced ultrasound (CEUS) of Liver Imaging Reporting and Data System version 2017 (LI-RADS v2017) categories among radiologists with different levels of experience. MATERIALS AND METHODS: From January 2014 to December 2014, a total of 326 patients at high risk of hepatocellular carcinoma (HCC) who underwent CEUS were included in this retrospective study. All lesions were classified according to LI-RADS v2017 by six radiologists with different levels of experiences: two residents, two fellows, and two specialists. Kappa coefficient was used to assess consistency of LI-RADS categories and major features among radiologists with different levels of experience. The diagnostic performance of HCC was described by accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the curve (AUC). RESULTS: Inter-reader agreement among radiologists of different experience levels was substantial agreement for arterial phase hyperenhancement, washout appearance, and early or late washout. Inter-reader agreement for LI-RADS categories was moderate to substantial. When LR-5 was used as criteria to determinate HCC, the AUC of LI-RADS for HCC was 0.67 for residents, 0.72 for fellows, and 0.78 for specialist radiologists. When compared between residents and specialists, accuracy, sensitivity, and AUC were significantly different (all p < 0.05). However, there were no significant differences in specificity, PPV, and NPV between the two groups. CONCLUSION:CEUS LI-RADS showed good diagnostic consistency among radiologists with different levels of experience, and consistency increased with experience levels. KEY POINTS: • The inter-reader agreement for LI-RADS categories was moderate to substantial agreement (κ, 0.60-0.80). • When compared between residents and specialists, accuracy, sensitivity, and AUC showed significantly different (all p < 0.05). However, there were no significant differences for specificity, PPV, and NPV between these two groups. • Among the radiologists with more than 1 year of experience, there was no significant difference in the diagnostic performance of HCC, suggesting that CEUS LI-RADS is a good standardized categorization system for high-risk patients.
Authors: Vito Cantisani; Emanuele David; Franca Maria Meloni; Christoph Frank Dietrich; Radu Badea; Daniela Messineo; Ferdiando D'Ambrosio; Fabio Pisgalia Journal: Med Ultrason Date: 2015-12 Impact factor: 1.611