Bin Zhang1, Jie Tian2, Shufang Pei3, Yubing Chen4, Xin He5, Yuhao Dong6, Lu Zhang6, Xiaokai Mo6, Wenhui Huang6, Shuzhen Cong3, Shuixing Zhang1. 1. 1 Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, P.R. China. 2. 2 Key Laboratory of Molecular Imaging, Chinese Academy of Science, Beijing, P.R. China. 3. 3 Department of Ultrasound, Guangdong Provincial People's Hospital, Academy of Medical Sciences, Guangzhou, Guangdong, P.R. China. 4. 4 Information Centre, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, P.R. China. 5. 5 School of Statistics and Management, Shanghai University of Finance and Economics, Shanghai, P.R. China. 6. 6 Department of Radiology, Guangdong Provincial People's Hospital, Academy of Medical Sciences, Guangzhou, Guangdong, P.R. China.
Abstract
Background: Ultrasound (US) examination is helpful in the differential diagnosis of thyroid nodules (malignant vs. benign), but its accuracy relies heavily on examiner experience. Therefore, the aim of this study was to develop a less subjective diagnostic model aided by machine learning. Methods: A total of 2064 thyroid nodules (2032 patients, 695 male; Mage = 45.25 ± 13.49 years) met all of the following inclusion criteria: (i) hemi- or total thyroidectomy, (ii) maximum nodule diameter 2.5 cm, (iii) examination by conventional US and real-time elastography within one month before surgery, and (iv) no previous thyroid surgery or percutaneous thermotherapy. Models were developed using 60% of randomly selected samples based on nine commonly used algorithms, and validated using the remaining 40% of cases. All models function with a validation data set that has a pretest probability of malignancy of 10%. The models were refined with machine learning that consisted of 1000 repetitions of derivatization and validation, and compared to diagnosis by an experienced radiologist. Sensitivity, specificity, accuracy, and area under the curve (AUC) were calculated. Results: A random forest algorithm led to the best diagnostic model, which performed better than radiologist diagnosis based on conventional US only (AUC = 0.924 [confidence interval (CI) 0.895-0.953] vs. 0.834 [CI 0.815-0.853]) and based on both conventional US and real-time elastography (AUC = 0.938 [CI 0.914-0.961] vs. 0.843 [CI 0.829-0.857]). Conclusions: Machine-learning algorithms based on US examinations, particularly the random forest classifier, may diagnose malignant thyroid nodules better than radiologists.
Background: Ultrasound (US) examination is helpful in the differential diagnosis of thyroid nodules (malignant vs. benign), but its accuracy relies heavily on examiner experience. Therefore, the aim of this study was to develop a less subjective diagnostic model aided by machine learning. Methods: A total of 2064 thyroid nodules (2032 patients, 695 male; Mage = 45.25 ± 13.49 years) met all of the following inclusion criteria: (i) hemi- or total thyroidectomy, (ii) maximum nodule diameter 2.5 cm, (iii) examination by conventional US and real-time elastography within one month before surgery, and (iv) no previous thyroid surgery or percutaneous thermotherapy. Models were developed using 60% of randomly selected samples based on nine commonly used algorithms, and validated using the remaining 40% of cases. All models function with a validation data set that has a pretest probability of malignancy of 10%. The models were refined with machine learning that consisted of 1000 repetitions of derivatization and validation, and compared to diagnosis by an experienced radiologist. Sensitivity, specificity, accuracy, and area under the curve (AUC) were calculated. Results: A random forest algorithm led to the best diagnostic model, which performed better than radiologist diagnosis based on conventional US only (AUC = 0.924 [confidence interval (CI) 0.895-0.953] vs. 0.834 [CI 0.815-0.853]) and based on both conventional US and real-time elastography (AUC = 0.938 [CI 0.914-0.961] vs. 0.843 [CI 0.829-0.857]). Conclusions: Machine-learning algorithms based on US examinations, particularly the random forest classifier, may diagnose malignant thyroid nodules better than radiologists.
Entities:
Keywords:
diagnosis; machine learning; random forest; thyroid nodule; ultrasound