Charlie A Hamm1,2, Clinton J Wang1, Lynn J Savic1,2, Marc Ferrante1, Isabel Schobert1,2, Todd Schlachter1, MingDe Lin1, James S Duncan1,3, Jeffrey C Weinreb1, Julius Chapiro4, Brian Letzen1. 1. Department of Radiology and Biomedical Imaging, Yale School of Medicine, 333 Cedar Street, New Haven, CT, 06520, USA. 2. Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Berlin Institute of Health, Institute of Radiology, Humboldt-Universität, 10117, Berlin, Germany. 3. Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT, 06520, USA. 4. Department of Radiology and Biomedical Imaging, Yale School of Medicine, 333 Cedar Street, New Haven, CT, 06520, USA. j.chapiro@googlemail.com.
Abstract
OBJECTIVES: To develop and validate a proof-of-concept convolutional neural network (CNN)-based deep learning system (DLS) that classifies common hepatic lesions on multi-phasic MRI. METHODS: A custom CNN was engineered by iteratively optimizing the network architecture and training cases, finally consisting of three convolutional layers with associated rectified linear units, two maximum pooling layers, and two fully connected layers. Four hundred ninety-four hepatic lesions with typical imaging features from six categories were utilized, divided into training (n = 434) and test (n = 60) sets. Established augmentation techniques were used to generate 43,400 training samples. An Adam optimizer was used for training. Monte Carlo cross-validation was performed. After model engineering was finalized, classification accuracy for the final CNN was compared with two board-certified radiologists on an identical unseen test set. RESULTS: The DLS demonstrated a 92% accuracy, a 92% sensitivity (Sn), and a 98% specificity (Sp). Test set performance in a single run of random unseen cases showed an average 90% Sn and 98% Sp. The average Sn/Sp on these same cases for radiologists was 82.5%/96.5%. Results showed a 90% Sn for classifying hepatocellular carcinoma (HCC) compared to 60%/70% for radiologists. For HCC classification, the true positive and false positive rates were 93.5% and 1.6%, respectively, with a receiver operating characteristic area under the curve of 0.992. Computation time per lesion was 5.6 ms. CONCLUSION: This preliminary deep learning study demonstrated feasibility for classifying lesions with typical imaging features from six common hepatic lesion types, motivating future studies with larger multi-institutional datasets and more complex imaging appearances. KEY POINTS: • Deep learning demonstrates high performance in the classification of liver lesions on volumetric multi-phasic MRI, showing potential as an eventual decision-support tool for radiologists. • Demonstrating a classification runtime of a few milliseconds per lesion, a deep learning system could be incorporated into the clinical workflow in a time-efficient manner.
OBJECTIVES: To develop and validate a proof-of-concept convolutional neural network (CNN)-based deep learning system (DLS) that classifies common hepatic lesions on multi-phasic MRI. METHODS: A custom CNN was engineered by iteratively optimizing the network architecture and training cases, finally consisting of three convolutional layers with associated rectified linear units, two maximum pooling layers, and two fully connected layers. Four hundred ninety-four hepatic lesions with typical imaging features from six categories were utilized, divided into training (n = 434) and test (n = 60) sets. Established augmentation techniques were used to generate 43,400 training samples. An Adam optimizer was used for training. Monte Carlo cross-validation was performed. After model engineering was finalized, classification accuracy for the final CNN was compared with two board-certified radiologists on an identical unseen test set. RESULTS: The DLS demonstrated a 92% accuracy, a 92% sensitivity (Sn), and a 98% specificity (Sp). Test set performance in a single run of random unseen cases showed an average 90% Sn and 98% Sp. The average Sn/Sp on these same cases for radiologists was 82.5%/96.5%. Results showed a 90% Sn for classifying hepatocellular carcinoma (HCC) compared to 60%/70% for radiologists. For HCC classification, the true positive and false positive rates were 93.5% and 1.6%, respectively, with a receiver operating characteristic area under the curve of 0.992. Computation time per lesion was 5.6 ms. CONCLUSION: This preliminary deep learning study demonstrated feasibility for classifying lesions with typical imaging features from six common hepatic lesion types, motivating future studies with larger multi-institutional datasets and more complex imaging appearances. KEY POINTS: • Deep learning demonstrates high performance in the classification of liver lesions on volumetric multi-phasic MRI, showing potential as an eventual decision-support tool for radiologists. • Demonstrating a classification runtime of a few milliseconds per lesion, a deep learning system could be incorporated into the clinical workflow in a time-efficient manner.
Entities:
Keywords:
Artificial intelligence; Deep learning; Liver cancer
Authors: Kathryn J Fowler; An Tang; Cynthia Santillan; Mythreyi Bhargavan-Chatfield; Jay Heiken; Reena C Jha; Jeffrey Weinreb; Hero Hussain; Donald G Mitchell; Mustafa R Bashir; Eduardo A C Costa; Guilherme M Cunha; Laura Coombs; Tanya Wolfson; Anthony C Gamst; Giuseppe Brancatelli; Benjamin Yeh; Claude B Sirlin Journal: Radiology Date: 2017-11-01 Impact factor: 11.105
Authors: U Rajendra Acharya; Joel En Wei Koh; Yuki Hagiwara; Jen Hong Tan; Arkadiusz Gertych; Anushya Vijayananthan; Nur Adura Yaakup; Basri Johan Jeet Abdullah; Mohd Kamil Bin Mohd Fabell; Chai Hong Yeong Journal: Comput Biol Med Date: 2018-01-03 Impact factor: 4.589
Authors: Mustafa R Bashir; Rong Huang; Nicholas Mayes; Daniele Marin; Carl L Berg; Rendon C Nelson; Tracy A Jaffe Journal: J Magn Reson Imaging Date: 2014-11-05 Impact factor: 4.813
Authors: Eric C Ehman; Spencer C Behr; Sarah E Umetsu; Nicholas Fidelman; Ben M Yeh; Linda D Ferrell; Thomas A Hope Journal: Abdom Radiol (NY) Date: 2016-05
Authors: Gary H Chang; David T Felson; Shangran Qiu; Ali Guermazi; Terence D Capellini; Vijaya B Kolachalama Journal: Eur Radiol Date: 2020-02-13 Impact factor: 5.315
Authors: Laurent Dercle; Lin Lu; Lawrence H Schwartz; Min Qian; Sabine Tejpar; Peter Eggleton; Binsheng Zhao; Hubert Piessevaux Journal: J Natl Cancer Inst Date: 2020-09-01 Impact factor: 13.506
Authors: Sara Ranjbar; Kyle W Singleton; Pamela R Jackson; Cassandra R Rickertsen; Scott A Whitmire; Kamala R Clark-Swanson; J Ross Mitchell; Kristin R Swanson; Leland S Hu Journal: J Digit Imaging Date: 2020-04 Impact factor: 4.056