Zhuo Wang1,2, Zhezhou Yu1, Yao Wang1, Huimao Zhang2,3, Yishan Luo4, Lin Shi4,5, Yan Wang1, Chunjie Guo2,3. 1. Key Laboratory of Symbol Computation & Knowledge Engineering, Ministry of Education, College of Computer Science & Technology, Jilin University, Changchun, China. 2. Department of Radiology, the First Hospital of Jilin University, Changchun, China. 3. Jilin Provincial Key Laboratory for Medical imaging, Changchun, China. 4. BrainNow Research Institute, Hong Kong, China. 5. Department of Imaging and Interventional Radiology, Chinese University of Hong Kong, Hong Kong, China.
Abstract
BACKGROUND: Magnetic resonance imaging (MRI) has a wide range of applications in medical imaging. Recently, studies based on deep learning algorithms have demonstrated powerful processing capabilities for medical imaging data. Previous studies have mostly focused on common diseases that usually have large scales of datasets and centralized the lesions in the brain. In this paper, we used deep learning models to process MRI images to differentiate the rare neuromyelitis optical spectrum disorder (NMOSD) from multiple sclerosis (MS) automatically, which are characterized by scattered and overlapping lesions. METHODS: We proposed a novel model structure to capture 3D MRI images' essential information and converted them into lower dimensions. To empirically prove the efficiency of our model, firstly, we used a conventional 3-dimensional (3D) model to classify the T2-weighted fluid-attenuated inversion recovery (T2-FLAIR) images and proved that the traditional 3D convolutional neural network (CNN) models lack the learning capacity to distinguish between NMOSD and MS. Then, we compressed the 3D T2-FLAIR images by a two-view compression block to apply two different depths (18 and 34 layers) of 2D models for disease diagnosis and also applied transfer learning by pre-training our model on ImageNet dataset. RESULTS: We found that our models possess superior performance when our models were pre-trained on ImageNet dataset, in which the models' average accuracies of 34 layers model and 18 layers model were 0.75 and 0.725, sensitivities were 0.707 and 0.708, and specificities were 0.759 and 0.719, respectively. Meanwhile, the traditional 3D CNN models lacked the learning capacity to distinguish between NMOSD and MS. CONCLUSION: The novel CNN model we proposed could automatically differentiate the rare NMOSD from MS, especially, our model showed better performance than traditional3D CNN models. It indicated that our 3D compressed CNN models are applicable in handling diseases with small-scale datasets and possess overlapping and scattered lesions.
BACKGROUND: Magnetic resonance imaging (MRI) has a wide range of applications in medical imaging. Recently, studies based on deep learning algorithms have demonstrated powerful processing capabilities for medical imaging data. Previous studies have mostly focused on common diseases that usually have large scales of datasets and centralized the lesions in the brain. In this paper, we used deep learning models to process MRI images to differentiate the rare neuromyelitis optical spectrum disorder (NMOSD) from multiple sclerosis (MS) automatically, which are characterized by scattered and overlapping lesions. METHODS: We proposed a novel model structure to capture 3D MRI images' essential information and converted them into lower dimensions. To empirically prove the efficiency of our model, firstly, we used a conventional 3-dimensional (3D) model to classify the T2-weighted fluid-attenuated inversion recovery (T2-FLAIR) images and proved that the traditional 3D convolutional neural network (CNN) models lack the learning capacity to distinguish between NMOSD and MS. Then, we compressed the 3D T2-FLAIR images by a two-view compression block to apply two different depths (18 and 34 layers) of 2D models for disease diagnosis and also applied transfer learning by pre-training our model on ImageNet dataset. RESULTS: We found that our models possess superior performance when our models were pre-trained on ImageNet dataset, in which the models' average accuracies of 34 layers model and 18 layers model were 0.75 and 0.725, sensitivities were 0.707 and 0.708, and specificities were 0.759 and 0.719, respectively. Meanwhile, the traditional 3D CNN models lacked the learning capacity to distinguish between NMOSD and MS. CONCLUSION: The novel CNN model we proposed could automatically differentiate the rare NMOSD from MS, especially, our model showed better performance than traditional3D CNN models. It indicated that our 3D compressed CNN models are applicable in handling diseases with small-scale datasets and possess overlapping and scattered lesions.
Authors: Geert Litjens; Thijs Kooi; Babak Ehteshami Bejnordi; Arnaud Arindra Adiyoso Setio; Francesco Ciompi; Mohsen Ghafoorian; Jeroen A W M van der Laak; Bram van Ginneken; Clara I Sánchez Journal: Med Image Anal Date: 2017-07-26 Impact factor: 8.545
Authors: Miles N Wernick; Yongyi Yang; Jovan G Brankov; Grigori Yourganov; Stephen C Strother Journal: IEEE Signal Process Mag Date: 2010-07 Impact factor: 12.551
Authors: Arman Eshaghi; Viktor Wottschel; Rosa Cortese; Massimiliano Calabrese; Mohammad Ali Sahraian; Alan J Thompson; Daniel C Alexander; Olga Ciccarelli Journal: Neurology Date: 2016-11-02 Impact factor: 9.910
Authors: Evangelia I Zacharaki; Sumei Wang; Sanjeev Chawla; Dong Soo Yoo; Ronald Wolf; Elias R Melhem; Christos Davatzikos Journal: Magn Reson Med Date: 2009-12 Impact factor: 4.668
Authors: Dean M Wingerchuk; Vanda A Lennon; Claudia F Lucchinetti; Sean J Pittock; Brian G Weinshenker Journal: Lancet Neurol Date: 2007-09 Impact factor: 44.182
Authors: Chris H Polman; Stephen C Reingold; Brenda Banwell; Michel Clanet; Jeffrey A Cohen; Massimo Filippi; Kazuo Fujihara; Eva Havrdova; Michael Hutchinson; Ludwig Kappos; Fred D Lublin; Xavier Montalban; Paul O'Connor; Magnhild Sandberg-Wollheim; Alan J Thompson; Emmanuelle Waubant; Brian Weinshenker; Jerry S Wolinsky Journal: Ann Neurol Date: 2011-02 Impact factor: 10.422
Authors: Zhiyu Cao; Yingren Mai; Wenli Fang; Ming Lei; Yishan Luo; Lei Zhao; Wang Liao; Qun Yu; Jiaxin Xu; Yuting Ruan; Songhua Xiao; Vincent C T Mok; Lin Shi; Jun Liu Journal: Front Hum Neurosci Date: 2022-06-14 Impact factor: 3.473