Xiao Zhou1,2, Shangran Qiu1,3, Prajakta S Joshi4,5, Chonghua Xue1, Ronald J Killiany4,6,7,8, Asim Z Mian6, Sang P Chin2,9,10, Rhoda Au4,7,8,11,12, Vijaya B Kolachalama13,14,15,16. 1. Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, 72 E. Concord Street, Evans 636, Boston, MA, 02118, USA. 2. Department of Computer Science, College of Arts & Sciences, Boston University, Boston, MA, USA. 3. Department of Physics, College of Arts & Sciences, Boston University, Boston, MA, USA. 4. Department of Anatomy and Neurobiology, Boston University School of Medicine, Boston, MA, USA. 5. Department of General Dentistry, Boston University School of Dental Medicine, Boston, MA, USA. 6. Department of Radiology, Boston University School of Medicine, Boston, MA, USA. 7. Department of Neurology, Boston University School of Medicine, Boston, MA, USA. 8. Boston University Alzheimer's Disease Center, Boston, MA, USA. 9. Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA, USA. 10. Center of Mathematical Sciences & Applications, Harvard University, Cambridge, MA, USA. 11. The Framingham Heart Study, Boston University School of Medicine, Boston, MA, USA. 12. Department of Epidemiology, Boston University School of Public Health, Boston, MA, USA. 13. Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, 72 E. Concord Street, Evans 636, Boston, MA, 02118, USA. vkola@bu.edu. 14. Department of Computer Science, College of Arts & Sciences, Boston University, Boston, MA, USA. vkola@bu.edu. 15. Boston University Alzheimer's Disease Center, Boston, MA, USA. vkola@bu.edu. 16. Faculty of Computing & Data Sciences, Boston University, Boston, MA, USA. vkola@bu.edu.
Abstract
BACKGROUND: Generative adversarial networks (GAN) can produce images of improved quality but their ability to augment image-based classification is not fully explored. We evaluated if a modified GAN can learn from magnetic resonance imaging (MRI) scans of multiple magnetic field strengths to enhance Alzheimer's disease (AD) classification performance. METHODS: T1-weighted brain MRI scans from 151 participants of the Alzheimer's Disease Neuroimaging Initiative (ADNI), who underwent both 1.5-Tesla (1.5-T) and 3-Tesla imaging at the same time were selected to construct a GAN model. This model was trained along with a three-dimensional fully convolutional network (FCN) using the generated images (3T*) as inputs to predict AD status. Quality of the generated images was evaluated using signal to noise ratio (SNR), Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE) and Natural Image Quality Evaluator (NIQE). Cases from the Australian Imaging, Biomarker & Lifestyle Flagship Study of Ageing (AIBL, n = 107) and the National Alzheimer's Coordinating Center (NACC, n = 565) were used for model validation. RESULTS: The 3T*-based FCN classifier performed better than the FCN model trained using the 1.5-T scans. Specifically, the mean area under curve increased from 0.907 to 0.932, from 0.934 to 0.940, and from 0.870 to 0.907 on the ADNI test, AIBL, and NACC datasets, respectively. Additionally, we found that the mean quality of the generated (3T*) images was consistently higher than the 1.5-T images, as measured using SNR, BRISQUE, and NIQE on the validation datasets. CONCLUSION: This study demonstrates a proof of principle that GAN frameworks can be constructed to augment AD classification performance and improve image quality.
BACKGROUND: Generative adversarial networks (GAN) can produce images of improved quality but their ability to augment image-based classification is not fully explored. We evaluated if a modified GAN can learn from magnetic resonance imaging (MRI) scans of multiple magnetic field strengths to enhance Alzheimer's disease (AD) classification performance. METHODS: T1-weighted brain MRI scans from 151 participants of the Alzheimer's Disease Neuroimaging Initiative (ADNI), who underwent both 1.5-Tesla (1.5-T) and 3-Tesla imaging at the same time were selected to construct a GAN model. This model was trained along with a three-dimensional fully convolutional network (FCN) using the generated images (3T*) as inputs to predict AD status. Quality of the generated images was evaluated using signal to noise ratio (SNR), Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE) and Natural Image Quality Evaluator (NIQE). Cases from the Australian Imaging, Biomarker & Lifestyle Flagship Study of Ageing (AIBL, n = 107) and the National Alzheimer's Coordinating Center (NACC, n = 565) were used for model validation. RESULTS: The 3T*-based FCN classifier performed better than the FCN model trained using the 1.5-T scans. Specifically, the mean area under curve increased from 0.907 to 0.932, from 0.934 to 0.940, and from 0.870 to 0.907 on the ADNI test, AIBL, and NACC datasets, respectively. Additionally, we found that the mean quality of the generated (3T*) images was consistently higher than the 1.5-T images, as measured using SNR, BRISQUE, and NIQE on the validation datasets. CONCLUSION: This study demonstrates a proof of principle that GAN frameworks can be constructed to augment AD classification performance and improve image quality.
Entities:
Keywords:
Alzheimer’s disease; Deep learning; Fully convolutional network; Generative adversarial network; Magnetic field strength; Magnetic resonance imaging
Authors: Kathryn A Ellis; Christopher C Rowe; Victor L Villemagne; Ralph N Martins; Colin L Masters; Olivier Salvado; Cassandra Szoeke; David Ames Journal: Alzheimers Dement Date: 2010-05 Impact factor: 21.566
Authors: Clifford R Jack; Matt A Bernstein; Nick C Fox; Paul Thompson; Gene Alexander; Danielle Harvey; Bret Borowski; Paula J Britson; Jennifer L Whitwell; Chadwick Ward; Anders M Dale; Joel P Felmlee; Jeffrey L Gunter; Derek L G Hill; Ron Killiany; Norbert Schuff; Sabrina Fox-Bosetti; Chen Lin; Colin Studholme; Charles S DeCarli; Gunnar Krueger; Heidi A Ward; Gregory J Metzger; Katherine T Scott; Richard Mallozzi; Daniel Blezek; Joshua Levy; Josef P Debbins; Adam S Fleisher; Marilyn Albert; Robert Green; George Bartzokis; Gary Glover; John Mugler; Michael W Weiner Journal: J Magn Reson Imaging Date: 2008-04 Impact factor: 4.813
Authors: Maria Elena Laino; Pierandrea Cancian; Letterio Salvatore Politi; Matteo Giovanni Della Porta; Luca Saba; Victor Savevski Journal: J Imaging Date: 2022-03-23