Veit Sandfort1,2, Matthew Jacobs3,4, Andrew E Arai3, Li-Yueh Hsu3,5. 1. Stanford Medicine, Pasteur Drive 300, Stanford, CA, 94305, USA. veit.sandfort@gmail.com. 2. National Heart Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA. veit.sandfort@gmail.com. 3. National Heart Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA. 4. Department of Electrical Engineering and Computer Science, The Catholic University of America, Washington, DC, USA. 5. Clinical Center, National Institutes of Health, Bethesda, MD, USA.
Abstract
OBJECTIVES: Cardiac magnetic resonance (CMR) first-pass perfusion is an established noninvasive diagnostic imaging modality for detecting myocardial ischemia. A CMR perfusion sequence provides a time series of 2D images for dynamic contrast enhancement of the heart. Accurate myocardial segmentation of the perfusion images is essential for quantitative analysis and it can facilitate automated pixel-wise myocardial perfusion quantification. METHODS: In this study, we compared different deep learning methodologies for CMR perfusion image segmentation. We evaluated the performance of several image segmentation methods using convolutional neural networks, such as the U-Net in 2D and 3D (2D plus time) implementations, with and without additional motion correction image processing step. We also present a modified U-Net architecture with a novel type of temporal pooling layer which results in improved performance. RESULTS: The best DICE scores were 0.86 and 0.90 for LV myocardium and LV cavity, while the best Hausdorff distances were 2.3 and 2.1 pixels for LV myocardium and LV cavity using 5-fold cross-validation. The methods were corroborated in a second independent test set of 20 patients with similar performance (best DICE scores 0.84 for LV myocardium). CONCLUSIONS: Our results showed that the LV myocardial segmentation of CMR perfusion images is best performed using a combination of motion correction and 3D convolutional networks which significantly outperformed all tested 2D approaches. Reliable frame-by-frame segmentation will facilitate new and improved quantification methods for CMR perfusion imaging. KEY POINTS: • Reliable segmentation of the myocardium offers the potential to perform pixel level perfusion assessment. • A deep learning approach in combination with motion correction, 3D (2D + time) methods, and a deep temporal connection module produced reliable segmentation results.
OBJECTIVES: Cardiac magnetic resonance (CMR) first-pass perfusion is an established noninvasive diagnostic imaging modality for detecting myocardial ischemia. A CMR perfusion sequence provides a time series of 2D images for dynamic contrast enhancement of the heart. Accurate myocardial segmentation of the perfusion images is essential for quantitative analysis and it can facilitate automated pixel-wise myocardial perfusion quantification. METHODS: In this study, we compared different deep learning methodologies for CMR perfusion image segmentation. We evaluated the performance of several image segmentation methods using convolutional neural networks, such as the U-Net in 2D and 3D (2D plus time) implementations, with and without additional motion correction image processing step. We also present a modified U-Net architecture with a novel type of temporal pooling layer which results in improved performance. RESULTS: The best DICE scores were 0.86 and 0.90 for LV myocardium and LV cavity, while the best Hausdorff distances were 2.3 and 2.1 pixels for LV myocardium and LV cavity using 5-fold cross-validation. The methods were corroborated in a second independent test set of 20 patients with similar performance (best DICE scores 0.84 for LV myocardium). CONCLUSIONS: Our results showed that the LV myocardial segmentation of CMR perfusion images is best performed using a combination of motion correction and 3D convolutional networks which significantly outperformed all tested 2D approaches. Reliable frame-by-frame segmentation will facilitate new and improved quantification methods for CMR perfusion imaging. KEY POINTS: • Reliable segmentation of the myocardium offers the potential to perform pixel level perfusion assessment. • A deep learning approach in combination with motion correction, 3D (2D + time) methods, and a deep temporal connection module produced reliable segmentation results.
Entities:
Keywords:
Cardiac magnetic resonance imaging; Deep learning; Image segmentation; Myocardial perfusion
Authors: Vikas Gupta; Hortense A Kirişli; Emile A Hendriks; Rob J van der Geest; Martijn van de Giessen; Wiro Niessen; Johan H C Reiber; Boudewijn P F Lelieveldt Journal: Med Image Anal Date: 2012-01-10 Impact factor: 8.545
Authors: Stefan Klein; Marius Staring; Keelin Murphy; Max A Viergever; Josien P W Pluim Journal: IEEE Trans Med Imaging Date: 2009-11-17 Impact factor: 10.048
Authors: Caroline Petitjean; Maria A Zuluaga; Wenjia Bai; Jean-Nicolas Dacher; Damien Grosgeorge; Jérôme Caudron; Su Ruan; Ismail Ben Ayed; M Jorge Cardoso; Hsiang-Chou Chen; Daniel Jimenez-Carretero; Maria J Ledesma-Carbayo; Christos Davatzikos; Jimit Doshi; Guray Erus; Oskar M O Maier; Cyrus M S Nambakhsh; Yangming Ou; Sébastien Ourselin; Chun-Wei Peng; Nicholas S Peters; Terry M Peters; Martin Rajchl; Daniel Rueckert; Andres Santos; Wenzhe Shi; Ching-Wei Wang; Haiyan Wang; Jing Yuan Journal: Med Image Anal Date: 2014-10-28 Impact factor: 8.545
Authors: Li-Yueh Hsu; Matthew Jacobs; Mitchel Benovoy; Allison D Ta; Hannah M Conn; Susanne Winkler; Anders M Greve; Marcus Y Chen; Sujata M Shanbhag; W Patricia Bandettini; Andrew E Arai Journal: JACC Cardiovasc Imaging Date: 2018-02-14