Fang Liu1, Alexey Samsonov1, Lihua Chen2, Richard Kijowski1, Li Feng3. 1. Department of Radiology, University of Wisconsin-Madison, Madison, Wisconsin. 2. Department of Radiology, Southwest Hospital, Chongqing, China. 3. Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York.
Abstract
PURPOSE: To develop and evaluate a novel deep learning-based reconstruction framework called SANTIS (Sampling-Augmented Neural neTwork with Incoherent Structure) for efficient MR image reconstruction with improved robustness against sampling pattern discrepancy. METHODS: With a combination of data cycle-consistent adversarial network, end-to-end convolutional neural network mapping, and data fidelity enforcement for reconstructing undersampled MR data, SANTIS additionally utilizes a sampling-augmented training strategy by extensively varying undersampling patterns during training, so that the network is capable of learning various aliasing structures and thereby removing undersampling artifacts more effectively and robustly. The performance of SANTIS was demonstrated for accelerated knee imaging and liver imaging using a Cartesian trajectory and a golden-angle radial trajectory, respectively. Quantitative metrics were used to assess its performance against different references. The feasibility of SANTIS in reconstructing dynamic contrast-enhanced images was also demonstrated using transfer learning. RESULTS: Compared to conventional reconstruction that exploits image sparsity, SANTIS achieved consistently improved reconstruction performance (lower errors and greater image sharpness). Compared to standard learning-based methods without sampling augmentation (e.g., training with a fixed undersampling pattern), SANTIS provides comparable reconstruction performance, but significantly improved robustness, against sampling pattern discrepancy. SANTIS also achieved encouraging results for reconstructing liver images acquired at different contrast phases. CONCLUSION: By extensively varying undersampling patterns, the sampling-augmented training strategy in SANTIS can remove undersampling artifacts more robustly. The novel concept behind SANTIS can particularly be useful for improving the robustness of deep learning-based image reconstruction against discrepancy between training and inference, an important, but currently less explored, topic.
PURPOSE: To develop and evaluate a novel deep learning-based reconstruction framework called SANTIS (Sampling-Augmented Neural neTwork with Incoherent Structure) for efficient MR image reconstruction with improved robustness against sampling pattern discrepancy. METHODS: With a combination of data cycle-consistent adversarial network, end-to-end convolutional neural network mapping, and data fidelity enforcement for reconstructing undersampled MR data, SANTIS additionally utilizes a sampling-augmented training strategy by extensively varying undersampling patterns during training, so that the network is capable of learning various aliasing structures and thereby removing undersampling artifacts more effectively and robustly. The performance of SANTIS was demonstrated for accelerated knee imaging and liver imaging using a Cartesian trajectory and a golden-angle radial trajectory, respectively. Quantitative metrics were used to assess its performance against different references. The feasibility of SANTIS in reconstructing dynamic contrast-enhanced images was also demonstrated using transfer learning. RESULTS: Compared to conventional reconstruction that exploits image sparsity, SANTIS achieved consistently improved reconstruction performance (lower errors and greater image sharpness). Compared to standard learning-based methods without sampling augmentation (e.g., training with a fixed undersampling pattern), SANTIS provides comparable reconstruction performance, but significantly improved robustness, against sampling pattern discrepancy. SANTIS also achieved encouraging results for reconstructing liver images acquired at different contrast phases. CONCLUSION: By extensively varying undersampling patterns, the sampling-augmented training strategy in SANTIS can remove undersampling artifacts more robustly. The novel concept behind SANTIS can particularly be useful for improving the robustness of deep learning-based image reconstruction against discrepancy between training and inference, an important, but currently less explored, topic.
Keywords:
data augmentation; data cycle-consistent adversarial network; deep learning; image reconstruction; reconstruction robustness; sampling discrepancy
Authors: Jo Schlemper; Jose Caballero; Joseph V Hajnal; Anthony N Price; Daniel Rueckert Journal: IEEE Trans Med Imaging Date: 2017-10-13 Impact factor: 10.048
Authors: Li Feng; Leon Axel; Hersh Chandarana; Kai Tobias Block; Daniel K Sodickson; Ricardo Otazo Journal: Magn Reson Med Date: 2015-03-25 Impact factor: 4.668
Authors: Thomas Benkert; Ye Tian; Chenchan Huang; Edward V R DiBella; Hersh Chandarana; Li Feng Journal: Magn Reson Med Date: 2017-11-28 Impact factor: 4.668
Authors: Morteza Mardani; Enhao Gong; Joseph Y Cheng; Shreyas S Vasanawala; Greg Zaharchuk; Lei Xing; John M Pauly Journal: IEEE Trans Med Imaging Date: 2018-07-23 Impact factor: 10.048
Authors: Tevfik F Ismail; Wendy Strugnell; Chiara Coletti; Maša Božić-Iven; Sebastian Weingärtner; Kerstin Hammernik; Teresa Correia; Thomas Küstner Journal: Front Cardiovasc Med Date: 2022-03-03
Authors: Akshay S Chaudhari; Christopher M Sandino; Elizabeth K Cole; David B Larson; Garry E Gold; Shreyas S Vasanawala; Matthew P Lungren; Brian A Hargreaves; Curtis P Langlotz Journal: J Magn Reson Imaging Date: 2020-08-24 Impact factor: 5.119