Kanghyun Ryu1, Cagan Alkan2, Shreyas S Vasanawala1. 1. Department of Radiology, Stanford University, 300 Pasteur Drive, Stanford, California, 94305, USA. 2. Department of Electrical Engineering, Stanford University, Stanford, California, 94305, USA.
Abstract
PURPOSE: Deep learning (DL) based reconstruction using unrolled neural networks has shown great potential in accelerating MRI. However, one of the major drawbacks is the loss of high-frequency details and textures in the output. The purpose of the study is to propose a novel refinement method that uses null-space kernel to refine k-space and improve blurred image details and textures. METHODS: The proposed method constrains the output of the DL to comply to the linear neighborhood relationship calibrated in the auto-calibration lines. To demonstrate efficacy, we tested our refinement method on the DL reconstruction under a variety of conditions (i.e., dataset, unrolled neural networks, and under-sampling scheme). Specifically, the method was tested on three large-scale public datasets (knee and brain) from fastMRI's multi-coil track. RESULTS: The proposed scheme visually reduces the structural error in the k-space domain, enhance the homogeneity of the k-space intensity. Consequently, reconstructed image shows sharper images with enhanced details and textures. The proposed method is also successful in improving high-frequency image details (SSIM, GMSD) without sacrificing overall image error (PSNR). CONCLUSION: Our findings imply that refining DL output using the proposed method may generally improve DL reconstruction as tested with various large-scale dataset and networks.
PURPOSE: Deep learning (DL) based reconstruction using unrolled neural networks has shown great potential in accelerating MRI. However, one of the major drawbacks is the loss of high-frequency details and textures in the output. The purpose of the study is to propose a novel refinement method that uses null-space kernel to refine k-space and improve blurred image details and textures. METHODS: The proposed method constrains the output of the DL to comply to the linear neighborhood relationship calibrated in the auto-calibration lines. To demonstrate efficacy, we tested our refinement method on the DL reconstruction under a variety of conditions (i.e., dataset, unrolled neural networks, and under-sampling scheme). Specifically, the method was tested on three large-scale public datasets (knee and brain) from fastMRI's multi-coil track. RESULTS: The proposed scheme visually reduces the structural error in the k-space domain, enhance the homogeneity of the k-space intensity. Consequently, reconstructed image shows sharper images with enhanced details and textures. The proposed method is also successful in improving high-frequency image details (SSIM, GMSD) without sacrificing overall image error (PSNR). CONCLUSION: Our findings imply that refining DL output using the proposed method may generally improve DL reconstruction as tested with various large-scale dataset and networks.
Authors: Florian Knoll; Jure Zbontar; Anuroop Sriram; Matthew J Muckley; Mary Bruno; Aaron Defazio; Marc Parente; Krzysztof J Geras; Joe Katsnelson; Hersh Chandarana; Zizhao Zhang; Michal Drozdzalv; Adriana Romero; Michael Rabbat; Pascal Vincent; James Pinkerton; Duo Wang; Nafissa Yakubova; Erich Owens; C Lawrence Zitnick; Michael P Recht; Daniel K Sodickson; Yvonne W Lui Journal: Radiol Artif Intell Date: 2020-01-29
Authors: Florian Knoll; Kerstin Hammernik; Chi Zhang; Steen Moeller; Thomas Pock; Daniel K Sodickson; Mehmet Akçakaya Journal: IEEE Signal Process Mag Date: 2020-01-20 Impact factor: 12.551
Authors: Kerstin Hammernik; Teresa Klatzer; Erich Kobler; Michael P Recht; Daniel K Sodickson; Thomas Pock; Florian Knoll Journal: Magn Reson Med Date: 2017-11-08 Impact factor: 4.668