Hanying Liang1, Guochen Ning1, Shangqi Dai1, Longfei Ma1, Jianwen Luo1, Xinran Zhang1, Hongen Liao2. 1. Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China. 2. Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China. liao@tsinghua.edu.cn.
Abstract
PURPOSE: 4D reconstruction based on radiation-free ultrasound can provide valuable information about the anatomy. Current 4D US technologies are either faced with limited field-of-view (FoV), technical complications, or cumbersome setups. This paper proposes a spatiotemporal US reconstruction framework to enhance its ability to provide dynamic structure information. METHODS: We propose a spatiotemporal US reconstruction framework based on freehand sonography. First, a collecting strategy is presented to acquire 2D US images in multiple spatial and temporal positions. A morphology-based phase extraction method after pose correction is presented to decouple the compounding image variations. For temporal alignment and reconstruction, a robust kernel regression model is established to reconstruct images in arbitrary phases. Finally, the spatiotemporal reconstruction is demonstrated in the form of 4D movies by integrating the US images according to the tracked poses and estimated phases. RESULTS: Quantitative and qualitative experiments were conducted on the carotid US to validate the feasibility of the proposed pipeline. The mean phase localization and heart rate estimation errors were 0.07 ± 0.04 s and 0.83 ± 3.35 bpm, respectively, compared with cardiac gating signals. The assessment of reconstruction quality showed a low RMSE (<0.06) between consecutive images. Quantitative comparisons of anatomy reconstruction from the generated US volumes and MRI showed an average surface distance of 0.39 ± 0.09 mm on the common carotid artery and 0.53 ± 0.05 mm with a landmark localization error of 0.60 ± 0.18 mm on carotid bifurcation. CONCLUSION: A novel spatiotemporal US reconstruction framework based on freehand sonography is proposed that preserves the utility nature of conventional freehand US. Evaluations on in vivo datasets indicated that our framework could achieve acceptable reconstruction performance and show potential application value in the US examination of dynamic anatomy.
PURPOSE: 4D reconstruction based on radiation-free ultrasound can provide valuable information about the anatomy. Current 4D US technologies are either faced with limited field-of-view (FoV), technical complications, or cumbersome setups. This paper proposes a spatiotemporal US reconstruction framework to enhance its ability to provide dynamic structure information. METHODS: We propose a spatiotemporal US reconstruction framework based on freehand sonography. First, a collecting strategy is presented to acquire 2D US images in multiple spatial and temporal positions. A morphology-based phase extraction method after pose correction is presented to decouple the compounding image variations. For temporal alignment and reconstruction, a robust kernel regression model is established to reconstruct images in arbitrary phases. Finally, the spatiotemporal reconstruction is demonstrated in the form of 4D movies by integrating the US images according to the tracked poses and estimated phases. RESULTS: Quantitative and qualitative experiments were conducted on the carotid US to validate the feasibility of the proposed pipeline. The mean phase localization and heart rate estimation errors were 0.07 ± 0.04 s and 0.83 ± 3.35 bpm, respectively, compared with cardiac gating signals. The assessment of reconstruction quality showed a low RMSE (<0.06) between consecutive images. Quantitative comparisons of anatomy reconstruction from the generated US volumes and MRI showed an average surface distance of 0.39 ± 0.09 mm on the common carotid artery and 0.53 ± 0.05 mm with a landmark localization error of 0.60 ± 0.18 mm on carotid bifurcation. CONCLUSION: A novel spatiotemporal US reconstruction framework based on freehand sonography is proposed that preserves the utility nature of conventional freehand US. Evaluations on in vivo datasets indicated that our framework could achieve acceptable reconstruction performance and show potential application value in the US examination of dynamic anatomy.
Authors: Thomas A Roberts; Joshua F P van Amerom; Alena Uus; David F A Lloyd; Milou P M van Poppel; Anthony N Price; Jacques-Donald Tournier; Chloe A Mohanadass; Laurence H Jackson; Shaihan J Malik; Kuberan Pushparajah; Mary A Rutherford; Reza Razavi; Maria Deprez; Joseph V Hajnal Journal: Nat Commun Date: 2020-10-05 Impact factor: 14.919