Dongsheng Jiang1,2, Yonghong Shi1,2, Demin Yao1,2, Yifeng Fan3, Manning Wang4,5, Zhijian Song6,7. 1. Digital Medical Research Center, School of Basic Medical Science, Fudan University, Shanghai, 200032, China. 2. Shanghai Key Laboratory of Medical Image Computing and Computer-Assisted Intervention, Shanghai, 200032, China. 3. School of Medical Imaging, Hangzhou Medical College, Hangzhou, 310053, China. 4. Digital Medical Research Center, School of Basic Medical Science, Fudan University, Shanghai, 200032, China. mnwang@fudan.edu.cn. 5. Shanghai Key Laboratory of Medical Image Computing and Computer-Assisted Intervention, Shanghai, 200032, China. mnwang@fudan.edu.cn. 6. Digital Medical Research Center, School of Basic Medical Science, Fudan University, Shanghai, 200032, China. zjsong@fudan.edu.cn. 7. Shanghai Key Laboratory of Medical Image Computing and Computer-Assisted Intervention, Shanghai, 200032, China. zjsong@fudan.edu.cn.
Abstract
PURPOSE: Multimodal image registration plays an important role in image-guided interventions/therapy and atlas building, and it is still a challenging task due to the complex intensity variations in different modalities. METHODS: The paper addresses the problem and proposes a simple, compact, fast and generally applicable modality-independent binary gradient angle descriptor (BGA) based on the rationale of gradient orientation alignment. The BGA can be easily calculated at each voxel by coding the quadrant in which a local gradient vector falls, and it has an extremely low computational complexity, requiring only three convolutions, two multiplication operations and two comparison operations. Meanwhile, the binarized encoding of the gradient orientation makes the BGA more resistant to image degradations compared with conventional gradient orientation methods. The BGA can extract similar feature descriptors for different modalities and enable the use of simple similarity measures, which makes it applicable within a wide range of optimization frameworks. RESULTS: The results for pairwise multimodal and monomodal registrations between various images (T1, T2, PD, T1c, Flair) consistently show that the BGA significantly outperforms localized mutual information. The experimental results also confirm that the BGA can be a reliable alternative to the sum of absolute difference in monomodal image registration. The BGA can also achieve an accuracy of [Formula: see text], similar to that of the SSC, for the deformable registration of inhale and exhale CT scans. Specifically, for the highly challenging deformable registration of preoperative MRI and 3D intraoperative ultrasound images, the BGA achieves a similar registration accuracy of [Formula: see text] compared with state-of-the-art approaches, with a computation time of 18.3 s per case. CONCLUSIONS: The BGA improves the registration performance in terms of both accuracy and time efficiency. With further acceleration, the framework has the potential for application in time-sensitive clinical environments, such as for preoperative MRI and intraoperative US image registration for image-guided intervention.
PURPOSE: Multimodal image registration plays an important role in image-guided interventions/therapy and atlas building, and it is still a challenging task due to the complex intensity variations in different modalities. METHODS: The paper addresses the problem and proposes a simple, compact, fast and generally applicable modality-independent binary gradient angle descriptor (BGA) based on the rationale of gradient orientation alignment. The BGA can be easily calculated at each voxel by coding the quadrant in which a local gradient vector falls, and it has an extremely low computational complexity, requiring only three convolutions, two multiplication operations and two comparison operations. Meanwhile, the binarized encoding of the gradient orientation makes the BGA more resistant to image degradations compared with conventional gradient orientation methods. The BGA can extract similar feature descriptors for different modalities and enable the use of simple similarity measures, which makes it applicable within a wide range of optimization frameworks. RESULTS: The results for pairwise multimodal and monomodal registrations between various images (T1, T2, PD, T1c, Flair) consistently show that the BGA significantly outperforms localized mutual information. The experimental results also confirm that the BGA can be a reliable alternative to the sum of absolute difference in monomodal image registration. The BGA can also achieve an accuracy of [Formula: see text], similar to that of the SSC, for the deformable registration of inhale and exhale CT scans. Specifically, for the highly challenging deformable registration of preoperative MRI and 3D intraoperative ultrasound images, the BGA achieves a similar registration accuracy of [Formula: see text] compared with state-of-the-art approaches, with a computation time of 18.3 s per case. CONCLUSIONS: The BGA improves the registration performance in terms of both accuracy and time efficiency. With further acceleration, the framework has the potential for application in time-sensitive clinical environments, such as for preoperative MRI and intraoperative US image registration for image-guided intervention.
Authors: Zhang Li; Dwarikanath Mahapatra; Jeroen A W Tielbeek; Jaap Stoker; Lucas J van Vliet; Frans M Vos Journal: IEEE Trans Med Imaging Date: 2015-07-13 Impact factor: 10.048
Authors: Mattias Paul Heinrich; Mark Jenkinson; Bartlomiej W Papiez; Sir Michael Brady; Julia A Schnabel Journal: Med Image Comput Comput Assist Interv Date: 2013