Zhimin Yuan1, Xiaofen Ma2, Jiajin Yi1, Zhengrong Luo1, Jialin Peng3. 1. College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China. 2. Department of Medical Imaging, Guangdong Second Provincial General Hospital, Guangzhou, 510317, China. 3. College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China; Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China. Electronic address: jialinpeng@hqu.edu.cn.
Abstract
BACKGROUND AND OBJECTIVE: With the advancement of electron microscopy (EM) imaging technology, neuroscientists can investigate the function of various intracellular organelles, e.g, mitochondria, at nano-scale. Semantic segmentation of electron microscopy (EM) is an essential step to efficiently obtain reliable morphological statistics. Despite the great success achieved using deep convolutional neural networks (CNNs), they still produce coarse segmentations with lots of discontinuities and false positives for mitochondria segmentation. METHODS: In this study, we introduce a centerline-aware multitask network by utilizing centerline as an intrinsic shape cue of mitochondria to regularize the segmentation. Since the application of 3D CNNs on large medical volumes is usually hindered by their substantial computational cost and storage overhead, we introduce a novel hierarchical view-ensemble convolution (HVEC), a simple alternative of 3D convolution to learn 3D spatial contexts using more efficient 2D convolutions. The HVEC enables both decomposing and sharing multi-view information, leading to increased learning capacity. RESULTS: Extensive validation results on two challenging benchmarks show that, the proposed method performs favorably against the state-of-the-art methods in accuracy and visual quality but with a greatly reduced model size. Moreover, the proposed model also shows significantly improved generalization ability, especially when training with quite limited amount of training data. Detailed sensitivity analysis and ablation study have also been conducted, which show the robustness of the proposed model and effectiveness of the proposed modules. CONCLUSIONS: The experiments highlighted that the proposed architecture enables both simplicity and efficiency leading to increased capacity of learning spatial contexts. Moreover, incorporating shape cues such as centerline information is a promising approach to improve the performance of mitochondria segmentation.
BACKGROUND AND OBJECTIVE: With the advancement of electron microscopy (EM) imaging technology, neuroscientists can investigate the function of various intracellular organelles, e.g, mitochondria, at nano-scale. Semantic segmentation of electron microscopy (EM) is an essential step to efficiently obtain reliable morphological statistics. Despite the great success achieved using deep convolutional neural networks (CNNs), they still produce coarse segmentations with lots of discontinuities and false positives for mitochondria segmentation. METHODS: In this study, we introduce a centerline-aware multitask network by utilizing centerline as an intrinsic shape cue of mitochondria to regularize the segmentation. Since the application of 3D CNNs on large medical volumes is usually hindered by their substantial computational cost and storage overhead, we introduce a novel hierarchical view-ensemble convolution (HVEC), a simple alternative of 3D convolution to learn 3D spatial contexts using more efficient 2D convolutions. The HVEC enables both decomposing and sharing multi-view information, leading to increased learning capacity. RESULTS: Extensive validation results on two challenging benchmarks show that, the proposed method performs favorably against the state-of-the-art methods in accuracy and visual quality but with a greatly reduced model size. Moreover, the proposed model also shows significantly improved generalization ability, especially when training with quite limited amount of training data. Detailed sensitivity analysis and ablation study have also been conducted, which show the robustness of the proposed model and effectiveness of the proposed modules. CONCLUSIONS: The experiments highlighted that the proposed architecture enables both simplicity and efficiency leading to increased capacity of learning spatial contexts. Moreover, incorporating shape cues such as centerline information is a promising approach to improve the performance of mitochondria segmentation.