Kaida Jiang1, Li Quan1, Tao Gong2. 1. College of Information Science and Technology, Donghua University, Shanghai, China. 2. College of Information Science and Technology, Donghua University, Shanghai, China. taogong@dhu.edu.cn.
Abstract
PURPOSE: Existing medical image segmentation models tend to achieve satisfactory performance when the training and test data are drawn from the same distribution, while they often produce significant performance degradation when used for the evaluation of cross-modality data. To facilitate the deployment of deep learning models in real-world medical scenarios and to mitigate the performance degradation caused by domain shift, we propose an unsupervised cross-modality segmentation framework based on representation disentanglement and image-to-image translation. METHODS: Our approach is based on a multimodal image translation framework, which assumes that the latent space of images can be decomposed into a content space and a style space. First, image representations are decomposed into the content and style codes by the encoders and recombined to generate cross-modality images. Second, we propose content and style reconstruction losses to preserve consistent semantic information from original images and construct content discriminators to match the content distributions between source and target domains. Synthetic images with target domain style and source domain anatomical structures are then utilized for training of the segmentation model. RESULTS: We applied our framework to the bidirectional adaptation experiments on MRI and CT images of abdominal organs. Compared to the case without adaptation, the Dice similarity coefficient (DSC) increased by almost 30 and 25% and average symmetric surface distance (ASSD) dropped by 13.3 and 12.2, respectively. CONCLUSION: The proposed unsupervised domain adaptation framework can effectively improve the performance of cross-modality segmentation, and minimize the negative impact of domain shift. Furthermore, the translated image retains semantic information and anatomical structure. Our method significantly outperforms several competing methods.
PURPOSE: Existing medical image segmentation models tend to achieve satisfactory performance when the training and test data are drawn from the same distribution, while they often produce significant performance degradation when used for the evaluation of cross-modality data. To facilitate the deployment of deep learning models in real-world medical scenarios and to mitigate the performance degradation caused by domain shift, we propose an unsupervised cross-modality segmentation framework based on representation disentanglement and image-to-image translation. METHODS: Our approach is based on a multimodal image translation framework, which assumes that the latent space of images can be decomposed into a content space and a style space. First, image representations are decomposed into the content and style codes by the encoders and recombined to generate cross-modality images. Second, we propose content and style reconstruction losses to preserve consistent semantic information from original images and construct content discriminators to match the content distributions between source and target domains. Synthetic images with target domain style and source domain anatomical structures are then utilized for training of the segmentation model. RESULTS: We applied our framework to the bidirectional adaptation experiments on MRI and CT images of abdominal organs. Compared to the case without adaptation, the Dice similarity coefficient (DSC) increased by almost 30 and 25% and average symmetric surface distance (ASSD) dropped by 13.3 and 12.2, respectively. CONCLUSION: The proposed unsupervised domain adaptation framework can effectively improve the performance of cross-modality segmentation, and minimize the negative impact of domain shift. Furthermore, the translated image retains semantic information and anatomical structure. Our method significantly outperforms several competing methods.
Authors: A Emre Kavur; N Sinem Gezer; Mustafa Barış; Sinem Aslan; Pierre-Henri Conze; Vladimir Groza; Duc Duy Pham; Soumick Chatterjee; Philipp Ernst; Savaş Özkan; Bora Baydar; Dmitry Lachinov; Shuo Han; Josef Pauli; Fabian Isensee; Matthias Perkonigg; Rachana Sathish; Ronnie Rajan; Debdoot Sheet; Gurbandurdy Dovletov; Oliver Speck; Andreas Nürnberger; Klaus H Maier-Hein; Gözde Bozdağı Akar; Gözde Ünal; Oğuz Dicle; M Alper Selver Journal: Med Image Anal Date: 2020-12-25 Impact factor: 8.545
Authors: Dong Nie; Roger Trullo; Jun Lian; Li Wang; Caroline Petitjean; Su Ruan; Qian Wang; Dinggang Shen Journal: IEEE Trans Biomed Eng Date: 2018-03-09 Impact factor: 4.538