Yangfan Ni1,2, Zhe Xie1,2, Dezhong Zheng1,2, Yuanyuan Yang1, Weidong Wang3. 1. Laboratory for Medical Imaging Informatics, Shanghai Institute of Technical Physics, Chinese Academy of Science, Shanghai, China. 2. Laboratory for Medical Imaging Informatics, University of Chinese Academy of Sciences, Beijing, China. 3. Biological Engineering Research Center, The General Hospital of the People's Liberation Army, Beijing, China.
Abstract
BACKGROUND: Accurate segmentation of pulmonary nodules is important for image-driven nodule analysis and nodule malignancy risk prediction. However, due to interobserver variability caused by manual segmentation, an accurate and robust automatic segmentation method has become an essential task. Therefore, the aim of the present study was to construct an accurate segmentation and malignant risk prediction algorithm for pulmonary nodules. METHODS: In the present study, we proposed a coarse-to-fine 2-stage framework consisting of the following 2 convolutional neural networks: a 3D multiscale U-Net used for localization and a 2.5D multiscale separable U-Net (MSU-Net) used for segmentation refinement. A multitask framework was proposed for nodules' malignancy risk prediction. Features from encoding and decoding paths of MSU-Net were integrated for pathology or morphology characteristic classification. RESULTS: Experimental results showed that our method achieved state-of-art results on the Lung Image Database Consortium and Image Database Resource Initiative dataset. The proposed method achieved a Dice similarity coefficient (DSC) of 83.04% and an overlapping error of 27.47% on the dataset. Our method achieved accuracy of 77.8% and area under the receiver-operating characteristic curve of 84.3% for malignancy risk prediction. Moreover, we compared our method with the inter-radiologist agreement, and the average DSC difference was only 0.39%. CONCLUSIONS: The results showed the effectiveness of the multitask end-to-end framework. The coarse-to-fine 2.5D strategy increased the accuracy and efficiency of pulmonary nodule segmentation and malignancy risk prediction of the computer-aided diagnosis system. In clinical practice, doctors can obtain accurate morphological characteristics and quantitative information of nodules by using the proposed method, so as to make future treatment plan. 2022 Quantitative Imaging in Medicine and Surgery. All rights reserved.
BACKGROUND: Accurate segmentation of pulmonary nodules is important for image-driven nodule analysis and nodule malignancy risk prediction. However, due to interobserver variability caused by manual segmentation, an accurate and robust automatic segmentation method has become an essential task. Therefore, the aim of the present study was to construct an accurate segmentation and malignant risk prediction algorithm for pulmonary nodules. METHODS: In the present study, we proposed a coarse-to-fine 2-stage framework consisting of the following 2 convolutional neural networks: a 3D multiscale U-Net used for localization and a 2.5D multiscale separable U-Net (MSU-Net) used for segmentation refinement. A multitask framework was proposed for nodules' malignancy risk prediction. Features from encoding and decoding paths of MSU-Net were integrated for pathology or morphology characteristic classification. RESULTS: Experimental results showed that our method achieved state-of-art results on the Lung Image Database Consortium and Image Database Resource Initiative dataset. The proposed method achieved a Dice similarity coefficient (DSC) of 83.04% and an overlapping error of 27.47% on the dataset. Our method achieved accuracy of 77.8% and area under the receiver-operating characteristic curve of 84.3% for malignancy risk prediction. Moreover, we compared our method with the inter-radiologist agreement, and the average DSC difference was only 0.39%. CONCLUSIONS: The results showed the effectiveness of the multitask end-to-end framework. The coarse-to-fine 2.5D strategy increased the accuracy and efficiency of pulmonary nodule segmentation and malignancy risk prediction of the computer-aided diagnosis system. In clinical practice, doctors can obtain accurate morphological characteristics and quantitative information of nodules by using the proposed method, so as to make future treatment plan. 2022 Quantitative Imaging in Medicine and Surgery. All rights reserved.
Authors: Michael F McNitt-Gray; Samuel G Armato; Charles R Meyer; Anthony P Reeves; Geoffrey McLennan; Richie C Pais; John Freymann; Matthew S Brown; Roger M Engelmann; Peyton H Bland; Gary E Laderach; Chris Piker; Junfeng Guo; Zaid Towfic; David P-Y Qing; David F Yankelevitz; Denise R Aberle; Edwin J R van Beek; Heber MacMahon; Ella A Kazerooni; Barbara Y Croft; Laurence P Clarke Journal: Acad Radiol Date: 2007-12 Impact factor: 3.173
Authors: Jo Schlemper; Ozan Oktay; Michiel Schaap; Mattias Heinrich; Bernhard Kainz; Ben Glocker; Daniel Rueckert Journal: Med Image Anal Date: 2019-02-05 Impact factor: 8.545