| Literature DB >> 35402427 |
Pingping Fan1,2,3, Wei Shan2,4,5, Huajun Yang2,4, Yu Zheng2, Zhenzhou Wu2, Shang Wei Chan2, Qun Wang2,3,5, Peiyi Gao1, Yaou Liu1,2,4, Kunlun He6,7, Binbin Sui2,3.
Abstract
Objective: To validate the reliability and efficiency of clinical diagnosis in practice based on a well-established system for the automatic segmentation of cerebral microbleeds (CMBs). Method: This is a retrospective study based on Magnetic Resonance Imaging-Susceptibility Weighted Imaging (MRI-SWI) datasets from 1,615 patients (median age, 56 years; 1,115 males, 500 females) obtained between September 2018 and September 2019. All patients had been diagnosed with cerebral small vessel disease (CSVD) with clear cerebral microbleeds (CMBs) on MRI-SWI. The patients were divided into training and validation cohorts of 1,285 and 330 patients, respectively, and another 30 patients were used for internal testing. The model training and validation data were labeled layer by layer and rechecked by two neuroradiologists with 15 years of work experience. Afterward, a three-dimensional convolutional neural network (CNN) was applied to the MRI data from the training and validation cohorts to construct a deep learning system (DLS) that was tested with the 72 patients, independent of the aforementioned MRI cohort. The DLS tool was used as a segmentation program for these 72 patients. These results were evaluated and revised by five neuroradiologists and subjected to an output analysis divided into the missed label, incorrect label, and correct label. The interneuroradiologists DLS agreement rate, which was assessed using the interrater agreement kappas test, was used for the quality analysis.Entities:
Keywords: cerebral microbleed; clinical evaluation; deep learning; neural network; segmentation
Year: 2022 PMID: 35402427 PMCID: PMC8988858 DOI: 10.3389/fmed.2022.807443
Source DB: PubMed Journal: Front Med (Lausanne) ISSN: 2296-858X
Basic information of the patients, manufacturers, and parameters of scanners.
| Patients characteristics (training/validation dataset) | Patient (images) metric |
| Number of patients | 1285/330 |
| Female to male ratio | 405:880/95:235 |
|
| |
| GE | 287/72 |
| Siemens | 356/88 |
| Philips | 642/170 |
|
| |
| 1.5T | 174/34 |
| 3T | 1111/296 |
|
| |
| Verio | 89/25 |
| Ingenia | 429/116 |
| Achieva | 77/13 |
| Trio Tim | 110/33 |
| Signa HDxt | 71/10 |
| DiSCOVERY MR750 | 205/70 |
| Ingenia CX | 133/33 |
| Skyra | 16/2 |
| Avanto | 100/18 |
| Aera | 43/6 |
| SIGNA Explorer | 12/2 |
| Prisma | 0/2 |
|
| |
| 512 × 384 | 96/15 |
| 432 × 432 | 459/157 |
| 512 × 512 | 326/60 |
| 256 × 192 | 183/47 |
| 256 × 232 | 62/15 |
| 480 × 480 | 21/7 |
| 768 × 624 | 9/3 |
| 256 × 224 | 42/9 |
| 224 × 256 | 10/2 |
| 320 × 320 | 9/1 |
| 384 × 264 | 3/0 |
| 320 × 260 | 18/3 |
| 640 × 520 | 13/2 |
| 310 × 320 | 1/0 |
| 352 × 352 | 9/1 |
| 256 × 256 | 21/8 |
| 260 × 320 | 1/0 |
| 560 × 560 | 2/0 |
Data distribution.
| patients | Small lesions | Large lesions | |
| Training dataset | 1,285 (79.6%) | 7,461 (79.5%) | 927 (81.5%) |
| Validation dataset | 330 (20.4%) | 1,926 (20.5%) | 211 (18.5%) |
| Summary | 1,615 | 9,387 | 1,138 |
FIGURE 1Network architecture of the proposed three-dimensional (3D) convolutional neural network (CNN). The network has 28 layers integrating six residual blocks. Bilinear interpolating arrows indicate upsampling operations to provide dense predictions for the segmentation task. Skip connections are used to fuse low- and high-level features in the network. Batch normalization is a linear transformation of the features to reduce covariance shift and accelerate the training process. The convolution bar represents the convolution operation that computes features. The number 64 indicates the number of channels in that layer, and 3 3 3 3 3 denotes the size of the 3D CNN kernels.
FIGURE 2Flowchart of the patients’ distribution in training and clinical evaluation sets. Model training and clinical evaluation steps use the distribution and classification of all samples in each step.
FIGURE 3(A) Overall framework for the testing stage. (B) Segmentation receiver operating characteristic (ROC) curve and area under the curve (AUC) score in the lesion level analysis.
Model performance obtained from the testing dataset.
| DSC | Precision | Recall | Sensitivity | Specificity | |
| Small lesions | 0.71 | 0.707 | 0.762 | 84.4% | 78.07% |
| Large lesions | 0.73 | 0.729 | 0.768 | 93.51% | 83.72% |
| In average | 0.72 | 0.718 | 0.765 | / | / |
Clinical evaluation.
| Observer 1 | Observer 2 | Observer 3 | Observer 4 | Observer 5 | Average | |
| Correct label | 787 (94.4%) | 770 (92.8%) | 790 (94.6%) | 784 (93.3%) | 761 (91.2%) | 778.4 (93.3%) |
| Incorrect label | 27 (3.2%) | 44 (5.3%) | 24 (2.9%) | 30 (3.6%) | 53 (6.4%) | 35.6 (4.3%) |
| Missed label | 20 (2.4%) | 16 (1.9%) | 21 (2.5%) | 26 (3.1%) | 20 (2.4%) | 20.6 (2.5%) |
FIGURE 4Representative cases of manual cerebral microbleeding (CMB) labeling and labeling with the deep learning system (DLS) system (A,B) along with the data distribution (C).