| Literature DB >> 34484652 |
Shahab U Ansari1, Kamran Javed1,2, Saeed Mian Qaisar3,4, Rashad Jillani1, Usman Haider1.
Abstract
Multiple sclerosis (MS) is a chronic and autoimmune disease that forms lesions in the central nervous system. Quantitative analysis of these lesions has proved to be very useful in clinical trials for therapies and assessing disease prognosis. However, the efficacy of these quantitative analyses greatly depends on how accurately the MS lesions have been identified and segmented in brain MRI. This is usually carried out by radiologists who label 3D MR images slice by slice using commonly available segmentation tools. However, such manual practices are time consuming and error prone. To circumvent this problem, several automatic segmentation techniques have been investigated in recent years. In this paper, we propose a new framework for automatic brain lesion segmentation that employs a novel convolutional neural network (CNN) architecture. In order to segment lesions of different sizes, we have to pick a specific filter or size 3 × 3 or 5 × 5. Sometimes, it is hard to decide which filter will work better to get the best results. Google Net has solved this problem by introducing an inception module. An inception module uses 3 × 3, 5 × 5, 1 × 1 and max pooling filters in parallel fashion. Results show that incorporating inception modules in a CNN has improved the performance of the network in the segmentation of MS lesions. We compared the results of the proposed CNN architecture for two loss functions: binary cross entropy (BCE) and structural similarity index measure (SSIM) using the publicly available ISBI-2015 challenge dataset. A score of 93.81 which is higher than the human rater with BCE loss function is achieved.Entities:
Mesh:
Year: 2021 PMID: 34484652 PMCID: PMC8410443 DOI: 10.1155/2021/4138137
Source DB: PubMed Journal: J Healthc Eng ISSN: 2040-2295 Impact factor: 2.682
Figure 1Manual segmentation of MS lesions: (a) T1w MRI, (b) manual segmentation by rater 1, and (c) manual segmentation by rater 2.
Figure 2Sample of the ISBI dataset: (a) T1w, (b) FLAIR, (c) T2w, and (d) PDw, (e) manual delineation by rater 1, and (f) manual delineation by rater 2.
Figure 3Proposed deep network architecture for MS lesion segmentation in brain MRI.
Figure 4Inception block in the proposed CNN architecture.
Performance metrics used in the proposed solution.
| Metric | Formula |
|---|---|
| Dice similarity coefficient | DSC=2TP/(FN+FP+2TP) |
| Jaccard similarity coefficient | JSC=TP/(TP+FP+FN) |
| Positive predicted value | PPV=TP/(TP+FP) |
| True positive rate | TPR=TP/(TP+FN) |
| Lesion-wise true positive rate | LTPR=LTP/RL |
| Lesion-wise false positive rate | LFPR=LFP/PL |
| Volume difference | VD=TP |
| Pearson correlation coefficient | Cor=cov( |
| Overall score | SC=(1/| |
Quantification of MS lesion segmentation with the BCE loss function.
| Subject | TP | Dice | Jaccard | PPV | TPR | LFPR | LTPR | VD |
|---|---|---|---|---|---|---|---|---|
| test01 | 1 | 0.6639 | 0.4969 | 0.8991 | 0.5263 | 0.1356 | 0.5068 | 0.4147 |
| test01 | 2 | 0.6916 | 0.5286 | 0.9131 | 0.5566 | 0.0806 | 0.5128 | 0.3904 |
| test01 | 3 | 0.682 | 0.5174 | 0.8845 | 0.5549 | 0.1452 | 0.5 | 0.3726 |
| test01 | 4 | 0.6732 | 0.5074 | 0.9226 | 0.5299 | 0.1034 | 0.4667 | 0.4256 |
| test02 | 1 | 0.6933 | 0.5306 | 0.7548 | 0.6411 | 0.1176 | 0.4653 | 0.1507 |
| test02 | 2 | 0.6823 | 0.5178 | 0.8229 | 0.5828 | 0.087 | 0.4969 | 0.2918 |
| test02 | 3 | 0.664 | 0.497 | 0.8241 | 0.5559 | 0.0638 | 0.4867 | 0.3254 |
| test02 | 4 | 0.6409 | 0.4716 | 0.8529 | 0.5134 | 0.0631 | 0.5411 | 0.3981 |
| test02 | 5 | 0.7099 | 0.5502 | 0.8444 | 0.6123 | 0.1277 | 0.4157 | 0.2748 |
| test03 | 1 | 0.4949 | 0.3288 | 0.8944 | 0.3421 | 0.125 | 0.3056 | 0.6175 |
| test03 | 2 | 0.5132 | 0.3451 | 0.9271 | 0.3548 | 0.1379 | 0.3333 | 0.6173 |
| test03 | 3 | 0.4988 | 0.3322 | 0.9457 | 0.3387 | 0 | 0.4375 | 0.6419 |
| test03 | 4 | 0.5838 | 0.4122 | 0.9242 | 0.4266 | 0.08 | 0.4667 | 0.5384 |
| test04 | 1 | 0.8168 | 0.6903 | 0.8693 | 0.7702 | 0.1154 | 0.6944 | 0.114 |
| test04 | 2 | 0.7928 | 0.6567 | 0.8205 | 0.7668 | 0.36 | 0.5172 | 0.0654 |
| test04 | 3 | 0.8067 | 0.676 | 0.8099 | 0.8035 | 0.08 | 0.7586 | 0.0078 |
| test04 | 4 | 0.7999 | 0.6665 | 0.8095 | 0.7905 | 0.2759 | 0.697 | 0.0234 |
| Average | 0.6711 | 0.5133 | 0.8658 | 0.5686 | 0.1234 | 0.5060 | 0.3335 |
Comparison with the existing techniques.
| Method | SC | DSC | PPV | LTPR | LFPR | VD |
|---|---|---|---|---|---|---|
| Birenbaum and Greenspan [ | 90.07 | 0.6271 | 0.7889 | 0.5678 | 0.4975 | 0.3522 |
| Litjens et al. [ | 86.92 | 0.5009 | 0.5491 | 0.4288 | 0.5765 | 0.5707 |
| Valverde et al. [ | 91.33 | 0.6294 | 0.7866 | 0.3669 | 0.1529 | 0.3384 |
| Aslani et al. [ | 89.85 | 0.4856 | 0.7402 | 0.3034 | 0.1708 | 0.4768 |
| Proposed | 90.84 | 0.6306 | 0.7888 | 0.5736 | 0.2512 | 0.3444 |
Quantification of MS lesion segmentation with the SSIM loss function.
| Subject | TP | Dice | Jaccard | PPV | TPR | LFPR | LTPR | VD |
|---|---|---|---|---|---|---|---|---|
| test01 | 1 | 0.6061 | 0.4348 | 0.866 | 0.4662 | 0.0408 | 0.4247 | 0.4617 |
| test01 | 2 | 0.6296 | 0.4595 | 0.8677 | 0.4941 | 0.0702 | 0.4487 | 0.4306 |
| test01 | 3 | 0.6179 | 0.447 | 0.85 | 0.4853 | 0.0556 | 0.4024 | 0.429 |
| test01 | 4 | 0.6194 | 0.4486 | 0.8814 | 0.4775 | 0.0909 | 0.4267 | 0.4582 |
| test02 | 1 | 0.6608 | 0.4934 | 0.7923 | 0.5667 | 0.0864 | 0.375 | 0.2847 |
| test02 | 2 | 0.631 | 0.4609 | 0.8246 | 0.5111 | 0.101 | 0.4025 | 0.3802 |
| test02 | 3 | 0.5987 | 0.4273 | 0.8224 | 0.4707 | 0.0667 | 0.34 | 0.4277 |
| test02 | 4 | 0.5909 | 0.4194 | 0.852 | 0.4523 | 0.0467 | 0.4452 | 0.4692 |
| test02 | 5 | 0.6617 | 0.4944 | 0.8427 | 0.5446 | 0.0978 | 0.3614 | 0.3537 |
| test03 | 1 | 0.4394 | 0.2815 | 0.7986 | 0.3031 | 0.0769 | 0.3333 | 0.6205 |
| test03 | 2 | 0.4663 | 0.3041 | 0.8313 | 0.3241 | 0.08 | 0.4 | 0.6102 |
| test03 | 3 | 0.4597 | 0.2985 | 0.852 | 0.3148 | 0.0909 | 0.375 | 0.6305 |
| test03 | 4 | 0.5254 | 0.3563 | 0.8287 | 0.3847 | 0.2 | 0.3333 | 0.5358 |
| test04 | 1 | 0.776 | 0.634 | 0.8535 | 0.7115 | 0.1304 | 0.5833 | 0.1664 |
| test04 | 2 | 0.762 | 0.6156 | 0.8345 | 0.7012 | 0.2353 | 0.4138 | 0.1597 |
| test04 | 3 | 0.7729 | 0.6299 | 0.8089 | 0.74 | 0.2273 | 0.5862 | 0.0852 |
| test04 | 4 | 0.7792 | 0.6383 | 0.8187 | 0.7433 | 0.1667 | 0.6364 | 0.0921 |
| test05 | 1 | 0.433 | 0.2763 | 0.3939 | 0.4806 | 0.45 | 0.2778 | 0.2201 |
| test05 | 2 | 0.4622 | 0.3006 | 0.5652 | 0.391 | 0.1852 | 0.4082 | 0.3082 |
| test05 | 3 | 0.5353 | 0.3655 | 0.6448 | 0.4576 | 0.1951 | 0.4923 | 0.2903 |
| test05 | 4 | 0.5169 | 0.3485 | 0.6145 | 0.446 | 0.1923 | 0.375 | 0.2742 |
| Average | 0.5974 | 0.4350 | 0.7830 | 0.4984 | 0.1374 | 0.4210 | 0.3661 |
Quantitative comparison of BCE and SSIM loss functions.
| Loss function | SC | DSC | PPV | LTPR | LFPR | VD |
|---|---|---|---|---|---|---|
| BCE | 90.84 | 0.6306 | 0.7888 | 0.5736 | 0.2512 | 0.3444 |
| SSIM | 89.01 | 0.5934 | 0.7288 | 0.4476 | 0.1935 | 0.3999 |
Figure 5Comparison of the segmentation results when using BCE and SSIM loss functions. (a) T1w. (b) T2w. (c) Rater 1. (d) BCE. (e) SSIM.