| Literature DB >> 35965752 |
Rajendran T1, Prajoona Valsalan2, Amutharaj J3, Jenifer M4, Rinesh S5, Charlyn Pushpa Latha G6, Anitha T6.
Abstract
In the domain of remote sensing, the classification of hyperspectral image (HSI) has become a popular topic. In general, the complicated features of hyperspectral data cause the precise classification difficult for standard machine learning approaches. Deep learning-based HSI classification has lately received a lot of interest in the field of remote sensing and has shown promising results. As opposed to conventional hand-crafted feature-based classification approaches, deep learning can automatically learn complicated features of HSIs with a greater number of hierarchical layers. Because HSI's data structure is complicated, applying deep learning to it is difficult. The primary objective of this research is to propose a deep feature extraction model for HSI classification. Deep networks can extricate features of spatial and spectral from HSI data simultaneously, which is advantageous for increasing the performances of the proposed system. The squeeze and excitation (SE) network is combined with convolutional neural networks (SE-CNN) in this work to increase its performance in extracting features and classifying HSI. The squeeze and excitation block is designed to improve the representation quality of a CNN. Three benchmark datasets are utilized in the experiment to evaluate the proposed model: Pavia Centre, Pavia University, and Salinas. The proposed model's performance is validated by a performance comparison with current deep transfer learning approaches such as VGG-16, Inception-v3, and ResNet-50. In terms of accuracy on each class of datasets and overall accuracy, the proposed SE-CNN model outperforms the compared models. The proposed model achieved an overall accuracy of 96.05% for Pavia University, 98.94% for Pavia Centre dataset, and 96.33% for Salinas dataset.Entities:
Mesh:
Year: 2022 PMID: 35965752 PMCID: PMC9371828 DOI: 10.1155/2022/9430779
Source DB: PubMed Journal: Comput Intell Neurosci
Figure 1Squeeze and excitation block [16].
Figure 2Proposed SE-CNN model for HSI classification.
Parameters of CNN model.
| Layer | Parameters |
|---|---|
| Input | Input image with a size of (64 × 64, 3) |
| C1 | Conv 2D (32, 3 × 3) |
| BN1 | Batch normalization |
| P1 | Maxpooling 2D (2, 2) |
| C2 | Conv 2D (32, 3 × 3) |
| P2 | Maxpooling 2D (2, 2) |
| C3 | Conv 2D (64, 3 × 3) drop out (0.35) ReLU |
| P3 | Maxpooling 2D (2, 2) |
| C4 | Conv 2D (128, 3 × 3) |
| P4 | Maxpooling 2D (2, 2) |
| FC1 | 1024 |
| FC2 | 256 |
| Output | Classification of images |
Pavia Centre dataset description.
| Class | Sample |
|---|---|
| Water | 824 |
| Trees | 820 |
| Asphalt | 816 |
| Self-blocking bricks | 808 |
| Bitumen | 808 |
| Tiles | 1260 |
| Shadows | 476 |
| Meadows | 824 |
| Bare soil | 820 |
| Total | 7456 |
Pavia University dataset description.
| Class | Sample |
|---|---|
| Asphalt | 6631 |
| Meadows | 18649 |
| Gravel | 2099 |
| Trees | 3064 |
| Painted metal sheets | 1345 |
| Bare soil | 5029 |
| Bitumen | 1330 |
| Self-blocking bricks | 3682 |
| Shadows | 947 |
| Total | 42776 |
Salinas scene dataset description.
| Class | Sample |
|---|---|
| Corn_senesced_green_weeds | 3278 |
| Celery | 3579 |
| Brocoli_green_weeds_1 | 2009 |
| Fallow_smooth | 2678 |
| Fallow | 1976 |
| Brocoli_green_weeds_2 | 3726 |
| Fallow_rough_plow | 1394 |
| Soil_vineyard_develop | 6203 |
| Stubble | 3959 |
| Vineyard_untrained | 7268 |
| Grapes_untrained | 11271 |
| Lettuce_romaine_6 wk | 916 |
| Lettuce_romaine_4 wk | 1068 |
| Vineyard_vertical_trellis | 1807 |
| Lettuce_romaine_7 wk | 1070 |
| Lettuce_romaine_5 wk | 1927 |
| Total | 54129 |
Figure 3Ground Truth images: (a) Pavia University; (b) Pavia Centre; (c) Salinas.
Evaluation of accuracy on each class of Pavia Centre dataset with overall accuracy.
| Class | VGG-16 | Inception-v3 | ResNet-50 | Proposed |
|---|---|---|---|---|
| Water | 99.89 | 100 | 100 | 100 |
| Trees | 94.85 | 95.78 | 95.10 | 95.43 |
| Asphalt | 93.90 | 96.39 | 96.02 | 95.18 |
| Self-blocking bricks | 87.56 | 89.08 | 90.17 | 90.38 |
| Bitumen | 95.44 | 96.71 | 96.50 | 97.84 |
| Tiles | 96.34 | 98.58 | 98.49 | 98.95 |
| Shadows | 95.04 | 95.20 | 94.99 | 95.46 |
| Meadows | 97.63 | 98.05 | 98.57 | 99.65 |
| Bare soil | 96.50 | 96.89 | 98.17 | 99.68 |
| Overall accuracy | 96.93 | 97.90 | 97.55 | 98.94 |
Figure 4Graphical plot of overall accuracy on Pavia Centre dataset.
Evaluation of accuracy on each class of Pavia University dataset with overall accuracy.
| Class | VGG-16 | Inception-v3 | ResNet-50 | Proposed |
|---|---|---|---|---|
| Asphalt | 93.85 | 92.61 | 96.20 | 96.89 |
| Meadows | 96.04 | 96.35 | 97.52 | 98.74 |
| Gravel | 78.33 | 81.26 | 80.09 | 81.63 |
| Trees | 90.12 | 96.79 | 96.62 | 96.08 |
| Painted metal sheets | 99.90 | 100 | 99.85 | 100 |
| Bare soil | 89.44 | 91.73 | 94.26 | 93.38 |
| Bitumen | 85.60 | 90.83 | 86.90 | 89.16 |
| Self-blocking bricks | 86.75 | 89.48 | 92.07 | 92.94 |
| Shadows | 100 | 99.73 | 99.97 | 100 |
| Overall accuracy | 94.85 | 95.14 | 95.57 | 96.05 |
Figure 5Graphical plot of overall accuracy on Pavia University dataset.
Evaluation of accuracy on each class of Salinas dataset with overall accuracy.
| Class | VGG-16 | Inception-v3 | ResNet-50 | Proposed |
|---|---|---|---|---|
| Brocoli_green_weeds_1 | 98.74 | 99.56 | 99.38 | 99.65 |
| Brocoli_green_weeds_2 | 97.49 | 99.89 | 99.60 | 99.96 |
| Fallow | 98.50 | 99.93 | 100 | 99.92 |
| Fallow_rough_plow | 98.87 | 99.50 | 99.10 | 99.44 |
| Fallow_smooth | 98.79 | 98.27 | 99.74 | 99.50 |
| Stubble | 96.00 | 96.80 | 99.28 | 99.81 |
| Celery | 98.94 | 99.13 | 99.41 | 99.90 |
| Grapes_untrained | 86.52 | 91.95 | 93.82 | 94.14 |
| Soil_vinyard_develop | 99.87 | 100 | 100 | 100 |
| Corn_senesced_green_weeds | 94.38 | 97.58 | 98.25 | 97.40 |
| Lettuce_romaine_4 wk | 93.82 | 97.75 | 99.01 | 98.57 |
| Lettuce_romaine_5 wk | 97.06 | 99.49 | 99.72 | 99.80 |
| Lettuce_romaine_6 wk | 98.31 | 99.24 | 98.90 | 99.35 |
| Lettuce_romaine_7 wk | 91.95 | 98.89 | 99.05 | 99.26 |
| Vinyard_untrained | 65.15 | 78.36 | 81.29 | 82.90 |
| Vinyard_vertical_trellis | 97.87 | 98.21 | 99.00 | 99.28 |
| Overall accuracy | 90.43 | 92.89 | 95.15 | 96.33 |
Figure 6Graphical plot of overall accuracy on Salinas dataset.
Figure 7Proposed model's accuracy on each dataset.