| Literature DB >> 35877644 |
Ibtissam Al Saidi1, Mohammed Rziza1, Johan Debayle2.
Abstract
The local binary model is a straightforward, dependable, and effective method for extracting relevant local information from images. However, because it only uses sign information in the local region, the local binary pattern (LBP) is ineffective at capturing discriminating characteristics. Furthermore, most LBP variants select a region with one specific center pixel to fill all neighborhoods. In this paper, a new variant of a LBP is proposed for texture classification, known as corner rhombus-shape LBP (CRSLBP). In the CRSLBP approach, we first use three methods to threshold the pixel's neighbors and center to obtain four center pixels by using sign and magnitude information with respect to a chosen region of an even block. This helps determine not just the relationship between neighbors and the pixel center but also between the center and the neighbor pixels of neighborhood center pixels. We evaluated the performance of our descriptors using four challenging texture databases: Outex (TC10,TC12), Brodatz, KTH-TIPSb2, and UMD. Various extensive experiments were performed that demonstrated the effectiveness and robustness of our descriptor in comparison with the available state of the art (SOTA).Entities:
Keywords: feature extraction; local binary pattern; texture classification
Year: 2022 PMID: 35877644 PMCID: PMC9324107 DOI: 10.3390/jimaging8070200
Source DB: PubMed Journal: J Imaging ISSN: 2313-433X
Figure 1(a) The 4 × 4 sub-block of the image. (b) The corner processing. The process of the first (c), second (d), and third (e) generated CRSLBP code. (f) mathematical representation of the block.
Figure 2The concatenation histogram of all CRSLBP processes.
Summary of the characteristics of the texture databases used in our experiments.
| Number | Name | Classes | Samples Per Class | Total Samples | Sample Resolution (Pixels) | Image Format (Monochrome) | Challenges |
|---|---|---|---|---|---|---|---|
| 1 | Brodatz | 112 | 9 | 1008 | 512 × 512 | JPG | Various texture types |
| 2 | KTH-TIPS2b | 11 | 4 × 108 | 4752 | 200 × 200 | BMP | illumination, scale, pose changes |
| 3 | OuTeX_TC_00010 | 24 | 180 | 4320 | 128 × 128 | RAS | Rotation changes (0 |
| and other degrees for test | |||||||
| 4 | OuTeX_TC_00012 | 24 | 200 | 4800 | 128 × 128 | RAS | Rotation and illumination |
| (“Tl84”, “horizon”) changes | |||||||
| 5 | UMD | 25 | 40 | 1000 | 1280 × 960 | PNG | Small illumination changes and strong scale, |
| rotation, and viewpoint changes | |||||||
Classification accuracy (%) of the CRSLBP for different R on the Outex dataset and (SVM, NN) classifier.
| Classification Accuracy (%) Outex (SVM) | Classification Accuracy (%) (NN) | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
| ||||||||||||||
|
|
|
|
| |||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
| LBP classic | 96.26 | 97.10 | 97.94 | 97.1 | 77.83 | 79.25 | 78.83 | 78.64 | 81.98 | 82.50 | 78.69 | 81.06 | 96.91 | 97.38 | 98.76 | 97.68 |
| HLBP | 92.48 | 98.40 | 98.17 | 96.35 | 72.52 | 78.37 | 74.81 | 75.23 | 76.17 | 79.21 | 76.02 | 77.13 | 93.06 | 99.23 | 98.15 | 96.81 |
| HRLBP | 92.69 | 98.31 | 98.31 | 96.43 | 73.52 | 78.46 | 74.58 | 75.52 | 75.08 | 79.42 | 75.92 | 76.80 | 94.60 | 99.23 | 98.76 | 97.53 |
| HLBP+LBP | 98.59 | 99.54 | 99.70 | 99.27 | 84.60 | 84.50 | 82.50 | 83.86 | 86.65 | 85.06 | 82.67 | 84.79 | 99.08 | 99.54 | 99.69 | 99.43 |
| HRLBP+RLBP | 98.59 | 99.56 | 99.72 | 99.29 | 85.29 | 84.60 | 82.42 | 84.10 | 86.83 | 85.21 | 82.62 | 84.88 | 98.92 | 100 | 100 | 99.64 |
| CPLBP | 95.30 | 96.06 | 98.01 | 96.45 | 76.31 | 78.04 | 77.52 | 77.29 | 79.94 | 78.52 | 79.29 | 79.25 | — | — | — | — |
| LTP | 99.21 | 99.56 | 99.42 | 99.40 | 85.71 | 83.92 | 83.42 | 84.35 | 85.92 | 85.23 | 82.21 | 84.45 | 99.53 | 99.69 | 99.84 | 99.69 |
| CLBP S/M | 98.70 | 99.40 | 99.49 | 99.20 | 85.60 | 85.62 | 83.27 | 84.83 | 86.98 | 85.77 | 82.67 | 85.14 | 99.22 | 99.84 | 99.69 | 99.58 |
| CLBP S | 96.08 | 97.13 | 97.99 | 97.07 | 77.92 | 79.85 | 78.56 | 78.78 | 81.48 | 82.75 | 78.35 | 80.86 | 95.98 | 97.99 | 98.77 | 97.58 |
| CLBP M | 94.40 | 97.08 | 98.14 | 96.54 | 73.10 | 76.50 | 75.00 | 74.87 | 77.54 | 77.58 | 76.10 | 77.07 | 95.37 | 97.99 | 98.61 | 97.32 |
| CLDP | 96.23 | 77.10 | 71.06 | 81.46 | 78.40 | 59.85 | 53.40 | 63.88 | 81.79 | 64.81 | 56.00 | 67.53 | 96.23 | 77.10 | 71.06 | 81.46 |
| RLBP | 96.32 | 97.27 | 97.89 | 97.16 | 78.40 | 78.94 | 78.40 | 78.58 | 81.73 | 82.60 | 78.75 | 81.03 | 95.98 | 97.68 | 98.30 | 97.32 |
| LBPV | 78.75 | 90.72 | 93.56 | 87.67 | 63.69 | 78.79 | 82.96 | 75.15 | 70.67 | 83.42 | 84.42 | 79.50 | 81.01 | 90.12 | 92.28 | 87.80 |
| CRSLBP | 99.65 | 99.84 | 99.79 | 99.76 | 94.23 | 94.50 | 93.17 | 93.97 | 95.42 | 94.45 | 93.87 | 94.58 | 99.69 | 99.84 | 99.84 | 99.79 |
| MRELBP | 99.90 | 99.90 | 87.02 | 87.02 | 87.04 | 87.04 | 100 | 100 | ||||||||
Classification accuracy (%) of the CRSLBP for different R on the KTH-TIPS2b, UMD and Brodatz dataset and the SVM and NN classifiers.
| (a) Using SVM Classifier | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| ||||||||||||
|
|
|
| ||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
| |
| LBP classic | 89.67 | 88.62 | 85.94 | 88.07 | 97.7 | 97.6 | 96.1 | 97.13 | 90.77 | 92.16 | 91.27 | 91.40 |
| HLBP | 89.41 | 90.51 | 89.29 | 89.74 | 94.90 | 95.20 | 95.30 | 95.13 | 84.23 | 84.33 | 84.72 | 84.43 |
| HRLBP | 89.44 | 91.35 | 89.26 | 90.02 | 94.50 | 94.80 | 95.00 | 94.77 | 83.43 | 85.02 | 84.73 | 84.39 |
| HLBP+LBP | 96.00 | 96.76 | 96.27 | 96.34 | 98.70 | 99.00 | 98.60 | 98.77 | 93.55 | 94.35 | 93.95 | 93.95 |
| HRLBP+RLBP | 96.11 | 96.55 | 96.06 | 96.24 | 99.00 | 98.70 | 98.20 | 98.63 | 93.45 | 94.25 | 93.75 | 93.81 |
| LTP | 95.73 | 96.46 | 95.75 | 95.98 | 98.9 | 98.2 | 98.3 | 98.47 | 93.65 | 94.84 | 94.94 | 94.47 |
| CLBP S/M | 94.93 | 96.14 | 95.18 | 95.42 | 98.8 | 98.2 | 98.00 | 98.33 | 93.65 | 94.84 | 94.94 | 94.47 |
| CLBP S | 89.14 | 89.27 | 85.69 | 80.03 | 97.60 | 97.00 | 96.30 | 94.20 | 90.67 | 93.65 | 91.47 | 91.93 |
| CLBP M | 85.69 | 88.15 | 85.65 | 86.50 | 94.70 | 94.50 | 93.40 | 94.20 | 81.65 | 84.42 | 83.63 | 83.23 |
| CLDP | 96.23 | 77.10 | 71.06 | 81.46 | 97.60 | 87.10 | 80.10 | 88.27 | 91.07 | 69.35 | 56.45 | 72.29 |
| RLBP | 89.58 | 89.16 | 85.69 | 88.14 | 97.50 | 97.90 | 96.60 | 97.33 | 91.07 | 93.06 | 91.67 | 91.93 |
| LBPV | 78.24 | 83.12 | 84.41 | 81.92 | 88.40 | 92.70 | 92 | 91.03 | 64.48 | 76.49 | 75.00 | 71.99 |
| CRSLBP | 96.89 | 96.76 | 97.19 | 96.94 | 98.50 | 98.40 | 98.80 | 98.56 | 94.15 | 95.54 | 95.44 | 95.04 |
| MRELBP | 98.55 | 98.55 | 99.60 | 99.60 | 97.02 | 97.02 | ||||||
|
| ||||||||||||
|
| ||||||||||||
|
|
|
| ||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
| |
| LBP classic | 87.08 | 84.85 | 83.59 | 85.17 | 96.00 | 92.67 | 94.00 | 94.22 | 87.42 | 90.07 | 90.73 | 89.40 |
| HLBP | 81.77 | 89.34 | 89.29 | 86.8 | 96.67 | 95.33 | 92.66 | 94.89 | 87.42 | 86.09 | 83.44 | 85.65 |
| HRLBP | 81.62 | 86.26 | 89.26 | 85.71 | 94.64 | 94.00 | 96.67 | 95.10 | 84.11 | 84.11 | 90.07 | 86.10 |
| HLBP+LBP | 94.25 | 95.79 | 96.27 | 95.44 | 98.00 | 99.33 | 100 | 99.11 | 95.37 | 96.03 | 94.04 | 95.15 |
| HRLBP+RLBP | 95.23 | 94.53 | 96.06 | 95.23 | 98.64 | 99.33 | 99.33 | 99.1 | 93.38 | 95.37 | 92.05 | 93.6 |
| LTP | 93.68 | 94.68 | 92.70 | 93.69 | 98.00 | 98.66 | 97.33 | 98.00 | 94.04 | 93.38 | 94.04 | 93.82 |
| CLBP S/M | 92.15 | 93.40 | 91.72 | 92.42 | 97.33 | 98.00 | 98.00 | 97.78 | 92.05 | 92.71 | 94.04 | 92.93 |
| CLBP S | 85.97 | 85.41 | 81.90 | 84.43 | 95.33 | 96.66 | 91.33 | 94.44 | 89.40 | 93.38 | 92.72 | 91.83 |
| CLBP M | 82.60 | 82.18 | 82.32 | 82.37 | 89.33 | 92.66 | 86.66 | 89.55 | 84.77 | 83.44 | 87.42 | 85.21 |
| CLDP | 96.23 | 77.10 | 71.06 | 81.46 | 96.66 | 83.33 | 75.33 | 85.11 | 85.43 | 60.26 | 58.94 | 68.21 |
| RLBP | 87.79 | 83.59 | 80.78 | 84.05 | 94.66 | 92.66 | 93.33 | 93.55 | 93.38 | 92.72 | 90.06 | 92.05 |
| LBPV | 71.39 | 79.95 | 72.37 | 74.57 | 65.33 | 84.00 | 87.33 | 78.88 | 59.60 | 78.15 | 74.83 | 70.86 |
| CRSLBP | 94.81 | 95.37 | 95.65 | 95.28 | 99.33 | 100 | 98.67 | 99.33 | 95.37 | 98.68 | 100 | 98.01 |
| MRELBP | 96.49 | 96.49 | 100 | 100 | 97.35 | 97.35 | ||||||
Classification accuracy (%) of CRSLBP compared with MRELBP using a set of R and SVM classifier.
| Outex (TC10,TC12) | KTH-TIPS2b | UMD | Brodatz | |||
|---|---|---|---|---|---|---|
|
|
|
| ||||
| MRELBP | 99.9% | 87.02% | 87.04% | 98.55% | 99.6% | 97.02% |
| CRSLBP | 99.88% | 94.77% | 95.56% | 99.22% | 99.1% | 95.84% |