Literature DB >> 35449840

MeQryEP: A Texture Based Descriptor for Biomedical Image Retrieval.

G Deep1, J Kaur1, Simar Preet Singh2, Soumya Ranjan Nayak3, Manoj Kumar4, Sandeep Kautish5.   

Abstract

Image texture analysis is a dynamic area of research in computer vision and image processing, with applications ranging from medical image analysis to image segmentation to content-based image retrieval and beyond. "Quinary encoding on mesh patterns (MeQryEP)" is a new approach to extracting texture features for indexing and retrieval of biomedical images, which is implemented in this work. An extension of the previous study, this research investigates the use of local quinary patterns (LQP) on mesh patterns in three different orientations. To encode the gray scale relationship between the central pixel and its surrounding neighbors in a two-dimensional (2D) local region of an image, binary and nonbinary coding, such as local binary patterns (LBP), local ternary patterns (LTP), and LQP, are used, while the proposed strategy uses three selected directions of mesh patterns to encode the gray scale relationship between the surrounding neighbors for a given center pixel in a 2D image. An innovative aspect of the proposed method is that it makes use of mesh image structure quinary pattern features to encode additional spatial structure information, resulting in better retrieval. On three different kinds of benchmark biomedical data sets, analyses have been completed to assess the viability of MeQryEP. LIDC-IDRI-CT and VIA/I-ELCAP-CT are the lung image databases based on computed tomography (CT), while OASIS-MRI is a brain database based on magnetic resonance imaging (MRI). This method outperforms state-of-the-art texture extraction methods, such as LBP, LQEP, LTP, LMeP, LMeTerP, DLTerQEP, LQEQryP, and so on in terms of average retrieval precision (ARP) and average retrieval rate (ARR).
Copyright © 2022 G. Deep et al.

Entities:  

Mesh:

Year:  2022        PMID: 35449840      PMCID: PMC9017451          DOI: 10.1155/2022/9505229

Source DB:  PubMed          Journal:  J Healthc Eng        ISSN: 2040-2295            Impact factor:   3.822


1. Introduction

Massive amounts of biomedical and health informatics data are generated on a regular basis as a result of the growth of biomedical imaging modalities, such as MRI, CT, ultrasound (US), and X-ray. A few investigations have reported the increment in imaging over time, yet generally little has been published about the characterizing patterns of imaging exhaustively. The primary goal here is to use such diverse biomedical imaging data and to develop new computational strategies so that a specialist can give an early analysis of the patients. Given that medical imaging is made of a variety of small structures, researchers have been particularly interested in developing well-structured approaches for working on large datasets of biomedical images for fast examination and retrieval. A deep learning technique for biomedical image identification and categorization on massive biomedical databases is used to find unpredictable patterns [1, 2]. The expertise of the content-based image retrieval (CBIR) technique is distributed to create content-based medical image retrieval (CBMIR) to solve the issue of biomedical images provided in comprehensive reviews [3-6]. In this context, it is found that the texture of the image provides useful discriminating visual feature information about the objects, content inside the image, and the connection with the background. Subsequently, the feature extraction of texture images has gotten perhaps the most challenging part in the processing of images using textural characteristics [7-9]. Local extreme co-occurrence patterns also played a vital role in texture analysis [10]. According to the perspective of directional characteristics-based texture retrieval, the patterns in three different orientations, such as diagonal, vertical, and horizontal, with discrete wavelet transform (DWT) are presented [11]. The appearance of any nodule/organ/lesion in clinical testing images is caused by changes in the intensity that affects different textural features. From that point, the texture turned out to be famous in the biomedical retrieval of images because of the significant importance of the texture obtained. With co-occurrence matrix, medical MRI and CT images' retrieval in different tissues is studied [12]. The motif co-occurrence matrix is used in the CBIR technique to outline texture characteristics [13]. Furthermore, textural information for retrieval of medical data with method of complexity was also analysed by using fractal dimension on various scaling factors [14]. The texture analysis is presented on the brain tumors dataset analysis [15]. By expanding GLCM to various scales based on Gaussian filtering, authors developed texture descriptors [16]. Yadav et al. [17] have suggested a compressive sampling-based technique for retrieving texture characteristics from big medical datasets. For the retrieval of content-based mammography, authors proposed techniques for texture features [18]. However, the computing complexity of the various methods employed based on the texture feature available in different literature is more expansive in terms of complexity [13, 15–17]. To overcome this complexity challenge, LBP suggested that it can be useful in various biomedical applications [19]. Furthermore, the same author executed more alterations, such as LBPriu2, LBPu2_P_R, GLBPu2_8_1, in LBP for texture characterizations because of its simplicity, very low computing complexity, ability to code small specifications, and resilience in detecting structural and textural information [20]. For image retrieval, BLK_LBP is proposed to utilize LBP characteristics to create block-based texture features [21]. To introduce the texture pattern approach, the extended form of the famous LBP feature is proposed, and the same can be termed as the center symmetric local binary pattern (CS-LBP) and local configuration pattern (LCP) texture descriptor [22, 23]. However, LCP and LBP descriptor are completely different [23]. Some of the other LBP versions are developed for texture image retrieval applications presented in the literature [24-26]. Other applications related to LTP and LBP [27, 28] have been explored, such as face classification [29]. Subsequently, a modified LBP suggested to obtain discriminative characteristics for the CBIR system was also presented [30]. To gain new texture features on biomedical images, rich literature on the extended algorithms of LBP, i.e., LTCoP [31], PVEP [32], GLMeP [33], DBWP [34], DLEP [35], LMEBP [36], LTrP [37], LQEP [38], LDEP [39], LDMaMEP [40], was studied. Previously, DLTerQEP [41], LMeTerP [42], and LQEQryP [42] proposed LBP moderation on biomedical datasets. Although we are already aware that LBP generates directional derivative first-order patterns, Zhang et al. suggested local derivative patterns (LDP) for facial identification and also investigated LBP as nondirectional local first-order patterns. Because of intensity variations, the appearance differentiation of individual objects in ordinary images is not detected by local binary and derivative pattern methods in the study of literature [43]. The LBP operator's primary drawback is that the limit of the binary function lies directly at the central pixel's intensity value, making it susceptible to noise. To address this flaw, the authors introduced LQP for texture analysis using two fixed thresholds specified by the user on medical images, which is one of the improved variants of LBP [44]. When compared to LBP, LQP has fewer pixel value variations [29]. By distinguishing the edges into more than three values, LQP has enhanced the performance of these techniques. To extract information from medical images, it employed a four-value code. In continuation to this, more discriminative features on biomedical datasets utilizing a nonbinary coding system, such as quinary coding rather than binary coding, were presented [45]. Furthermore, LQP was studied to extract the efficient features for indexing and retrieval [46]. Nanni et al. [47] have shown that combining texture descriptors with LQP and deep learning algorithms yields improved results on similar datasets used in the literatures. Rampun et al. [48] captured the texture information using the LQP operator for mammogram analysis. The local quinary pattern descriptor was compared to the most advanced texture descriptors [49]. In research by Rachdi et al. [50], the multiscale quinary pattern descriptor presented high capability over other local feature descriptors in extracting discriminative feature representation [50]. Ahmad et al. [51] investigated the use of a feature descriptor, i.e., directional local quinary patterns (DLQP) for detecting plant leaf diseases. In some more investigations, Murala and Jonathan [33] presented a technique called local mesh patterns (LMeP) for biomedical image retrieval that encrypts the gray scale connection among the close neighbors for a particular center pixel using three different orientations of mesh patterns. On different datasets, Rubavathi and Ravi [52] have used the LMCoP method for the retrieval of images. Until now, the typical LBP technique establishes a circumferential link between the referred pixel and its neighbors in the investigation. Rather than LBP, the LMeP technique establishes a link between a referred pixel's surrounding neighbors in an image. The number of neighbors has an impact on the possible relationships among them. According to the research articles reviewed, despite the fact that LBP and its variations accomplish agreeable performance, a different technique to expand the discriminative power in biomedical images for better texture representation is required. Focusing on the further development of texture analysis performance, the local 2D patterns, traditional LBP, LQP, and LMeP texture methods encouraged us to form a practically simple yet strong approach, namely the quinary encoding on mesh patterns (MeQryEP), for the retrieval of biomedical images in this paper. The following are the major novelties of the proposed descriptor (MeQryEP): (a) it is, as of now, demonstrated by Tan and Triggs [29] and Zhu et al. [53] that the dependability of LTP and LBP is lowered for illumination changes, respectively. To resolve this issue, the possibility of LQP is utilized for representing biomedical images in the data sets. (b) It gathers quinary coding features from three different directional local mesh patterns in a given image, resulting in more spatial structure information and improved retrieval. (c) The proposed texture operator shows superior performance to many current advanced texture descriptors, and moreover, in view of its large discriminative power of texture features, it is more viable for the understanding and analysis of image texture. The paper is prepared as follows: Section 1 gives a brief overview of medical image retrieval and associated research. Section 2 also includes a brief discussion of local patterns and the suggested approach. The ideas of the proposed system framework and assessment measures are presented in Section 3. There are experimental findings and discussions in Section 4. Finally, in Section 5, concluding comments and some thoughts about the future are provided.

2. Examining Local Patterns and Proposing a Novel Method

Here, we will go through a few of the most common texturing techniques that have been described in the literature. Given its ease-of-implementation consideration, the decision is centered on the usage of a block of 3 × 3 size, which is considerably the most necessary neighborhood, particularly in real-time applications.

2.1. Primary Version: Local Binary Patterns (LBPs)

The LBP operator developed by Ojala et al. is the most effective and frequently used local texture descriptor [20]. LBPs are resistant and durable to the constant changes in intensity in their original and improved forms because of their discriminative power, simple implementation, and low computational complexity. Hence, many researchers have considered it. By threshing the intensity of the adjacent pixels, the LBP technique describes the local contrast and spatial structure of each 3 × 3 local area in the image. Given a n × m pixels gray scale image I, where I (g) indicates the gray level of the image's g th pixel. At each pixel, the LBP operator is generated by comparing the binary value differences around the value of a central pixel, gc, in a small rounded neighborhood (with radius R). The current pixel's value of LBP is calculated as follows:where gc: center pixel's gray value gp: the gray symmetric circular values of neighborhood, gp (p = 0,..., P − 1). P: pixels of image in the radius circle R(R > 0 2p: factor of binomial for each sign f1 (gp−gc) After determining the LBP value of each pixel in the image, a histogram is created to characterize the texture image. Figure 1 displays a circular neighborhood set example for various patterns of (P, R).
Figure 1

Circular neighborhood sets for different (P, R).

2.2. Local Quinary Patterns (LQPs)

Nanni et al. introduced another variation of LBP for the analysis of the medical image, using a quinary encoding termed LQP in the elliptical neighborhood [44]. The difference between the center pixel's gray value and the gray values of one of their neighbors in this variation assumes 5-digit encryption values (i.e., −2, −1, 2, 1, and 0) rather than the 02 values (i.e., 1, 0) or 03 values (i.e., −1, 1, and 0) in the normal LBP and LTP. The code of binary LBP is substituted by a code of quinary LQP, and the indicator f1(x) is substituted with a 05-valued function based on two thresholds, t1 and t2, stated in equation (2). The subsequent binary function bc(x),  c ∈ {−2,   − 1, 1,  2} is used for conversion in equation (3). When c = 1, c = −1, c = −2, and c = 2 are used, the 1st binary pattern is formed. The 2nd, 3rd, and 4th binary coding patterns are produced in the same way. Finally, from these, four binary patterns' histograms are constructed. After that, 04 histograms are combined to obtain features. Figure 2 shows an illustration of the patterns of the quinary [44] being divided into 04 binary patterns.
Figure 2

Calculation of LBP and LQP operators.

2.3. Local Mesh Patterns (LMeP)

The LMeP for the retrieval of biomedical images is designed by Murala and Jonathan using the LBP concept [33]. The LMeP value is calculated using the surrounding neighbors' relationship for a particular center pixel in the image [see in (equation (4))].where j is the LMeP index, and the x/y operation's remainder is given by mod (x, y). The potential LMeP patterns (particular 3 × 3 pattern) (LMeP_8_1, LMeP_16_2, LMePu2 (with uniform patterns)) for the P neighbors are P/2, and in this study, we exclusively experiment with the first 03-oriented LMeP patterns for j = 1, 2, 3 in equation (4), as shown in Figure 3. Next, the extended local mesh ternary pattern (LMeTerP) descriptor (Deep et al. [42]), where the LTP (Tan and Triggs [29]) connection is between the center pixel (gray value “16”) and neighbors (at threshold, t = 2) for the first mesh pattern image, is also shown in Figure 4. From the ternary pattern {−1, −1, −1, −1, −1, 1, −1, −1}, the upper LTP and lower LTP are converted. The unique LMeTerP values are calculated from LTP patterns. Other mesh pattern images had their LMeTerP values computed as well. The LBP and the initial 03 LMeP for a specified (P, R) [(8, 1), (16, 2), and (24, 3) for experimentation] with the center pixel (gray value “16”) highlighted in green color and the computations and the LMeTerP calculations of that local mesh patterns are shown in Figure 4.
Figure 3

The LBP and the first three LMeP calculations for a given (P, R) [33].

Figure 4

Example of obtaining LBP and LMeTerP for the 3 × 3 pattern [42].

2.4. Proposed Method: Quinary Encoding on Mesh Patterns (MeQryEP)

In this paper, the concept of local pattern techniques (LBP, LMeP, and LQP) has been used to state MeQryEP. With three mesh pattern orientations, MeQryEP describes the gray scale connection among the surrounding neighbors for a particular center pixel. It uses quinary pattern features from image mesh structures to obtain extra spatial structure information. Because of the five encoding techniques that create more texture patterns, its extracted features are more robust than other approaches, such as LBP, LTP, and other advanced texture descriptors. We used the given image's convolution operations (see equations (2) & (4)) to produce the 03 images each of the local mesh pattern for j = 1, 2, 3 to expand the conventional LQP to MeQryEP.where LBPmesh: [Npixels(:, 1:P), Npixels(:, 1:P)]. The neighboring pixels' array of the given image (I) is represented by Npixels (P, R). win_dir_Vec: A directional padding vector for windows that move over LBPmesh. Window(win_dir_vec) with (j = 1, 2, 3) is as follows: win_dir_vec {1, 1}, win_dir_vec {1, 2} ,  win_dir_vec {1, 3}, according to the five values (−2,   − 1,  0 ,  1,  2) of the quinary coding. ‘Same': the central portion of a convolution that is the same size as LBPmesh. Equation (5) yields a five-value code array with the values (−2/−1/0/1/2). Using the idea of LQP provided, the produced mesh quinary pattern is further transformed into 04 binary coding patterns (upper and lower LQP coding patterns) at different thresholds (t1, t2). The unique MeQryEP values (decimal values) are also defined by a binomial weight multiplied with each LQP coding for a specific mesh pattern image selected (3 × 3) for the characterization of local pattern spatial structure. Two higher LQP (for c = 2 and 1 as in equation (3)) equations are defined as below in equations (6) and (7).where where Similarly, (for c = −1 and −2 as in equation (3)), two lower LQP equations ((8) and (9)) are computed as follows:wherewhere A range of values from (0 to 2P-1) is of each of MeQryEP method, LQP (01 upper and 01 lower LQPs) map of the mesh images. Following the detection of local patterns, (LBP, MQryP, LQP, or MeQryEP) constructs a final histogram feature vector (by concatenating four descriptor histograms of each LQP operator) using the following equation (10).where an input image's size is represented by k1 × k2. As we know, the high number of feature dimensions (from 2P to 5P) affects LQP, thus summing the retrieved patterns, as seen in equation (2), which is a good idea (using 5-value quinary F coding). Nanni et al. handled the above-mentioned difficulty by dividing each quinary pattern code into 04 binary patterns scheme (02 upper LQPs and 02 lower LQPs) in this study utilizing two user thresholds (t1, t2) (see in equations (5) to (9)) [44]. The original LQP operator is inferior because of its splitting into 02 LBPs on the upside and 02 on the downside. This study explores the optimum performance with a suitable feature dimension. In local mesh patterns, an illustration of MeQryEP computation for center pixel (the gray value “16”) highlighted in the green color is shown in Figure 5. Look at the initial MeQryEP mesh pattern image. As a result of equation (4), the neighbors are {57, −11, 12, −9, −15, −54, 62, −42}. The obtained result replaces the five-valued function (as in equation (2)) on the thresholds (t1 = 3, t2 = 7), and we obtain {2, −2, −1, −2, −2, −2, 2, −2} quinary values (tolerance of center pixel values are 16 ± 3 for t1 and 16 ± 7 for t2). Using equations (5) to (9), the quinary value coding is transformed into 04 binary patterns, such as upper LQPs and lower LQPs. Finally, the weights are added to each pattern, yielding 04 distinct values (42, 0, 0, 213) that are pointed to MeQryEP for the characterization of the local pattern's spatial structure. In addition, MeQryEP values for various mesh pattern images will be computed. The reason for that is the proposed descriptor results in more spatial structure information, improved retrieval, and also high performance because of its large discriminative power of texture features.
Figure 5

Example to obtain MeQryEP calculation for the 3 × 3 pattern of an image at (P = 8, R = 1).

The proposed MeQryEP is different from the earlier acquainted, existing technique of LBP. With three specified orientations of mesh patterns, MeQryEP extracts the gray scale connection for a given center pixel among the neighbors, while LBP mines the gray scale connection between a center pixel and its neighbors' pixels. MeQryEP uses quinary pattern features from the mesh structures of an image to get extra information of the spatial structure that makes it different from the previously used LBP. It helps in the identification of the descriptive features of biomedical images using more discriminating code than binary and a pool of thresholds. The LBP, LTP, and MeQryEP replies in a facial reference image are illustrated in Figure 6. Face image is used since it gives visually understandable results to distinguish the efficacy of various techniques. The feature map of the texture technique MeQryEP (upper and lower LQPs) captures more directional edge information than the LBP and LTP feature map for the extraction of texture.
Figure 6

Response of proposed method on a reference face.

3. Extraction of Features and the Proposed Method's Framework

3.1. Extracting Features

The process for the feature extraction using MeQryEP is demonstrated in Figure 7, and the stepwise approach is described below.
Figure 7

Procedure of feature extraction for MeQryEP.

(Input): image query as an input Output: retrieval results as the output (1) Open an image that you are looking for (or gray-scale image): query image (2) Form local mesh pattern designs at (j = 1, j = 2, j = 3) amongst the neighbors for a given central pixel. (3) For each mesh pattern, calculate the MeQryEP quinary coding at various thresholds values (t1, t2) and adjust the t values as necessary. (4) Split each quinary coding into 04 binary patternsl, such as upper LQPs and lower LQPs. (5) For upper and lower LQPs, compute MeQryEP decimal values. (6) Make a histogram for each binary pattern. (7) Concatenate the histograms to create a feature vector. (8) For comparing query image with a database image, (12) is employed. (9) The images will be returned based on the finest matches.

3.2. A Measure of Similarity

This is a representation of the feature vector's query image, obtained by extracting the feature fQ=(fQ, fQ,…,  fQ). Also, the |DB| dataset of each medical image is provided with feature vectors fDB=(fDB, fDB,…,  fDB); j=1,2,…,  |DB|. The only aim is to retrieve n top match images in the |DB| dataset by the measurement of the distance between the query image and the image of the dataset. The n finest images comparable to the query image will finally appear. For the purposes of measuring similarity distance, the following D metric is employed:where the ith feature of the jth image in the dataset |DB| is fDB.

3.3. The Framework of the Proposed System

Figure 8 shows the suggested system retrieval framework flowchart utilizing MeQryEP.
Figure 8

Flowchart of the proposed retrieval system framework.

3.4. Measures of Assessment

Average precision, precision, average retrieval precision (ARP), average recall, recall, and average retrieval rate (ARR)), as computed by equations (12) to (15), are the measurements for the performances of the suggested technique. The precision (P) and recall (R) for query image, Iq, have the following definitions:

4. Findings from the Experiments and Discussions

Experiments on three distinct medical datasets are used to access the performance of the suggested method employing nonbinary enlargement, such as quinary coding for the retrieval of biomedical images. The suggested method's findings are evaluated in the subsections that follow. Every image in the database is picked as a query image in each trial. The system gathers n images of database X=(x1 ,  x2,   …  ,  xn) for each query, with the smallest image matching distance (equation (12)). We may conclude that the system has properly matched if and only if the required series (xi;  i = 1, 2,...,n) are related to the same class of the query image. We investigated the influence of a collection of alternative pairs of thresholds (t1, t2) (upper and lower thresholds) in this research since we know that threshold selection is a vital task. Equations (5) to (9) are used here to calculate quinary values on these sets of pairs of thresholds. To extract a distinct feature set according to a pair of thresholds and select the dataset optimized thresholds that give the best retrieval results with respect to ARP and ARR on given different three biomedical datasets, a group of different threshold pairs according to t1={1,…, 25} and t2={t1+2,…, 27} are chosen.

4.1. LIDC-IDRI-CT (Dataset 1) Experiment

The dataset consists of 84 instances, each with around 100–400 images of digital imaging and communication (DICOM) and an XML data file, including the physician annotations. This dataset is the public CT scan image database (lung image database consortium and image database resource initiative (LIDC-IDRI) by Kascic and NEMA-CT online image database that is used for experimentation [54, 55]. There are 143 nodules in the database, ranging in size from ≤3 to ≥ 30 mm (separated physically by radiologists). LIDC 2 image toolkit (accessible online, Lampert) converts the CT lung imaging (512 × 512) into the “tif” imagery image format of the database for fast execution [56]. It was the radiologists' job to find the nodule sites, and they were given a list of 12 patients with a total of 75 nodules (26 benign and 49 malignant) and 229 slices. Additionally, the regions of interest (ROIs) were manually marked from each slice of certain patients to create the database of ROI CT images. Table 1 lists the details of the CT scan data collection. The sample nodule lung images from the lung database are shown in Figure 9 (one image from each patient scan).
Table 1

Data acquisition details of LIDC-IDRI-CT image database.

Case no.DataNo. of slicesNo. of imagesResolutionSlice thickness (mm)Tube voltage (kv)Tube current (mA)
1LIDC-IDRI-00022040512 × 5121.3120440
2LIDC-IDRI-00031040512 × 5122.5120300
3LIDC-IDRI-00062080512 × 5121.3120440
4LIDC-IDRI-00072184512 × 5121.3120440
5LIDC-IDRI-00101560512 × 5121.3120401
6LIDC-IDRI-001127108512 × 5122.5120265
7LIDC-IDRI-00122080512 × 5122.5120300
8LIDC-IDRI-00131872512 × 5122.5120320
9LIDC-IDRI-00140728512 × 5122.5120300
10LIDC-IDRI-00151976512 × 5121.3120361
11LIDC-IDRI-001626104512 × 5122.5120265
12LIDC-IDRI-001726104512 × 5122.5120265

URL for download: https://cabig.nci.nih.gov/tools/NCIA.

Figure 9

Sample nodule images from LIDC-IDRI-CT image database.

As illustrated in Figure 10 and Table 2, the suggested method's performance is measured with respect to ARR and ARP. By passing various query images (i.e., 1–10) on the dataset 1, Figure 10 demonstrates the performance retrieval of the given proposed approach (MeQryEP) and some other current approaches (LBPu2, LBPriu2, LQP, DLTerQEP, LMeP, LMeTerP, LQEQryP) with respect to ARR and ARP. The circular neighborhoods (8, 1) and (16, 2) are used in set for different (P,R) of LBP with uniform patterns. On the dataset 1, the suggested technique (MeQryEP) is evaluated for quinary value computation with two distinct thresholds (t1, t2). It has been noted that the thresholds (3, 7) function better for MeQryEP with respect to ARR. Table 2 highlights the performance of several approaches. In the majority of situations, MeQryEP outperforms the current techniques LBPu2, LBPriu2, LQP, DLTerQEP, LMeTerP, and LQEQryP, as shown in Figure 10. Three query results of the suggested technique (MeQryEP) based on ten top matches on the given dataset are shown in Figure 11.
Figure 10

Performance comparison of the proposed method (MeQryEP) with other existing methods by passing different query images (1–10) in terms of (a) ARP and (b) ARR on LIDC-IDRI-CT database.

Table 2

Performance comparison of the (MeQryEP) with other existing methods in terms of ARR on LIDC-IDRI-CT database.

LBPu2LBPriu2LQPDLTerQEPLMePLMeTerPLQEQryPPM-MeQryEP
ARR 0.57170.65820.76540.8030.83280.85720.8033 0.9628

Bold value is showing the best performance value by the proposed descriptor in the table. Pm: proposed method, i.e., MeQryEP.

Figure 11

Query results of MeQryEP on LIDC-IDRI-CT database by passing three query images (a–c).

4.2. VIA and I-ELCAP-CT (Dataset 2) Experiment

Public collection of vision and image analysis group (VIA) and international early lung cancer action program (I-ELCAP) provided a computer tomography (CT) dataset to evaluate several computer-aided detection methods (online access from VIA/I-ELCAP CT (dataset (2) lung image dataset) [57]. DICOM format is used to store these images. The thickness of a 1.25-mm slice can be obtained in a single breath hold with CT scans. They were also told the sites of nodules found by radiologist. As a result, the ROI CT image database is created using ROIs that have been manually annotated. Table 3 displays the results of the tests on the date acquisition information of 10 CT scans with 100 images each and a resolution of 512 × 512. Dataset 2 sample images are shown in Figure 12 (one image from each category).
Table 3

Data acquisition details of VIA/I-ELCAP-CT lung image database.

DataNo. of slicesResolutionIn-plane resolutionSlice thickness (mm)Voltage (kv)
W1-10100512 × 5120.76 × 0.761.25120

URL for download: http://www.via.cornell.edu/-databases/lungdb.html.

Figure 12

Sample images from VIA/I-ELCAP-CT image database.

With respect to ARR and ARP, Figure 12 compares the performance retrieval of the suggested approach (MeQryEP) with that of other current methods ((LBPu2, LTP, LDP, LTCoP, PVEP, LTrP, LMeP, LMePu2, LQEP, DLTerQEP, LMeTerP, and LQEQryP). The circular neighborhoods (8, 1) and (16, 2) are used in set for different (P, R) of LBP with uniform patterns. On the dataset 2, the suggested technique (MeQryEP) is evaluated for quinary value computation with two distinct thresholds (t1, t2). It has been detected that the thresholds (2, 23) function better for MeQryEP. In terms of recall, Table 4 demonstrates group-based performance in the dataset 2 of the suggested approach and additional current methods. Figure 13 shows the performance of each category with respect to recall and precision of the approach suggested, as well as other current approaches. On the dataset 2, the suggested approach (MeQryEP) clearly outperforms other current methods with respect to ARP, ARR, precision, and recall, as shown in Figures 13 and 14.
Table 4

Group-wise performance of the proposed method and other existing methods in terms of recall values on VIA/I-ELCAP-CT database.

MethodLBPu2LTPLTCoPLDPLTrPPVEPLMePLMePu2LQEPLTrPDLTerQEPLQEQryPPM-MeQryEP
Group
132.4436.0538.437.7333.0336.0337.4337.1838.2333.0342.394242.42
240.534.8736.0337.1436.8539.8535.4534.734.7836.8536.0239.7540.88
338.6739.1138.9945.59434028.930.538.764341.7241.5843.9
466.9559.9470.0161.4962.463.472.9773.0765.7962.470.1272.273.9
536.1732.1139.6732.64414037.9336.5540.294141.644.4245.07
654.2448.0953.2246.6151.759.752.950.6354.1551.754.7263.9464.22
748.4936.5449.4538.451.452.453.2748.5752.0851.452.6658.8958.97
881.1878.2484.2377.1189.591.595.5685.5788.7989.588.1494.1795.08
947.8443.1146.0944.2441.948.942.9642.0443.1141.944.6547.5948.9
1072.6767.1968.5768.5569.5578.5569.5872.0368.0869.5568.6369.9372.74
Total51.91547.5352.4748.9552.0355.0352.751.0852.4152.0354.0757.45 58.61

Bold value is showing the best performance value by the proposed descriptor in the table.

Figure 13

Category-wise performance of MeQryEP and other existing methods in terms of (a) precision and (b) recall on VIA/I-ELCAP-CT database.

Figure 14

Comparison of the MeQryEP with other existing methods in terms of (a) ARP and (b) ARR on VIA/IELCAP-CT database.

4.3. OASIS-MRI (Dataset 3) Experiment

The open access series of imaging studies (OASIS) dataset is used in the experiment. The open access imaging series was established by Marcus et al. and represents an advance of magnetic resonance imaging (MRI) data (dataset for usage in the medical research sector is available online) [58]. Specifics of the MRI acquisition are given in Table 5. Four hundred and twenty-one patients ranging in age from 18 to 96 are included in this data set. In addition, four categories (124, 102, 89, and 106 pictures) are classified in 421 images to test the retrieval of images based on the form of the ventricle in the images. Figure 15 shows one sample image from each dataset 2 type.
Table 5

MRI data acquisition details (adopted from [58]).

SequenceMP-RAGE
TR (msec)9.7
TE (msec)4.0
Flip angle (o)10
TI (msec)20
TD (msec)200
OrientationSagittal
Thickness, gap (mm)1.25, 0
Resolution (pixels)176 × 208

URL for download: http://www.ncbi.nlm.nih.gov/pubmed/17714011.

Figure 15

Sample images from OASIS-MRI database.

With respect to ARP, Table 6 highlights the retrieval outcomes of MeQryEP and additional current techniques on the OASIS dataset. With respect to ARP (i.e., at n equal to10) in Table 6 and Figure 16, the following conclusions are drawn:
Table 6

Comparison of various techniques showing group-wise performance in terms of precision on the OASIS-MRI database.

MethodPrecision (%) (n = 10)
Group 1Group 2Group 3Group 4Total
LBPu2_8_1 51.7732.5433.8249.0641.8
CS_LBP 44.740.131.1748.2741.06
BLK_LBP 48.1341.2235.1650.0143.63
LTP 56.5336.2734.975044.44
LDP 46.2936.3736.8245.5641.26
GLBPu2_8_1 54.4337.9426.5146.0341.23
LTrP 49.5536.9935.4547.0142.25
PVEP 53.8942.0736.5750.3145.71
LMePu2_8_1 52.8236.5636.0851.544.24
LMEBP 46.1740.1736.8349.1743.09
LQEP 50.9736.3739.135.5740.5
DLTerQEP 54.2742.6537.0846.4245.11
LMeTerP 54.9238.1435.1754.2545.62
LQEQryP 54.1143.0436.7451.0446.23
PM-MeQryEP 54.8443.0236.1353.1246.78

Bold value is showing the best performance value by the proposed descriptor in the table.

Figure 16

(a) Comparison of the proposed method with other existing methods on different values of (P, R) as a function of the number of top matches and (b) different group of images (based on the shape of ventricular in the images) comparison of the proposed method with other existing methods on the OASIS-MRI database.

When compared to other retrieval methods (LBPu2_8_1 (41.8%), LDP (41.26%), LTP (44.44%), BLK_LBP (43.63%), CS_LBP (41.06%), LMEBP (43.08%), PVEP (45.71), LTrP (42.25%), LQEP (40.51%), LMePu2_8_1 (44.24%), GLBPu2_8_1 (41.23%), DLTerQEP (45.11%), LMeTerP (45.62%), and LQEQryP (46.23%)), the suggested directional pattern approach (MeQryEP (46.78%) has a better average retrieval precision. Graphs illustrating the performance retrieval of the suggested approach and additional current methods with respect to ARP in accordance with the number of highest matches are shown in Figure 16(a). On the OASIS-MRI image database, Figure 16(b) shows the group-wise performance of several techniques with respect to ARP. On the OASIS-MRI dataset, the suggested technique (MeQryEP) is tested for the quinary value computation with two distinct thresholds (t1, t2). It can be shown that the thresholds (11, 13) perform better for MeQryEP. It is evident from Figure 16 that the suggested technique exceeds a large number of other current methods for the biomedical image retrieval of OASIS-MRI image databases.

4.4. Performance of Feature Vector Size

Using LBP, LTP, LDP, LTCoP, PVEP, LTrP, DLEP, LMeP, LQEP, LMeTer, DLTerQEP, and LQEQryP, Table 7 lists the feature vector size for a particular query image. The testing is done on Intel core i3-10th Gen processor, 4 GB of memory, and 256 GB SSD. The MATLAB Simulink is used to implement all of the techniques. Table 7 makes it obvious that the suggested approach's (MeQryEP) vector length is larger in comparison to some other current techniques, as it exceeds three distinct biomedical databases with regard to ARP and ARR.
Table 7

Feature vector length of query image using various methods.

MethodFeature vector length
LBP256
LTP2 × 256
LTCoP2 × 256
LDP4 × 256
LMeP3 × 256
DLEP4 × 512
LTrP13 × 256
PVEP4 × 256
LQEP1 × 4096
LMeTerP3 × 2 × 256
DLTerQEP2 × 4096
LQEQryP4 × 4096
PM-MeQryEP3 × 4 × 256

5. Conclusions and Prospects for the Future

Here, a conceptually simple, easy-to-implement, and highly discriminating texture operator named “MeQryEP” is designed for the indexing and retrieval of the biomedical image based on various state-of-the-art techniques, such as LBP (LQP, LMeP, and LMeTerP), which are so-calling mesh pattern encoding. The approach suggested codes for the connection between the gray scale of a given center pixel for the neighboring areas with three specified mesh pattern orientations. The core of the approach is to encrypt additional information about spatial structure using quinary patterns from the mesh image structures. The findings of three distinct types of medical databases are taken to evaluate the strength and efficacy of the novel nonbinary coding technique. MeQryEP demonstrated its high capability, with great accuracy, to discriminate between LBP, LTP, LQEP, LMeP, LMeTerP, DLTerQEP, LQEQryP, and additional current state-of-the-art techniques on used LIDC-IDRI-CT, VIA/I-ELCAP-CT, and OASIS-MRI benchmark texture datasets, as demonstrated by its test results. Furthermore, this work can be valuable in the different uses of indexing and recovery of images based on content. In the future, the experimentation should likewise be possible utilizing other well-known nonbinary coding schemes like octal coding to increase the retrieval of the proposed technique performance. Three distinct types of benchmark biomedical databases are used to assess the appropriateness of the suggested descriptor. The suggested descriptor may be compared with the most advanced descriptors and evaluated on hundreds of biomedical datasets, including Covid-19 variant datasets. Execution time can also be considered to be a performance parameter in the future.
  15 in total

1.  Content-based image retrieval for large biomedical image archives.

Authors:  Sameer Antani; L Rodney Long; George R Thoma
Journal:  Stud Health Technol Inform       Date:  2004

2.  Local tetra patterns: a new feature descriptor for content-based image retrieval.

Authors:  Subrahmanyam Murala; R P Maheshwari; R Balasubramanian
Journal:  IEEE Trans Image Process       Date:  2012-05       Impact factor: 10.856

Review 3.  Texture analysis: a review of neurologic MR imaging applications.

Authors:  A Kassner; R E Thornhill
Journal:  AJNR Am J Neuroradiol       Date:  2010-04-15       Impact factor: 3.825

4.  Local binary patterns variants as texture descriptors for medical image analysis.

Authors:  Loris Nanni; Alessandra Lumini; Sheryl Brahnam
Journal:  Artif Intell Med       Date:  2010-03-24       Impact factor: 5.326

5.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance.

Authors:  Minh N Do; Martin Vetterli
Journal:  IEEE Trans Image Process       Date:  2002       Impact factor: 10.856

6.  Local mesh patterns versus local binary patterns: biomedical image indexing and retrieval.

Authors:  Subrahmanyam Murala; Q M Jonathan Wu
Journal:  IEEE J Biomed Health Inform       Date:  2013-11-04       Impact factor: 5.772

7.  [Medical image retrieval based on nonlinear texture features].

Authors:  Wei Liu; Hong Zhang; Qinye Tong
Journal:  Sheng Wu Yi Xue Gong Cheng Xue Za Zhi       Date:  2008-02

8.  Enhanced local texture feature sets for face recognition under difficult lighting conditions.

Authors:  Xiaoyang Tan; Bill Triggs
Journal:  IEEE Trans Image Process       Date:  2010-02-17       Impact factor: 10.856

9.  An Empirical Study Into Annotator Agreement, Ground Truth Estimation, and Algorithm Evaluation.

Authors:  Thomas A Lampert; Andre Stumpf; Pierre Gancarski
Journal:  IEEE Trans Image Process       Date:  2016-03-21       Impact factor: 10.856

10.  Different approaches for extracting information from the co-occurrence matrix.

Authors:  Loris Nanni; Sheryl Brahnam; Stefano Ghidoni; Emanuele Menegatti; Tonya Barrier
Journal:  PLoS One       Date:  2013-12-26       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.