Evaluation of COVID-19 chest computed tomography: A texture analysis based on three-dimensional entropy.

Radiologists, and doctors in general, need relevant information for the quantification and characterization of pulmonary structures damaged by severe diseases, such as the Coronavirus disease 2019 (COVID-19). Texture-based analysis in scope of other pulmonary diseases has been used to screen, monitor, and provide valuable information for several kinds of diagnoses. To differentiate COVID-19 patients from healthy subjects and patients with other pulmonary diseases is crucial. Our goal is to quantify lung modifications in two pulmonary pathologies: COVID-19 and idiopathic pulmonary fibrosis (IPF). For this purpose, we propose the use of a three-dimensional multiscale fuzzy entropy (MFE3D) algorithm. The three groups tested (COVID-19 patients, IPF, and healthy subjects) were found to be statistically different for 9 scale factors ( p < 0.01 ). A complexity index (CI) based on the sum of entropy values is used to classify healthy subjects and COVID-19 patients showing an accuracy of 89.6 % , a sensitivity of 96.1 % , and a specificity of 76.9 % . Moreover, 4 different machine-learning models were also used to classify the same COVID-19 dataset for comparison purposes.

Introduction

Coronavirus disease 2019 (COVID-19), a highly infectious disease, is caused by a new coronavirus called SARS-CoV-2 [13], [34]. The SARS-CoV-2 infection leads to pulmonary interstitial damages, which may cause severe pneumonia, acute respiratory distress syndrome, multiple organ failure, and death [3], [7], [13], [34]. Currently, the gold standard diagnostic test for COVID-19 is a real-time reverse transcription polymerase chain reaction (RT-PCR) of the viral nucleic acid [7], [13], [34]. However, many studies have demonstrated the importance of using chest computed tomography (CT) in the management of COVID-19 patients [7], [33], [34]. Recent studies have found that chest CT have higher sensitivity values compared to RT-PCR when diagnosing COVID-19 [1], [14]. According to [1], chest CT has a sensitivity of , with RT-PCR as a reference standard. Besides, a study conducted on 51 COVID-19 patients [16] revealed that diagnosing through chest CT only misses of the positive cases.

The severity and the time course of the disease may lead to different CT patterns in COVID-19 patients. The main hallmarks of CT manifestations of COVID-19 are ground glass opacities (GGO), and consolidated pulmonary opacities [2]. Li et al. reported that these two features were both present in of their COVID-19 patients dataset [16]. GCO are present in most of the patients with a predominantly bilateral distribution in the posterior, subpleural, and peripheral lung areas [2], [7], [34]. GGO is defined as a hazy area of increased opacity within which pulmonary vessels remain visible. There can be several causes of GGO such as partial filling of air spaces, interstitial thickening, partial collapse of alveoli, increased capillary blood volume, or a combination of these [10]. This CT feature is considered to be one of the earliest visible CT manifestation as well as the most common imaging findings [34]. As the time gap between the first symptoms and the chest CT execution increases, so does the frequency of consolidation, and bilateral and peripheral lung disease. Other features like linear opacities and crazy-paving pattern can also appear [2].

Image texture analysis has been proposed as an alternative approach to the more traditional visual methods, for disease quantification. Texture analysis may improve the diagnosis and monitoring of pulmonary diseases [4], [8], [25], [26]. So far, several works have described typical CT imaging features [7], [13], [28], [33], [34], but they do not always indicate the complete information regarding the patients or CT imaging parameters [12]. Recently, a segmentation and classification scheme has been proposed for identification of pulmonary regions affected by COVID-19 among normal ones on CT images [6]. Besides, several works based on neural networks and machine learning techniques have been proposed to classify COVID-19 [17], [29], [30], [31], [32].

In [30], public datasets of X-rays and CT scans were used to classify COVID-19 cases and No Findings (healthy) cases, having a total of 510 images. Their feed-forward neural network based on texture features shows a validation accuracy of . To feed this neural network the authors used a 129 vector composed by gray-level co-occurrence matrix and based features, and local binary patterns [20], [21].

Wang et al. [32] proposed the use of a three-dimensional deep neural network called DeCoVNet. The authors used a large dataset of COVID-19 and non-COVID-19 CT volumes. Besides, they also used a data augmentation technique to increase their dataset. They report accuracy values of [32].

Other approaches have also been used with successful results. For example, in [17] the authors combined COVID-19 images with images generated using generative adversial network (GAN) and classified up to 4 classes (COVID-19, normal, pneumonia bacterial, and pneumonia virus cases). After obtaining the dataset, they used neural networks already proposed: AlexNet [15], GoogLeNet [27], and ResNet18 [11]. When classifying COVID-19 and normal cases, the validation accuracy reported is , , and , respectively [17].

Another interesting method used in this application is the FGCNet [31]. The authors use CT slices chosen by radiologists to classify COVID-19 cases. Their work involved a preprocessing stage, obtaining gray-scaled and increased contrast images that are posteriorly down-sampled [31]. Their network is based on convolutional neural network (CNN) to obtain a representation at the image level, and on graph convolutional network (GCN) to obtain a relation-aware representation. A data augmentation stage is also performed in their work. The authors report a mean accuracy of and a mean sensitivity of [31].

We herein propose the application of a newly developed textural analysis method for CT scans [9] based on three-dimensional multiscale fuzzy entropy (MFE3D) determination. This quantitative analysis is first applied to CT scans of COVID-19 patients, to determine pulmonary textual changes. Then, the results are compared to those obtained from healthy subjects and idiopathic pulmonary fibrosis (IPF) patients, another pulmonary disease for which quantification is not an easy task [9].

Materials and methods

The extremely recent MFE3D algorithm that we propose to use in our work has previously been tested on synthetic data for validation purposes, having already shown interesting results in CT scans texture analysis (for details see [9]).

Clinical dataset

The total clinical dataset, processed in this study, is composed of CT scans from 51 patients diagnosed with COVID-19, 26 healthy subjects, and 26 IPF patients, making a total of 103 subjects. The population characteristics for each group as well as the detailed description of the CT scans features are shown in Table 1 and Table 2 , respectively. The data regarding IPF disease goes inline with the disease's incidence since IPF typically affects elderly males [24].

Table 1

Population characteristics of COVID-19 patients, healthy subjects, and idiopathic pulmonary fibrosis (IPF).

Subjects	Mean age (years)	Gender
		Male (%)	Female (%)
Healthy subjects	48.19±14.84	21   (80.8%)	5   (19.2%)
IPF patients	74.96±9.38	22   (84.6%)	4   (15.4%)
COVID-19 patients	58.84±14.87	34   (66.7%)	17   (33.3%)

Table 2

Clinical dataset CT features (kVp – kiloVolt peak).

Reconstruction matrix	512×512 pixels
Tube voltage (% of subjects)	100 kVp (37.9%)
	120 kVp (62.1%)
Mean pixel spacing	0.72±0.06 mm
Mean number of scans per patient	375.43±83.26 units
Slice thickness (% of subjects)	0.625 mm (3.9%)
	1.000 mm (63.1%)
	1.250 mm (33.0%)
Total collimation width (% of patients)	20 mm (29.1%)
	58 mm (1.9%)

The CT images were collected by the University Hospital of Rennes, France (IRB approval following the Declaration of Helsinki - approval number of 19.6). IPF-diagnosed patients were diagnosed with stable IPF (according to multidisciplinary discussions) and were recruited at the competence center for rare pulmonary diseases, Department of Respiratory Medicine, University Hospital of Rennes, France. Neither infection nor exacerbation was encountered in the preceding 8 weeks to their first appointment. The subjects that underwent chest CT scans to rule out other pathologies were considered healthy if the scans, verified by an expert radiologist, confirmed the absence of any abnormal structures of the lungs parenchyma [9]. For the COVID-19 dataset, the suspected patients, admitted to the regional emergency departments of COVID-19 (University Hospital of Rennes, France) between March 26 and April 17 of 2020, were considered as possible candidates. These patients were assessed using a non-contrast chest CT scan and all underwent RT-PCR testing for SARS-CoV-2. The retrospectively confirmed cases were included in the dataset.

Fig. 1 shows typical examples of chest CT in the basal area of the lungs for each group. The control group is represented in Fig. 1a by a 53 years old healthy subject with normal lung structure. In Fig. 1b, a CT scan from a diagnosed patient with IPF (78 years old) is represented and shows honeycombing and reticular pattern which are two typical features of IPF patients in CT scans. Fig. 1c and Fig. 1d show CT scans of two patients diagnosed with COVID-19 with ages of 56 and 72 years, respectively. Fig. 1c shows ground glass opacities and some consolidation. In Fig. 1d, consolidation is mainly visible.

Fig. 1

CT scans examples of a healthy person (a), idiopathic pulmonary fibrosis (IPF) (b), and Coronavirus disease 2019 (COVID-19) patients (c and d).

Segmentation of the region of interest

As mentioned earlier, one of the most common features present in CT images of pulmonary regions affected by COVID-19 is GGO. This feature, caused by the presence of COVID-19, is mainly predominant in posterior, subpleural, and peripheral lung regions with a bilateral distribution [34], [7]. On the other hand, IPF affects basal, subpleural, and peripheral lung regions [24]. Hence, the motivation is to segment volumes from these regions according to both diseases incidence.

Therefore, we selected CT scans from the basal and peripheral lung areas that were posteriorly segmented to a region of interest (ROI). The ROI volumes used for entropy analysis had voxels and were chosen based on the process detailed in [9]. This process searches for a cube (with an edge of 50 voxels) using a bottom-up approach to guarantee that the volume corresponds to a basal and peripheral region. Given the slice thickness (see Table 2), the final volumes represent a region of the lung with a height up to 62.5 mm. All the ROI volumes were taken from the right lung as an arbitrary choice. Volumes from the left lungs were not considered to avoid data correlation.

Entropy determination

The algorithm applied in this work relies on two main steps. The first step is to determine the fuzzy entropy on the original region of interest (ROI) using a three-dimensional fuzzy entropy (FuzEn3D) [9]. This algorithm divides the volume into smaller three-dimensional templates of size , , where corresponds to the size of the edge of the cubes to be compared, i.e., the embedding dimension. Afterwards, a fuzzy exponential function, controlled by parameters tolerance () and fuzzy power (), is used to determine a similarity degree between the templates. Finally, the entropy value is determined by a relation between the average similarity degree obtained for two consecutive embedded dimensions ( and ).

Consider a given volume, , of dimensions W L H (W-width, L-length, H-height). To determine its entropy value, cubic templates of edge sizes and , both with the same starting voxel (), must be compared. The total number of three-dimensional templates that can be obtained is [9].

In order to simplify the mathematical notation, two volumetric templates of edge size , with different starting voxels, can be defined using U and U . For comparison purposes of the templates, the distance between the two templates ( and ), , is defined as the infinity norm distance between them and used in the exponential fuzzy function to obtain the similarity degree as it follows [9]:

The variable represents the tolerance parameter, chosen as a percentage of the standard deviation of the original data, and is the fuzzy power parameter [9].

Once the similarity degree is computed for all the possible templates (excluding self-matches) then, the average of all similarity degrees is defined as follows [9]:

The previous steps are repeated for () - edged three-dimensional templates, allowing to determine the entropy value as the natural logarithm of the ratio between and [9]:

According to the recently validated algorithm [9], the embedding dimension (), tolerance (), and fuzzy power () parameters used to determine entropy values were , , and , where SD(U) stands for the standard deviation of the original volume. The maximum downsampling scale applied in this analysis is . These parameters were previously obtained using synthetic volumes [9], allowing us to compare the three different conditions in this study (healthy, IPF-suffering, and COVID-19-suffering patients). Otherwise, the comparison between the two pathologies would be much harder. Even if these parameters might not be the optimal ones, these ones allow an adequate and consistent analysis.

The second main step that this processing procedure relies on corresponds to the application of a coarse-graining procedure to produce different downsampled volumes, in order to obtain information across several scale factors (). The number of voxels for each downsampled volume, , is determined by the relation where represents the degree of downsampling and , , and the original volume width, length, and height, respectively (in this study voxels). The computation of FuzEn3D is then repeated for each downsampled volume (see equation (4)).

The described data processing results in a total of 10 entropy values for each volume (one for each scale factor). The entropy computation was performed on MATLAB R2019® software. The full description of the algorithm can be found in [9].

Complexity index

Based on [5], we also propose the use of a score for the multiscale entropy values. This score is unique for each ROI and is computed as a complexity index (CI). It is defined as the sum of the entropy values for a certain interval of scale factors, i.e.:

For this work, as described below, and were chosen, therefore, . Moreover, the CI was used to classify the healthy subjects and COVID-19 patients using a threshold (of 1.74 to maximize the accuracy). The receiver operating characteristic (ROC) analysis was also performed.

Statistics

Once the multiscale fuzzy entropy values were obtained for each scale factor, the normality of the groups was assessed using the Shapiro-Wilk test (for ). When the distribution of the three groups was found to be normal, the one-way ANOVA parametric test was performed. Otherwise, a Kruskal-Wallis test was used to find if the groups were statistically significantly different. Afterwards, to perform a pairwise comparison, the post-hoc Tukey's honestly significant difference test was used. A similar procedure was considered for the CI values to verify the existence of statistical differences. The statistical analysis was also performed on MATLAB R2019® software considering a statistical significance for .

Classification approaches

For comparison purposes, the MFE3D entropy values of to and the CI values were used as features for several classifiers. Due to the rise of entropy for the last two-scales, probably associated with the extremely low size of the down-sampled volumes, the last two scale factors values were not used as features.

The classifiers used were: support vector machine (SVM) with a linear and a radial basis function (rbf) kernel, a k-nearest neighbors (kNN) algorithm, and finally, a neural network using the Multi-layer Perceptron (MLP) classifier.

The regularization parameter was set to for the linear-SVM and for the rbf-SVM. The gamma parameter was set to for the rbf-SVM since the number of features is 9. For the kNN algorithm, the number of neighbors used was , using the Manhattan distance definition. The MLP network used 4 hidden layers, with 40 neurons each, using a quasi-Newton based optimizer, with ReLu activation, and a learning rate of .

The classification approaches used a split of for the train and test dataset. In addition, within the train dataset, we also used a k-fold technique with , obtaining the validation scores.

Similarly to the threshold classifier using the complexity index, these different classification approaches were used to classify healthy, and COVID-19 cases. In the Results and Discussion section, these are compared in terms of accuracy, area under the curve (AUC), and sensitivity. The mean values and best cases of accuracy, AUC, and sensitivity of the validation and test datasets are shown.

The classifiers models were implmented using Python® 3.7.4 and the library scikit-learn 0.24.1. [22].

Results and discussion

The results obtained for the MFE3D values are presented in Fig. 2 . The entropy values are depicted as mean standard deviation for each scale factor () and group. Fig. 2 shows different values for FuzEn3D for each group and at each scale factor, allowing a direct comparison between previously obtained results [9] and the new COVID-19 data. Except for , COVID-19 group FuzEn3D mean values are higher, with a significant difference, than both healthy and IPF groups. Furthermore, the three groups follow a decreasing behavior of their entropy values up to . The rise observed for and occurs due to the small size of the downsampled coarse-grained volumes. Given that the original volumes have a size of voxels, for the volume has voxels resulting in a structure with few similarities between its voxels, leading to higher values of entropy.

Fig. 2

Mean and standard deviation for the tridimensional fuzzy entropy values for healthy subjects, idiopathic pulmonary fibrosis (IPF), and coronavirus disease 2019 (COVID-19) patients. Results for the scale factors to are shown.

For , the entropy increase can be explained by the blood vessels that have a size between 2-4 mm [23]. When considering the mean pixel spacing value, these vessels will be represented up to around pixels. For , they are averaged and represented only by 1.1 pixels. We hypothesize that this introduces slight three-dimensional texture modifications, leading to a more irregular structure and, therefore, a relative increase of the system's entropy value [9].

The normality of the entropy values distribution was assessed using Shapiro-Wilk test for a statistical significance of (Table 3 ). The results show that only for the scale factor , the three groups, healthy subjects, IPF, COVID-19 patients, follow a normal distribution for p-values of 0.125, 0.601, and 0.054, respectively. For the remaining scale factors, at least one group does not follow a normal distribution.

Table 3

Normality test assessment using Shapiro-Wilk (W) statistics and a statistical significance of (*) for healthy subjects, idiopathic pulmonary fibrosis (IPF), and coronavirus disease 2019 (COVID-19) patients.

Scale factor (τ)	Healthy subjects		IPF patients		COVID-19 patients
	W(26)	p	W(26)	p	W(51)	p
1	0.70	0.000*	0.95	0.233	0.99	0.820
2	0.94	0.125	0.97	0.601	0.96	0.054
3	0.80	0.000*	0.96	0.003*	0.94	0.008*
4	0.72	0.000*	0.85	0.001*	0.95	0.028*
5	0.84	0.001*	0.95	0.184	0.91	0.001*
6	0.67	0.000*	0.83	0.001*	0.88	0.000*
7	0.63	0.000*	0.70	0.000*	0.79	0.000*
8	0.79	0.000*	0.79	0.000*	0.83	0.000*
9	0.93	0.080	0.86	0.003*	0.84	0.000*
10	0.92	0.048*	0.94	0.130	0.95	0.027*

For , the normality assumption is verified, therefore the one-way ANOVA test was used to verify the existence of a statistical difference between the groups. For the remaining scales, the Kruskal-Wallis test was performed. The statistical test and the corresponding p-values are presented in Table 4 .

Table 4

One-way ANOVA (F) and Kruskal-Wallis (H) statistics for and for and , respectively, to assess statistical differences between the three groups for (**) and for (*).

Scale factor (τ)	Test statistics
1	H(2,100)=17.79	p=1.374E−04 **
2	F(2,100)=13.55	p=6.211E−04 **
3	H(2,100)=52.70	p=3.607E−12 **
4	H(2,100)=51.22	p=7.552E−12 **
5	H(2,100)=17.66	p=1.463E−04 **
6	H(2,100)=46.10	p=9.762E−11 **
7	H(2,100)=46.89	p=6.585E−11 **
8	H(2,100)=42.77	p=5.168E−10 **
9	H(2,100)=7.60	p=2.230E−02 *
10	H(2,100)=9.83	p=7.300E−03 **

The null hypothesis of both one-factor ANOVA and Kruskal-Wallis is rejected with a significant level of 0.01, for most of the scales (9 out of 10). This means that the population median of the groups is different, confirming the discriminatory nature of FuzEn3D. For the case of one-factor ANOVA (), the populations of each group do not have the same mean value. The previous results only determine the existence of a statistical difference between the groups. To evaluate which specific groups are statistically different from each other, a post hoc test for pairwise comparison is applied. With that in mind, a Tukey's honestly significant difference test was performed to assess multiple comparisons of the groups. Table 5 summarizes the results for healthy, IPF, and COVID-19 groups.

Table 5

Tukey's honestly significant difference test of the possible comparison pairs (Healthy (H) VS. IPF; Healthy VS. COVID; and, IPF VS. COVID). Statistical significance for (**) and for (*).

Scale factor (τ)	p-Value
	H-IPF	H-COVID	IPF-COVID
1	0.330	0.000**	0.040*
2	0.502	0.000**	0.002**
3	0.003**	0.000**	0.002**
4	0.001**	0.000**	0.010*
5	0.100	0.000**	0.163
6	0.001**	0.000**	0.023*
7	0.001**	0.000**	0.015*
8	0.002**	0.000**	0.031*
9	0.942	0.101	0.040*
10	0.093	0.005**	0.754

From the results obtained using Tukey's test, we can observe that the null hypothesis is rejected in many cases, confirming that the distributions show mean ranks (mean values for ) that are statistically significantly different from each other (please see also Table 6 ). Special attention should be given to the cases of . For these scale factors, the null hypothesis is rejected for all the groups combinations with a significance level of . Moreover, in one case () the three combinations are statistically significant for .

Table 6

Mean estimates using Tukey's test for Healthy subjects, IPF, and COVID-19 patients. Estimation of the mean values for , and estimation of the mean ranks for the remaining scale factors.

Scale factor (τ)	Mean estimates
	Healthy subjects	IPF patients	COVID-19 patients
1	34.54±5.86	46.31±5.86	63.80±4.18
2	0.45±0.02	0.48±0.02	0.57±0.01
3	19.54±5.86	46.69±5.86	71.25±4.18
4	18.92±5.86	49.19±5.86	70.29±4.18
5	32.81±5.86	49.81±5.86	62.90±4.18
6	20.31±5.86	50.12±5.86	69.12±4.18
7	20.31±5.86	49.42±5.86	69.47±4.18
8	21.44±5.86	50.27±5.86	68.46±4.18
9	45.38±5.86	42.65±5.86	60.14±4.18
10	67.46±5.86	50.19±5.86	45.04±4.18

Nevertheless, the most significant result is the direct comparison between healthy and COVID-19 groups. The null hypothesis is rejected, in 9 out of 10 scales, for significance level of , making MFE3D a discriminatory metric between healthy subjects and COVID-19 patients. For to and , the group of COVID-19 patients is statistically different from the group of healthy subjects.

The CI was defined based on the sum of the entropy values from scale factors . Scales 9 and 10 were not included because they present a different behavior compared with the lower scale factors. Fig. 3 presents the box-histogram plot of the CI distributions for each group. The healthy subjects have a mean CI of , IPF patients have , and COVID-19 patients have .

Fig. 3

Box-histogram plot of the complexity index for the healthy, IPF patients, and COVID-19 groups.

From the CI distributions, we can see that COVID-19 patients’ values increase up to 5.2 while the highest value for the healthy group is lower than 2.2 (excluding outliers). Moreover, the spread of the CI in the case of COVID-19 patients is much larger than the one of the healthy group. Even when comparing with the IPF group, COVID-19 patients exhibit higher CI. The distribution results of the CI shows that it can be a good indicator for fast screening of COVID-19 patients.

Besides, the normality of the CI values for the three groups was assessed to further analyze the statistical differences between them. Using a Shapiro-Wilk (W) test (with a significance level of ) we obtained for the healthy subjects and , for the IPF patients and , and finally, for the COVID-19 patients and . Given that the CI values of two groups do not follow a normal distribution, we proceeded to the Kruskal-Wallis analysis obtaining and . This implies that there is a statistical difference between the three groups for . When performing Tukey's test, the mean ranks were estimated, leading to , , and for healthy subjects, IPF, and COVID-19 patients, respectively. Moreover, for the three comparisons Healthy-IPF, Healthy-COVID-19, and IPF-COVID-19 the respective p-values were: , , and . For the first two comparisons, the groups are statistically different for , and the third is statistically different for . Therefore, we can conclude that the estimated mean rank of CI for COVID-19 patients is statistically significantly higher than for the other two groups.

To proof the screen capabilities of the CI metric, a simple classifier based on a fixed threshold was implemented to classify the subjects as healthy subjects or as COVID-19 patients. The receiver operating characteristic (ROC) curve of this classifier was plotted by changing the decision threshold from 0 to 5.2 with steps of 0.01 (please see Fig. 4 ).

Fig. 4

ROC curve of the threshold classifier to detect COVID-19 patients. The color-scale indicates the global accuracy of the classifier.

This simple classifier can achieve an accuracy of 0.896 with a sensitivity of 0.961 and a specificity of 0.769 for a decision threshold of 1.74. The area under the ROC curve achieved by this system was 0.940. The high sensitivity value shows the ability to determine that the subject has COVID-19 given that the subject is infected.

As mentioned previously, COVID-19 disease has some CT hallmark features that will modify the image texture. These features introduce variability in the lungs’ CT scans which explains higher entropy values for COVID-19 patients compared to healthy subjects. However, it is not only important to differentiate COVID patients from healthy subjects but also other pulmonary diseases with similar CT features. So far, this analysis has shown the potential to discriminate both cases using MFE3D. On the other hand, this dataset is not balanced or considering the incidence of both diseases which can be a drawback in the design of a classifier. The dataset is also quite small and should be larger to make sure that the conclusions regarding the considered sample still apply to the population. Another major drawback is the fact that the settings and features of the CT scans are not uniform which can result on some texture differences that are not being considered. Furthermore, as mentioned earlier, since it is necessary to differentiate COVID-19 patients from other pulmonary pathologies a more robust classifier can be used and include, for example, a dataset of IPF patients.

Herein, texture-based features are used to classify COVID-19 cases. Previous studies have also used texture-based features to obtain an automated system to detect COVID-19. The novelty here is that volumetric data is analysed and then, through a multiscale entropy algorithm and complexity index, these texture-based features are obtained.

Table 7 shows the accuracy of the classifiers. For the best classifiers, MLP and kNN, a validation accuracy of and is reported, respectively. In addition, the kNN classifiers has the best test accuracy (), and the MLP neural network has the second best test accuracy of . Therefore, when using a neural network an high accuracy value can be achieved. Based on this, in the future, it can be interesting to explore more options in terms of neural networks approaches to classify volumetric HRCT data.

Table 7

Accuracy of the classifiers for healthy and COVID-19 cases using MFE3D and CI values as features.

		MLPC	SVM-rbf	kNN	SVM-linear
Validation	Mean (%)	90.3±7.0	84.5±10.8	89.9±8.5	85.7±8.3
	Best (%)	100.0	100.0	100.0	100.0
Test	Mean (%)	90.0±8.8	85.3±6.4	92.4±4.8	86.5±5.6
	Best (%)	100.0	94.1	100.0	94.1

When analyzing the AUC values in Table 8 , the MLP neural network demonstrates to have the highest mean AUC () for the validation dataset, revealing the effectiveness of the model in detecting COVID-19 disease. For the test dataset, this value decreases which can result from slight overfitting and from the unbalanced dataset. For the test dataset, the kNN shows the best mean AUC value ().

Table 8

Area under the curve (AUC) of the classifiers for healthy and COVID-19 cases using MFE3D and CI values as features.

		MLPC	SVM-rbf	kNN	SVM-linear
Validation	Mean	0.958±0.052	0.942±0.064	0.905±0.010	0.946±0.074
	Best	1.000	1.000	1.000	1.000
Test	Mean	0.871±0.091	0.861±0.049	0.907±0.059	0.861±0.049
	Best	0.955	0.955	1.000	0.955

Another parameter of major importance is the sensitivity to detect COVID-19 (Table 9 ). The two classifiers with the highest mean validation sensitivity are the MLP neural network and kNN with and , respectively. This reveals that in case someone is infected there is a high probability to detect it and classify the case correctly. This value is of extremely importance since a recent study stated that the RCT-PCR test has a sensitivity of around which is lower than the presented classifiers [18]. Nevertheless, there is still space to improve this results. One of the drawbacks of this work and that can explain why the average test accuracy is above the is that an unbalanced dataset is used. Another disadvantage is that the dataset is only composed by 77 subjects.

Table 9

Sensitivity of the classifiers for healthy and COVID-19 cases using MFE3D and CI values as features.

		MLPC	SVM-rbf	kNN	SVM-linear
Validation	Mean (%)	93.5±8.1	82.8±15.1	94.5±8.0	86.0±10.3
	Best (%)	100.0	100.0	100.0	100.0
Test	Mean (%)	93.6±11.3	82.7±9.0	93.4±6.4	87.3±11.5
	Best (%)	100.0	100.0	100.0	100.0

In [30], the validation accuracy in classifying COVID-19 and healthy subjects was higher than when full images are used as features for their feed-forward network. Nevertheless, when using texture-based features the validation accuracy is , as mentioned earlier [30]. With the neural network used in our study with 9 texture-based features, we were able to reach similar accuracy. Nonetheless, a supplementary study, with a larger dataset, would be useful to take further conclusions.

The accuracy reported in [32] was . They also classify COVID-19 and non-COVID-19 cases. If we consider our mean test accuracy, our kNN approach outperforms their results. In addition, the MLP classifier achieves similar performance using a smaller dataset (see Table 7). However, when considering the best value of accuracy, our approaches outperform their method.

In addition, using FGCNet [31], a mean accuracy of and a mean sensitivity of can be achieved. Using GAN and neural networks, the authors of [17] achieved accuracy values superior to . Although the best cases of our classifier can reach accuracy, the mean value of our approaches are not as good.

The extreme good values shown in [17] can also be explained by the fact that the test dataset only contains 18 images, compared to the 130 images of the train dataset, which corresponds to a dataset split of . In fact Wang et al. [31] compares ResNet and the GoogLeNet with FCGNet and they report accuracy values of and , respectively.

As mentioned earlier, our dataset is too small but the approach of using texture-based features, from three-dimensional CT data, in addition with other classification approaches, namely, with AlexNet [15], GoogLeNet [27], and ResNet18 [11], and the FGCNet [31] can be of great interest.

Conclusions

With this work, we have demonstrated that the entropy analysis of CT data can contain relevant information concerning the pulmonary condition of COVID-19 patients. The presented work showed significant statistical differences (p-values 0.01) between the entropy values of 9 out of 10 scales when comparing healthy subjects with COVID-19 patients. The presented technique can be used for COVID-19 patients screening, with improvements on the response time compared to traditional diagnosis methods, allowing for fast patients isolation. Just the distribution of a simple uni-dimensional metric, like the CI, could be used to signalize potential COVID-19 patients with high sensitivity () even using a simple threshold classifier.

When applying different classifiers to our full dataset, we show that a mean accuracy of is achieved. The classification approaches used can achieve similar or superior results to other literature classification methods. Although some techniques based on deep learning show better results [31], [30], [17], our method used less features. Furthermore, our methodology is based on a statistical analysis of texture-based features. A simple score as the CI reached similar accuracy values, using only one feature and a threshold classifier as the more sophisticated classification models used.

In the future, after these preliminary results, it should be interesting applying this validated method in larger public datasets. Furthermore, since the disadvantages of this method is that we use an unbalanced and small dataset, the correction of this issue could lead to an improvement of both the statistical tests and machine learning results.

Even though machine-learning and deep learning can reveal very helpful, these techniques can involve an huge amount of training time and data to obtain desirable results. Besides, overfitting is one of the main issues that can occur in classification models. For clinical practitioners can also be very difficult to interpret this type of models and their results. However, statistical approaches are very common in medical sciences. Therefore, a model based on a statistical assessment provides more insight for the specialists, being easier for them to interpret the results. This method also allows to select the best features to use in a machine learning or deep learning system instead of using a huge number of features that can lead to high computational cost and overfitting issues.

Future work based on this evidence can also be the development of a classification system based in other more successful deep learning strategies. by expanding the number of variables. Moreover, by increasing the number of subjects, a more complete analysis can be performed, and eventually, could use the complexity index or some similar score to quantify the extent of the diseases.

Finally, it has been reported that recovered COVID-19 patient might present a reduced lung function [19]. The findings detailed in this work open the possibility to assess and quantify the lung function of recovered COVID-19 patients. This could be achieved by comparing the CT scans before and after recovery to confirm the extent of pulmonary damages.

Authors’ contribution

Andreia S. Gaudêncio: Conceptualization, Methodology, Software, Formal Analysis, Writing – Original Paper, Writing – Review and Editing. Pedro G. Vaz: Conceptualization, Methodology, Software, Formal analysis, Writing – Original Paper, Writing – Review and Editing. Mirvana Hilal: Conceptualization, Writing – Review and Editing. Guillaume Mahé: Resources, Writing – Review and Editing. Mathieu Lederlin: Resources, Writing – Review and Editing. Anne Humeau-Heurtier: Conceptualization, Supervision, Writing – Review and Editing. João M. Cardoso: Conceptualization, Supervision, Writing – Review and Editing.