The Performance of CURB-65 and PSI for Predicting In-Hospital Mortality of Community-Acquired Pneumonia in Patients with Type 2 Diabetes Compared with the Non-Diabetic Population.

OBJECTIVE: To compare the performance of CURB-65 and Pneumonia Severity Index (PSI) for predicting in-hospital mortality of community-acquired pneumonia (CAP) between patients with and without type 2 diabetes (T2DM).
METHODS: A retrospective study was conducted on 2365 CAP patients in The First Hospital of Qinhuangdao, China. The primary outcome was in-hospital mortality. The area under curves (AUCs) was used to evaluate the abilities of CRB-65, CURB-65, and PSI class for predicting in-hospital mortality in patients with CAP.
RESULTS: Among CAP patients, 127 patients (5.4%) died, 80 patients were without diabetes, and 47 patients had T2DM. In-hospital mortality increased with the risk stratification defined as CURB-65 and PSI class in both non-diabetes and T2DM patients (P<0.05). The AUCs for predicting in-hospital mortality were 0.728～0.798 in patients without T2DM (CRB-65: 0.728, CURB-65: 0.757 and PSI class: 0.798) and 0.641～0.716 in patients with T2DM (CRB-65: 0.641, CURB-65: 0.677 and PSI class: 0.716)(P<0.001). The AUC of the PSI class was lower in patients with T2DM than in patients without T2DM (P<0.05).
CONCLUSION: CURB-65 and PSI class are correlated with in-hospital mortality of CAP in patients with and without T2DM. Compared with non-diabetes patients, the predictive performance of CURB-65 and PSI class decreased in patients with T2DM. A prediction model for evaluating the CAP severity in the T2DM population should be developed by future studies.

Introduction

Community-acquired pneumonia (CAP) is a very common respiratory disease and an important cause of mortality and morbidity worldwide. The incidence of CAP ranges from 1.76 to 9.6 per 1000 person-years.1–5 CAP patients may have different outcomes varying from rapid recovery to death. Therefore, it is crucial to evaluate the severity of CAP before starting treatment. CURB-65 and Pneumonia Severity Index (PSI) are two commonly used tools for evaluating the severity of CAP,6,7 which have been recommended by several CAP guidelines.8–11

Diabetes is another major global health problem. According to the latest data from International Diabetes Federation, there were 463 million adults living with diabetes in 2019. Type 2 diabetes, which is the most common type of diabetes,12 can cause a series of microvascular and macrovascular complications to vital organs, including the lungs.13 Diabetes can destroy immune response, affect airway glucose homeostasis, thus reducing the pulmonary function.15–17 Pneumonia is considered a pulmonary complication of diabetes.14 Studies have suggested that diabetes can increase hospitalization risk in patients with CAP, thus leading to higher mortality and increased cost of treatment.18–21

It remains unclear whether CURB-65 and PSI can be used to evaluate the severity of CAP in patients with diabetes. The aim of this study was to compare the performance of CURB-65 and PSI for predicting in-hospital mortality of community-acquired pneumonia between patients with and without type 2 diabetes in First Hospital of Qinhuangdao, China.

Methods

Subjects

This retrospective study included patients hospitalized at the First Hospital of Qinhuangdao between January 2015 and December 2018. The inclusion criteria were the following: 1) all patients were diagnosed with CAP, 2) patients over 18 years of age. The exclusion criteria were: 1) patients with type 1 diabetes; 2) patients with other specific types of diabetes; 3) patients with no clear type classification; 4) patients with pre-diabetes; 5) pregnancy; 6) obstetric infection; 7) clinical data about CURB-65 and PSI missing. This study was approved by the ethics committee of the First Hospital of Qinhuangdao.

Definition of CAP and Classification of Diabetic Type

The definition of CAP was done according to the 2016 CAP clinical practice guidelines by the Chinese Thoracic Society.8

Diabetic types were classified using the International classification of Diseases-10 (ICD-10). The codes of T2DM were included in the study. The codes of type 1 diabetes and other specific types of diabetes were excluded. Nonspecific codes and codes of pre-diabetes were also excluded in the study.

Data Collection

Initial data after admission were extracted from the Hospital Information System. Sociodemographic variables included age, sex, and ethnicity. Clinical data included the diagnosis and classification of diabetes, neoplastic disease, liver disease, congestive heart failure, cerebrovascular disease, and renal disease. Physical examination included mental status, respiratory rate, blood pressure, temperature, and pulse. Laboratory data included arterial pH, PaO2, SaO2, urea, sodium, glucose, and hematocrit. Pleural effusion was also collected. The scores of CRB-65 [confusion, respiratory rate≥30/min, blood pressure (systolic blood pressure<90mmHg or diastolic blood pressure≤60mmHg) and age ≥65years], CURB-65 [CRB-65 plus urea>7mmol/L] and PSI were calculated.6,7 Patients with a CRB-65 score 0 were defined as a low-risk group, with a score 1～2 as an intermediate-risk group, and with a score ≥3 as a high-risk group. Patients with a CURB-65 score 0～1 were defined as a low-risk group, with score 2 as an intermediate-risk group, and with scores 3～5 as a high-risk group. According to the PSI score, patients were classified into five risk classes. Patients with PSI class I～III were defined as a low-risk group, with class IV as an intermediate-risk group, and with class V as a high-risk group. The primary outcome was in-hospital mortality.

Statistical Analyses

All analyses were performed using the SPSS 24.0 statistical software (SPSS 24.0 for Windows; SPSS, Inc., Chicago, IL). Numerical variables were not normally distributed and were expressed as medians (interquartile range). Comparisons were conducted between groups using the Mann–Whitney U-test. Categorical data were reported as abnormal subjects (%) and were analyzed using the chi-square test or Fisher’s exact test. The relationship between the risk stratification and in-hospital mortality was analyzed by multiple logistic regression, adjusted for sex and age. The area under curves (AUCs) for CRB-65, CURB-65, and PSI class were drawn by receiver operating characteristic curve (ROC curve) analysis. AUCs were used to evaluate the abilities of CRB-65, CURB-65, and PSI classes for predicting in-hospital mortality in patients with CAP. The performance of CRB-65, CURB-65, and PSI for predicting in-hospital mortality of CAP was compared between patients with and without T2DM. The ROC curve analysis was performed with MedCalc15.2.2 software (Ostend, Belgium). P<0.05 was considered statistically significant.

Results

A total of 2682 CAP patients were analyzed. Thirty-six patients with type 1 diabetes, other specific types of diabetes, or no clear type classification, and 23 patients with pre-diabetes were excluded from the study, as well as 8 patients with pregnancy or obstetric infection. Two hundred fifty patients were additionally excluded due to missing clinical data (CURB-65 and PSI). Eventually, this study enrolled 2365 patients (1372 males and 993 females), aged 66.6±17.3 years (). Among those patients, 531 patients (22.5%) had T2DM.

Among the CAP patients, 127 patients (5.4%) died, 80 patients were without diabetes, and 47 patients had T2DM. The percentage of chronic obstructive pulmonary disease (COPD) and asthma were similar between those patients with and without T2DM (P>0.05) (). The scores of CRB-65, CURB-65, and PSI were all significantly higher in T2DM patients than non-diabetes patients (P<0.001) (). In-hospital mortality increased with the risk stratification defined as CRB-65, CURB-65, and PSI class (P<0.05). Moreover, in-hospital mortality increased with the risk stratification defined as CURB-65 and PSI class in both non-diabetes and T2DM patients (P<0.05) (Figure 1, ).

Figure 1

The mortality in community-acquired pneumonia patients with different risk stratification.

The characteristics of patients with different clinical outcomes are shown in Table 1. The scores of CRB-65, CURB-65, and PSI were significantly higher in death patients than in those who survived (P<0.001). In non-diabetic and T2DM patients, the scores of CRB-65, CURB-65, and PSI were all significantly higher in death patients than survival patients (P<0.001). In survival patients, the scores of CRB-65, CURB-65, and PSI were all significantly higher in T2DM patients than in non-diabetic patients (P<0.001). In death patients, the scores of CRB-65, CURB-65, and PSI were similar between T2DM patients and non-diabetic patients (P>0.05) (Table 1). The number (%) of patients with each CRB-65 score, CURB-65 score, and PSI class are presented in .

Table 1

The Characteristics of CURB-65 and PSI in Community-Acquired Pneumonia Inpatients with Different Clinical Outcomes

Variables	All (N=2365)			Non-Diabetes Group (N=1834)			Type 2 Diabetes Group (N=531)
	Survival (N=2238)	Death (N=127)	P	Survival (N=1754)	Death (N=80)	P	Survival (N=484)	Death (N=47)	P
CURB-65
Age≥65 years[n(%)]	1338(59.8)	106(83.5)	<0.001	996(56.8)	66(82.5)	<0.001	342(70.7)	40(85.1)	0.035
Confusion[n(%)]	189(8.4)	35(27.6)	<0.001	136(7.8)	25(31.3)	<0.001	53(11.0)	10(21.3)	0.037
Urea>7mmol/L[n(%)]	674(30.1)	79(62.2)	<0.001	482(27.5)	49(61.3)	<0.001	192(39.7)	30(63.8)	0.001
Respiratory rate≥30/min[n(%)]	88(3.9)	16(12.6)	<0.001	69(3.9)	10(12.5)	0.001	19(3.9)	6(12.8)	0.018
Low BP(SBP<90 or DBP<60mmHg)[n(%)]	244(10.9)	32(25.2)	<0.001	190(10.8)	25(31.3)	<0.001	54(11.2)	7(14.9)	0.443
CURB-65 Score	1(0～2)	2(1～3)	<0.001	1(0～2)	2(1～3)	<0.001	1(1～2)$	2(1～3)	<0.001
CRB-65 Score	1(0～1)	1(1～2)	<0.001	1(0～1)	1(1～2)	<0.001	1(1～1)$	1(1～2)	<0.001
PSI
Age*	65.0(51.0～75.0)	73.0(65.0～82.0)	<0.001	64.0(48.0～75.0)	74.5(65.0～81.8)	<0.001	67.0(59.0～76.0)$	72.0(66.0～82.0)	0.008
Neoplastic disease[n(%)]	117(5.2)	24(18.9)	<0.001	95(5.4)	19(23.8)	<0.001	22(4.5)	5(10.6)	0.142
Liver disease[n(%)]	111(5.0)	2(1.6)	0.082	81(4.6)	1(1.3)	0.251	30(6.2)	1(2.1)	0.418
Congestive heart failure[n(%)]	277(12.4)	36(28.3)	<0.001	190(10.8)	18(22.5)	0.001	87(18.0)	18(38.3)	0.001
Cerebrovascular disease[n(%)]	417(18.6)	33(26.0)	0.040	271(15.5)	17(21.3)	0.163	146(30.2)	16(34.0)	0.582
Renal disease[n(%)]	180(8.0)	21(16.5)	0.001	115(6.6)	8(10.0)	0.229	65(13.4)	13(27.7)	0.009
Altered mental status[n(%)]	189(8.4)	35(27.6)	<0.001	136(7.8)	25(31.3)	<0.001	53(11.0)	10(21.3)	0.037
Respiratory rate≥30/min[n(%)]	88(3.9)	16(12.6)	<0.001	69(3.9)	10(12.5)	0.001	19(3.9)	6(12.8)	0.018
SBP<90mmHg[n(%)]	42(1.9)	12(9.4)	<0.001	34(1.9)	10(12.5)	<0.001	8(1.7)	2(4.3)	0.219#
Temperature<35°C or ≥40°C[n(%)]	2(0.1)	0(0.0)	1.000#	1(0.1)	0(0.0)	1.000#	1(0.2)	0(0.0)	1.000#
Pulse≥125/min[n(%)]	71(3.2)	25(19.7)	<0.001	52(3.0)	16(20.0)	<0.001	19(3.9)	9(19.1)	<0.001
Arterial pH<7.35[n(%)]	16(0.7)	8(6.3)	<0.001	10(0.6)	6(7.5)	<0.001#	6(1.2)	2(4.3)	0.152#
Urea≥11mmol/L[n(%)]	247(11.0)	51(40.2)	<0.001	164(9.4)	29(36.3)	<0.001	83(17.1)	22(46.8)	<0.001
Sodium<130mmol/L[n(%)]	146(6.5)	16(12.6)	0.008	98(5.6)	9(11.3)	0.062	48(9.9)	7(14.9)	0.413
Glucose≥14mmol/L[n(%)]	115(5.1)	15(11.8)	0.001	22(1.3)	1(1.3)	1.000	93(19.2)	14(29.8)	0.085
Hematocrit<30%[n(%)]	300(13.4)	39(30.7)	<0.001	213(12.1)	30(37.5)	<0.001	87(18.0)	9(19.1)	0.842
PaO2<60mmHg or SaO2<90%[n(%)]	54(2.4)	11(8.7)	<0.001	33(1.9)	8(10.0)	<0.001	21(4.3)	3(6.4)	0.782
Pleural effusion[n(%)]	947(42.3)	77(60.6)	<0.001	718(40.9)	50(62.5)	<0.001	229(47.3)	27(57.4)	0.184
PSI Score	80.0(59.0～102.0)	122.0(100.0～142.0)	<0.001	76.0(55.0～98.0)	118.5(98.5～144.0)	<0.001	91.0(72.0～112.0)$	125.0(101.0～141.0)	<0.001

Notes: *The patient’s age in years (age minus 10 for females). #Fisher’s exact test. Numerical data were not normally distributed, they were expressed as medians (IQR). Comparisons were conducted between groups using the Mann–Whitney U-test. $Compared with Non-diabetes survival group P<0.001.

Abbreviations: PSI, pneumonia severity index; BP, blood pressure; SBP, systolic blood pressure; DBP, diastolic blood pressure; IQR, interquartile range.

The AUCs for predicting in-hospital mortality were 0.705～0.782 (P<0.001) (Figure 2, ). The AUC of CURB-65 was higher than the AUC of CRB-65 (P<0.05). The AUC of the PSI class was higher than the AUCs of CRB-65 and CURB-65 (P<0.05). In patients with T2DM, the AUC of the PSI class was higher than the AUC of CRB-65 (P<0.05). The AUCs for predicting in-hospital mortality were 0.728～0.798 in patients without T2DM and 0.641～0.716 in patients with T2DM (P<0.001). The AUC of the PSI class was lower in patients with T2DM than in patients without T2DM (P<0.05) (Figure 2, ). For both non-diabetic and T2DM patients the optimal cut-off points were CRB-65 score 2, CURB-65 score 2, and PSI class Ⅳ. The sensitivities, specificities, and Youden’s index are shown in Table 2. For non-diabetic patients, the sensitivity of CRB-65 was 45.0% and the specificity of CRB-65 was 86.1%; the sensitivity of CURB-65 was 70.0% and the specificity of CURB-65 was 70.2%; the sensitivity of PSI was 83.8% and the specificity of PSI was 68.0%. For T2DM patients, the sensitivity of CRB-65 was 40.4% and the specificity of CRB-65 was 83.1%; the sensitivity of CURB-65 was 72.3% and the specificity of CURB-65 was 59.5%; the sensitivity of PSI was 83.0% and the specificity of PSI was 49.0%.

Figure 2

The receiver operator characteristic curve of CURB-65 and PSI for evaluating the risk of death in community-acquired pneumonia inpatients. (A) All patients; (B) non-diabetic patients; (C) type 2 diabetic patients.

Table 2

The Sensitivities, Specificities and Youden’s Index of CURB-65 and PSI for Evaluating the Risk of Death in Community-Acquired Pneumonia Inpatients

Variables		All (N=2365)			Non-Diabetes Group (N=1834)			Type 2 Diabetes Group (N=531)
CRB-65	Score	Sen(%)	Spe(%)	Youden’s Index	Sen(%)	Spe(%)	Youden’s Index	Sen(%)	Spe(%)	Youden’s Index
	0	100	0	0.000	100	0	0.000	100	0	0.000
	1	90.6	34.2	0.248	91.3	37.1	0.283	89.4	24.0	0.133
	2	43.3	85.4	0.287	45.0	86.1	0.311	40.4	83.1	0.235
	3	14.2	97.4	0.116	20.0	97.6	0.176	4.3	96.7	0.009
	4	0.8	99.9	0.007	1.3	99.9	0.012	0	99.6	−0.004
CURB-65	Score
	0	100	0	0.000	100	0	0.000	100	0	0.000
	1	92.1	29.7	0.218	92.5	32.8	0.253	91.5	18.2	0.097
	2	70.9	67.9	0.388	70.0	70.2	0.402	72.3	59.5	0.318
	3	35.4	91.1	0.265	38.8	91.8	0.305	29.8	88.6	0.184
	4	11.8	98.3	0.101	16.3	98.4	0.147	4.3	97.7	0.020
	5	0.8	99.9	0.007	1.3	99.9	0.012	0	99.6	−0.004
PSI	Class
	I	100	0	0.000	100	0	0.000	100	0	0.000
	II	99.2	14.2	0.134	98.8	17.3	0.161	100	2.9	0.029
	III	93.7	38.2	0.319	92.5	42.6	0.351	95.7	22.1	0.179
	IV	83.5	63.9	0.473	83.8	68.0	0.517	83.0	49.0	0.319
	V	36.2	91.8	0.280	35.0	92.9	0.279	38.3	87.8	0.261

Abbreviations: PSI, pneumonia severity index; Sen, sensitivity; Spe, specificity.

Discussion

Our study shows that in-hospital mortality increased with the CAP risk stratification in both non-diabetes and T2DM patients. Nevertheless, the AUCs for predicting in-hospital mortality were lower in T2DM patients compared with non-diabetic patients. When the sensitivities were similar, the specificities were lower in T2DM patients than non-diabetic patients.

In diabetes stratified analyses, the AUCs were 0.728～0.798 in the non-diabetic group and 0.641～0.716 in the T2DM group. The AUCs dropped by 0.080～0.087 in patients with T2DM compared to patients without T2DM. However, the difference was statistically significant only in PSI. AUC is an index for evaluating the discrimination of the prediction model. The reduction of AUC reflects poor discrimination in T2DM. In the predictive model of death, we expected death patients to have a high-risk score and survival patients to have a low-risk score. In our study, the scores of CRB-65, CURB-65, and PSI were all high in death patients with or without T2DM. However, the scores of CRB-65, CURB-65, and PSI were higher in survival patients with T2DM than those without T2DM. Hence, the difference of CRB-65, CURB-65, and PSI between survival and death patients shrunk in T2DM. The power of discrimination decreased. Due to the similar score in death patients, the sensitivities were similar. The specificities were low in T2DM because of the higher scores in survival patients with T2DM.

The development of CURB-65 was based on three large prospective studies of CAP from the United Kingdom, New Zealand, and the Netherlands. The development of PSI was based on MedisGroups Comparative Hospital Database from the United States. Although CURB-65 and PSI were developed in the European and American populations, the accuracy of CURB-65 and PSI have been validated in an Asian population. The AUCs of CURB-65 and PSI in predicting 28-day mortality were 0.829 and 0.813 in Beijing Chao-yang Hospital;22 the AUCs of CRB-65, CURB-65, and PSI in predicting 30-day mortality were 0.694～0.736 in Hong Kong;23 the AUCs of CURB-65 and PSI in predicting 28-day mortality were 0.701 and 0.735 in Korea;24 the AUCs of CURB-65 and PSI in predicting 30-day mortality were 0.755 and 0.767 in Japan.25 In summary, the accuracies of CURB-65 and PSI were moderate in the Asian populations.26 Similar to the above study, we found that the AUCs of CRB-65, CURB-65, and PSI in predicting in-hospital mortality were 0.705～0.782.

The Clinical Practice Guideline of the American Thoracic Society and Infectious Diseases Society of America recommends using the PSI over the CURB-65 to determine the need for hospitalization in CAP.9 Aujesky et al found that PSI has higher discriminatory power for short-term mortality than CURB-65.27 Moreover, Zhang et al found that PSI performed significantly better than CURB-65 for mortality prediction.28 The meta-analysis also found that PSI had the highest sensitivity for mortality.29 In our study, the performance of PSI was also superior to CRB-65 and CURB-65. The AUC and sensitivity of PSI were higher than CRB-65 and CURB-65. The specificity of PSI was similar to CURB-65. Nonetheless, PSI includes many variables, which complicates its implementation.

Aging is associated with high mortality in CAP patients.30 The discriminative power of CURB-65 and PSI decreases with aging.28 In our study, the age was generally high in T2DM patients, even in survival patients, which may be the main reason why the scores were higher in survival T2DM patients. Another reason could be associated with concomitant disease. T2DM often coexists with multiple concomitant diseases, such as chronic kidney disease, heart failure, cerebrovascular diseases, and so on.31–33 In our study, these concomitant diseases were also common in survival T2DM patients.

This study has a few limitations. First, the predictive accuracy of CURB-65 and PSI was poor in influenza pneumonia.34 The constituents of etiology may affect the performances of CURB-65 and PSI. However, it was not possible to obtain the information on the aetiology of CAP. Second, the nursing home residency is one of the PSI requirements.7 There was not nursing home resident in our Hospital Information System. As this was a retrospective study, it was not possible to confirm the patient’s address. However, there are not many nursing homes in Qinhuangdao. Thirdly, this is a single-center study, and therefore, the results cannot be generalizable to other hospitals or regions in the country or other countries. Consequently, the result should be validated in other populations.

In summary, our data suggest that CURB-65 and PSI class are correlated with in-hospital mortality of CAP in patients with and without T2DM. However, compared with non-diabetic patients, the predictive performance of CURB-65 and PSI class decreased in patients with T2DM. A prediction model for evaluating the CAP severity in the T2DM population should be developed by future studies.