Performance of Procalcitonin to Distinguish Fungal from Bacterial Infections in Patients with Systemic Lupus Erythematosus.

PURPOSE: To evaluate the performance of serum procalcitonin (PCT) concentrations to diagnose fungal infection in patients with systemic lupus erythematosus (SLE). PATIENTS AND METHODS: From January 2017 to October 2020, SLE patients hospitalized for serious infection with an identified single bacterial or fungal pathogen, as well as PCT measured within 24h after admission were included. The diagnostic performance of PCT was evaluated independently and in combination with the white blood cell (WBC) count, C-reactive protein (CRP) level, and erythrocyte sedimentation rate (ESR). The analysis included the sensitivity, specificity, positive and negative predictive values, positive and negative likelihood ratios, and the crude and adjusted area under the receiver operating characteristic curve (AUROC).
RESULTS: Sixty-nine patients were included; 26 had a fungal infection (38%) and 43 had a bacterial infection (22 gram-positive and 21 gram-negative). Fungal infection patients were mainly distributed in the respiratory group (88.5%), and bacterial infection distribution were more prevalent in respiratory group (44.2%) and abdominal/urinary group (23.3%). The PCT concentration was significantly lower in fungal infections than bacterial infections (fungal: 0.22 ng/mL, interquartile range [IQR], 0.09-0.44 vs bacterial: 0.60 ng/mL, IQR, 0.16-5.74; p = 0.016) and differed significantly between different infection sites (p = 0.022). PCT had better diagnostic performance for predicting fungal infection (AUROC = 0.731) than the WBC count (AUROC = 0.581), the CRP level (AUROC = 0.716), and ESR (AUROC = 0.583). PCT and ESR together had the best diagnostic performance, with 46.2% sensitivity and 88.4% specificity. Further, the AUROC increased compared to PCT alone but was statistically insignificant (p = 0.693).
CONCLUSION: For SLE patients with serious infection, the PCT concentration had better diagnostic accuracy for predicting fungal infection than the WBC count, the CRP level, and ESR. Combining PCT and ESR obtained the highest AUROC and provided an acceptable discrimination performance.

Introduction

Systemic lupus erythematosus (SLE) is a heterogeneous systemic autoimmune disease with protean clinical manifestations.1 The overall survival rate of SLE has dramatically improved over the past decades, partially due to immunosuppressive agents. However, immunological aberrations may increase the susceptibility of SLE patients to infections, becoming a major cause of death.2,3 In one recent population-based study, renal disease, infections, and cardiovascular disease were the top three causes of mortality of SLE patients.4 Patients with these acute events were more likely to seek care in the emergency department (ED), with approximately 40% patients having at least one ED visit per year of SLE.5 Further, infections were the leading cause of ED visits for SLE patients.6

SLE patients are often in an immunosuppressive state compared to non-immunocompromised individuals. Opportunistic infections, for example, fungi, are more common, increasing the challenges of anti-infection. Further, diagnosing a specific pathogen based on symptoms, signs, and clinical imaging alone is difficult. Narrowing the etiology of the pathogen’s species is crucial for the timely administration of appropriate antimicrobials. Therefore, identifying laboratory markers capable of distinguishing pathogenic microorganisms is greatly important.

Procalcitonin (PCT), the precursor of calcitonin, is normally secreted by parafollicular cells (C cells) of the thyroid and neuroendocrine cells in the lungs and the intestine. Under normal physiological conditions, the PCT concentration in healthy individuals is negligible. Therefore, serum PCT may be a tool for differentiating between bacterial and non-bacterial causes of inflammation,7,8 and could also be useful in systemic autoimmune diseases. Brodská et al reported that the PCT concentration in fungal infections was significantly lower than in Gram-positive and Gram-negative bacterial infections.9 However, similar studies have not been performed in individuals with SLE. In a small sample study, lupus patients with bacterial or fungal infections had higher serum PCT concentrations than those with viral infections, but the study did not compare bacterial and fungal infections.10 Further, a Chinese retrospective study reported that fungal infection ranked third in the total number of infections in SLE patients but did not analyze the PCT concentration.11

Therefore, the serum PCT concentrations in SLE patients with infection remains unknown,12–14 along with the difference between bacterial and fungal infections and the predictive value for fungal infection. To address this knowledge gap, we retrospectively analyzed SLE patients with infection to determine if the PCT concentration can differentiate between bacterial and fungal infections.

Methods

Study Design, Setting, and Subjects

This cross-sectional study evaluated SLE patients admitted to Renji Hospital, affiliated with Shanghai Jiao Tong University of Medicine, from the ED between January 2017 and October 2020. SLE patients aged 18 years or older hospitalized for serious infection were screened. Serious infection was defined as a composite of bacterial infections (eg, meningitis, encephalitis, cellulitis, endocarditis, pneumonia, pyelonephritis, septic arthritis, osteomyelitis, and bacteremia) or invasive fungal infections (eg, systemic candidiasis, cryptococcosis, aspergillosis, or Pneumocystis jirovecii) using discharge diagnosis ICD-10 codes from hospital inpatient records. Patients with viral infections were excluded, as it is well-documented that they have little effect on the PCT concentration, and we aimed to distinguish between bacterial and fungal infections. Patients with mixed infections were also excluded because, in this situation, it is difficult to decipher the effect of the infecting pathogen on the PCT level. Other exclusion criteria included other autoimmune diseases, a history of burns, multiple traumas, or surgery in the last three months, malignant tumors, SLE concurrent macrophage activation syndrome, and patients without PCT data within 24 h of admission. The study protocol was approved by the ethics committees of Shanghai Jiao Tong University of Medicine affiliated with Renji Hospital. Written informed consent was not required because all data were analyzed retrospectively and anonymously. The study conforms to the provisions of the Declaration of Helsinki (as revised in 2013).

Infectious Pathogen Identification

The infectious pathogen identification was based on a positive pathogen test from various specimens (eg, blood, sputum, pus, and urine), clear evidence of infection (eg, radiographic presentations on computed tomography, ultrasound, or magnetic resonance imaging), and obvious clinical signs correlating with infection. Molecular diagnostic methods, including next-generation sequencing and real-time quantitative reverse transcription-polymerase chain reaction, were also used to determine the causative pathogens (Pneumocystis jiroveci and Nocardia farcinica, respectively). Additionally, a positive response to the standard anti-infective therapy supported the diagnosis.

The above processes and decisions regarding the pathogenicity of common contaminants, including coagulase-negative staphylococci, Corynebacterium, and Candida species, were judged by an infectious disease physician and two trained physicians to avoid misclassification. The reviewers were blinded to the PCT concentration, and if they disagreed on the pathogen, the final result was decided based on the majority. Individuals were divided into a bacterial group (Gram-negative and Gram-positive subgroups) and a fungal group based on the pathogen.

PCT, C-Reactive Protein (CRP), White Blood Cell (WBC) Count, and Erythrocyte Sedimentation Rate (ESR) Measurements

PCT was measured using a UPT-3A-1200 with automated time-resolved fluorescence immunoassay (Rejing, China) with a 0.02 ng/mL limit of detection. In healthy individuals, the PCT concentration is <0.05 ng/mL in our laboratory. The CRP concentration and WBC count were analyzed in serum using a BC-7500R with high-sensitivity latex-enhanced nephelometry (Mairui, China). ESR was determined by the Westergren method using an established normal range of 0–20 mm/h. Per routine clinical practice, the medical staff ordered a PCT test if the patient was suspected to be admitted to the hospital due to infection. For individuals with multiple PCT tests during the first 24 h of admission, the highest value was used for analysis. A PCT level below the lower limit of detection was replaced by values half of the limit of detection (ie, 0.01 ng/mL).

Data Collection

We used a standardized electronic data extraction form to record data on patient demographics, comorbidities, clinical and laboratory characteristics, the infection site, microbiological test results, medication history, and inflammatory markers. SLE disease activity was assessed using the SLE Disease Active Index 2000 (SLEDAI-2k); a high SLEDAI score represents high disease activity. The current tools to identify infection and the infection severity, such as the sequential organ failure assessment (SOFA) and quick SOFA scores, were also applied as indicated at baseline. Following the Sepsis 3.0 criteria, patients were classified as having sepsis if there was a suspected or documented infection plus an acute increase in the SOFA score (greater than 2 points).

Statistical Analyses

Data are expressed as means ± standard deviations or medians (interquartile ranges [IQR]) and percentages, depending on the variable type. The PCT concentrations were compared between the documented bacterial and fungal groups using the Mann–Whitney U-test, and a difference between multiple infection sites calculated by Kruskal–Wallis nonparametric test. The discriminative ability of the PCT concentration for predicting fungal versus bacterial infections was evaluated by the area under the receiver operating characteristic curve (AUROC) and 95% confidence intervals. The discriminatory ability of the CRP concentration, WBC count, and ESR to predict fungal infection were also evaluated by AUROC independently and combined with the PCT concentration. In parallel, the AUROC was calculated after adjusting for covariates (eg, the SLEDAI score and infection site) affecting the PCT concentration. Cut-off values were determined by the Youden index.

Statistical analyses were performed using the IBM SPSS version 24.0 for Windows (IBM Corp., Armonk, NY, USA). Adjusted AUROC was computed using the R package “RISCA” version. All tests were two-sided, and a p-value of <0.05 was considered statistically significant.

Results

During the study period, a total of 123 patients were screened and 69 patients were included in the final analysis (Figure 1); 22 (32%) had a Gram-positive infection, 21 (30%) had a Gram-negative infection, and 26 (38%) had a fungal infection. Twenty-three (88.5%) fungal infection patients were distributed in the respiratory group, 2 (7.7%) in the abdominal/urinary group and 1 (3.8%) in the other group. Nineteen (44.2%) bacterial infection patients were distributed in the respiratory group, 10 (23.3%) in the abdominal/urinary group, 5 (11.6%) in the skin/soft-tissue and 9 (20.9%) in the other group. Table 1 presents the demographic and clinical characteristics. Patients with a fungal infection had a significantly lower SLEDAI score than those with a bacterial infection (7.54 vs 10.48; p = 0.037), but other baseline characteristics did not differ between the fungal and bacterial groups.

Figure 1

Study population flow diagram.

Table 1

Baseline Characteristics of Gram-Positive Bacterial, Gram-Negative Bacterial and Fungal Infection Groups

Variable†	Bacterial Group (n=43)		Fungal Group (n=26)	P-value*
	Gram-Positive Bacterial (n=22)	Gram-Negative Bacterial (n=21)
Female, n (%)	20 (90.9%)	16 (76.2%)	24 (92.31%)	0.305
Age (year), mean (SD)	43.32 (16.81)	44.38 (14.72)	47.73 (14.50)	0.307
Diabetes mellitus, n (%)	2 (9.1%)	6 (28.6%)	6 (23.08%)	0.766
Disease activity and organ involvement
SLEDAI score, mean (SD)	11.32 (6.31)	9.55 (5.58)	7.54 (4.71)	0.037
Disease course (year), median (IQR)	6.50 (0.7–16.8)	4.00 (0.30–13.0)	4.00 (0.4–9.5)	0.406
Lupus nephritis, n (%)	15 (68.2%)	11 (52.4%)	17 (65.38%)	0.683
Interstitial lung disease, n (%)	1 (4.6%)	3 (14.3%)	4 (15.38%)	0.444
Infection time course (day), median (IQR)	6.50 (3.3–10.0)	14.0 (6.0–15.0)	10.0 (5.3–15.0)	0.559
Laboratory results
ESR (mm/h), median (IQR)	37 (17–61)	53 (28–70)	44 (16–80)	0.906
Albumin (g/L), mean (SD)	24.2 (6.5)	27.1 (5.9)	28.2 (7.3)	0.121
Creatinine (μmol/L), median (IQR)	86 (59–182)	82 (54–175)	69 (55–106)	0.165
Urea nitrogen (mmol/L), median (IQR)	10.5 (7.0–16.6)	9.0 (6.6–23.8)	7.2 (5.6–15.1)	0.133
WBC (*109/L), mean (SD)	7.99 (4.02)	8.80 (5.20)	7.93 (3.60)	0.666
Platelet count (*109/L), median (IQR)	104 (56 −178)	105 (41–147)	134 (69–204)	0.139
Lactate (mmol/L), mean (SD)	2.09 (1.44)	2.63 (2.03)	2.09 (0.89)	0.488
CRP (mg/L), median (IQR)	38 (9–117)	49 (6–115)	23 (5–56)	0.122
Procalcitonin (ng/mL), median (IQR)	1.43 (0.14–8.26)	0.57 (0.20–2.57)	0.22 (0.09–0.44)	0.016
qSOFA score, n (%)				0.581
score = 0	16 (72.7%)	13 (61.9%)	17 (65.4%)
score = 1	5 (22.7%)	5 (23.8%)	8 (30.8%)
score = 2	1 (4.6%)	3 (14.3%)	1 (3.9%)
SOFA score, mean (SD)	4.94 (2.15)	4.87 (2.67)	5.32 (2.31)	0.451
Sepsis, n (%)	17 (77.3%)	15 (71.4%)	21 (80.8%)	0.545
Mortality, n (%)	9 (40.9%)	7 (33.3%)	6 (23.1%)	0.222

Notes: *P-values were calculated to compare the differences between the bacterial and fungal groups. Comparison of continuous variables using student-t test and Mann–Whitney nonparametric test. Categorical variables were compared using chi-squared test or Fisher exact test. †Data are presented as median (interquartile range) or mean (standard deviation).

Abbreviations: SLEDAI, systemic lupus erythematosus disease activity index; ESR, erythrocyte sedimentation rate; WBC, white blood cell; CRP, C-reactive protein; SOFA, sequential organ failure assessment; qSOFA, quick sequential organ failure assessment.

details the pathogen distributions. Streptococcus spp (n = 11) and Escherichia coli (n = 8) were the most commonly identified bacteria. Of the fungal group, Candida spp (n = 13) was the most common, followed by Aspergillus fumigatus (n = 5), Cryptococcus neoformans (n = 4), Pneumocystis jirovecii (n = 3), and Penicillium marneffei (n = 1).

The PCT concentration in patients with fungal infections (0.22 ng/mL [IQR, 0.09–0.44]) was significantly lower than in patients with Gram-positive (1.43 ng/mL [IQR, 0.14–8.26]; p = 0.049) or Gram-negative (0.57 ng/mL [IQR, 0.20–2.57]; p = 0.033) infections (Figure 2A). The CRP concentration (p = 0.122), WBC count (p = 0.666), and ESR (p = 0.906) did not differ between the bacterial and fungal groups (–) The PCT concentration significantly differed between different infection sites (p = 0.022) and was the highest in patients with an abdominal or urinary infection, followed by skin and soft tissue and respiratory infections (Figure 2B). In the comparable respiratory infection group, the PCT concentration in patients with fungal and bacterial infection also show difference (P=0.041) ().

Figure 2

PCT concentrations in patients with different groups.

The bacterial and fungal infection groups were compared, and the AUROC were plotted based on the derived cut-off values for PCT, CRP, WBC, and ESR (Figure 3). PCT had the highest AUROC, providing a relatively higher diagnostic value than the other three markers (all p-values <0.05). The PCT sensitivity (76.9%) and specificity (58.1%) were the best at a cut-off value of 0.49 ng/mL, and the positive predictive value (PPV) and negative predictive value (NPV) were 52.6% and 80.7%, respectively. After adjusting for the SLEDAI score and infection site, PCT also outperformed the other biomarkers for the discrimination of fungal infections with statistically significant incremental differences (p <0.001) (Table 2).

Figure 3

ROC curve and AUROC of fungal infection by PCT and other biomarkers.

Table 2

Results of the ROC Analysis for Predicting Fungal Infection

Variable	AUROC (95% CI)	P-value	Adjusted AUROC (95% CI)*	Cut-Off†	Spec.	Sens.	PPV	NPV	LR+	LR-
PCT	0.674 (0.545–0.803)	0.016	0.731 (0.602–0.859)	0.49	0.581	0.769	0.526	0.807	1.838	0.397
CRP	0.612 (0.476–0.748)	0.122	0.716 (0.580–0.852)	109	0.279	0.923	0.436	0.857	1.280	0.276
ESR	0.509 (0.363–0.654)	0.906	0.583 (0.438–0.729)	15	0.884	0.269	0.583	0.667	2.315	0.827
WBC	0.514 (0.373–0.655)	0.843	0.581 (0.440–0.722)	7.03	0.605	0.500	0.433	0.667	1.265	0.827
PCT+CRP	0.646 (0.514–0.777)	0.044	/	/	0.372	0.923	0.471	0.889	1.470	0.207
PCT+ESR	0.688 (0.559–0.817)	0.009	/	/	0.884	0.462	0.706	0.731	3.969	0.609
PCT+WBC	0.677 (0.548–0.846)	0.014	/	/	0.512	0.846	0.552	0.846	1.733	0.301

Notes: *Adjusted AUROC was adjusted for infection site and SLEDAI score based on 1000 bootstrap calculation, p values of Variable between AUROC and Adjusted AUROC were all less than 0.001. †Evaluated at Youden’s index maximum.

Abbreviations: PCT, procalcitonin; CRP, C-reactive protein; WBC, white blood cell; ESR, erythrocyte sedimentation rate; AUROC, area under the receiver operating characteristic curves; Sens., sensitivity; Spec., specificity; PPV, positive predictive value; NPV, negative predictive value; LR+, positive likelihood ratio; LR-, negative likelihood ratio.

We also analyzed the AUROC of the markers in varying combinations to increase the diagnostic accuracy. PCT and ESR combined had the highest PPV (70.6%), AUROC (0.688), and the specificity of the combination of PCT and ESR for confirming fungal infections was the highest of all combinations (88.4%) (Table 2); however, the AUROC showed no significant differences, as compared to PCT alone (p = 0.693; Figure 3).

Discussion

This cross-sectional study indicated that the PCT concentration has better diagnostic performance for discriminating fungal from bacterial infections in SLE patients than the CRP concentration, WBC count, and ESR. The results were consistent after accounting for the influence of the SLEDAI score and infection site. The combination of PCT and ESR obtained the highest AUROC and provided an acceptable discrimination performance. However, we do not recommend solely relying on the PCT concentration for diagnostic decisions.

Previous studies have evaluated PCT as an infection biomarker in SLE. One study evaluated patients with SLE and systemic inflammatory response syndrome, demonstrating that the PCT concentration was significantly higher in the infected group than in the non-infected group.15 Further, AlJarhi et al found that PCT levels helped differentiate bacterial infections from disease activity in SLE patients.16 However, these studies excluded fungal infections or were not specifically targeted to fungi. Meanwhile, for SLE patients, fungi are becoming the predominant pathogen and a common reason for hospitalization. Therefore, clarifying the ability of PCT to differentiate fungal and bacterial infections is necessary. To our knowledge, this is the first report aiming to elucidate the role of PCT in SLE patients with serious infections.

In our study, the PCT concentration was significantly lower in the fungal infection group than in the bacterial infection group, in line with the literature regarding critically ill patients.17,18 Although the serum PCT concentration was elevated in fungal and bacterial infections, PCT expression mechanisms differed. Mostly, C-type lectin receptors (CLR) recognize fungi.19 Cytokine secretion (eg, interleukin [IL]-1, IL-10, and IL-6) induced by CLR signaling pathway activation results in a slightly elevated PCT concentration after fungal infection.20 Gram-negative and Gram-positive bacteria are precociously recognized by the innate immune system via toll-like receptor 4 and toll-like receptor 2, leading to higher IL-6 and IL-8 levels and contributing to elevated PCT levels.21 Our results agree with this theory. Thus, we suggest a larger study of the diagnostic value of the PCT concentration for confirmation.

In this study, a PCT concentration of <0.49 ng/mL indicated a fungal infection (with 77% sensitivity, 58% specificity, 53% PPV, and 81% NPV at this cut-off). Our results are partially consistent with those previously reported for diagnosing bacteremia using the PCT concentration (>0.5 ng/mL).7 Furthermore, a systematic review strengthens our findings, suggesting that a PCT concentration of >0.5 ng/mL strongly indicated a bacterial infection in SLE patients.12 However, this review did not compare the PCT concentrations between fungal and bacterial infections because of the high proportion of mixed infections. To avoid this issue, our protocol only included patients with a single-pathogen infection. In contrast, a multicenter retrospective study conducted in an intensive care unit indicated that a PCT threshold of <1.93 ng/mL was optimal for diagnosing candidemia,22 with better sensitivity and specificity than a cut-off of <0.5 ng/mL. This result is not surprising since, in that study, the PCT level in patients with candidemia was higher than in patients in our study with fungal infections (0.73 vs 0.22 ng/mL). That study also had better AUROC curves (AUROC = 0.789) for the PCT assay than in our population. Thus, the discriminative capability differences should be interpreted with caution, considering the different study populations and definitions of fungal infection. By including various fungal species, our results could be more applicable to clinical scenarios.

Early investigators raised the possibility of determining SLE disease activity based on PCT concentrations.14,23 Likewise, we found a significant difference between the groups based on the SLEDAI score. Our study also confirmed that the infection site influences the PCT concentration, in line with the study by Thomas et al.18 Adjusted AUROC compliment unadjusted AUROC by allowing for the control of confounding factors, resulting in a more precise assessment of diagnostic testing. Our findings demonstrated an improvement in the AUROC of PCT (from 0.6740 to 0.7308) after adjusting for the SLEDAI score and infection site, but it was not “excellent” (ie, AUROC >0.8). However, the discriminatory performance of PCT was overall superior to the CRP concentration, WBC count, and ESR. For this reason, we recommend that the PCT concentration be used cautiously as a single biomarker for diagnosing or ruling out fungal infections, and it is no substitute for clinical judgment in cases of severely ill patients or patients with SLE. Combining clinical features and biomarkers will likely add value to the overall diagnostic accuracy.

Candida infections were the most frequent type of fungal infection (50%), followed by Aspergillus and Cryptococcus neoformans. These results differ from previously published findings from China, where Candida was found in only 22.2% of cases (ranking third) and Aspergillus was found in 33.3% (ranking first).24 This may largely be related to the sample size, but the range of variation was small. Our results also deliver useful information about fungus types by assessing the fungal infections in SLE patients.

This study has some limitations. First, it is inherently limited by the retrospective design, and the PCT assay protocol was not strictly unified. Although PCT concentrations are influenced by multiple factors, such as previous antibiotic administration and concurrent macrophage activation syndrome, genuine differences regarding the PCT concentration between fungal and bacterial infections were unlikely to be attenuated through relatively stringent patient selection criteria. Second, we possibly missed some cases since the data was obtained from discharge electronic records, despite our cases being classified based on ICD-10 codes coupled with manual audits. Third, despite knowing which pathogen species affected the PCT concentration, there were too many species to adjust for when calculating the AUROC. Forth, multiple measurement of PCT concentration might contribute to the higher predictive power of fungal infections,25 compared with a single measurement. However, because of the retrospective nature of the data, we have not been able to carry out this analysis. Finally, conclusions drawn from this study can only apply to SLE patients infected with bacteria or fungi alone and cannot be extrapolated to SLE patients with mixed infection.

Conclusion

The PCT concentration is a useful marker for discerning fungal from bacterial infections in patients with SLE; the combination of PCT and ESR yielded the highest AUROC and exhibited an acceptable performance. However, further research is needed to confirm its diagnostic capacity for fungal infections.