Serum soluble urokinase-type plasminogen activator receptor as a biological marker of bacterial infection in adults: a systematic review and meta-analysis.

The serum concentration of soluble urokinase-type plasminogen activator receptor (suPAR) reflects immune activation. We performed a meta-analysis to evaluate the usefulness of suPAR for the diagnosis and prognosis of bacterial infections. PubMed, Embase and Cochrane Library databases were searched for studies reporting the detection of suPAR in adult patients with bacterial infections. Seventeen studies were selected from 671 studies. The pooled sensitivity and specificity of suPAR for diagnosing infection were 0.73 and 0.79, respectively, and the area under the summary receiver operating characteristic curve (AUC) was 0.82. Subgroup analyses revealed suPAR showed similar AUC values for diagnosing sepsis and bacteremia, but the AUC for differentiating sepsis from systemic inflammatory response syndrome (SIRS) was only 0.68. Elevated suPAR levels were significantly associated with a high risk of death, with a pooled risk ratio of 3.37 (95% confidence interval, 2.60-4.38). The pooled sensitivity and specificity for predicting mortality were 0.70 and 0.72, respectivfely, with an AUC of 0.77. Serum suPAR could be a biomarker for the diagnosis and prognosis of bacterial infection, but it is relatively ineffective for differentiating sepsis from SIRS. Further investigation is required to evaluate whether using of suPAR in combination with other biomarkers can improve diagnostic efficacy.

The urokinase-type plasminogen activator (uPA) system is composed of a proteinase, uPA receptor (uPAR) and an inhibitor. The uPA system is involved in pericellular proteolysis, cell migration and tissue remodeling1. Soluble uPAR (suPAR) is the soluble form of uPAR, and is a glycoprotein with a molecular weight of 55–60 kDa. Under normal physiological conditions, uPA and uPAR are predominantly expressed by neutrophils, monocytes, macrophages and activated T-cells, and the serum concentration of suPAR is relatively stable throughout the day23. However, when inflammatory cells are activated by cytokines, the expression of uPAR can be up-regulated, thus elevating the serum levels of suPAR4. It has been demonstrated that the serum concentrations of suPAR can be increased during inflammatory and infectious diseases, such as arthritis, liver fibrosis, human immunodeficiency virus (HIV) infection, bacterial infection and malaria, reflecting the activation of the immune system45678.

Therefore, suPAR might be a useful biological marker for diagnosing patients with systemic inflammation and infection. Several studies have described its potential for the prediction of infection9. Additionally, a high suPAR level has been shown to be associated with a poor prognosis of infections1. The review of Backes et al., which included a limited number of studies, evaluated the usefulness of the suPAR levels for diagnosing and prognosing systemic inflammation or infection10. Their review reported that suPAR showed potential as a promising prognostic marker for critically ill patients, but had little diagnostic value for sepsis10. However, the precise diagnostic and prognostic value of suPAR in bacterial infection remains unclear.

Recently, considerably more well-designed and well-executed studies with larger sample sizes investigating the diagnostic and prognostic value of suPAR in infections have been published. To establish the overall diagnostic and prognostic value of suPAR for adult patients with bacterial infections, we searched currently available publications and performed a meta-analysis.

Methods

Search strategy and selection criteria

We systematically searched studies indexed until June 10, 2016, in the PubMed, Embase and Cochrane Library databases. The search terms used were: (“soluble urokinase receptor” OR “urokinase plasminogen activator receptor” OR “suPAR” OR “soluble uPAR” OR “soluble uPA receptor”) AND (“infection” OR “systemic inflammation” OR “SIRS” OR “bacteremia” OR “sepsis” OR “septicemia” OR “septicaemia” OR “septic shock”). Additionally, the reference lists of the selected articles were reviewed manually to obtain potentially relevant articles. No language restrictions were applied.

Studies were considered eligible if they reported the diagnostic and/or prognostic usefulness of suPAR in adult patients suffering from suspected or defined bacterial infections. The bacterial infections were either confirmed by a microbiological test or diagnosed from their clinical manifestation. The diagnosis of sepsis and systemic inflammatory response syndrome (SIRS) met the criteria of the American College of Chest Physicians/Society of Critical Care Medicine11. Because we focused on evaluating the usefulness of serum suPAR as a biological marker of bacterial infection in adults, studies enrolling patients <18 years old, and studies reporting infections caused by pathogens other than bacteria, such as HIV, malaria, tuberculosis and fungi were excluded. A 2 × 2 contingency table was constructed based on the results of the selected studies. Reviews, conference abstracts, expert opinions, editorials, animal experiments and studies without enough data were also excluded. Two authors (NW and HY) independently performed the search and selection process. Any disagreement was discussed and resolved by the third author (CJ).

Ethical approval

Ethical approval was not required in this study.

Data extraction and quality assessment

Data from each included study were independently extracted by 2 authors (NW and HY). The following baseline information was extracted: authors and country where the study was performed, year of publication, study design, sample size, baseline characteristics of the study population (age, sex, underlying conditions, and intensive care unit [ICU] admission), mortality, and the time point of measurement of suPAR levels. With regards to outcomes of interest, the optimal cut-off threshold, values for sensitivity, specificity, true-positive, true-negative, false-positive, and false-negative, and the area under the receiver operating characteristic (ROC) curve (AUC) were extracted from each study.

This meta-analysis was conducted in accordance with the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. The quality and bias of the included studies were assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) checklist by 2 independent authors (NW and HY). This quality assessment tool included 14 questions (each of which is scored as yes, no, or unclear) with a maximum score of 14 12.

Statistical analysis

STATA (version 12.0) (StataCorp, College Station, TX) and Meta-Disc software were used for the statistical analyses of data. P values < 0.05 were considered statistically significant. Publication bias was tested by Deek’s funnel plot. Threshold effects on the diagnostic accuracy of suPAR were evaluated by the Spearman correlation coefficient between the logit of sensitivity and the logit of 1 – specificity. If no threshold effect existed, the bivariate random-effects regression model was used to calculate the pooled sensitivity, specificity, diagnostic odds ratio (DOR), positive likelihood ratio (PLR), and negative likelihood ratio (NLR). We also constructed the summary receiver operating characteristic (SROC) curve by plotting individual and summary points of sensitivity and specificity to assess overall diagnostic accuracy. In addition, relative risk (RR) was calculated to assess the usefulness of suPAR for predicting mortality, which was pooled by either a fixed-effect or random-effect model based on the DerSimonian and Laird method.

The Q test and I index were calculated to assess between-study heterogeneity. I > 50% was considered to be a substantial degree of heterogeneity among studies. Except for assessing the threshold effect, other sources of potential heterogeneity were explored by subgroup and univariate meta-regression analyses.

Results

The primary search identified 671 studies derived from the 3 databases. Of those 671 studies, 112 were eliminated because of repetition, and 559 were disregarded based on evaluation of their title or abstract, thereby leaving 62 studies to be scrutinized by a full-text review. No additional relevant articles in the bibliographies of the selected articles were identified. Finally, 17 studies were included in this systematic review. The detailed search and study selection process is shown in Fig. 1.

Figure 1

Flow chart of study selection.

Characteristics of the included studies

Among the 17 eligible studies, 9 studies including 1237 patients reported the usefulness of suPAR for diagnosing infections131415161718192021, and 10 studies including 3041 patients reported its usefulness for predicting mortality14212223242526272829. The characteristics of the studies are presented in Table S1. One study had a retrospective design18, and the others had a prospective design. On average, the overall QUADAS scores of the included studies met 11 of the 14 criteria, suggesting that these studies were of a high quality. Of the 9 studies reporting the diagnostic value of suPAR, 3 recruited patients with bacteremia and control groups with negative blood culture tests161819, and 7 recruited patients with sepsis and well-matched control groups with similar profiles of age and sex13141516192021. Additionally, 4 studies investigated the diagnostic value of suPAR in differentiating sepsis from SIRS16192021. Of the 10 studies reporting the value of suPAR in predicting mortality, 7 recruited patients suffering from sepsis14212526272829, and 3 recruited patients with bacteremia222324. The serum level of suPAR was measured using an enzyme-linked immunosorbent assay kit (ViroGates, Birkerød, Denmark) in most of the included studies. The optimal cut-off threshold of each study was retrospectively determined based on the ROC curve. The mean cut-off for suPAR in the included studies where it was used for the diagnosis of infections was 6.4 ng/ml (range: 2.7–9.5 ng/ml), and the mean cut-off where it was used for mortality prediction was 10.0 ng/ml (range: 6–12.9 ng/ml).

Diagnostic value of suPAR for infections

As shown in Figure S1, no significant publication bias was detected by Deek’s funnel plot (P = 0.39). Additionally, no significant difference in the threshold effect was observed (Spearman correlation coefficient = −0.03; P = 0.93). By using the bivariate random-effects regression model, the pooled sensitivity and specificity of suPAR in diagnosing infections were 0.73 [95% confidence interval (CI), 0.58–0.84; I = 91.54%, Q = 94.58 (P < 0.01)] and 0.79 [95% CI, 0.73–0.83; I = 58.86%, Q = 19.45 (P = 0.01)], respectively (Fig. 2). The PLR and NLR were 3.4 (95% CI, 2.4–4.7) and 0.34 (95% CI, 0.21–0.57), respectively. The DOR was 10 (95% CI, 5–22), and the overall AUC was 0.82 (95% CI, 0.79–0.85; Fig. 3), indicating a moderate diagnostic accuracy.

Figure 2

Forrest plot of the sensitivity and specificity of suPAR for the diagnosis of bacterial infections.

Figure 3

Summary receiver operating characteristics curve for studies evaluating the value of suPAR for the diagnosis of bacterial infections.

SEN, sensitivity; SPE, specificity.

Substantial heterogeneity exists among the included studies. Thus, we used univariate meta-regression and subgroup analyses to explore the sources of heterogeneity in sensitivity and specificity. The clinical setting, sample size, type of infection, prevalence, tested sample and QUADAS score were used as covariates. Meta-regression analysis revealed that the clinical setting and QUADAS score significantly accounted for the heterogeneity of sensitivity, and no tested variables accounted for the heterogeneity of specificity (Figure S2). A subgroup analysis is presented in Table 1. suPAR showed a similar usefulness for diagnosing sepsis and bacteremia, with an area under the SROC curve of 0.82. However, its diagnostic performance in differentiating sepsis from SIRS was not optimal, with an AUC of 0.68 (95% CI, 0.64–0.72).

Table 1

Subgroup analysis of the diagnostic and prognostic value of suPAR based on different variables.

Study type	Variables	Studies, No. (Patients, No.)	Sensitivity (95%CI)	Specificity (95%CI)	+LR (95%CI)	−LR (95%CI)	DOR (95%CI)	AUC (95%CI)
Diagnostic value	Overall	9 (1237)	0.73 (0.58–0.84)	0.79 (0.73–0.83)	3.4 (2.4–4.7)	0.34 (0.21–0.57)	10 (5–22)	0.82 (0.79–0.85)
	Bacteremia	3 (416)	0.60 (0.53–0.67)	0.79 (0.73–0.84)	3.2 (2.4–4.2)	0.48 (0.37–0.63)	7 (4–18)	0.82 (0.71–0.92)
	Sepsis	7 (1062)	0.67 (0.53–0.79)	0.80 (0.72–0.86)	3.4 (2.1–5.3)	0.41 (0.26–0.65)	8 (3–20)	0.82 (0.78–0.85)
	Sepsis from SIRS	4 (481)	0.61 (0.53–0.68)	0.82 (0.63–0.93)	3.4 (1.4–8.5)	0.48 (0.34–0.67)	7 (2–25)	0.68 (0.64–0.72)
	Cut–off <6.5 ng/ml	4 (612)	0.82 (0.49–0.95)	0.74 (0.67–0.81)	3.2 (2.0–5.2)	0.25 (0.07–0.92)	13(2–76)	0.78 (0.74–0.81)
	Cut-off ≥6.5 ng/ml	5 (625)	0.65 (0.56–0.72)	0.82 (0.74–0.88)	3.6 (2.3–5.5)	0.43 (0.34–0.55)	8 (4–15)	0.77 (0.73–0.80)
Prognostic value	Overall	10 (3041)	0.70 (0.60–0.78)	0.72 (0.62–0.80)	2.5 (1.9–3.3)	0.42 (0.33–0.55)	6 (4–9)	0.77 (0.73–0.80)
	Bacteremia	3 (332)	0.64 (0.51–0.76)	0.83 (0.78–0.87)	3.5 (2.2–5.7)	0.39 (0.16–0.92)	11 (5–22)	0.84 (0.76–0.92)
	Sepsis	7 (2709)	0.71 (0.62–0.79)	0.66 (0.58–0.74)	2.1 (1.7–2.6)	0.44 (0.33–0.58)	5 (3–8)	0.74 (0.70–0.78)
	Cut-off <10 ng/ml	4 (498)	0.75 (0.65–0.83)	0.61 (0.50–0.71)	1.9 (1.4–2.6)	0.40 (0.27–0.61)	5 (2–10)	0.75 (0.71–0.79)
	Cut-off ≥10 ng/ml	6 (2543)	0.65 (0.50–0.78)	0.78 (0.66–0.86)	2.9 (2.0–4.2)	0.45 (0.31–0.63)	7 (4–11)	0.78 (0.74–0.81)

Abbreviations: CI, confidence interval; +LR, positive likelihood ratio; −LR, negative likelihood ratio; DOR, diagnositic odds ratio; AUC, area under the receiver operating characteristic curve.

Usefulness of suPAR for predicting mortality in cases of infection

The pooled results of 10 included studies showed that an elevated suPAR level was associated with a higher risk of death due to infection (Fig. 4). The RR of each study ranged from 1.93 to 10.71, and the pooled RR were 3.61 for in-hospital mortality, 3.89 for 1-month mortality and 2.16 for ICU mortality. Owing to the moderate heterogeneity between studies, a random-effect model was used to pool RR estimates.

Figure 4

Forest plot of suPAR to predict mortality in bacterial infections.

RR, risk ratio.

The Spearman correlation coefficient of these studies was 0.21 (P = 0.56), indicating that no significant threshold effect existed. However, Deek’s funnel plot showed there was a publication bias (P = 0.03; Figure S3). As displayed in Fig. 5, the estimated sensitivity and specificity of suPAR for predicting mortality of infection were 0.70 [95% CI, 0.60–0.78; I = 75.09%, Q = 36.14 (P < 0.01)] and 0.72 [95% CI, 0.62–0.80; I = 90.25%, Q = 92.34 (P < 0.01)], respectively. The DOR was 6 (95% CI, 4–9), and the AUC was 0.77 (95% CI, 0.73–0.80; Fig. 6), suggesting that the efficiency of suPAR was moderate for the prediction of mortality among patients with infection.

Figure 5

Forrest plot of the sensitivity and specificity of suPAR for the prediction of mortality in bacterial infections.

Figure 6

Summary receiver operating characteristics curve for studies evaluating the value of suPAR for the prediction of mortality in bacterial infections.

SEN, sensitivity; SPE, specificity.

The study design, clinical setting, sample size, type of infection, prevalence, tested sample, mortality and QUADAS score were used as factors in the meta-regression analysis to assess the source of heterogeneity among studies. The findings revealed that: study design significantly contributed to the heterogeneities of both sensitivity and specificity (Figure S4). The results of the subgroup analysis are shown in Table 1.

Discussion

Bacterial infections, such as sepsis and bacteremia, are the major causes of mortality and morbidity in critically ill patients30. Accurate and timely diagnosis to initiate proper anti-infective therapy and early screening of high-risk populations is mandatory to improve the clinical course and outcome. Culturing samples has been considered as the ideal standard, but it is time-consuming and lacks sensitivity and specificity31. Biomarkers can help to detect the presence of a bacterial infection, and they are useful for monitoring the evolution of the infectious process27. Therefore, clinicians are continuously seeking biological markers to differentiate infectious from non-infectious conditions. In this meta-analysis, the pooled data of 9 studies including 1237 patients showed that the overall AUC of suPAR for the diagnosis of bacterial infection was 0.82. The subgroup analysis found that the AUCs for diagnosing bacteremia and sepsis were also both 0.82. These results suggest that serum suPAR level might be a useful diagnostic criterion for bacterial infections. Additionally, the pooled results showed that an elevated suPAR levels was associated with a higher risk of death, with an AUC of 0.77, indicating a moderate prognostic usefulness of suPAR for bacterial infections.

Sepsis is a heterogeneous syndrome commonly caused by the response of the immune system to invasive bacterial infections32. Currently, serum C-reactive protein (CRP) and procalcitonin (PCT) have been evaluated routinely for sepsis diagnosis. The level of CRP can increase significantly during acute inflammation, but its specificity for sepsis diagnosis is relatively low9. In earlier studies, PCT was found to be a reliable marker for bacterial infections, with more sensitivity and specificity than CRP33. However, the meta-analysis performed by Tang et al.34 showed that the diagnostic performance of PCT for differentiating sepsis from other non-infectious causes of SIRS was not optimal. The mean values of sensitivity and specificity were both 71% (95% CI, 67–76), and the AUC was 0.78 (95% CI, 0.73–0.83)34. In our study, although suPAR had a moderate value for discriminating sepsis and bacteremia from non-infectious conditions, the subgroup analysis showed that the accuracy of suPAR for differentiating sepsis from SIRS in critically ill adult patients was low (AUC = 0.68). suPAR failed to exhibit a higher sensitivity than the other biomarkers used for discriminating sepsis from SIRS, such as PCT, soluble triggering receptor expressed on myeloid cells-1 (sTREM-1), and presepsin343536.

By far, no biomarkers with ideal accuracy have been identified for monitoring the course and predicting the outcome of infections or sepsis. Peschanski et al. found that PCT levels at admission were moderately accurate in identifying the outcome in septic patients, with 51% sensitivity and an AUC of 0.6737. Additionally, a recent meta-analysis showed that the commonly used cut-off for PCT of 0.5 ng/mL only had a sensitivity of 44% to identify patients with pneumonia who have a high risk of death38. The meta-analysis performed by Su et al. found that the pooled sensitivity and specificity of sTREM-1 for the prediction of mortality in infection were 0.75 (95% CI, 0.61–0.86) and 0.66 (95% CI, 0.54–0.75), respectively39. Elevated suPAR levels at the initial stage were significantly associated with a high risk of death, with a pooled RR of 3.37 (95% CI, 2.60–4.38). The pooled sensitivity and specificity of suPAR for mortality prediction in adult patients with bacteremia and sepsis were 0.70 and 0.72, respectively, which were similar to those of sTREM-1. The largest review, which included cohort studies enrolling a total of 1914 patients, suggested that the Acute Physiology and Chronic Health Evaluation II (APACHE II) score combined with the serum suPAR level could be a novel rule for predicting the outcome of in sepsis26. Therefore, the combination of suPAR and other biological markers or risk scores can improve the prediction of mortality for infections.

Compared with meta-analyses including randomized controlled trials, those including diagnostic studies may have more publication bias40. We detected publication bias in the prognostic studies reviewed here. The exclusion of conference abstracts and studies without enough data could contribute to the publication and reporting bias. Thus, the value of suPAR for prognosis might be overestimated. We observed a significant degree of heterogeneity in sensitivity among the studies analyzed. A meta-regression analysis revealed that the clinical setting and QUADAS score substantially affected the sensitivity of suPAR for the diagnosis of bacterial infections. For the analysis of prognostic studies, the study design significantly contributed to the heterogeneities of both sensitivity and specificity in the meta-regression analysis. In addition, despite no significant threshold effect in both diagnostic and prognostic studies, the cut-off point of suPAR could also account for the heterogeneity. As shown in Table 1, high cut-off points (≥6.5 ng/ml for diagnostic studies; ≥10 ng/ml for prognostic studies) indicated a lower sensitivity and higher specificity of suPAR for diagnosing and predicting the mortality of bacterial infections.

Several limitations exist in the current meta-analysis. First, the serum suPAR level is associated not only with infection, but also with other diseases, such as malignant tumor, atherosclerosis and acute kidney injury/failure. Although the included studies mainly enrolled patients with sepsis and/or bacteremia, the baseline characteristics (disease severity, comorbidities, concurrent infections with pathogens except for bacteria, etc.) of the study populations varied, so some confounding factors might exist in the included studies. However, we could not specifically perform further analysis because of the limited data. Second, the sample sizes of some subgroup analyses were relatively small, which increased the rate of type II error. Third, since we did not have access to the original data of each study, we could not determine the optimal cut-off point of suPAR for the diagnosis and prognosis of bacterial infection. Lastly, some degree of publication bias could reduce the prognostic power of suPAR.

In conclusion, our meta-analysis suggests that the serum suPAR level could be a potential marker of bacterial infection. However, its accuracy in discriminating sepsis from SIRS in critically ill adult patients was not better than that of PCT and sTREM-1. Additionally, the suPAR level at the initial stage of infection had a moderate diagnostic value for mortality prediction in patients with sepsis and bacteremia. A high suPAR level could indicate the need for more intense monitoring and treatment. However, considering the lack of a perfect unique biomarker, further investigation is required to evaluate the usefulness of suPAR combined with other biomarkers for improving diagnostic efficacy.

Additional Information

How to cite this article: Ni, W. et al. Serum soluble urokinase-type plasminogen activator receptor as a biological marker of bacterial infection in adults: a systematic review and meta-analysis. Sci. Rep. 6, 39481; doi: 10.1038/srep39481 (2016).

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.