Contrast-enhanced ultrasound for the differential diagnosis between benign and metastatic superficial lymph nodes: a meta-analysis.

PURPOSE: Contrast-enhanced ultrasound (CEUS) is a new technique used to distinguish benign from metastatic superficial lymph nodes (LNs) with variable accuracy. The objective of this meta-analysis was to evaluate the accuracy of CEUS for the diagnosis of superficial metastatic LNs.
METHODS: A comprehensive literature search of PubMed, Web of Science, Medline, Embase, and the Cochrane Library was performed until April 2018. Nine articles reporting the diagnosis of 436 LNs by CEUS were investigated. The Mantel-Haenszel and DerSimonian-Laird methods were used to analyze pooled sensitivity, specificity, diagnostic OR, positive likelihood ratio (LR), and negative LR, and a summary receiver operating characteristic (SROC) curve was also evaluated.
RESULTS: The pooled sensitivity and specificity of CEUS for the differential diagnosis of benign and metastatic superficial LNs were 0.88 (95% CI, 0.83-0.92) and 0.80 (95% CI, 0.74-0.85), respectively. The pooled positive LR, negative LR, and diagnostic OR were 4.36 (95% CI, 2.38-7.99), 0.17 (95% CI, 0.10-0.31), and 32.75 (95% CI, 11.08-96.84), respectively. SROC area under the curve (AUC) was 0.9288. The subgroup analysis excluding outliers implied that the heterogeneity was almost eliminated, and the pooled sensitivity and specificity were 0.87 (95% CI, 0.81-0.92) and 0.79 (95% CI, 0.71-0.85), respectively. The SROC AUC was 0.8950.
CONCLUSION: CEUS, a novel imaging modality for the characterization of superficial LNs, shows a high sensitivity and specificity in the diagnosis of superficial metastatic LNs. The different diagnostic standards, contrast agents, and contrast modes contribute to a considerable level of heterogeneity among studies. A uniform standard for distinguishing between benign and metastatic LNs is needed for further clinical application.

Introduction

In a wide number of clinical situations, including prognosis prediction, carcinoma staging, selecting, and monitoring treatment for patients with carcinoma and lymphoma, it is crucial to distinguish between benign and malignant lymph nodes (LNs).1,2 Currently, several diagnostic imaging modalities are applied to characterize LNs, including ultrasound (US), computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET). As reported by Liao et al,3 the pooled sensitivity of CT, MRI, PET, and US was 52%, 65%, 66%, and 66%, respectively, while the pooled specificity was 93%, 81%, 87%, and 78%, respectively. However, currently, there is no imaging modality capable of accurately staging nodal disease. In this context, US-guided fine-needle aspiration cytology (FNAC) can improve the diagnostic accuracy; FNAC has proven to be the most accurate imaging modality for the detection of cervical LN metastases.4 Compared with other modalities, US is easy to use, widely available, and less expensive and does not involve exposure to ionizing radiation. Currently, US is regarded as a valuable tool for the diagnosis of metastatic LNs,5,6 which are characterized by hypoechoic mass, the absence of echogenic hilum, round shape, and blood vessels that are predominant in periphery.6–8

Contrast-enhanced ultrasound (CEUS), a novel technique for evaluating tissue perfusion in real time, has been widely used for the evaluation of lesions in the liver, kidney, pancreas, spleen, ovary, thyroid, breast, and prostate, as well as for sentinel nodes identification in patients with breast cancer.9–12 CEUS helps radiologists to detect and characterize focal lesions; its contrast pools, as well as its sensitivity and specificity in diagnosing liver lesions, are similar to contrast CT, which is more costly and involves higher levels of exposure to ionizing radiation. Recently, CEUS has been used to distinguish benign from malignant superficial LNs,13–15 revealing that CEUS has a higher sensitivity in identifying minor regions of hypovascularity or hypervascularity not detectable by Doppler techniques, thus leading to a better evaluation in LNs categorization.16 Compared with other imaging modalities, such as CT and MRI, gray-scale US combined with CEUS is capable of evaluating the shape, margins, internal structure, and vascularization of LNs.17 It has improved the accuracy of ultrasonography for the diagnosis of superficial lymphadenopathy compared with conventional US.18,19 Nevertheless, Schulte-Altedorneburg et al20 have found that the use of US agent does not improve the diagnostic accuracy in identifying malignant LNs. The main limitation of CEUS is the practice pattern because the interpretation of sonographic images depends on individual skill and the experience of the radiologist. In addition, CEUS is not suitable for patients who have allergic reaction to contrast agents or pregnant women.21

A series of studies assessing the accuracy of CEUS in distinguishing benign from malignant superficial LNs have been published, with the sensitivity ranging from 76% to 99% and the specificity ranging from 55% to 98%.13,15,22–32 The aim of this meta-analysis was to evaluate the overall accuracy of CEUS for the differential diagnosis between benign and metastatic superficial LNs.

Methods

Search strategy

A comprehensive search of PubMed, Web of Science, Medline, Embase, and the Cochrane Library was performed for relevant literature published from January 1980 to April 2018. The search terms were (lymph node OR lymph nodes) and (ultrasound OR sonography OR ultrasonography OR ultrasonic OR US) and (contrast enhanced OR CE OR contrast enhancement OR echo enhanced OR contrast imaging) and (surgery OR biopsy OR pathology OR histology). All references from the selected studies were reviewed to identify additional relevant articles to expand our study. Two authors (Mei Mei and Ligang Ye) independently searched and extracted the data following the same process. All disagreements were resolved by mutual agreement. Articles written by the same authors were scrutinized to avoid duplicate data. In case there was any unclear information, the authors were contacted for further clarification.

The local ethics committee and institutional review board approved this study.

Study selection

The following studies were included: 1) studies using CEUS for differential diagnosis between benign and metastatic superficial LNs among adults with carcinoma; 2) studies using a reference standard of US-guided biopsy or surgical histology; 3) articles written in English; and 4) studies providing adequate data to construct a 2×2 contingency table for true-positive, true-negative, false-positive, and false-negative results.

The following studies were excluded: 1) studies using CEUS for identifying sentinel LNs by subcutaneous injection of contrast agent; 2) studies with incomplete data available to construct a 2×2 contingency table; 3) retrospective studies; 4) studies that recruited patients with lymphoma; 5) studies using CEUS for evaluating LNs in pediatric patients; 6) studies with duplicate data; 7) reviews, editorials, and letters that did not report their own data; and 8) case reports.

Quality of studies

The revised tool for the quality assessment of diagnostic accuracy studies (QUADAS-2) was used to assess the quality of included studies.33 This tool comprises four domains: patient selection, index test, reference standard, and flow and timing. Two investigators assessed the quality of the selected studies independently. All disagreements were resolved by mutual consensus. For each domain, the risk of bias and concerns about applicability were labeled as low risk, high risk, and unclear risk.

Statistical methods

This meta-analysis of the evaluation of accuracy of CEUS was performed by calculating the pooled sensitivity, specificity, posi tive likelihood ratio (LR), negative LR, and diagnostic ORs. We constructed a 2×2 contingency table for each selected study, and a value of 0.5 was added to all cells with zero. Pooled results were calculated by using the Mantel–Haenszel method (fixed-effect model) when there was no significant heterogeneity; otherwise, the DerSimonian–Laird method (random-effect model) was used. The heterogeneity among included studies was analyzed by Cochran’s Q test. Inconsistency (I2) was calculated to express the variability attributable to heterogeneity across the studies. I2>25% was considered significant for heterogeneity when the random-effect model (DerSimonian–Laird method) should be used.34 A summary receiver operating characteristic (SROC) curve was produced by the Moses–Shapiro–Littenberg method to explore the nonlinear relationship between sensitivity and 1 – specificity.35 The value of area under the curve (AUC) was calculated; an AUC close to 0.5 indicated a poor test, whereas an AUC of 1.0 indicated a perfect diagnostic test.36

Additionally, we performed the meta-regression analysis to explore the possible sources of heterogeneity among the included studies with the following covariates: number of LNs (<50 vs ≥50), interpretation of CEUS (qualitative vs quantitative), contrast agent (SonoVue vs Levovist), and contrast mode (harmonic vs color/power Doppler). P<0.05 was considered statistically significant. Furthermore, outliers were identified by inspection of the plots of sensitivity, specificity, positive LR, and negative LR, and SROC curve. A subgroup analysis was performed by excluding outliers. Spearman correlation analysis was conducted to assess threshold effect. A strong positive correlation between the log of sensitivity and the log of 1 – specificity manifested the presence of threshold effect.

For studies using both the qualitative and quantitative diagnostic standards, sensitivity analysis was conducted by using either one of the two or both. Deeks’ asymmetry test was used, and a funnel plot of diagnostic log OR vs 1/sqrt (effective sample size) was constructed for the publication bias assessment.37 A slope coefficient with P<0.05 indicated the presence of publication bias.

The pooled sensitivity, specificity, positive LR, negative LR, diagnostic OR, and SROC AUC, and meta-regression results were analyzed using software Meta-DiSc, version 1.4 (Ramón y Cajal Hospital, Madrid, Spain). The publication bias assessment was performed using Stata version 11.0 (Stata Corporation, College Station, TX, USA).

Results

The predefined search strategy yielded 2,665 studies, among which nine were eligible for analysis. No articles were found by searching the reference lists. The detailed flowchart of literature research is presented in Figure 1, while the characteristics of the selected studies are shown in Table 1. A total of 436 LNs analyzed using CEUS were investigated in this meta-analysis. Among them, 319 LNs were in the neck, 100 were in the axilla, and 17 were in the groin region. In addition, 23 LN metastases were from melanoma, 63 were from squamous cell carcinoma, 85 were from breast cancer, 61 were from ENT cancer, 37 were from oral cavity carcinoma, 8 were from adenocarcinoma, 8 were from small-cell malignancy, and 18 were from poorly differentiated carcinoma. SonoVue and Levovist are the two main contrast agents, and various imaging strategies were applied to US including color/power Doppler and contrast harmonic-enhanced US. The selected studies all used intravenous contrast agent. Among the nine studies, three studies used qualitative interpretation of CEUS, including inhomogeneous nature, early impregnation, perfusion defects, peripheral perfusion, or mixed patterns with heterogenic hyperperfusion;15,26,32 three studies used quantitative interpretation of CEUS;27,28,31 and the remaining three studies used both the qualitative and quantitative interpretation of CEUS13,22,25

Figure 1

Flowchart showing the selection process of the eligible studies.

Table 1

Characteristics of the included studies

Study	Patients/LNsa	Sex (M/F)	Age, mean (years)	Location	Contrast agent	Contrast mode	Interpretation of CEUS	Gold standard
Cui et al (2018)22	62/62	32/30	NA	Neck	SonoVue	Harmonic	Hypo-enhancement, a shallow descending curve, or no apparent notch on the TIC analysis	US-guided biopsy
Poanta et al (2014)19	61/61	33/28	51.2	Neck	SonoVue	Harmonic	Inhomogeneous or no enhancement; DPI <14.15, RBV <497	US-guided biopsy, surgery
Dudau et al (2014)15	17/25	NA	58.2	Neck	SonoVue	Harmonic	Heterogeneous enhancement or filling defect	Surgery
Ouyang etal (2010)25	51/52	NA	49.5	Axilla	SonoVue	Harmonic	Centripetal perfusion, or heterogeneous, or scarce perfusion; SImax–SImin >28b	Surgery
de Giorgi et al (2010)26	15/19	10/5	49	Axilla, groin	SonoVue	Harmonic	Early impregnation, or high impregnation, or anarchic impregnation	Surgery
Zenk et al (2007)27	60/60	NA	NA	Neck	SonoVue	Harmonic	Wash-in time (hilus) <15.90 s; time to peak (hilus) <24.55 s; maximum increase (central LN)<5.73	Surgery
Rubaltelli et al (2007)28	31/31	18/13	53.6	Neck, axilla, groin	SonoVue	Harmonic	SImax–SImin >24–31b	Surgery
Yang et al (2001)31	86/32	NA	56	Axilla	Levovist	Power Doppler	Increase in peripheral vessel number after contrast material >0.41	Surgery
Moritz et al (2000)32	39/94	32/7	62	Neck	Levovist	Color Doppler	Predominantly peripheral vessels	Surgery

Notes:

The number of LNs which was analyzed using CEUS.

The difference of signal intensity in the hyperintense region relative to that in the hypointense region.

Abbreviations: CEUS, contrast-enhanced ultrasound; DPI, derived peak intensity; F, female; LNs, lymph nodes; M, male; NA, not available; RBV, regional blood volume; TIC, time-intensity curve; US, ultrasound.

Quality assessment of studies

The quality assessment of the selected studies using QUA-DAS-2 tool is shown in Table 2 and Figure 2. Concerning the patients’ selection bias, four studies did not explicitly report consecutive patients.13,22,26,27 Regarding applicability concerns for the patient selection, four studies were labeled as having high bias because only patients with a definite carcinoma were included.22,25,26,31 Regarding risk of bias for the index test, four studies did not prespecify the diagnostic threshold.25,27,28,31 All studies met the predefined criteria such as qualitative diagnostic standards, quantitative diagnostic standards, or both. There were no concerns about reference standard applicability because all studies applied pathological evaluation. Nevertheless, two studies were labeled as “unknown” because the blinded status was not specifically mentioned.15,27 For the flow and timing domain, one study was labeled as having high risk because not all subjects were included in the analysis.22

Table 2

Quality assessment of the included studies using QUADAS-2

Study	Risk of bias				Applicability concerns
	Patient selection	Index test	Reference standard	Flow and timing	Patient selection	Index test	Reference standard
Cui et al (2018)22	Unknown	Low	Low	High	High	Low	Low
Poanta et al (2014)19	Unknown	Low	Low	Low	Low	Low	Low
Dudau et al (2014)15	Low	Low	Unknown	Low	Low	Low	Low
Ouyang et al (2010)25	Low	High	Low	Low	High	Low	Low
de Giorgi et al (2010)26	Unknown	Low	Low	Low	High	Low	Low
Zenk et al (2007)27	Unknown	High	Unknown	Low	Low	Low	Low
Rubaltelli et al (2007)28	Low	High	Low	Low	Low	Low	Low
Yang et al (2001)31	Low	High	Low	Low	High	Low	Low
Moritz et al (2000)32	Low	Low	Low	Low	Low	Low	Low

Figure 2

Quality assessment of the included studies using QUADAS-2 tool.

Meta-analysis

The pooled sensitivity (random-effect model) and specificity (random-effect model) of CEUS for the differential diagnosis of benign and metastatic superficial LNs were 0.88 (95% CI, 0.83–0.92) and 0.80 (95% CI, 0.74–0.85), respectively (Figures 3 and 4). Significant heterogeneity was found for the sensitivity (I2=46.6%) and specificity (I2=77.6%). The pooled positive LR (random-effect model), negative LR (random-effect model), and diagnostic OR (random-effect model) for diagnosing LNs by CEUS were 4.36 (95% CI, 2.38–7.99), 0.17 (95% CI, 0.10–0.31), and 32.75 (95% CI, 11.08–96.84), respectively (Figures 5–7). Significant heterogeneity was found for positive LR (I2=75.4%), negative LR (I2=50.0%), and diagnostic OR (I2=64.0%). SROC AUC was 0.9288 (standard error [SE] =0.0379) (Figure 8). The pooled sensitivity, specificity, positive LR, negative LR, and diagnostic OR were similar to the studies reporting application of either one of the two diagnostic standards or both such as the studies by Poanta et al,19 Ouyang et al,25 and Cui et al.22

Figure 3

Forest plot showing the pooled sensitivity of CEUS for diagnosis of superficial metastatic LNs.

Abbreviations: CEUS, contrast-enhanced ultrasound; df, degrees of freedom; LNs, lymph nodes; LR, likelihood ratio.

Figure 4

Forest plot showing the pooled specificity of CEUS for diagnosis of superficial metastatic LNs.

Abbreviations: CEUS, contrast-enhanced ultrasound; df, degrees of freedom; LNs, lymph nodes; LR, likelihood ratio.

Figure 5

Forest plot showing positive LR of CEUS for diagnosis of superficial metastatic LNs.

Abbreviations: CEUS, contrast-enhanced ultrasound; df, degrees of freedom; LNs, lymph nodes; LR, likelihood ratio.

Figure 6

Forest plot showing negative LR of CEUS for diagnosis of superficial metastatic LNs.

Abbreviations: CEUS, contrast-enhanced ultrasound; df, degrees of freedom; LNs, lymph nodes; LR, likelihood ratio.

Figure 7

Forest plot showing the diagnostic OR of CEUS for diagnosis of superficial metastatic LNs.

Abbreviations: CEUS, contrast-enhanced ultrasound; df, degrees of freedom; LNs, lymph nodes.

Figure 8

SROC curve of CEUS for diagnosis of superficial metastatic LNs.

Abbreviations: AUC, area under the curve; CEUS, contrast-enhanced ultrasound; LNs, lymph nodes; SE, standard error; SROC, summary receiver operating characteristic.

The Spearman correlation coefficient between the log of sensitivity and the log of 1 – specificity was −0.467 (P=0.205), indicating that there was no significant threshold effect. The meta-regression analysis was performed to explore the potential sources of heterogeneity. Table 3 shows the relationship between the characteristics of studies and the diagnostic OR. These data suggested that there was no relationship between the characteristics of studies and the diagnostic OR. The forest plots (Figures 3–7) showed that the studies by Zenk et al27 and Moritz et al32 were outliers. Therefore, subgroup analysis excluding outliers was performed, which implied that the heterogeneities were almost eliminated in pooled estimates (Table 4). The SROC AUC was 0.8950 (SE =0.0318).

Table 3

Meta-regression analysis of the possible sources of heterogeneity

Study characteristics	P-value	RDORa	95% CI
Number of LNs (<50 LNs vs ≥50 LNs)	0.8633	1.29	0.03–57.69
Diagnostic standard (quality vs quantity)	0.0666	0.04	0.00–1.34
Contrast agent (SonoVue vs Levovist)	0.4740	6.62	0.01–3531.46
Contrast mode (harmonic vs color/power Doppler)	0.4740	6.62	0.01–3531.46

Notes:

When the study characteristics indicated a lower diagnostic OR, RDOR is <1; otherwise, it is >1. P<0.05 indicated significant relationship between the characteristics of studies and the diagnostic OR.

Abbreviations: LNs, lymph nodes; RDOR, relative diagnostic OR.

Table 4

Subgroup analysis excluding outliers

Pooled results	Value	95% CI	P-value	I2a (%)
Sensitivity	0.87	0.81–0.92	0.3611	8.9
Specificity	0.79	0.71–0.85	0.4720	0.0
Positive LR	4.21	2.94–6.02	0.4740	0.0
Negative LR	0.17	0.11–0.26	0.4083	2.2
Diagnostic OR	24.83	12.92–47.74	0.4812	0.0

Note:

I2>50% was considered significant for heterogeneity.

Abbreviation: LR, likelihood ratio.

Deeks’ funnel plot of diagnostic log OR vs 1/sqrt (effective sample size) did not show significant asymmetry (P=0.409), indicating that there was no significant publication bias in this meta-analysis (Figure 9).

Figure 9

Funnel plot showing the results of Deeks’ asymmetry test for the assessment of publication bias of the included studies (P=0.409).

Abbreviation: ESS, effective sample size.

Discussion

The histological status of LNs is a very powerful prognostic indicator for patients with carcinoma and lymphoma. US has proven to be a valuable technique for evaluating superficial LNs. US is superior to CT and MRI in the view of assessing the morphology and internal structure of LNs17 because it can allow accurate LN characterization including morphology, margin, and internal structure, while color/power Doppler imaging provides further information about vascularization.6,8,21,38 Until now, the most commonly used approaches to detect LNs metastases were CT and MRI due to their lower interobserver variation, less time consumption, and ease of detection of deeply located LNs. However, imaging alone is not accurate enough to guide clinical staging and treatment decisions for patients with carcinoma and lymphoma. In this context, CEUS is a simple approach which can allow evalua tion of tissue perfusion in real time and extends US examination by a few minutes. This tool has also been shown to be very useful in the differential diagnosis of lymphadenopathy.13–15

Our meta-analysis demonstrated that CEUS, as a diagnostic imaging technique for superficial metastatic LNs, has a high pooled sensitivity (88%) with a fair pooled specificity (80%). No significant publication bias was found using Deeks’ asymmetry test based on the funnel plot. Therefore, we performed meta-regression analysis to find the potential source of heterogeneity among the studies. Our results revealed that there was no relationship between the characteristics of studies and the diagnostic OR. The forest plots (Figures 2–5) showed that the studies by Zenk et al27 and Moritz et al32 were outliers. Therefore, subgroup analysis excluding outliers was performed, which revealed that the heterogeneities were almost eliminated in pooled estimates (Table 4).

CEUS could be performed by color/power Doppler and by contrast harmonic-enhanced US. US contrast agents were first used to accentuate color/power Doppler signals as reported by Moritz et al, obtaining 100% sensitivity and 98% specificity in differentiation of benign from malignant LNs.32 Nevertheless, Doppler imaging has some limitations, especially in cases of LNs situated nearby pulsating tissues such as arterial vessels. Contrast harmonic-enhanced US imaging is a relatively new technique that can detect the microcirculation and parenchymal perfusion of lesions with a very low mechanical index, thus allowing minimum bubble destruction and a prolonged time of microvascularization assessment. Over recent years, contrast harmonic-enhanced US has been most commonly used for diagnosis of LNs.

The enhanced microvascular pattern is a visualized diagnostic standard. Generally, malignant LNs are inhomogeneous, with early impregnation, perfusion defects, peripheral perfusion, or mixed patterns with heterogenic hyperperfusion. These characteristics of microvascular pattern seem to be reliable features of malignant LNs.1,14,15,18,19,25,32,39 Yet, these observations largely depend on the individual skills and experience of the radiologist. Although the objective CEUS parameters concerning the kinetics of contrast agent are significant, their predictive ability is not yet reliable enough for routine clinical use. In addition, Scheipers et al have reported that the computer-guided self-learning analysis systems may help to identify investigator-independent classification characteristics.40 Automated quantitative software of US signal intensity was used to analyze the difference between maximum and minimum signal intensity.25,28 It demonstrated that the value of SImax–SImin ranging from 24 to 31 had the highest accuracy for differentiation between benign and malignant LNs with a sensitivity of 92% and a specificity of 89%. Consequently, further random, blinded, and multicenter studies should be performed to confirm the optimal CEUS parameters and cutoffs to differentiate malignant LNs from benign LNs before this approach can be applicable in practice. Perfusion software with higher accuracy should be developed to optimize measurement of functional parameters and to improve the accuracy of CEUS in diagnosing superficial metastatic LNs.

Patients with lymphoma, which have a more variable CEUS appearance, are regarded as a special group because the microvascular pattern of lymphoma partially overlaps with reactive and metastatic LNs.39,41,42 Yu et al have demonstrated that T-cell lymphomas have intense homogeneous mass, while B-cell lymphomas show perfusion defects.39 Controversially, the most often reported pattern is intense homogeneous enhancement, which causes difficulties in distinguishing lymphomatous nodes from reactive LNs.1,43,44 Thus, we excluded the studies which recruited patients with lymphoma from the present meta-analysis to avoid heterogeneities. Additionally, since there are very few published studies that are in general based on a very limited sample, the CEUS microvascular pattern for lymphomatous nodes still remains controversial. Therefore, further random, blinded, large sample, and multicenter studies are required to assess the CEUS pattern of lymphoma and to assess the ultimate benefit of CEUS in diagnosing patients with lymphoma before this approach can be applied in practice.

The present study has some limitations. Firstly, various diagnostic standards for CEUS were used in the selected studies, as well as different study designs, contrast agents, and contrast modes. Accordingly, it is very plausible that many variations in characteristics of these studies may lead to the heterogeneity. Secondly, we did not include articles written in other languages besides English. Thirdly, some studies were also excluded because of insufficient data; although we tried to contact the authors to obtain additional data, unfortunately the data were still not sufficient.

Conclusion

CEUS, as a novel imaging modality for the characterization of superficial LNs, showed a high sensitivity and specificity in diagnosing superficial metastatic LNs. The different diagnostic standards, contrast agents, and contrast modes contributed to a considerable level of heterogeneity among the studies. A uniform standard for distinguishing benign from metastatic LNs is needed for further clinical application.