Yun Ye1, Su-Liang Li1, Jian-Jun Wang2, Bing Liu1. 1. Department of Laboratory Medicine. 2. Emergency Department, The First Affiliated Hospital of Xi'an Medical University, Xi'an, Shaanxi, China.
Abstract
BACKGROUND: Circulating tumor cells (CTCs) have become a potential diagnostic tumor marker and have the potential for wide clinical applications. However, the diagnostic parameters vary among previous studies. A systematic review of the literature and meta-analysis were conducted to assess the diagnostic value of CTCs for lung cancer. METHODS: Eligible studies were searched in PubMed, Medline, Cochrane Library, and Embase databases. The included studies assessed the diagnostic value of CTCs in patients with lung cancer up to September 30, 2018. A total of 1601 patients in 8 studies were included in the meta-analysis. We calculated the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC) to investigate the diagnostic value of CTCs for lung cancer. STATA version 12.0 and Meta-DiSc version 1.4 software were used to analyze the data. RESULTS: The pooled sensitivity was 0.75 (95% CI: 0.73-0.78), the specificity was 0.89 (95% CI: 0.86-0.92), the PLR was 6.29 (95% CI: 3.98-9.96), and the NLR was 0.24 (95% CI: 0.14-0.42). Furthermore, the pooled DOR of CTCs for lung cancer was 27.73 (95% CI: 12.99-59.23). The summarized area under the ROC curve was 0.93 (95% CI: 0.90-0.95). The meta-regression analysis suggested that the heterogeneity was mainly attributed to the experimental methods. The results of the clinical diagnosis efficiency show that the diagnostic efficiency has increased significantly by testing CTCs for diagnosing lung cancer. CONCLUSION: The results of this meta-analysis suggest that CTCs are associated with a high diagnostic value for lung cancer. These findings require large-scale prospective studies to verify and evaluate the diagnostic value in the future.
BACKGROUND: Circulating tumor cells (CTCs) have become a potential diagnostic tumor marker and have the potential for wide clinical applications. However, the diagnostic parameters vary among previous studies. A systematic review of the literature and meta-analysis were conducted to assess the diagnostic value of CTCs for lung cancer. METHODS: Eligible studies were searched in PubMed, Medline, Cochrane Library, and Embase databases. The included studies assessed the diagnostic value of CTCs in patients with lung cancer up to September 30, 2018. A total of 1601 patients in 8 studies were included in the meta-analysis. We calculated the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC) to investigate the diagnostic value of CTCs for lung cancer. STATA version 12.0 and Meta-DiSc version 1.4 software were used to analyze the data. RESULTS: The pooled sensitivity was 0.75 (95% CI: 0.73-0.78), the specificity was 0.89 (95% CI: 0.86-0.92), the PLR was 6.29 (95% CI: 3.98-9.96), and the NLR was 0.24 (95% CI: 0.14-0.42). Furthermore, the pooled DOR of CTCs for lung cancer was 27.73 (95% CI: 12.99-59.23). The summarized area under the ROC curve was 0.93 (95% CI: 0.90-0.95). The meta-regression analysis suggested that the heterogeneity was mainly attributed to the experimental methods. The results of the clinical diagnosis efficiency show that the diagnostic efficiency has increased significantly by testing CTCs for diagnosing lung cancer. CONCLUSION: The results of this meta-analysis suggest that CTCs are associated with a high diagnostic value for lung cancer. These findings require large-scale prospective studies to verify and evaluate the diagnostic value in the future.
Lung cancer, including small cell lung cancer and non-small cell lung cancer, is one of the most common malignant tumors worldwide.[ The 5-year survival rate for early stage lung cancer is approximately 13 times greater than that for advanced stage lung cancer, and patients with early stage lung cancer have the opportunity to undergo surgery, which could significantly reduce the disease mortality.[ Therefore, it is very important to diagnose and treat lung cancer in the early stage. If lung cancer can be diagnosed early and treated quickly, the prognosis of patients can be significantly improved.[Circulating tumor cells (CTCs) enter the blood flow from the original tumor or metastases. It is an important cause of postoperative recurrence and distant metastasis in patients with malignant tumors.[ In previous studies, CTCs have been used to evaluate the prognosis of malignancies and to monitor and direct personalized therapeutics.[ Recently, CTCs have gradually demonstrated their value in the diagnosis of various cancers and have become a potential new diagnostic tumor marker. Moreover, compared with the traditional biopsy method, the use of CTCs as a diagnostic has the advantages of fewer side effects, simple operation, and repeatability.[ However, the diagnostic parameters are varied among the previous studies. Therefore, we conducted a systematic review to investigate the diagnostic value of circulating tumor cells in lung cancer and to compare the diagnostic parameters according to the previous studies and patient characteristics.
Methods
Search strategy
The meta-analysis was conducted in accordance with the guidelines for the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA).[ A comprehensive search of the literature in PubMed, Medline, Cochrane Library, and Embase databases was conducted up to September 30, 2018. The following search strategy was used: (“circulating tumor cells” OR “circulating tumor cell” OR “CTCs” OR “CTC”) and (“lung carcinoma” OR “lung cancer” OR “lung tumor” OR “lung neoplasm”). Subsequently, eligible literature was included for further screening.
Study selection
The literature search and study selection were independently conducted by 2 researchers (Ye and Li), and any inconsistencies were resolved by group discussion until a consensus was reached. Studies were included if the study met the following criteria: the study describes the testing of CTCs in the peripheral blood of patients who are diagnosed with lung cancer; all patients with lung cancer must be confirmed by pathological biopsy; the control group consists of benign pulmonary diseasepatients or healthy volunteers; and sensitivity, specificity, and critical values must be explicitly mentioned in the study. The exclusion criteria included the following: no definite diagnosis threshold; incomplete clinical data; duplicate reports; and animal experiments.
Data extraction and quality assessment
The following information was collected from the included studies: the name of the first author, publication year, country in which the study was performed, age, number of patients, cut-off value, the detection method for CTCs, the sensitivity and specificity of CTCs, and the AUC (the area under the receiver operating characteristic curve). The Quality Assessment of Diagnostic Accuracy Studies tool-2 (QUADAS-2) was used to evaluate the quality of the studies included in this meta-analysis independently by the 2 authors (YY and JJW).[ All authors agreed to the final determinants of the literature to be considered. Because this is a systematic review and meta-analysis, the ethical approval and patient written informed consent are not required.
Statistical analysis
Review Manager (RevMan) version 5.3 was used for quality assessment, while other analyses were conducted using Stata version 12.0 statistical software (StataCorp, LLC., College Station, TX) and Meta-DiSc version 1.4 (Ramony Cajal Hospital, Madrid, Spain). The sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and corresponding 95% confidence intervals (CIs) were calculated from true positive (TP), false positive (FP), false negative (FN), and true negative (TN) results, which were extracted from each study before data pooling. Sensitivity, specificity, PLR, and NLR were summarized by the bivariate random effects meta-analysis,[ and the summary receiver operating characteristic (sROC) curve and the area under the ROC curve were summarized by the hierarchical regression model. The Q-statistic and I-square were used to inspect the statistical heterogeneity across the eligible studies (P-values ≤.05 indicated statistically significant heterogeneity for the Q-statistic).[I2 values of 25%, 50%, and 75% represented low, medium, and high heterogeneity, respectively.[ A random-effects model was used if the heterogeneity was high (when the I2 was >50% and the P-value was ≤.05); otherwise, the fixed effects model was used. Meta-regression analyses were conducted on the basis of the year of publication, age, country, and diagnostic methods.[ Deeks asymmetry test was used to evaluate potential publication bias.[ Fagan nomogram was used to evaluate the pre-test probability and post-test probability of the PLR and NLR.[ A P-value <.05 was regarded as statistically significant, and all tests were 2-sided.
Results
Literature search
The selection process of studies is shown in Fig. 1. In total, 386 relevant studies were identified from a search of the abovementioned databases using the search strategy as described above, of which 273 studies were excluded due to duplication. After carefully reading each article, 72 studies were excluded because they were letters, reviews, comments, nonhuman studies, or contained incomplete clinical data. Upon further review, 33 additional studies were excluded because there were missing index details or they were irrelevant to lung cancer. Finally, a total of 8 publications were enrolled for this meta-analysis.
Figure 1
The flow chart of searching eligible articles process in this meta-analysis.
The flow chart of searching eligible articles process in this meta-analysis.
Study characteristics
The characteristics of the selected studies are listed in Table 1. Eight studies were published between 2009 and 2018, including 1093 lung cancerpatients and 508 controls. Six studies were conducted in China,[ 1 study was conducted in Italy,[ and 1 study was conducted in Japan.[ The quality of included studies was assessed by QUADAS-2 and some studies had moderately high scores. The quality assessment results of the included studies are shown in Fig. 2.
Table 1
Characteristics of the eligible studies in the meta-analysis.
Figure 2
Bar charts of the quality assessment of included studies using the tool of Quality Assessment of Diagnostic Accuracy Studies 2 (QUADUA-2). (Left) Risk of bias. (Right) Applicability concerns.
Characteristics of the eligible studies in the meta-analysis.Bar charts of the quality assessment of included studies using the tool of Quality Assessment of Diagnostic Accuracy Studies 2 (QUADUA-2). (Left) Risk of bias. (Right) Applicability concerns.
Meta-analysis
The summarized results for sensitivity, specificity, PLR, and NLR are presented in Fig. 3. The pooled sensitivity was 0.75 (95% CI: 0.73–0.78), the specificity was 0.89 (95% CI: 0.86–0.92), the PLR was 6.29 (95% CI: 3.98–9.96), and the NLR was 0.24 (95% CI: 0.14–0.42). Furthermore, the pooled DOR of CTCs for lung cancer was 27.73 (95% CI: 12.99–59.23) (Fig. 4). Finally, the summarized area under the ROC curve was 0.93 (95% CI: 0.90–0.95) (Fig. 5).
Figure 3
Forest plots for the sensitivity, specificity, PLR, and NLR. (A) Pooled sensitivity. (B) Pooled specificity. (C) Pooled PLR. (D) Pooled NLR. The point estimates from each study are shown as solid circle. The pooled estimates are shown as a solid diamond. Effect sizes were pooled by random-effect models. NLR = negative likelihood ratio, PLR = positive likelihood ratio.
Figure 4
Forest plot for diagnostic odds ratio of CTCs in the diagnosis of lung cancer. CTC = circulating tumor cells.
Figure 5
The summary receiver operator characteristic curve (sROC) with area under curve (AUC) of CTCs in the diagnosis of lung cancer for all studies. CTC = circulating tumor cells, sROC = summary receiver operating characteristic, AUC = area under curve.
Forest plots for the sensitivity, specificity, PLR, and NLR. (A) Pooled sensitivity. (B) Pooled specificity. (C) Pooled PLR. (D) Pooled NLR. The point estimates from each study are shown as solid circle. The pooled estimates are shown as a solid diamond. Effect sizes were pooled by random-effect models. NLR = negative likelihood ratio, PLR = positive likelihood ratio.Forest plot for diagnostic odds ratio of CTCs in the diagnosis of lung cancer. CTC = circulating tumor cells.The summary receiver operator characteristic curve (sROC) with area under curve (AUC) of CTCs in the diagnosis of lung cancer for all studies. CTC = circulating tumor cells, sROC = summary receiver operating characteristic, AUC = area under curve.
Heterogeneity analysis
Due to the high heterogeneity of the DOR, meta-regression analysis was conducted based on the year of publication, age, country, and diagnostic methods. The results suggested that the heterogeneity was mainly attributed to the diagnostic methods (Fig. 6) (Table 2).
Figure 6
The meta-regression analyses of the enrolled studies. CI = confidence interval.
Table 2
Meta-regression.
The meta-regression analyses of the enrolled studies. CI = confidence interval.Meta-regression.
Clinical diagnosis efficiency
Through the analysis of Fagan nomogram, we determined that the pre-test probability of the PLR was 20% and the post-test probability was 67%. The pre-test probability of the NLR was 20%, and the post-test probability decreased to 6% (Fig. 7).
Figure 7
Fagan nomogram of CTCs in the diagnosis of lung cancer. CTCs = circulating tumor cells.
Fagan nomogram of CTCs in the diagnosis of lung cancer. CTCs = circulating tumor cells.
Publication bias
Deeks funnel plot asymmetry test was used to evaluate publication bias. The funnel plots of the studies were symmetrical, and the results of the test showed no evidence of publication bias (P = .57) (Fig. 8).
Figure 8
Deeks funnel plot for the assessment of publication bias.
Deeks funnel plot for the assessment of publication bias.
Discussion
Lung cancer is a common malignant tumor and is the main cause of cancer-related deaths worldwide.[ Each year, approximately 1.8 million new cases of lung cancer occur worldwide, accounting for 23% of new cases of cancer. Due to the lack of effective diagnostic methods and specific clinical features, most patients are in advanced stages or metastatic after a definitive diagnosis, losing the opportunity for surgery, and facing a very low 5-year survival rate.[ Compared with the traditional detection method, CTCs have shown improved sensitivity and specificity in the diagnosis of lung cancer.[This meta-analysis evaluated the diagnostic value of CTCs for lung cancer, including 8 studies involving a total of 1601 patients. The pooled sensitivity of CTCs for the diagnosis of lung cancer was 0.75, the pooled specificity was 0.89, the missed diagnosis rate was 0.25, and the misdiagnosis rate was 0.11, which showed that the diagnostic efficiency was high. The results show that the PLR and NLR of CTCs for lung cancer were 6.29 and 0.24, respectively, which suggested an acceptable detection rate. Taken all together, it indicated that overall accuracy of lung cancer detection using CTCs was relatively good. Furthermore, the high DOR suggested a stronger discrimination ability for lung cancer. We used an sROC to summarize the overall test performance and an AUC to evaluate the overall diagnostic efficiency. The summarized area under the ROC curve was 0.93, which indicated a high diagnostic value.The I2 value of the heterogeneity test of the DOR was 72.6%, indicating high heterogeneity. Therefore, we use meta-regression analysis to explore the possible sources of heterogeneity. The P-value of the method was .04 (<.05), indicating that the method is the main source of heterogeneity. The results of the clinical diagnosis efficiency showed that it has increased significantly by testing CTCs for diagnosing lung cancer. The Fagan nomogram showed that the abnormal CTCs was suspicious for lung cancer increased the pretest probability of cancer from 20% to 67%,whereas a normal CTCs decreased the pretest probability from 20% to 6%. Compared with the diagnosis of lung cancer without CTCs, the diagnosis accuracy of lung cancer by CTCs is significantly increased. Therefore, combined with clinical information, detection of CTCs timely and effectively can help clinicians to treat and monitor the development of the disease and is beneficial to early diagnosis of lung cancer.Based on the results of the current meta-analysis, we speculate that CTCs have high diagnostic value for lung cancer. Nevertheless, there are several limitations to this study. First, there may have been publication bias because our study did not include unpublished articles and articles published in other languages. Second, we used summarized data for analysis, and a more detailed analysis was limited. Third, the small sample size in some of the included literature may have affected the determination of the diagnostic value of CTCs in the diagnosis of lung cancer.
Conclusion
The results of this meta-analysis suggest that CTCs are associated with a high diagnostic value for lung cancer. These findings require large-scale prospective studies to verify and evaluate the diagnostic value in the future.
Acknowledgments
The authors thank the study participants and research personnel for their involvement in the study. The authors also thank Professors Xiao-Ke Hao and Yue-Yun Ma for their valuable assistance.
Authors: William D Travis; Hisao Asamura; Alexander A Bankier; Mary Beth Beasley; Frank Detterbeck; Douglas B Flieder; Jin Mo Goo; Heber MacMahon; David Naidich; Andrew G Nicholson; Charles A Powell; Mathias Prokop; Ramón Rami-Porta; Valerie Rusch; Paul van Schil; Yasushi Yatabe Journal: J Thorac Oncol Date: 2016-04-21 Impact factor: 15.609
Authors: Daniel F Hayes; Massimo Cristofanilli; G Thomas Budd; Matthew J Ellis; Alison Stopeck; M Craig Miller; Jeri Matera; W Jeffrey Allard; Gerald V Doyle; Leon W W M Terstappen Journal: Clin Cancer Res Date: 2006-07-15 Impact factor: 12.531