Diagnostic value of long noncoding RNAs for hepatocellular carcinoma: A PRISMA-compliant meta-analysis.

BACKGROUND: Increasing evidences have shown that long noncoding RNAs (lncRNAs) are involved in cancer diagnosis and prognosis. However, the overall diagnostic accuracy of lncRNAs for hepatocellular carcinoma (HCC) remains unclear. Herein, we perform a meta-analysis to assess diagnostic value of lncRNAs for HCC.
METHODS: The online PubMed, Cochrane, Web of Science, and Embase database were searched for eligible studies published until October 5, 2016. Study quality was evaluated with the Quality Assessment for Studies of Diagnostic Accuracy (QUADAS). All statistical analyses were conducted with Stata 12.0 and Meta-Disc 1.4.
RESULTS: We included 19 studies from 10 articles with 1454 patients with HCC and 1300 controls. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and AUC for lncRNAs in the diagnosis of HCC were 0.83 (95% confidence interval [CI]: 0.76-0.88), 0.80 (95% CI: 0.73-0.86), 4.2 (95% CI: 3.00-5.80), 0.21 (95% CI: 0.15-0.31), 20 (95% CI: 11-34), and 0.88 (95% CI: 0.85-0.91), respectively. Additionally, the diagnostic value of lncRNAs varied based on sex ratio of cases and characteristics of methods (specimen type and reference gen).
CONCLUSION: This meta-analysis suggests lncRNAs show a moderate diagnostic accuracy for HCC. However, prospective studies are required to confirm its diagnostic value.

Introduction

Hepatocellular carcinoma (HCC), accounting for 70% to 90% of all primary liver cancer, is one of the most common malignant cancers and the 2nd-leading cause of cancer-related death worldwide.[ Surgical resection is a gold standard therapy for HCC[; however, HCC is often diagnosed at advanced stages due to inefficient screening, and many patients miss the chance of surgery, which leads to a very poor prognosis with the 5-year survival rate at 7%.[ Therefore, early diagnosis of HCC is vital to improve patient's survival and facilitate cancer prevention.

Until now, serum biomarker detection[ and imaging technology are commonly used for HCC screening.[ However, the usefulness of serological markers is limited due to unsatisfied sensitivity and specificity. Alpha fetoprotein (AFP), the most widely used tumor marker for HCC, may remain normal in almost 40% of patients with early stage HCC, and even in 15% to 30% of advanced patients.[ Furthermore, patients with chronic hepatitis B (HBV) and/or C may also be with increased AFP concentrations.[ Ultrasonography is an ideal and cost-effective screening technique method to identify HCC patients in early screening, yet it fails to distinguish nodules of less than 3 cm.[ CT and MRI have accredited sensitivity (55%–91%) and specificity (77%–96%) in diagnosis of the early stage of HCC.[ However, owing to high expense and radiation exposure, it is unpractical for large-scale screening and routine surveillance. Therefore, there is an urgent need to identify a noninvasive, cost-effective, and sensitive diagnostic biomarkers to improve diagnosis and screening strategies of HCC.

Long noncoding RNAs (lncRNAs), a class of ncRNAs longer than 200 nucleotides, are disable to code proteins.[ They have multiple functions, such as modulating protein and RNA activity, regulating transcription, protein trafficking and cell metabolism, and also acting as structural components.[ Notably, many studies have evidently revealed the important roles of lncRNAs in the formation, progression, and prognosis of HCC.[ Recently, some researchers have found that lncRNAs are stably detected, and mounting evidences indicate that these abnormal expressed lncRNAs may served as a diagnostic biomarker for multiple diseases.[ However, considering the limits of single study, such as small sample size, heterogeneous populations, and differences in detection techniques, the diagnostic accuracy of lncRNAs for HCC is still unclear. Thus, this meta-analysis focused on assessing its overall diagnostic value for HCC.

Methods

Search strategy and selection criteria

We performed this meta-analysis in accordance with the PRISMA 2009 guidelines (Supplement S1).[ The online PubMed, Cochrane, Web of Science, and Embase database were searched until October 5th 2016. The keywords for the search included: “liver cancer or neoplasm or carcinoma” AND “long non-coding RNAs or lncRNAs” AND “sensitivity or diagnosis or AUC or ROC or specificity.” References of eligible articles and relevant reviews were also manually searched to find out potential studies. As this meta-analysis was based on previous published studies, ethical approval and patient consent were not necessary.

The included studies must meet these criteria: about diagnostic performance of lncRNAs for HCC; HCC was diagnosed based on pathological examination; and published studies must provide sufficient data to construct the diagnostic 2-by-2 tables. The exclusion criteria were: duplicate articles; letters, reviews, meta-analyses, editorials, and case reports; and studies without sufficient diagnostic data. Any related articles were carefully assessed by 2 researchers (HQQ and CGY) independently. Disagreements were resolved by discussion.

Data extraction and quality assessment

We extracted information of studies as follows: details of studies (first author, published date, and country), clinical characteristics of subjects (number of participants, sex ratio, and sources of control), details of detection method (specimen type, reagents, cut-off value, reference gene, and lncRNAs profiles), and diagnostic performance (sensitivity, specificity, and data of 2-by-2 tables). If the article contained the overlapping data that evaluated the diagnostic accuracy of the same lncRNA, only the largest study was selected. If the study contains the training and validating cohorts, information from each cohort was all extracted and deemed as an individual study.

Study quality was evaluated with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool.[ According to the 14-items scoring criteria, a score of 1 for “yes,” 0 for “unclear” and “no” (high risk) were given, respectively.[

Two reviewers (HQQ and CGY) performed data extraction and quality assessment independently. Any disagreements were resolved by consensus.

Statistical analysis

Statistical analysis was conducted with the STATA 12.0 and Meta-Disc 1.4. Pooled results were used to estimate sensitivity, specificity, diagnostic odds ratio (DOR), positive diagnostic likelihood ratio (positive likelihood ratio, PLR), and negative diagnostic likelihood ratio (negative likelihood ratio, NLR) with the bivariate analysis. The heterogeneity from the threshold and nonthreshold effects was assessed using the Spearman correlation analysis method, Cochran-Q, and inconsistency index (I2) tests, respectively. A P value (≤.05) and I2 value (≥50%) indicated significant heterogeneity existed across studies, then a random-effect model was conducted. Subgroup analysis and meta-regression were performed to explore the sources of heterogeneity. Country, sample size, sex ratio, source of control, specimen type, method, lncRNAs profiles, reference gene, and QUADAS scores were as covariates. Sensitivity and influence analysis were further performed to find the potential sources of heterogeneity.[ At last, the publication bias was estimated with Deek funnel plot and a P value < .1 showed statistical significance.[

Results

Literature selection

As showed in Fig. 1, 287 articles from databases were initially identified; titles and abstracts were reviewed after 98 duplicated articles were excluded; due to letters, reviews, meta-analyses, or irrelevant research topic, further 166 articles were excluded, leaving 23 articles for full-text review; as a result, 13 articles were finally excluded due to unrelated to cancer diagnosis, insufficient data, or irrelevant to our topic. Finally, 10 articles[ containing 19 studies were identified.

Figure 1

Flow diagram of study selection process.

Study characteristics and quality assessment

Nineteen studies from 10 articles with 1454 HCC and 1300 matched controls were included. The patient demographics of each study were present in Supplement S2. The size of case and control groups ranged from 20 to 147 and 20 to 232, respectively. Nine studies were conducted in China, 1 in Japan, and 9 in Egypt; the patients with HCC were all confirmed by pathological examination; among these studies, lncRNAs levels were detected with the quantitative reverse transcription PCR (qRT-PCR) method, but the reference gene and specimen types were inconsistent; additionally, circulating lncRNAs were detected in 18 studies; 6 of 19 studies evaluated the diagnostic performance of a panel of lncRNAs for HCC, and the rest 13 assessed the diagnostic accuracy of single lncRNA (Table 1).

Table 1

Main characteristics of 19 studies included in meta-analysis.

QUADAS-1 summary plot was presented in Fig. 2. According to the criteria, all the 19 studies achieved QUADAS scores equal or greater than 10 (Table 1), indicating moderate quality. The details of the quality assessment of each study were presented in Supplement S3.

Figure 2

Study quality assessment using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) checklist.

Diagnostic accuracy and threshold analysis

In our study, threshold effects, considered as one of the important reasons for heterogeneity, was assessed by Spearman correlation coefficient with Meta-Disc software. The Spearman correlation coefficient was 0.103 (P = .675), suggesting no obvious heterogeneity from threshold effect. Then heterogeneity from nonthreshold was evaluated by Cochran-Q and inconsistency index (I2) tests. There was substantial heterogeneity in pooled sensitivity (I2 = 91.58%, P < .01) and pooled specificity (I2 = 90.03%, P < .01), then, a random-effect model was conducted. The pooled sensitivity, specificity, PLR, NLR, and DOR of lncRNAs in HCC diagnosis were 0.83 (95% confidence interval [CI]: 0.76–0.88), 0.80 (95% CI: 0.73–0.86), 4.2 (95% CI: 3.00–5.80), 0.21 (95% CI: 0.15–0.31), and 20 (95% CI: 11–34), respectively (Fig. 3). The summary receiver operator characteristic curve was also plotted. As shown in Fig. 4, circulating lncRNAs achieved an AUC of 0.88 (95% CI: 0.85–0.91), which suggesting a moderate accuracy in HCC diagnosis.

Figure 3

Forest plots of sensitivities and specificities of LncRNAs in HCC diagnosis for all included studies. HCC = hepatocellular carcinoma, lncRNA = long noncoding RNA.

Figure 4

SROC curve for lncRNAs in the diagnosis of HCC. HCC = hepatocellular carcinoma, lncRNA = long noncoding RNA, SROC = summary receiver operator characteristic curve.

Subgroup analysis and meta-regression

As displayed in Table 2, studies with male ≥75% or plasma as specimen tended to have significantly lower sensitivity and specificity than those with male <75% (joint P < .01) or serum as specimen (joint P < .01). Significantly lower sensitivity and higher specificity were reported in studies with GAPDH as reference gene than in those with β-actin as reference gene (joint P < .01). Additionally, studies with panels of lncRNAs as diagnostic biomarkers or qRT-PCR(TaqMan) as detection method revealed higher sensitivity and specificity than those with single lncRNAs or qRT-PCR(SYBR); however, the differences were not significant (joint P = .11, P = .75). And sensitivity and specificity did not change significantly, regardless of the country in which the studies were performed, QUADAS scores, size of cases, and the source of control.

Table 2

Results of subgroup analyses and univariate meta-regression.

Sensitivity and influence analysis

We then performed the influence analysis to explore effects of each study. As indicated in Fig. 5, after individual study was separately omitted, 1 outlier study was identified, indicating that the Wang et al[ study might be a source of heterogeneity. We then conducted sensitivity analyses. After the Wang et al study was excluded, the I2 and summary statistics altered minimally. Among 19 included studies, only Zhou et al[ study assessed the diagnostic value of lncRNAs for HCC in tissue, and possessed the lowest quality simultaneously. After this study was excluded, the I2and summary statistics also did not alter significantly.

Figure 5

Influence analysis of the overall pooled study (outlier detection analysis). Influence analysis was performed with Stata 12.0.

Publication bias

To evaluate publication bias, Deeks funnel plot asymmetry test was performed. As displayed in Fig. 6, P = .42 suggested that the slope coefficient did not reveal obvious evidences of asymmetry, thus there was no potential publication bias among studies.

Figure 6

Deeks’ funnel plots for the overall studies included in the meta-analysis.

Discussion

HCC is the most common malignancy. Due to inefficient methods for screening and diagnosis, the prognosis is poor. Hence, identification of reliable diagnostic biomarkers for HCC is urgently needed.

In present study, the overall pooled sensitivity and specificity of lncRNAs for HCC detection were 0.83 and 0.80, with an AUC value of 0.88, indicating that the diagnostic accuracy of lncRNAs is moderate. DOR, another global index of diagnostic accuracy,[ converts the strengths of sensitivity and specificity into a single indictor, and the larger the value of DOR is, the higher accuracy it indicates.[ The overall pooled DOR of lncRNAs was 20 in this study, suggesting a moderate diagnostic accuracy. For a diagnostic test, a high PLR and a low NLR value present superior performance.[ Given the moderate PLR and NLR in our study, these results are not sufficient to rule in or out the diagnosis of HCC.

However, there are still some points that support the potential clinical practice of lncRNAs as a diagnostic biomarker: First, lncRNAs are characterized with the relatively stable in body fluids and are detectable in tumor tissues or peripheral blood, which make them suitable noninvasive biomarkers.[ Second, the diagnostic accuracy of single lncRNA may be relatively poor, a combination of multiple biomarkers therefore seems to be promising for HCC screening. As reported, lncRNAs could discriminate patients with HCC from healthy people with higher accuracy than the existing biomarkers (sensitivity: 91.4% vs 82.8%; specificity: 88.6% vs 82.8%), when combined with AFP, the sensitivity significant raises to 100%.[ Likewise, a panel of lncRNAs (lncRNA-UCA1 and lncRNA-WRAP53) also achieved a higher accuracy than single lncRNA.[ However, in contrast to these studies,[ the difference in overall sensitivity and specificity was not statistical significant between panels of lncRNAs and single lncRNA in our study. This might be because of differences in the study quality, heterogeneous populations, and detection techniques.

Early-stage HCC, with 5-year survival rate from 50% to 75%, can be effectively treated. However, patients with advanced stage have a dismal prognosis (50% survival at 1 year). Even worse, the median survival is less than 3 months for patients with end stage.[ Thus, it is vital to make an early diagnosis. As reported by Wang et al, HBV-positive HCC could be accurately diagnosed with a panel of lncRNAs, with AUC values of 0.9494 and 0.9491 for 2 cohorts, respectively. Excitingly, the diagnostic accuracy remained high at early Barcelona Clinic Liver Cancer stages (AUC values of 0.945 and 0.9564, respectively). Regrettably, due to incomplete clinical characteristics, we failed to estimate the diagnostic value of lncRNAs for early-stage HCC. Further researches are needed.

In Africa, Egypt has the highest prevalence of hepatitis C virus in the world.[ And in Asia, HCC in China alone accounts for >50% of the cases worldwide due to the prevalence of HBV.[ The diagnostic accuracy of lncRNAs may be affected by different virus infection of patients with HCC. However, according to subgroup analysis, the differences in diagnostic accuracy of lncRNAs between Asian and African county were not statistically significant. Thus, more studies are required to confirm this point in the future. Like miRNAs, the diagnostic value of lncRNAs varies based on differences of detection methods.[ Therefore, to minimize protocol-based bias and make the results comparable, standardized protocol is needed to be established.[ In our study, studies with GAPDH as reference gene had lower sensitivity and higher specificity than those with β-actin as reference gene. What is more, plasma-based lncRNA profile achieved lower accuracy than serum-based assay, indicating that matrix differences may influence the diagnostic accuracy of lncRNA and analysis using serum may be better.

Sex difference is one of risk factors for HCC, differences in lifestyle may be partly account for this.[ Recently, sex hormones are found to play a vital role in the development of HCC. As reported by Naugler et al,[ the gender disparity in HCC may be explained by estrogen-mediated inhibition of IL-6 production. Interestingly, our study demonstrated that sex differences also impact the diagnostic accuracy of lncRNAs for HCC, studies with male ≥75% tended to have lower diagnostic accuracy than those with male <75%.

In this study, substantial heterogeneity was found among overall studies. We found no evidence of heterogeneity from the threshold effect. Meta-regression and subgroup analysis were then performed. According to the results, the diagnostic value of lncRNAs differed depending on sex ratio of cases, and characteristics of methods (specimen type and reference gen). We also performed sensitivity and influence analysis, and found Wang et al study was an outlier. After this study and Zhou et al study with the lowest quality was excluded, respectively, the overall results did not alter significantly. There might be other potential sources of heterogeneity, such as, mean age, virus infection, tumor stage, status of smoking, and ethanol intake. Unfortunately, meta-regression based on these variables was failed to be done due to incomplete clinical data.

Finally, the following limitations merit consideration. First, it is vital for the diagnostic biomarkers that they could distinguish patients with HCC from not only healthy people but also patients with diseases, especially with similar symptom. However, the control sources of half of included studies were almost from healthy blood, which would lead to an overestimate of diagnostic value. Second, there was substantial heterogeneity among included studies. The results of subgroup analyses might not fully explain the observed heterogeneity. Due to limited clinical characteristics, we failed to find other sources of heterogeneity and estimate the values of lncRNAs as a diagnostic biomarker for HCC at early stages. Finally, only studies conducted in Asia and Africa were included, leading a population selection bias. It remains unknown whether these findings may be applied to other parts of the world.

In conclusion, the results of our study indicates that lncRNAs has moderate diagnostic accuracy for HCC. Nevertheless, because of substantial heterogeneity among the included studies, further large-scale, high-quality, and multicenter validation studies are required to confirm these findings.