Literature DB >> 31395014

Diagnostic accuracy of in-house real-time PCR assay for Mycobacterium tuberculosis: a systematic review and meta-analysis.

Zhenhong Wei1, Xiaoping Zhang1, Chaojun Wei2, Liang Yao3,4, Yonghong Li2, Xiaojing Zhang1, Hui Xu2, Yanjuan Jia2, Rui Guo2, Yu Wu2, Kehu Yang5,6, Xiaoling Gao7.   

Abstract

BACKGROUND: In recent years, studies on the diagnostic accuracy of in-house real-time PCR (hRT-PCR) assay for the detection of Mycobacterium tuberculosis (Mtb) have been reported with unignorable discrepancies. To assess the overall accuracy of the hRT-PCR assay for Mtb diagnosis in different samples for individuals with active pulmonary and extra-pulmonary Mtb infection, a systematic review and meta-analysis were performed.
METHODS: The PUBMED, EMBASE, Web of Science, and Cochrane databases were searched up to June 2017 for eligible studies that estimated diagnostic sensitivity and specificity with the hRT-PCR assay in respiratory and non-respiratory samples in pulmonary and extra-pulmonary Mtb infection patients, with Mtb culture as the reference standard. Bivariate random effect models were used to provide pooled estimation of diagnostic accuracy. Further, subgroup and meta-regression analyses were performed to explore sources of heterogeneity. The risk of bias was assessed by the QUADAS-2 tool.
RESULTS: Of the 3589 candidate studies, 18 eligible studies met our inclusion criteria. Compared to Mtb culture data, the pooled sensitivity and specificity were 0.96 and 0.92, respectively. The diagnostic odds ratio (DOR) was 192.96 (95% CI 68.46, 543.90), and the area under the summary ROC curve (AUC) was 0.9791. There was significant heterogeneity in sensitivity and specificity among the enrolled studies (p < 0.001). The studies with high-quality assessment and application of respiratory specimen were associated with better accuracy.
CONCLUSIONS: In low-income/high-burden settings, our results suggested that the hRT-PCR assay could be a useful test for the diagnosis of TB with high sensitivity and specificity.

Entities:  

Keywords:  In-house real-time PCR; Laboratory diagnosis; Meta-analysis; Systematic review; Tuberculosis

Mesh:

Year:  2019        PMID: 31395014      PMCID: PMC6686366          DOI: 10.1186/s12879-019-4273-z

Source DB:  PubMed          Journal:  BMC Infect Dis        ISSN: 1471-2334            Impact factor:   3.090


Background

Tuberculosis (TB) remains a major public health problem worldwide. In 2015, 10.4 million new cases of TB were reported. Approximately 1.4 million people died of the disease, and there were an additional 0.4 million deaths from co-infected with HIV [1]. Rapid diagnosis and treatment are pivotal for the effective control of TB in clinical practice [2]. Acid-fast staining and Mtb culture are classical Mtb diagnosis techniques. The acid-fast stain lacks sensitivity, and the culture requires several weeks for incubation [3, 4]. The inherent limitations make it difficult for them to meet the requirement for early diagnostics [5]. Nucleic acid amplification tests (NAATs), such as polymerase chain reaction (PCR), which was developed in 1983, are now a common tool for the rapid diagnosis of many infectious diseases, including TB [6]. To date, some commercial tests, including COBAS TaqMan, Xpert MTB/RIF and the Abbott Real-Time MTB assay, have been used for TB diagnosis [7-9]. However, due to the limited infrastructure and medical resources, many clinical laboratories in suburban areas with high TB burden cannot afford these assays [1]. In-house polymerase chain reaction (hPCR) that uses equipment and reagents available from diverse suppliers in competitive markets may be more affordable, feasible, and sustainable than Xpert MTB/RIF [10]. hPCR is thus becoming popular in these areas. Several regions of the mycobacterial genome, such as IS6110 and 16S rDNA, have been used as targets for assays [11-13]. Meta-analysis of previous studies demonstrated that the diagnostic accuracy of hPCR assays was variable and inconsistent compared with commercial tests [14, 15]. For example, the sensitivity of hPCR for tuberculosis meningitis varied between 0 and 100% [16]. In recent years, PCR technologies have improved markedly with the development of RT-PCR for the detection of mycobacterial infection [17]. This method has the advantage over conventional PCR in speed, automation, high sensitivity and specificity, and a low risk of cross-contamination [18, 19]. In contrast to the commercial kits, an inexpensive RT-PCR would be particularly popular in regions that are short of medical equipment, such as Brazil, India, China, the Russian Federation, Southeast Asian, South Africa, and East Africa. Medical resources are limited in the majority of these countries [1]. Although recent studies have revealed that RT-PCR assays have good diagnostic performance for TB, there are unignorable discrepancies between their results [10, 20–32]. Moreover, none of the researchers could demonstrate precise diagnostic accuracy due to their limited statistical power. Therefore, by systematic review and meta-analysis, we explored factors associated with heterogeneity as well as diagnostic accuracy of the hRT-PCR assay for TB using data from previous studies.

Methods

The current meta-analysis was conducted according to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [33]. Since the study was a systematic review and meta-analysis of published articles, patient consent or approval from the institutional ethics committee was not necessary.

Search strategy

We searched the following databases: PUBMED, EMBASE, Web of Science and Cochrane Library. All searches were up to date as of June 2017. The search terms used included “tuberculosis”, “Mycobacterium tuberculosis”, “nucleic acid amplification techniques”, “real time PCR”, “quantitative real-time polymerase chain reaction”, “PCR, quantitative real-time”, “quantitative real-time PCR”, “real-time PCR, quantitative”, “sensitivity and specificity”, or “predictive value”. In addition, the references of several previously published reviews on NAATs were searched for possible candidate articles.

Study selection

We included all available studies that reported the assessment of hRT-PCR assay for direct detection of TB. Reasons for studies exclusion were (i) the reference standard was not culture proven Mtb; (ii) studies performed with other assays other than hRT-PCR assay (in mixed Methods Research, data were analysed for the eligible cases separately); (iii) application of hRT- PCR assay for determining drug resistance; (iv) incomplete data (lacking any of the availability data including true-positive, true-negative, false-positive and false-negative or these variables could not be calculated from the published data) were not extracted; (v) evaluation of hRT- PCR assay on animal specimens; and (vi) conference abstracts, letters, case reports, editorials, and reviews without original data were excluded. Two investigators (LY and YHL) independently screened candidate literature by looking up the title and abstract. Then, the full texts of the potentially relevant articles were carefully read to determine whether they could be included. Disagreements were resolved by consensus between the two investigators.

Data extraction and quality assessment

Two investigators (LY and YHL) independently extracted accurate information from the ultimately included articles. Disagreements were resolved by consensus between the two investigators. The quality of the included studies was independently estimated by two investigators (HX and RG) using a Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2), which consists of seven domains [34]. A study was treated as a high-quality study when it had no domain with a high risk of bias and no domain with high applicability concerns.

Statistical analysis

Analysis was performed using Meta-Disc (version 1.4) software [35]. We pooled the data with the DerSimonian-Laird random effects model (REM), with the following pooled estimates: sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), and the diagnostic odds ratio (DOR). Each study in the meta-analysis contributed a pair of numbers: sensitivity and specificity. A summary receiver operating characteristic (SROC) curve was constructed for the hRT-PCR assay [36]. A shoulder-like curve illustrates that the variability between studies may be due to the threshold effect. A non-shoulder-like curve indicates that sensitivity and specificity are not correlated. The overall diagnostic performance of that hRT-PCR assay was assessed as the area under the curve (AUC) (an AUC value of 100% indicates a perfect test, while an AUC of 50% signifies poor diagnostic accuracy) [37, 38]. Heterogeneity between included studies refers to a high degree of variability in study results. The heterogeneity could be explained by variability in thresholds or differences in test methods and study characteristics. Chi-square and Fisher’s exact tests were used to detect statistically significant heterogeneity. Heterogeneity between included studies was evaluated with subgroup (stratified) analysis and meta-regression analysis [39]. In the subgroup analysis, we computed pooled DOR estimates in various strata. The following factors as potential sources of heterogeneity: study design, target sequence, respiratory specimen versus non-respiratory specimen, the distribution of TB, and components of study quality. The meta-regression model produces relative diagnostic odds ratios (RDOR) as the output [39]. An RDOR is a ratio of two DORs. An RDOR of 1.0 explains that a particular covariate does not affect the overall DOR. An RDOR> 1.0 explains that studies with a particular characteristic have a higher DOR than studies without this characteristic. For an RDOR< 1.0, the converse is true. Finally, since publication bias is an important focus for meta-analyses of diagnostic studies [40], the potential publication bias of included studies was assessed by Deeks’s funnel plot (Stata version 12.0; Stata Corp., College Station, TX).

Results

Study search

Of the 3589 unique articles, we finally identified 15 eligible articles representing 18 independent studies (Fig. 1). The performance of the hRT-PCR assay in Mtb detection of clinical specimens was evaluated from all included studies with Mtb culture as a reference standard. Summary characteristics of the included studies are shown in Table 1. Eleven studies used respiratory specimens, and five used non-respiratory specimens. Two studies focused on patients with HIV-associated TB. Five studies were from Brazil, two were from India, and the remaining studies were from eight different countries. Among them, eight are the high TB burden countries. Eleven studies used IS6110 as an amplification target, and 7 studies used other targets (e.g., mpt64 and senX3-regX3). A total of 3281 samples, including 2809 respiratory samples and 472 non-respiratory samples, provided valid results.
Fig. 1

The study search flow chart

Table 1

Characteristics of the included studies

AuthorYearStudy designCountryNumber of participantsNumber of samples sent for cultureCulture+/−Type of test (target sequence)Acid-fast stainCultureRespiratory specimenNon-respiratory specimenR/NRTPFPFNTN
Aggarwal 2012 [20]Cross-sectionalIndia808018/6216 s rRNA?MGITcsf0/801214648
Albuquerque 2014 [21]Cross-sectionalBrazil14014047/93IS6110ZN7H9,LJsp140/0411692
Barletta 2014 [10]Cross-sectionalPeru11211284/28IS6110ZNLJsp109/0791525
Chaidir 2013 [22]Case-controlIndonesia230230102/105IS6110ZNLiquid and solidcsf0/2079446859
Darban-Sarokhalil 2012 [23]Case-controlIran247247112/135cyp141ZNLJsp247/0101311132
Gallo 2016 [24]Cross-sectionalBrazil?14511351/100mpt64?Liquid and solidsp1451/013474496
Inoue 2011 [25]Cross-sectionalSingapore41441455/128IS6110?MGITspcsf,pf,ti104/664338116
Lee 2011 [26]Case-controlKorea37012953/76senX3-regX3ZN3% Ogawatiti53/764711665
Lira, LA 2012 [27]Case-controlBrazil16516566/99IS6110ZNLJsp165/0582897
Lyra 2014 [28]Cross-sectionalBrazil18119411/91IS6110ZNLJsp102/0113088
Miller 2011 [29]Cross-sectionalAmerica9011289/23IS6110?MGIT, LJ,7H11sp,ba,bal.,tiIn,ab,pf,ti89/23304771
Rao 2016 [30]Cross-sectionalIndia10020044/5616sRNA?MGITsp100/0442054
Rozales 2014 [31]Cross-sectionalBrazil44744742/405IS6110ZN7H9,MGITsp,bal124/0417175
Sanjuan-Jimenez 2015 [32]Case-controlSpain15314576/69senX3-regX3ZNLJ,MGITsp,ba,balpf,In,ur,csf,ar125/206501169
Sanjuan-Jimenez 2015 [32]Case-controlSpain15314576/69IS6110ZNLJ,MGITsp,ba,balpf,In,ur,csf,ar125/20729460

Acid-fast stain: ZN, Ziehl-Neelsen; Culture: MGIT, Mycobacteria growth indicator tube; LJ, Löwenstein-Jensen; 7H9, Middlebrook 7H9 Broth. Respiratory specimen: sp., sputum; ba, broncheal/tracheal aspirate; bal., bronchialalveolar lavage; ti, tissue specimen. Non-respiratory specimen: ln, lymph node; pf, pleural fluid; ar, articular fluid; ab, abcess/pus; ur, urine; csf, cerebrospinal fluid; ti, tissue sample. Specimen number: R, number of the respiratory specimens; NR, number of the non-respiratory specimens. “?” represents that the specific method is not mentioned in this paper. TP, true-positive; FP, false-positive; FN, false-negative; TN, true-negative

The study search flow chart Characteristics of the included studies Acid-fast stain: ZN, Ziehl-Neelsen; Culture: MGIT, Mycobacteria growth indicator tube; LJ, Löwenstein-Jensen; 7H9, Middlebrook 7H9 Broth. Respiratory specimen: sp., sputum; ba, broncheal/tracheal aspirate; bal., bronchialalveolar lavage; ti, tissue specimen. Non-respiratory specimen: ln, lymph node; pf, pleural fluid; ar, articular fluid; ab, abcess/pus; ur, urine; csf, cerebrospinal fluid; ti, tissue sample. Specimen number: R, number of the respiratory specimens; NR, number of the non-respiratory specimens. “?” represents that the specific method is not mentioned in this paper. TP, true-positive; FP, false-positive; FN, false-negative; TN, true-negative

Quality evaluation

We assessed the quality of the studies by QUADAS2. To assess the risk of bias regarding patient selection, three studies were deemed to be of case-control design, which compared diagnosed TB patients to non-TB individuals. Therefore, there was a high risk of bias based on the patient selection method after QUADAS2 assessment. As for “index test” evaluation, four studies failed to illustrate the blind working flow. Given the advanced acknowledgement of the reference test results, the bias could arise from the interpretation of the index test. These studies had an unclear risk of bias on the index test. For the reference standard, two studies did not provide sufficient description concerning the reference test results. Therefore, these studies were considered to have an unclear risk of bias on the reference test. No other domain had a high risk of bias or a high applicability concern (Fig. 2).
Fig. 2

Summary of methodological quality of studies according to the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies-2) tool. High-quality study: a study that had no domain with a high risk of bias and no domain with high applicability concerns; medium/moderate-quality study: a study that had domain with an unclear risk of bias or domain with unclear applicability concerns; low-quality study: a study that had a domain with a high risk of bias and domain with high applicability concerns

Summary of methodological quality of studies according to the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies-2) tool. High-quality study: a study that had no domain with a high risk of bias and no domain with high applicability concerns; medium/moderate-quality study: a study that had domain with an unclear risk of bias or domain with unclear applicability concerns; low-quality study: a study that had a domain with a high risk of bias and domain with high applicability concerns

Diagnostic accuracy of hRT-PCR assay

When all 18 studies using the hRT-PCR assay were evaluated together, the overall sensitivity and specificity estimates were 0.96 (95% CI 0.95, 0.96) and 0.92 (95% CI 0.90, 0.93), respectively. The sensitivity and specificity of all studies are shown in the forest plot (Fig. 3a, b). The overall LR+ was 16.90 (95% CI 7.22, 39.56), and LR- was 0.11 (95% CI 0.06, 0.18). The pooled DOR was 192.96 (95% CI 68.46, 543.90). Heterogeneity was detected by chi-square analysis in the summary results. All measurements showed high heterogeneity (p < 0.001 for the test of heterogeneity). The accuracy was measured, and their corresponding chi-square test was applied to statistically analyse heterogeneity (Table 2). The overall accuracy of the hRT-PCR assay in a summary receiver operating characteristic (SROC) curve is displayed in Fig. 4, and the curve displayed a trade-off between sensitivity and specificity. The area under the SROC curve (AUC) was 0.9791, indicating a highly diagnostic accuracy. Overall, significant heterogeneity in sensitivity and specificity deserves more attention in the clinical applications of the hRT-PCR assay in TB detection.
Fig. 3

Forest plot of specificity and sensitivity estimates. a Forest plot of sensitivity estimates and 95% confidence intervals (CI). The point estimates of sensitivity from each study are shown as solid circles. Error bars are 95% CI. Circles are proportional to study size. The pooled estimate is denoted by the diamond at the bottom. b Forest plot of specificity estimates and 95% CI. The point estimates of specificity from each study are shown as solid circles. Error bars are 95% CI. Circles are proportional to study size. The pooled estimate is denoted by the diamond at the bottom

Table 2

Pooled Summary Estimates of All Studies

Accuracy MeasurePooled summary measurea (95% CI)P value for heterogeneityb
Sensitivity0.96 (0.95–0.96)< 0.001
Specificity0.92 (0.90–0.93)< 0.001
Positive Likelihood Ratio (LR+)16.90 (7.22–39.56)< 0.001
Negative Likelihood Ratio (LR-)0.11 (0.06–0.18)< 0.001
Diagnostic Odds Ratio (DOR)192.96 (68.46–543.90)< 0.001

aRandom effects model

bChi-square or Fisher’s exact test for heterogeneity

Fig. 4

Summary receiver operating characteristic curves for RT-PCR assays. Each solid circle represents each study in the meta-analysis. The curve is the regression line that summarizes the overall diagnostic accuracy. SROC = summary receiver operating characteristic; AUC = area under the curve; SE (AUC) = standard error of AUC; Q* = an index defined by the point on the SROC curve where the sensitivity and specificity are equal, which is the point closest to the top-left corner of the ROC space; SE (Q*) = standard error of Q* index

Forest plot of specificity and sensitivity estimates. a Forest plot of sensitivity estimates and 95% confidence intervals (CI). The point estimates of sensitivity from each study are shown as solid circles. Error bars are 95% CI. Circles are proportional to study size. The pooled estimate is denoted by the diamond at the bottom. b Forest plot of specificity estimates and 95% CI. The point estimates of specificity from each study are shown as solid circles. Error bars are 95% CI. Circles are proportional to study size. The pooled estimate is denoted by the diamond at the bottom Pooled Summary Estimates of All Studies aRandom effects model bChi-square or Fisher’s exact test for heterogeneity Summary receiver operating characteristic curves for RT-PCR assays. Each solid circle represents each study in the meta-analysis. The curve is the regression line that summarizes the overall diagnostic accuracy. SROC = summary receiver operating characteristic; AUC = area under the curve; SE (AUC) = standard error of AUC; Q* = an index defined by the point on the SROC curve where the sensitivity and specificity are equal, which is the point closest to the top-left corner of the ROC space; SE (Q*) = standard error of Q* index

Exploration of heterogeneity

Heterogeneity is an important concern on diagnostic meta-analysis. The threshold effect, method differences and study characteristics may lead to the variability. The SROC curve with studies was weighted by their inverse variance, as shown in Fig. 4. The non-shoulder-like curve indicated no threshold effect in the current meta-analysis. Furthermore, the Spearman correlation coefficient was 0.147, and the p value was 0.562. It illustrated no threshold effect. Subgroup analysis was also used to explore other factors that were associated with heterogeneity by stratifying data into relatively more homogeneous strata. The DOR estimates of the study characteristics are compared in Table 3. The heterogeneity could be explained in some strata, including specimen type, the distribution of TB, and quality of studies. However, even after stratification, the heterogeneity remained in the evaluation of diagnostic accuracy.
Table 3

Stratified analyses for the evaluation of heterogeneity in studies with real-time PCR assay

Subgroup (Number of studies)Summary diagnostic odds ratio (95% CI)aChi2 square test of heterogeneityP value for heterogeneityb
Study design
 Cross-sectional (10)403.18 (120.05–1354.05)36.66< 0.001
 Case-control (8)73.86 (20.40–267.48)34.01< 0.001
Target sequence
 IS6110 (11)144.74 (51.24–408.86)39.39< 0.001
 Other target (7)297.17 (30.22–2921.73)66.27< 0.001
Specimen type
 Respiratory (11)598.12 (269.12–1329.32)19.090.039
 Non-respiratory (5)12.39 (6.67–22.73)3.570.468
 Both (2)202.47 (64.68–633.83)0.000.944
Region of study
 TB high-burden country (8)281.86 (37.69–2107.75)90.46< 0.001
 Other country (10)160.73 (72.80–354.83)15.170.086
Quality of study
 High-quality (7)926.97 (303.59–2830.38)12.830.046
 Medium-quality (8)76.77 (22.98–256.50)26.65< 0.001
 Low-quality (3)72.35 (4.47–1170.04)19.07< 0.001

aRandom effects model

bchi-square or Fisher’s exact test for heterogeneity; high-quality study: a study that had no domain with a high risk of bias and no domain with high applicability concerns; medium/moderate-quality study: a study that had domain with a unclear risk of bias or domain with unclear applicability concerns; low-quality study: a study that had a domain with a high risk of bias and domain with high applicability concerns

Stratified analyses for the evaluation of heterogeneity in studies with real-time PCR assay aRandom effects model bchi-square or Fisher’s exact test for heterogeneity; high-quality study: a study that had no domain with a high risk of bias and no domain with high applicability concerns; medium/moderate-quality study: a study that had domain with a unclear risk of bias or domain with unclear applicability concerns; low-quality study: a study that had a domain with a high risk of bias and domain with high applicability concerns We further performed a meta-regression analysis to explain the variation after subgroup analysis. As shown in Table 4, the RDOR was established from the meta-regression analysis using the restricted maximum likelihood (REML) method to measure between-study variance. Studies with respiratory specimens produced RDOR values that were significantly higher than those used non-respiratory specimens or both specimens. Studies with a high-quality level produced RDOR that were significantly higher than those with medium quality levels or low-quality levels. The distribution of TB displayed a slightly higher RDOR but no statistical significance in the final regression model. Study design and target sequence did not produce a significant RDOR, indicating that the use of any study design and target sequence did not substantially affect diagnostic accuracy. Therefore, specimen types and quality of studies may affect accuracy heterogeneity. Evaluation of the Deeks’ (p = 0.11) test did not show evidence of publication bias. Furthermore, the funnel plot did not display the presence of asymmetry (Fig. 5).
Table 4

Meta-regression analysis to determine sources of heterogeneity

InterceptCoefficientP valueRelative diagnostic odds ratio (RDOR)95% confidence interval
Intercept5.3470.0000
Threshold (S)0.1690.5382
TB high-burden country vs. other country0.7560.30562.13(0.46;9.96)
IS6110 vs. other target sequences−0.8120.22660.44(0.11;1.77)
Cross-sectional design vs. case-control design−0.7590.51020.47(0.04;5.45)
High-quality level vs moderate/low-quality level1.1750.02723.24(1.17;9.00)
Respiratory specimens vs non-respiratory specimens /both2.2620.00259.60(2.54;36.25)

High-quality study: a study that had no domain with a high risk of bias and no domain with high applicability concerns; medium/moderate-quality study: a study that had domain with an unclear risk of bias or domain with unclear applicability concerns; low-quality study: a study that had a domain with a high risk of bias and domain with high applicability concerns

Fig. 5

A Deeks’ funnel plot assessment test evaluated the potential publication bias for in-house RT-PCR assays. The plot shows the symmetric distribution of the log of diagnostic odds ratios against the inverse root of effective sample sizes (ESS), indicating the absence of any publication bias

Meta-regression analysis to determine sources of heterogeneity High-quality study: a study that had no domain with a high risk of bias and no domain with high applicability concerns; medium/moderate-quality study: a study that had domain with an unclear risk of bias or domain with unclear applicability concerns; low-quality study: a study that had a domain with a high risk of bias and domain with high applicability concerns A Deeks’ funnel plot assessment test evaluated the potential publication bias for in-house RT-PCR assays. The plot shows the symmetric distribution of the log of diagnostic odds ratios against the inverse root of effective sample sizes (ESS), indicating the absence of any publication bias

Discussion

Principal findings

We summarized the evidence on the accuracy of the hRT-PCR assay for the diagnosis of TB and performed a meta-regression analysis to explore factors involved in in-house RT-PCR assay performance. This meta-analysis included 18 independent studies with a total of 97% AUC, indicating that the hRT-PCR assay for TB detection was useful in rapidly identifying TB cases and that negative data guaranteed the certainty for ruling out active TB. Since there is significant performance heterogeneity in our recruited studies, subgroup and meta-regression analysis indicated that the use of respiratory specimens and studies with high quality were associated with better diagnostic accuracy of hRT-PCR.

Clinical implications

Even though the meta-analysis shows the power in evaluating the overall diagnostic accuracy of hRT-PCR, more caution is necessary to determine clinical accuracy due to significant heterogeneity. Previous meta-analyses [14, 16, 41] did not fully interpret the cause of heterogeneity found in hPCR results across studies. Our results showed that respiratory specimens and high-quality design were associated with better diagnostic accuracy of the hRT-PCR assay, which was consistent with a recent meta-analysis of the Xpert MTB/RIF PCR assay for the diagnosis of extra-pulmonary TB. There was a performance difference in the specimen site, with low sensitivity in pleural fluid (37%) and cerebrospinal fluid samples (69%) [42]. This finding was not surprising given the paucibacillary nature of these specimens documented in other studies and meta-analysis [14, 16, 42]. The “case-control” study design and the IS6110 targeted sequence for hPCR were associated with better accuracy based on previous empirical research and meta-analyses [14, 43–45]. Some researchers were concerned that the case-control study might overestimate the diagnostic accuracy since it samples patients from the extreme ends of the clinical spectrum (an ideal, “extreme contrast” setting). For example, the sensitivity of a test is evaluated in seriously diseased subjects, and the specificity in healthy individuals [46]. In our meta-analyses, laboratory factors (such as target sequence and amplification technique) weighted more on accuracy than study design features. The IS6110 gene was widely used for both pulmonary and extra-pulmonary TB diagnosis [13, 47, 48]. Due to its multiple copies in the genome of the Mtb complex, PCR might result in better sensitivity [14]. However, our data demonstrated that study design with IS6110 had little impact on diagnostic accuracy. This is possible because RT-PCR used in our enrolled studies carries better advanced technology compared to conventional PCR. RT-PCR uses built-in automated thermocyclers and fluorimeters to monitor PCR reactions in a single tube format in which the reaction processes rapidly and minimizes the risk of contamination from product carryover [49]. Therefore, RT-PCR can provide reliable and repeatable results. The performance of hRT-PCR was heterogeneous across studies; some patients could have false-positive hRT-PCR results and others false negative. Accuracy is related to the standard/reference assay, TB culture. Reliability is based on clinical diagnosis of TB disease. However, not all recruited studies have evaluated their hRT-PCR according to these standards. Caution is highly necessary for the clinical implications and applicability of hRT-PCR. The combination with other clinical information, such as the disease history, family medical records, microscopy screening and histopathology data, is recommended in clinical practice.

Previous meta-analyses of nucleic acid amplification (NAA) test accuracy

PCR technology is widely used in the diagnosis of infectious diseases. Multiple commercial and in-house NAA techniques have been developed for TB diagnosis [41, 50]. Xpert MTB/RIF, approved by the WHO and the FDA, is a novel, rapid, automated, cartridge-based NAA test that can simultaneously detect TB and rifampicin resistance directly on untreated sputum [51]. In addition, Xpert MTB/RIF was recommended for the diagnosis of TB in some special subjects, such as children and patients with certain forms of extra-pulmonary TB. A systematic review showed that Xpert MTB/RIF offered an acceptable sensitivity (62%) and specificity (98%) for the diagnosis of pulmonary tuberculosis in children [52]. Compared to hRT-PCR, the main features of Xpert MTB/RIF are its ability to detect resistance to rifampicin with a simple procedure and high cost. Xpert MTB/RIF may be practical for middle/high income regions. In fact, the majority of low- and middle-income countries, particularly those with limited resources, smear microscopy was still used for TB diagnosis [52]. Therefore, the hRT-PCR assay might substitute Xpert MTB/RIF in a low-income setting where multi-drug resistant TB is not prevalent. Another practical assay that might meet the needs of urban areas is loop-mediated isothermal amplification (LAMP) with a commercialized LAMP kit (Loopamp MTBC) [53]. A previous systematic review concerning the LAMP assay included 27 studies [54]; 9 out of the 27 studies evaluated the Loopamp MTBC, and the other 18 evaluated in-house LAMP assays. The summary of sensitivity and specificity for Loopamp MTBC were 80.9 and 96.5%, versus 93.0 and 91.8% for in-house LAMP assays, respectively. LAMP seems inferior to the RT-PCR tests in our analysis. Considering their low cost and simplicity, LAMP assays might be accepted in countries with limited resources.

Limitations of the review

Our review had some limitations. First, only one study evaluated the diagnostic test accuracy of the hRT-PCR assay for smear status, and only two studies included HIV-positive patients. Therefore, we could not determine the effect of smear and HIV status on the accuracy of the hRT-PCR assay. Second, we only included published studies in English, and this could have caused bias in our conclusion. Third, despite the fact that the subgroup analysis and meta-regression analysis could explain part of the observed heterogeneity in accuracy estimates, considerable heterogeneity remained unexplained. Finally, although we searched as many sources as possible, some eligible studies may have been missed.

Conclusion

In conclusion, based on the meta-analysis using the bivariate model, the diagnostic accuracy of the hRT-PCR assay for TB detection was acceptable. Subgroup and meta-regression analyses were performed, and we found that the diagnostic characteristics were different, depending on the specimen type and quality of the studies. Thus, the hRT-PCR assay, a relatively inexpensive assay compared to other commercial kits, has potential practical value for diagnosing TB, especially in low-income/high-burden settings, where infrastructures and medical resources are limited. Raw data. (XLSX 11 kb)
  51 in total

Review 1.  Diagnostic Standards and Classification of Tuberculosis in Adults and Children. This official statement of the American Thoracic Society and the Centers for Disease Control and Prevention was adopted by the ATS Board of Directors, July 1999. This statement was endorsed by the Council of the Infectious Disease Society of America, September 1999.

Authors: 
Journal:  Am J Respir Crit Care Med       Date:  2000-04       Impact factor: 21.405

Review 2.  Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests.

Authors:  J J Deeks
Journal:  BMJ       Date:  2001-07-21

3.  Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy.

Authors:  Fujian Song; Khalid S Khan; Jacqueline Dinnes; Alex J Sutton
Journal:  Int J Epidemiol       Date:  2002-02       Impact factor: 7.196

Review 4.  Evaluation of diagnostic procedures.

Authors:  J André Knottnerus; Chris van Weel; Jean W M Muris
Journal:  BMJ       Date:  2002-02-23

Review 5.  Diagnostic accuracy of nucleic acid amplification tests for tuberculous meningitis: a systematic review and meta-analysis.

Authors:  Madhukar Pai; Laura L Flores; Nitika Pai; Alan Hubbard; Lee W Riley; John M Colford
Journal:  Lancet Infect Dis       Date:  2003-10       Impact factor: 25.071

6.  Exploring sources of heterogeneity in systematic reviews of diagnostic tests.

Authors:  Jeroen G Lijmer; Patrick M M Bossuyt; Siem H Heisterkamp
Journal:  Stat Med       Date:  2002-06-15       Impact factor: 2.373

7.  Application of rapid-cycle real-time polymerase chain reaction for diagnostic testing in the clinical microbiology laboratory.

Authors:  Franklin R Cockerill
Journal:  Arch Pathol Lab Med       Date:  2003-09       Impact factor: 5.534

8.  Rapid and specific detection of Mycobacterium tuberculosis from acid-fast bacillus smear-positive respiratory specimens and BacT/ALERT MP culture bottles by using fluorogenic probes and real-time PCR.

Authors:  Nancimae Miller; Tim Cleary; Günter Kraus; Andrea K Young; Gina Spruill; H James Hnatyszyn
Journal:  J Clin Microbiol       Date:  2002-11       Impact factor: 5.948

9.  Assessment by meta-analysis of PCR for diagnosis of smear-negative pulmonary tuberculosis.

Authors:  Olga L Sarmiento; Kristen A Weigle; Janet Alexander; David J Weber; William C Miller
Journal:  J Clin Microbiol       Date:  2003-07       Impact factor: 5.948

Review 10.  Nucleic acid amplification tests in the diagnosis of tuberculous pleuritis: a systematic review and meta-analysis.

Authors:  Madhukar Pai; Laura L Flores; Alan Hubbard; Lee W Riley; John M Colford
Journal:  BMC Infect Dis       Date:  2004-02-23       Impact factor: 3.090

View more
  7 in total

1.  Prediction of PCR amplification from primer and template sequences using recurrent neural network.

Authors:  Kotetsu Kayama; Miyuki Kanno; Naoto Chisaki; Misaki Tanaka; Reika Yao; Kiwamu Hanazono; Gerry Amor Camer; Daiji Endoh
Journal:  Sci Rep       Date:  2021-04-05       Impact factor: 4.379

2.  Estimate false-negative RT-PCR rates for SARS-CoV-2. A systematic review and meta-analysis.

Authors:  Valentina Pecoraro; Antonella Negro; Tommaso Pirotti; Tommaso Trenti
Journal:  Eur J Clin Invest       Date:  2021-12-05       Impact factor: 5.722

3.  Clinical performance of quantitative PCR for the molecular identification of skeletal tuberculosis from formalin-fixed paraffin-embedded tissues.

Authors:  Gang He; Chun-Yu Chen; Xin Zhang; Pei-Pei Ding; Chang-Zheng Hu; Xiu-Fang Huang; Xian Zhang; Xu Gong; Pei-Lin Zhen; Liang Zhang
Journal:  BMC Infect Dis       Date:  2022-07-28       Impact factor: 3.667

4.  Comparison of Four Real-Time Polymerase Chain Reaction Assays for the Detection of SARS-CoV-2 in Respiratory Samples from Tunja, Boyacá, Colombia.

Authors:  Lorenzo H Salamanca-Neita; Óscar Carvajal; Juan Pablo Carvajal; Maribel Forero-Castro; Nidya Alexandra Segura
Journal:  Trop Med Infect Dis       Date:  2022-09-10

Review 5.  Tuberculous Meningitis: Pathogenesis, Immune Responses, Diagnostic Challenges, and the Potential of Biomarker-Based Approaches.

Authors:  Charles M Manyelo; Regan S Solomons; Gerhard Walzl; Novel N Chegou
Journal:  J Clin Microbiol       Date:  2021-02-18       Impact factor: 5.948

6.  Development of a SYBR Green Multiplex Real Time PCR for Simultaneous Detection of Mycobacterium Tuberculosis and Nocardia Asteroides in Respiratory Samples.

Authors:  Safar Ali Alizadeh; Amir Javadi; Jalal Mardaneh; Neda Nasirian; Sajjad Alizadeh; Maryam Mohammadbeigi; Siamak Heidarzadeh
Journal:  Ethiop J Health Sci       Date:  2021-03

Review 7.  Reimagining the status quo: How close are we to rapid sputum-free tuberculosis diagnostics for all?

Authors:  Ruvandhi R Nathavitharana; Alberto L Garcia-Basteiro; Morten Ruhwald; Frank Cobelens; Grant Theron
Journal:  EBioMedicine       Date:  2022-03-23       Impact factor: 11.205

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.