Literature DB >> 23674550

Incremental value of T-SPOT.TB for diagnosis of active pulmonary tuberculosis in children in a high-burden setting: a multivariable analysis.

Daphne I Ling1, Mark P Nicol, Madhukar Pai, Sandra Pienaar, Nandini Dendukuri, Heather J Zar.   

Abstract

INTRODUCTION: Interferon γ release assays (IGRAs) are increasingly used for tuberculosis (TB) infection, but their incremental value beyond patient demographics, clinical signs and conventional tests for active disease has not been evaluated in children.
METHODS: The incremental value of T-SPOT.TB was assessed in 491 smear-negative children from two hospitals in Cape Town, South Africa. Bayesian model averaging was used to select the optimal set of patient demographics and clinical signs for predicting culture-confirmed TB. The added value of T-SPOT.TB over and above patient characteristics and conventional tests was measured using statistics such as the difference in the area under the receiver operating characteristic curve (AUC), the net reclassification improvement (NRI) and the integrated discrimination improvement (IDI).
RESULTS: Cough longer than 2 weeks, fever longer than 2 weeks, night sweats, malaise, history of household contact and HIV status were the most important predictors of culture-confirmed TB. Binary T-SPOT.TB results did not have incremental value when added to the baseline model with clinical predictors, chest radiography and the tuberculin skin test. The AUC difference was 3% (95% CI 0% to 7%). Using risk cut-offs of <10%, 10-30% and >30%, the NRI was 7% (95% CI -8% to 31%) but the CI included the null value. The IDI was 3% (95% CI 0% to 11%), meaning that the average predicted probability across all possible cut-offs improved marginally by 3%.
CONCLUSIONS: In a high-burden setting, the T-SPOT.TB did not have added value beyond clinical data and conventional tests for diagnosis of TB disease in smear-negative children.

Entities:  

Keywords:  Clinical Epidemiology; Tuberculosis

Mesh:

Year:  2013        PMID: 23674550      PMCID: PMC3862980          DOI: 10.1136/thoraxjnl-2012-203086

Source DB:  PubMed          Journal:  Thorax        ISSN: 0040-6376            Impact factor:   9.139


Interferon γ release assays (IGRAs) are used for diagnosis of tuberculosis (TB) infection, but their incremental value beyond patient demographics, clinical signs and conventional tests for active disease has not been evaluated in children. Our study shows that the T-SPOT.TB does not have added value beyond patient demographics, clinical signs and conventional tests for diagnosis of active pulmonary TB (PTB) in smear-negative children. Our findings have great relevance for paediatric clinical practice in high-burden, low-resource settings and are consistent with the WHO recommendation against the use of IGRAs for diagnosis of active PTB in low and middle income countries.

Introduction

The diagnosis of pulmonary tuberculosis (PTB) in children may be challenging.1 2 Microbiological confirmation with culture is often unavailable due to the difficulty of specimen collection; even when specimens are obtained, smear results are usually negative due to paucibacillary disease. The diagnosis therefore relies on clinical and radiological findings and evidence of TB infection as measured by the tuberculin skin test (TST).3 Interferon γ release assays (IGRAs) have been developed to replace the TST for diagnosis of TB infection. Meta-analyses of IGRA performance in children show that they have higher specificity but similar sensitivity compared with the TST for active TB, although IGRA sensitivity is lower in high-incidence versus low-incidence settings.4 5 While the intended use of IGRAs is not for active TB, they may be helpful in providing evidence for a rapid diagnosis in children when combined with other routine clinical and laboratory investigations. If conventional tests such as smears are negative, then a T-SPOT.TB (Oxford Immunotec, Abingdon, UK) result could add diagnostic information while culture results are pending. Two published studies on the incremental value of IGRAs in adult patients showed limited utility of IGRAs for active TB disease.6 7 Our study aim was to investigate the incremental value of T-SPOT.TB beyond patient demographics, clinical signs and conventional tests in the diagnostic workup of hospitalised children being evaluated for PTB in a high-burden setting. Using a multivariable approach, the incremental value was measured by the difference between the area under the receiver operating characteristic curve (AUC), net reclassification improvement (NRI) and integrated discrimination improvement (IDI).

Methods

Study enrolment

The study enrolment process has been previously described.8 Briefly, hospitalised children ≤15 years with suspected PTB were consecutively enrolled from two hospitals in Cape Town from February 2009 to July 2011. To be eligible, a child had to present with cough >2 weeks and at least one of the following: exposure to a household TB case within the past 3 months, weight loss or failure to thrive within the past 3 months, positive TST result or chest radiography (CXR) suggestive of PTB. After the parent or legal guardian provided informed consent, the child underwent a physical examination and extensive diagnostic testing. The study was approved by the Faculty of Health Sciences, Research Ethics Committee at the University of Cape Town.

Diagnostic testing

Two sequential induced sputum8 and two nasopharyngeal aspirate specimens9 were collected, after which concentrated fluorescent acid-fast smear microscopy and liquid culture were performed. A definite TB case was defined by at least one positive culture for Mycobacterium tuberculosis in any specimen. An anterio-posterior and lateral CXR, taken on enrolment, were evaluated by a single experienced reviewer, blinded to other test results. The results were reported as consistent, inconsistent or inconclusive for PTB. When the result was inconclusive, a second reviewer read and classified the CXR; a third reviewer evaluated the radiograph when there was disagreement. The TST was performed using the Mantoux technique with 2 tuberculin units of purified protein derivative (PPD RT23, Statum Serum Institute) and read by a trained nurse at 48–72 h. The cut-off value for a positive TST was ≥5 mm in HIV-infected children and ≥10 mm for others. A HIV rapid test was performed on all children and confirmed by HIV ELISA in children ≥18 months or PCR in children <18 months. The T-SPOT.TB was performed according to the manufacturer's guidelines. All of the tests were run within 3–4 h of a blood specimen taken by a single trained technologist. Peripheral blood mononuclear cells were separated, and the cell concentration was adjusted to 2.5×106 cells/ml. To each of four interferon γ capture antibody precoated wells, the following were added: 50 μl of Positive Control, Panel A (ESAT6), Panel B (CFP10), and Nil control. Then, 100 μl of cell suspension was added to each well. This was incubated overnight at 37°C in 5% CO2. The test result was positive if Panel A minus Nil control and/or Panel B minus Nil control ≥6 spots. The test result was negative if both Panel A minus Nil control and Panel B minus Nil control ≤5 spots. A Nil control >10 spots was considered Indeterminate. Two observers, who were blinded to all other test results, reported the number of spots, and the mean number was used in the analysis. Indeterminate results were excluded from analysis. Physicians were blinded to the T-SPOT.TB results and did not use them in the clinical decision-making.

Estimation of incremental value

We used Bayesian model averaging (BMA) to identify the most parsimonious set of predictors in a logistic regression model for the outcome of culture-confirmed TB. Predictors for patient demographics and clinical signs were determined a priori and included passive smoke exposure, HIV status, history of household contact, weight for age Z score, night sweats, cough >2 weeks, fever >2 weeks, malaise, loss of appetite and weight loss. We used the BMA programme in the statistical software package R that considers all possible combinations of predictors. This programme performs a model selection procedure based on the Bayesian information criterion.10 The advantage of this approach is that it does not lead to overfitting.11 Predictors that were in the top six models, which together had an 88% probability of being the best model, were included in the clinical model. Since children with positive smears are diagnosed with definite TB and started on treatment, the incremental value of T-SPOT.TB was evaluated only in smear-negative children. To reflect the diagnostic workup for active TB in children in our hospital setting, the clinical model was extended by the CXR result (consistent or inconsistent with PTB) and the TST result (positive or negative according to the recommended cut-off depending on HIV status). The clinical predictors, CXR and TST formed the baseline model. This model was further extended by the T-SPOT.TB result (positive or negative according to the manufacturer's recommended cut-off) to determine its incremental value. We also performed the same extension using the quantitative log-transformed spot-forming cells (SFCs) rather than the binary result. In the primary analysis using confirmed TB as the outcome, all culture-negative children were considered non-TB cases, even if they were clinically diagnosed with TB and started on treatment. In a secondary analysis, we estimated the incremental value of T-SPOT.TB using the children placed on empirical treatment for TB as the outcome. Evaluating incremental value involves comparing prediction models, with and without the new test as a covariate. The difference in AUC for the two models is the most familiar statistic for estimating added value. The AUC is formally defined as the probability that for each randomly selected pair, consisting of one individual with and one without the event, the predicted probability of disease will be higher for the individual who has the event.12 More recently, Pencina and colleagues proposed the NRI and IDI statistics for comparing prediction models.13 Both measures are based on quantifying appropriate reclassification by the addition of a new test to an existing model, or higher probability for patients with the event and lower probability for those without the event. The NRI is the net proportion of individuals with the event who are reclassified into a higher risk category, plus the net proportion of individuals without the event who are reclassified into a lower risk category: NRI=(pup,events − pdown,events)+(pdown,nonevents − pup,nonevents), where lower-case p is the proportion of upward or downward movement into predefined risk categories. We used the risk categories of <10%, 10–30% and >30% based on the probability distribution of our models and the categories used by Metcalfe et al.7 The IDI, a continuous form of the NRI across all risk thresholds from 0% to 100%, is the sum of the increase in probability among patients with the event and the decrease in probability among patients without the event. It is formally defined by: , where upper-case is the average predicted probability of the outcome in the old model and the new extended model with the additional test. Tenfold cross validation was performed on the data to avoid overestimating the incremental value. All 95% CIs for the AUC, NRI and IDI were obtained using 1000 bootstrap samples. An interval that did not cross the null value of 0 would represent statistically significant added value. All incremental value analyses were performed using the user-written package ‘incrisk’ in Stata, V.12.14

Results

Patient characteristics

As shown in figure 1, 557 children with CXR and TST results had the T-SPOT.TB performed. In 29 (5%) children, the T-SPOT.TB was indeterminate (all due to high Nil control), and they were excluded from further analysis. The demographic and clinical characteristics of the 528 children are summarised in table 1. The median age was 22 months (IQR 12–53). The prevalence of HIV infection was 24%, with most children in the late clinical stages of disease as defined by WHO.15 The median CD4 cell count was 489 cells/ml (IQR 226–832). Most children had findings consistent with PTB on CXR, while most were negative on TST and T-SPOT.TB. Culture-confirmed TB was diagnosed in 91 (17%) children, while only 37 (7%) were positive on smear microscopy. Based on clinical judgment, 296 (56%) children were diagnosed with PTB, for which they were started on treatment.
Figure 1

Flowchart of children included in the study. CXR, chest radiography; TB, tuberculosis; TST, tuberculin skin test.

Table 1

Demographic and clinical characteristics of 528 children at enrolment

CharacteristicFrequency (%) in all children (n=528)Frequency (%) in culture-confirmed children (n=91)Frequency (%) in treated children (n=296)
Median age in months (IQR)22 (12 to 53)28 (16 to 62)25 (13 to 61)
Male292 (55)54 (59)164 (55)
BCG vaccinated (based on presence of scar and vaccination records)447 (85)60 (66)240 (81)
Night sweats275 (52)54 (59)159 (54)
Malaise245 (46)56 (62)153 (52)
Fever >2 weeks85 (16)24 (26)59 (20)
Cough >2 weeks169 (32)45 (49)118 (40)
History of household TB contact321 (61)61 (67)185 (63)
HIV positive124 (24)15 (17)71 (24)
 WHO clinical stage 111 (9)02 (3)
 WHO clinical stage 235 (28)5 (33)15 (21)
 WHO clinical stage 350 (40)6 (40)31 (44)
 WHO clinical stage 428 (23)4 (27)23 (32)
Median CD4 cell count in HIV-positive children (IQR)*489 (226 to 832)333 (112 to 485)471 (152 to 832)
Median weight for age Z score (IQR)−1.56 (−2.84 to −0.56)−1.62 (−3.07 to −0.78)−1.61 (−3.01 to −0.68)
Median height for age Z score (IQR)†−1.23 (−2.33 to −0.30)−1.11 (−2.33 to −0.60)−1.17 (−2.34 to −0.33)
Median weight for height Z score (IQR)‡−0.66 (−2.06 to 0.42)−1.39 (−3.05 to −0.48)−0.77 (−2.40 to 0.23)
CXR consistent with pulmonary TB372 (71)81 (89)217 (73)
TST positive (recommended cut-offs)§213 (40)68 (74)193 (65)
T-SPOT.TB positive (manufacturer's cut-off)175 (33)75 (82)157 (53)
Median number of SFCs on T-SPOT.TB (IQR)3 (1 to 13)25 (7 to 67)7 (2 to33)
Smear positive37 (7)37 (41)37 (13)

*CD4 cell count not available for nine HIV-positive children.

†Data available for 430 children.

‡Data available for 385 children.

§5 mm for HIV-infected children; 10 mm for others.

CXR, chest radiography; SFC, spot-forming cell; TB, tuberculosis; TST, tuberculin skin test.

Demographic and clinical characteristics of 528 children at enrolment *CD4 cell count not available for nine HIV-positive children. †Data available for 430 children. ‡Data available for 385 children. §5 mm for HIV-infected children; 10 mm for others. CXR, chest radiography; SFC, spot-forming cell; TB, tuberculosis; TST, tuberculin skin test. Flowchart of children included in the study. CXR, chest radiography; TB, tuberculosis; TST, tuberculin skin test.

Incremental value

Predictors that were in the top six models according to the BMA procedure included cough >2 weeks, fever >2 weeks, night sweats, malaise, HIV infection, and history of household contact. These predictors comprised the clinical model. The Hosmer–Lemeshow goodness-of-fit test indicated no significant differences between the observed and predicted probability of TB (χ2=7.84, p=0.45). The cross-validated odds ratios for the logistic regression models are presented in table 2.
Table 2

Cross-validated ORs (95% CIs) for culture-confirmed TB for the baseline model with clinical predictors, CXR and TST and the expanded model with binary T-SPOT.TB results (n=491)

PredictorBaseline model without T-SPOT.TBExpanded model with T-SPOT.TB (binary)
Night sweats1.42 (0.72 to 2.80)1.32 (0.66 to 2.69)
Malaise1.82 (0.94 to 3.53)2.08 (1.03 to 4.18)
Fever >2 weeks1.90 (0.83 to 4.35)1.86 (0.78 to 4.48)
Cough >2 weeks1.52 (0.73 to 3.16)1.42 (0.67 to 3.03)
History of TB contact0.84 (0.43 to 1.65)0.61 (0.29 to 1.25)
HIV positive0.43 (0.14 to 1.34)0.64 (0.19 to 2.14)
CXR consistent with TB5.53 (2.03 to 15.03)4.62 (1.65 to 12.94)
TST positive19.30 (7.32 to 50.91)7.54 (2.56 to 22.20)
T-SPOT.TB5.93 (2.39 to 14.73)

CXR, chest radiography; TB, tuberculosis; TST, tuberculin skin test.

Cross-validated ORs (95% CIs) for culture-confirmed TB for the baseline model with clinical predictors, CXR and TST and the expanded model with binary T-SPOT.TB results (n=491) CXR, chest radiography; TB, tuberculosis; TST, tuberculin skin test. The incremental value analysis was performed in 491 children with negative smear results. With culture-confirmed TB as the outcome, the AUC for the baseline model with clinical predictors, CXR and TST was 85% (95% CI 80% to 90%). Addition of T-SPOT.TB to this model did not substantially improve its discriminatory ability, as the AUC increased only to 88% (95% CI 85% to 92%) and 87% (95% CI 84% to 92%) when the binary result or quantitative result was added, respectively (table 3). When using the NRI measure, binary T-SPOT.TB results (NRI=7%; 95% CI −8% to 31%) and quantitative SFC results (NRI=8%; 95% CI −7% to 25%) reclassified patients appropriately. However, both CIs included the null value. Table 4 provides a detailed calculation of the NRI for comparing the baseline model with the expanded model with binary T-SPOT.TB results. The numbers along the diagonal represent children who remained in the same risk category even after addition of T-SPOT.TB results. In children with confirmed PTB, the T-SPOT.TB increased the probability of TB in 20% (11/54) of children, while incorrectly decreasing the probability in 17% (9/54) of children. Thus, the net improvement for confirmed PTB cases was 3% (95% CI −10% to 28%). In children without confirmed PTB, the T-SPOT.TB correctly decreased the probability of TB in 9% (38/437) of children but increased the probability in 5% (24/437) of children for a net improvement of 4% (95% CI −1% to 7%).
Table 3

AUC, NRI and IDI results with culture-confirmed TB and empirical treatment for active TB as the outcome in smear-negative children (n=491). Comparisons are made between the baseline model with clinical predictors, CXR and TST and the expanded model with addition of T-SPOT.TB

AUC expanded (95% CI)AUC baseline (95% CI)AUC difference (95% CI)NRI events (95% CI)NRI non-events (95%CI)NRI sum (95% CI)IDI events (95% CI)IDI non-events (95% CI)IDI sum (95% CI)
Culture-confirmed TB
 Clinical+CXR+TST+T-SPOT.TB (binary)0.88 (0.85 to 0.92)0.85 (0.80 to 0.90)0.03 (0.002 to 0.07)0.03 (−0.10 to 0.28)0.04 (−0.01 to 0.07)0.07 (−0.08 to 0.31)0.02 (0.001 to 0.10)0.01 (0.001 to 0.01)0.03 (0.001 to 0.11)
 Clinical+CXR+TST+T-SPOT.TB (quantitative)0.87 (0.84 to 0.92)0.85 (0.80 to 0.90)0.02 (0.002 to 0.06)0.07 (−0.09 to 0.22)0.01 (−0.01 to 0.07)0.08 (−0.07 to 0.25)0.04 (0.002 to 0.10)0.004 (0.001 to 0.01)0.04 (0.002 to 0.12)
Empirical treatment for active TB
 Clinical+CXR+TST+T-SPOT.TB (binary)0.86 (0.83 to 0.90)0.84 (0.81 to 0.88)0.02 (0.003 to 0.03)0.01 (−0.02 to 0.04)0.12 (−0.01 to 0.19)0.13 (−0.001 to 0.20)0.01 (0.002 to 0.03)0.01 (0.003 to 0.03)0.02 (0.01 to 0.06)
 Clinical+CXR+TST+T-SPOT.TB (quantitative)0.86 (0.83 to 0.90)0.84 (0.81 to 0.88)0.02 (0.003 to 0.04)0.01 (−0.03 to 0.05)0.08 (−0.01 to 0.22)0.09 (−0.01 to 0.24)0.01 (0.003 to 0.03)0.02 (0.003 to 0.03)0.03 (0.01 to 0.06)

AUC, area under the curve; CXR, chest radiography; IDI, integrated discrimination improvement; NRI, net reclassification improvement; TST, tuberculin skin test.

Table 4

Reclassification tables to calculate the NRI for binary T-SPOT.TB results in smear-negative children with and without culture-confirmed TB, using the risk categories <10%, 10–30% and >30%*

Clinical+CXR+TST+T-SPOT.TB (expanded model)
Clinical+CXR+TST (baseline model)<10%10–30%>30%Total
Confirmed TB (N=54)
 <10%4509
 10–30%49619
 >30%142126
 Total9182754
Not confirmed TB (N=437)
 <10%318120330
 10–30%26291267
 >30%2102840
 Total3465140437

Numbers in bold indicate correctly-reclassified patients that are used to calculate the NRI.

*The risk categories are based on the predicted probabilities from the logistic regression model. The T-SPOT.TB correctly reclassified 3% of culture-confirmed cases (11/54 above the diagonal minus 9/54 below the diagonal). The T-SPOT.TB correctly reclassified 4% of non-confirmed cases (38/437 below the diagonal minus 24/437 above the diagonal). Thus, the overall NRI is 7%.

CXR, chest radiography; NRI, net reclassification improvement; PTB, pulmonary tuberculosis; TST, tuberculin skin test.

AUC, NRI and IDI results with culture-confirmed TB and empirical treatment for active TB as the outcome in smear-negative children (n=491). Comparisons are made between the baseline model with clinical predictors, CXR and TST and the expanded model with addition of T-SPOT.TB AUC, area under the curve; CXR, chest radiography; IDI, integrated discrimination improvement; NRI, net reclassification improvement; TST, tuberculin skin test. Reclassification tables to calculate the NRI for binary T-SPOT.TB results in smear-negative children with and without culture-confirmed TB, using the risk categories <10%, 10–30% and >30%* Numbers in bold indicate correctly-reclassified patients that are used to calculate the NRI. *The risk categories are based on the predicted probabilities from the logistic regression model. The T-SPOT.TB correctly reclassified 3% of culture-confirmed cases (11/54 above the diagonal minus 9/54 below the diagonal). The T-SPOT.TB correctly reclassified 4% of non-confirmed cases (38/437 below the diagonal minus 24/437 above the diagonal). Thus, the overall NRI is 7%. CXR, chest radiography; NRI, net reclassification improvement; PTB, pulmonary tuberculosis; TST, tuberculin skin test. Considering all possible risk categories from 0% to 100%, the IDI showed that the T-SPOT.TB did not improve the average probability of TB (IDI=3% (95% CI 0% to 11%) for binary results and IDI=4% (95% CI 0% to 12%) for quantitative results). Figure 2 depicts the probability distributions for children with and without confirmed TB and the marginal improvements with addition of binary T-SPOT.TB results. As seen in this figure, adding T-SPOT.TB to the standard workup did not cause substantial increases in predicted probabilities for confirmed TB cases (ie, shifts to the right). For non-TB cases, the probabilities are appropriately concentrated to the left even without the addition of T-SPOT.TB.
Figure 2

Distributions of the predicted probability of tuberculosis (TB) for children with (top) and without (bottom) culture-confirmed TB. Plots on the left represent the baseline model with clinical predictors, chest radiography (CXR) and tuberculin skin test (TST). Plots on the right represent this model extended by binary T-SPOT.TB results. The T-SPOT.TB increased marginally the average probability in confirmed cases from 29% to 31%, while for non-confirmed cases the average probability was reduced only from 9% to 8%.

Distributions of the predicted probability of tuberculosis (TB) for children with (top) and without (bottom) culture-confirmed TB. Plots on the left represent the baseline model with clinical predictors, chest radiography (CXR) and tuberculin skin test (TST). Plots on the right represent this model extended by binary T-SPOT.TB results. The T-SPOT.TB increased marginally the average probability in confirmed cases from 29% to 31%, while for non-confirmed cases the average probability was reduced only from 9% to 8%. When empirical treatment for active TB was used as the outcome of our model, T-SPOT.TB results increased the AUC marginally from 84% to 86% (AUC difference=2%; 95% CI 0% to 3%). A similar finding was seen with the IDI, in which the IDI was 2% (95% CI 1% to 6%) for binary results and 3% (95% CI 1% to 6%) for quantitative results. When risk categories were used for the NRI, the magnitude of improvement was larger in children who were not treated. The T-SPOT.TB correctly decreased the probability of disease in these children. However, the CI contained the null value. Overall, T-SPOT.TB results did not substantially reclassify smear-negative children into appropriate risk categories (table 3).

Discussion

Although meta-analyses have shown that IGRAs have suboptimal sensitivity for active PTB in children,4 5 diagnostic tests such as the T-SPOT.TB are not performed alone. The diagnostic workup is inherently a sequential process that begins with patient demographics, then signs and symptoms, followed by simpler tests, and extending to more expensive and/or invasive tests. Unfortunately, diagnostic research that evaluates the added value of new TB tests beyond routinely measured variables and conventional tests is limited. Our study is the first incremental value analysis of the IGRA in children, in whom diagnosis of active TB remains a challenge. We measured the added value of T-SPOT.TB in a high-burden setting using the difference in AUC and the NRI and IDI measures that have been more recently described. Our findings show that T-SPOT.TB does not have utility in supporting a diagnosis of active PTB in hospitalised smear-negative children beyond the clinical history and standard tests. When culture-confirmed TB was used as the outcome in the analysis, T-SPOT.TB did not increase the discriminatory ability of the model according to the AUC. Furthermore, it did not correctly reclassify a substantial number of children, whether using prespecified risk categories with the NRI or continuous risk probabilities with the IDI. In a secondary analysis, the findings were similar when empirical TB treatment based on clinical judgment was used as the outcome. Two studies have been published thus far on the incremental value of IGRAs in smear-negative adult patients using culture-confirmed TB as the gold standard.6 7 Both studies evaluated the QuantiFERON-TB (QFT, Cellestis/Qiagen, Australia) assay in adults. Metcalfe and colleagues found that quantitative interferon γ results significantly improved discrimination according to the AUC and appropriately reclassified patients using the NRI when added to patient demographic and clinical characteristics in a low-incidence setting.7 The added value of the QFT, however, was lower when predictors based on subjective clinical judgment of risk (low, medium or high) were incorporated into their model. In the second study, Rangaka and colleagues evaluated the use of the QFT to screen for active TB in HIV-infected adults before starting isoniazid preventive therapy.6 According to the AUC, the QFT had less added value compared with TST for improving upon a baseline clinical model. Based on evidence from these incremental value studies and those based on test accuracy,16 WHO recommended against the use of IGRAs for diagnosing active TB disease in low and middle income countries.17 Our findings are supportive of this negative recommendation in high-burden settings for children as well.

Strengths and limitations

In our methodological approach, we used a BMA procedure that considers all possible combinations of predictors. This model selection process and the cross-validation step avoid developing an overly optimistic model that would have worse performance when applied to other data. Furthermore, we assessed the incremental value using two newer measures that are based on risk probabilities. One major criticism of the AUC as an overall measure of model performance has been its lack of direct clinical interpretation to individual patients. The NRI and IDI are more informative than the AUC in that they calculate the increase in appropriate reclassification separately for events and non-events. Our study also had several limitations. Only results from one reader were used for most CXRs, so that a consensus read was not possible. Furthermore, we could not evaluate specific radiological findings, such as lobar consolidation or lymphadenopathy, in our analysis. In the secondary analysis in which empirical TB treatment based on clinical judgment was used as the outcome of the model, incorporation bias may be an issue. This type of bias would generally overestimate the performance of tests that are also used in assigning the final outcome. This problem is difficult to avoid in the context of childhood TB, as the absence of an adequate reference standard requires that the entire clinical picture be taken into account when making a final diagnosis. Our study recruited children from secondary and tertiary-care hospitals, where disease is more severe and treating physicians are highly specialised and/or more prone to overtreatment. Thus, our findings may not be applicable to primary-care facilities with less experienced clinicians or in community and ambulatory settings where children would present with milder form of disease. Furthermore, the availability of resources in our hospital setting may not be representative of other settings in which certain diagnostic tests are not standard of care. In fact, smear microscopy is being phased out as the first-line diagnostic test in South Africa with the nationwide rollout of the rapid Xpert MTB/RIF test (Cepheid, USA).18 Further analysis will be required to determine the incremental value of T-SPOT.TB in children in whom Xpert MTB/RIF is negative. Moreover, our study findings may not be generalisable to settings with low prevalence of HIV coinfection. The lack of a gold standard to confirm the diagnosis further complicates conducting research studies for childhood TB. Recently, efforts have been made to develop practical reference standards based on consensus clinical case definitions19 and to suggest a standardised approach for reporting findings so that results are comparable across studies.20 Thus, these are important steps forward for facilitating the inclusion of children in diagnostic studies that will target this important group as a priority for new TB technologies.
  16 in total

1.  Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond.

Authors:  Michael J Pencina; Ralph B D'Agostino; Ralph B D'Agostino; Ramachandran S Vasan
Journal:  Stat Med       Date:  2008-01-30       Impact factor: 2.373

2.  The utility of an interferon gamma release assay for diagnosis of latent tuberculosis infection and disease in children: a systematic review and meta-analysis.

Authors:  Shingai Machingaidze; Charles Shey Wiysonge; Yulieth Gonzalez-Angulo; Mark Hatherill; Sizulu Moyo; Willem Hanekom; Hassan Mahomed
Journal:  Pediatr Infect Dis J       Date:  2011-08       Impact factor: 2.129

3.  Evaluation of tuberculosis diagnostics in children: 1. Proposed clinical case definitions for classification of intrathoracic tuberculosis disease. Consensus from an expert panel.

Authors:  Stephen M Graham; Tahmeed Ahmed; Farhana Amanullah; Renee Browning; Vicky Cardenas; Martina Casenghi; Luis E Cuevas; Marianne Gale; Robert P Gie; Malgosia Grzemska; Ed Handelsman; Mark Hatherill; Anneke C Hesseling; Patrick Jean-Philippe; Beate Kampmann; Sushil Kumar Kabra; Christian Lienhardt; Jennifer Lighter-Fisher; Shabir Madhi; Mamodikoe Makhene; Ben J Marais; David F McNeeley; Heather Menzies; Charles Mitchell; Surbhi Modi; Lynne Mofenson; Philippa Musoke; Sharon Nachman; Clydette Powell; Mona Rigaud; Vanessa Rouzier; Jeffrey R Starke; Soumya Swaminathan; Claire Wingfield
Journal:  J Infect Dis       Date:  2012-03-22       Impact factor: 5.226

4.  Evaluation of tuberculosis diagnostics in children: 2. Methodological issues for conducting and reporting research evaluations of tuberculosis diagnostics for intrathoracic tuberculosis in children. Consensus from an expert panel.

Authors:  Luis E Cuevas; Renee Browning; Patrick Bossuyt; Martina Casenghi; Mark F Cotton; Andrea T Cruz; Lori E Dodd; Francis Drobniewski; Marianne Gale; Stephen M Graham; Malgosia Grzemska; Norbert Heinrich; Anneke C Hesseling; Robin Huebner; Patrick Jean-Philippe; Sushil Kumar Kabra; Beate Kampmann; Deborah Lewinsohn; Meijuan Li; Christian Lienhardt; Anna M Mandalakas; Ben J Marais; Heather J Menzies; Grace Montepiedra; Charles Mwansambo; Richard Oberhelman; Paul Palumbo; Estelle Russek-Cohen; David E Shapiro; Betsy Smith; Giselle Soto-Castellares; Jeffrey R Starke; Soumya Swaminathan; Claire Wingfield; Carol Worrell
Journal:  J Infect Dis       Date:  2012-04-03       Impact factor: 5.226

Review 5.  Interferon-gamma release assays and childhood tuberculosis: systematic review and meta-analysis.

Authors:  A M Mandalakas; A K Detjen; A C Hesseling; A Benedetti; D Menzies
Journal:  Int J Tuberc Lung Dis       Date:  2011-08       Impact factor: 2.373

6.  Accuracy of the Xpert MTB/RIF test for the diagnosis of pulmonary tuberculosis in children admitted to hospital in Cape Town, South Africa: a descriptive study.

Authors:  Mark P Nicol; Lesley Workman; Washiefa Isaacs; Jacinta Munro; Faye Black; Brian Eley; Catharina C Boehme; Widaad Zemanay; Heather J Zar
Journal:  Lancet Infect Dis       Date:  2011-07-19       Impact factor: 25.071

Review 7.  Interferon-γ release assays for active pulmonary tuberculosis diagnosis in adults in low- and middle-income countries: systematic review and meta-analysis.

Authors:  John Z Metcalfe; Charles K Everett; Karen R Steingart; Adithya Cattamanchi; Laurence Huang; Philip C Hopewell; Madhukar Pai
Journal:  J Infect Dis       Date:  2011-11-15       Impact factor: 5.226

8.  Evaluation of quantitative IFN-gamma response for risk stratification of active tuberculosis suspects.

Authors:  John Z Metcalfe; Adithya Cattamanchi; Eric Vittinghoff; Christine Ho; Jennifer Grinsdale; Philip C Hopewell; L Masae Kawamura; Payam Nahid
Journal:  Am J Respir Crit Care Med       Date:  2009-10-01       Impact factor: 21.405

9.  Interferon release does not add discriminatory value to smear-negative HIV-tuberculosis algorithms.

Authors:  M X Rangaka; H P Gideon; K A Wilkinson; M Pai; J Mwansa-Kambafwile; G Maartens; J R Glynn; A Boulle; K Fielding; R Goliath; R Titus; S Mathee; R J Wilkinson
Journal:  Eur Respir J       Date:  2011-06-30       Impact factor: 16.671

10.  The impact and cost of scaling up GeneXpert MTB/RIF in South Africa.

Authors:  Gesine Meyer-Rath; Kathryn Schnippel; Lawrence Long; William MacLeod; Ian Sanne; Wendy Stevens; Sagie Pillay; Yogan Pillay; Sydney Rosen
Journal:  PLoS One       Date:  2012-05-31       Impact factor: 3.240

View more
  14 in total

Review 1.  Epidemiology and clinical management of tuberculosis in children in Canada.

Authors:  Shaun K Morris; Anne-Marie Demers; Ray Lam; Lisa G Pell; Ryan Jp Giroux; Ian Kitai
Journal:  Paediatr Child Health       Date:  2015-03       Impact factor: 2.253

Review 2.  Recommendations for the diagnosis of pediatric tuberculosis.

Authors:  E Chiappini; A Lo Vecchio; S Garazzino; G L Marseglia; F Bernardi; E Castagnola; P Tomà; D Cirillo; C Russo; C Gabiano; D Ciofi; G Losurdo; M Bocchino; E Tortoli; M Tadolini; A Villani; A Guarino; S Esposito
Journal:  Eur J Clin Microbiol Infect Dis       Date:  2016-01       Impact factor: 3.267

3.  Novel interferon-gamma assays for diagnosing tuberculosis in young children in India.

Authors:  N Shaikh; A Gupte; S Dharmshale; S Pokkali; M Thakar; V J Upadhye; A A Ordonez; A Kinikar; N Gupte; V Mave; A Kagal; A Gupta; A Lalvani; R Paranjpe; R Bharadwaj; S K Jain
Journal:  Int J Tuberc Lung Dis       Date:  2017-04-01       Impact factor: 2.373

Review 4.  Gamma interferon release assays for detection of Mycobacterium tuberculosis infection.

Authors:  Madhukar Pai; Claudia M Denkinger; Sandra V Kik; Molebogeng X Rangaka; Alice Zwerling; Olivia Oxlade; John Z Metcalfe; Adithya Cattamanchi; David W Dowdy; Keertan Dheda; Niaz Banaei
Journal:  Clin Microbiol Rev       Date:  2014-01       Impact factor: 26.132

5.  The performance and limitation of T-SPOT.TB for the diagnosis of TB in a high prevalence setting.

Authors:  Changtai Zhu; Zhonghua Liu; Zhiqiang Li; Shencong Mei; Zhongyi Hu
Journal:  J Thorac Dis       Date:  2014-06       Impact factor: 2.895

Review 6.  Systematic review and meta-analysis on the utility of Interferon-gamma release assays for the diagnosis of Mycobacterium tuberculosis infection in children: a 2013 update.

Authors:  S Sollai; L Galli; M de Martino; E Chiappini
Journal:  BMC Infect Dis       Date:  2014-01-08       Impact factor: 3.090

7.  Application Values of T-SPOT.TB in Clinical Rapid Diagnosis of Tuberculosis.

Authors:  Feng Zhu; Qinfang Ou; Jian Zheng
Journal:  Iran J Public Health       Date:  2018-01       Impact factor: 1.429

8.  Screening tests for active pulmonary tuberculosis in children.

Authors:  Bryan Vonasek; Tara Ness; Yemisi Takwoingi; Alexander W Kay; Susanna S van Wyk; Lara Ouellette; Ben J Marais; Karen R Steingart; Anna M Mandalakas
Journal:  Cochrane Database Syst Rev       Date:  2021-06-28

9.  Active tuberculosis in patients with systemic lupus erythematosus from Southern China: a retrospective study.

Authors:  Minxi Lao; Dongying Chen; Xiangni Wu; Haihong Chen; Qian Qiu; Xiuyan Yang; Zhongping Zhan
Journal:  Clin Rheumatol       Date:  2018-09-23       Impact factor: 3.650

10.  Fluctuating Behavior and Influential Factors in the Performance of the QuantiFERON-TB Gold In-Tube Assay in the Diagnosis of Tuberculosis.

Authors:  Lei Bao; Tao Li; Ni Diao; Yaojie Shen; Lingyun Shao; Ying Zhang; Shuihua Lu; Wenhong Zhang
Journal:  PLoS One       Date:  2015-08-19       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.