Bingqi Sun1, Ying Sun2. 1. Department of Laboratory Medicine, No. 10 People's Hospital of Shenyang, Shenyang, China. 2. Department of Oncology, No. 10 People's Hospital of Shenyang, Shenyang, China.
Abstract
BACKGROUND: While rifampicin (RFP) and isoniazid (INH) are the most commonly used first-line antituberculosis drugs, multidrug resistance in Mycobacterium tuberculosis poses a threat to the success of tuberculosis (TB) control programs. Clinical practice guidelines and expert consensuses recommend drug susceptibility testing (DST) before the initiation of antituberculosis treatment. However, traditional DST is time-consuming and has high requirements for laboratory conditions. The recently developed molecular diagnostic techniques, such as DNA microarray, offer new options. We thus investigated the diagnostic value of DNA microarray in detecting RFP + INH-resistant TB, with an attempt to identify simple, efficient, and accurate drug-resistant TB testing methods. METHODS: The clinical features and DST results of patients diagnosed with pulmonary tuberculosis by Bactec MGIT 960 liquid culture system (Becton, Dickinson and Company, Franklin Lakes, NJ, USA) who received DNA microarray analysis in our center from July 2019 to July 2020 were retrospectively analyzed. Level of agreement between liquid culture and DNA microarray technology was assessed by using the Cohen kappa coefficient. With the results of liquid culture as the gold standard, the sensitivity and specificity of the DNA microarray were calculated, and the receiver operating characteristic (ROC) curves were used to assess the diagnostic values of the DNA microarray in detecting RFP + INH-resistant TB. RESULTS: A total of 825 patients were enrolled. The sensitivity and specificity of DNA microarray were 0.84 and 0.94, respectively, in the detection of RFP resistance, with an area under the curve (AUC) of 0.89 [95% confidence interval (CI): 0.87-0.91)] and a Cohen kappa coefficient of 0.78 (95% CI: 0.72-0.83). For INH resistance, the sensitivity and specificity of the DNA microarray were 0.73 and 0.97, respectively, with an AUC of 0.85 (95% CI: 0.82-0.87) and a Cohen kappa coefficient of 0.75 (95% CI: 0.70-0.80). CONCLUSIONS: The DNA microarray had high specificity and sensitivity in detecting RFP + INH-resistant TB. As a rapid, accurate, and practical technique, it can be routinely performed in clinical laboratories. 2021 Journal of Thoracic Disease. All rights reserved.
BACKGROUND: While rifampicin (RFP) and isoniazid (INH) are the most commonly used first-line antituberculosis drugs, multidrug resistance in Mycobacterium tuberculosis poses a threat to the success of tuberculosis (TB) control programs. Clinical practice guidelines and expert consensuses recommend drug susceptibility testing (DST) before the initiation of antituberculosis treatment. However, traditional DST is time-consuming and has high requirements for laboratory conditions. The recently developed molecular diagnostic techniques, such as DNA microarray, offer new options. We thus investigated the diagnostic value of DNA microarray in detecting RFP + INH-resistant TB, with an attempt to identify simple, efficient, and accurate drug-resistant TB testing methods. METHODS: The clinical features and DST results of patients diagnosed with pulmonary tuberculosis by Bactec MGIT 960 liquid culture system (Becton, Dickinson and Company, Franklin Lakes, NJ, USA) who received DNA microarray analysis in our center from July 2019 to July 2020 were retrospectively analyzed. Level of agreement between liquid culture and DNA microarray technology was assessed by using the Cohen kappa coefficient. With the results of liquid culture as the gold standard, the sensitivity and specificity of the DNA microarray were calculated, and the receiver operating characteristic (ROC) curves were used to assess the diagnostic values of the DNA microarray in detecting RFP + INH-resistant TB. RESULTS: A total of 825 patients were enrolled. The sensitivity and specificity of DNA microarray were 0.84 and 0.94, respectively, in the detection of RFP resistance, with an area under the curve (AUC) of 0.89 [95% confidence interval (CI): 0.87-0.91)] and a Cohen kappa coefficient of 0.78 (95% CI: 0.72-0.83). For INH resistance, the sensitivity and specificity of the DNA microarray were 0.73 and 0.97, respectively, with an AUC of 0.85 (95% CI: 0.82-0.87) and a Cohen kappa coefficient of 0.75 (95% CI: 0.70-0.80). CONCLUSIONS: The DNA microarray had high specificity and sensitivity in detecting RFP + INH-resistant TB. As a rapid, accurate, and practical technique, it can be routinely performed in clinical laboratories. 2021 Journal of Thoracic Disease. All rights reserved.
Entities:
Keywords:
DNA microarray; Mycobacterium tuberculosis; drug resistance; isoniazid; rifampicin
According to the World Health Organization (WHO), an estimated 10 million tuberculosis (TB) cases occur worldwide every year, with China accounting for 9% of the total annual incidence. Although the number of TB deaths is declining globally, it remains one of the top 10 causes of death worldwide (1). While rifampicin (RFP) and isoniazid (INH) are the most commonly used first-line anti-TB drugs, multidrug resistance (MDR) in Mycobacterium tuberculosis poses a great threat to the success of TB treatment and global TB control (2,3). It was reported that 4.1% of all newly diagnosed and 19.0% of all previously treated TB patients are RFP-resistant; globally the total number of RFP-resistant TB patients reached 600,000, among whom 490,000 (82%) had MDR (i.e., resistance to at least RFP and INH) (1). Both the updated WHO guidelines for the treatment of multidrug- and rifampicin-resistant TB (MDR/RR-TB) and the 2019 WHO Consolidated Guidelines on Drug-Resistant Tuberculosis Treatment recommend phenotypic drug susceptibility testing (DST) prior to anti-TB treatment, which should be applied for first- and second-line anti-TB drugs, with rapid molecular DST being performed whenever possible (4,5). Currently, the WHO recommends M. tuberculosis culture as the reference standard for drug resistance testing; however, the traditional method is time-consuming (7–12 weeks) and has high technical laboratory requirements (6). Delays in DST may lead to prolonged use of ineffective drugs and missed opportunities to prevent transmission (7). With the development of testing technologies, drug resistance in M. tuberculosis can now successfully be detected by several molecular techniques, including real-time quantitative polymerase chain reaction (RT-PCR) (Xpert MTB/RFP) (8), line probe assays (LPAs) (9), and DNA microarray (10). DNA microarray uses specific genes at specific nucleotide sites to determine resistance to RFP and/or INH by detecting mutations in M. tuberculosis robB, katG, and inhA genes (11). Compared with other molecular techniques, DNA microarray is simpler and more affordable; also, it enables the simultaneous detection of both INH and RFP resistance–associated mutations in M. tuberculosis (12). Here, we investigated the diagnostic performance of DNA microarray in detecting RFP + INH-resistant TB, with an attempt to identify simple, efficient, and accurate drug-resistant TB testing methods. We hypothesized that the DNA microarray would have the same detection performance compared with traditional culture methods. We present the following article in accordance with the STARD reporting checklist (available at https://dx.doi.org/10.21037/jtd-21-913).
Methods
Participants
In this retrospective study, patients with suspected TB admitted to our center from July 2019 to July 2020 were enrolled as the research participants. The inclusion criteria were as follows: (I) the diagnosis of pulmonary TB was confirmed by sputum mycobacterium culture; and (II) the same specimen was tested for both RFP and INH resistance with DNA microarray. The exclusion criteria were as follows: (I) contaminated specimens, and/or (II) lack of key data. All procedures performed in this study involving human participants were in accordance with the Declaration of Helsinki (as revised in 2013). All patients signed the informed consent forms, and the study was approved by the institutional review board of our hospital (Ethical approval document number: KYXM-2019-056-01).
Equipment and reagents
Bactec MGIT960 liquid culture system and reagents (BD, Becton, Dickinson and Company, Franklin Lakes, NJ, USA) were used for liquid culture, with the reagent lot number being 9234016 and the DST reagent lot number being 9296422. Microarray hybridization was based on CapitalBio DNA microarray (CapitalBio Corp., Beijing, China).
Assays
Traditional liquid culture method
The Bactec MGIT960 system was used for rapid culture and DST, as described in a Chinese TB laboratory test protocol (13). More specifically, 0.5 mL of the treated specimen was added into a mycobacteria growth indicator tube (MGIT), which was then placed on the Bactec MGIT960 liquid culture system for culture. Positive specimens were further used for DST. During DST, M. tuberculosis isolated from TB patients was subject to in vitro culture in known concentrations of the test drugs, with a final concentration of 1.0 µg/mL for RFP and 0.1 µg/mL for INH in the culture tubes. The results of DST were reported automatically by the Bactec MGIT960 system on days 4–13.
Microarray analysis
The RFP resistance gene rpoB and the INH resistance genes katG and inhA were used as target genes. The wild type and mutations of these genes in M. tuberculosis were detected. The specimens were stored in appropriate sterile containers. During the test, mixed phosphate buffer (pH 6.8) was added 15–20 minutes after incubation in 4% NaOH, and the subsequent mixture was stirred 1–2 times. The supernatant was removed following centrifugation, the pellet was washed with 0.5–1 mL of mixed phosphate buffer, and the resultant sediments were placed on the microarray platforms. The results were recorded by a LuxScan 10K microarray scanner (CapitalBio). PCR, hybridization, washing/drying, scanning, and result interpretation were performed according to the manufacturer’s instructions.
Statistical analysis
The results of the conventional culture method were used as the gold standard to evaluate the detection performance of the DNA microarray, and the detection results were transformed, with 0 indicating sensitive and 1 indicating resistant. The differences and agreements in testing results between the 2 methods were evaluated by using the McNemar test and Cohen’s kappa, respectively. Kappa values below 0.4 indicated poor agreement, values between 0.4 and 0.75 indicated fair agreement, and values of 0.75 and higher indicated good and excellent agreement. The receiver operating characteristic (ROC) curves were used to calculate the specificity, sensitivity, and area under the curve (AUC) of the DNA microarray. The sensitivity and specificity were determined by the maximum value of the Youden Index. A P value <0.05 was deemed statistical significant. All statistical analyses were performed using MedCalc 19.0.4 software (MedCalc, Mariakerke, Belgium).
Results
Patients
DST was performed in a total of 990 patients during the study period. After 165 patients were excluded (including specimen contamination in 7 cases, negative microarray results in 84 cases, no microarray data in 43 cases, and a small number of isolates on microarray analysis in 31 cases), 825 patients (including 592 treatment-naive patients and 233 patients seeking retreatment) were entered into the final analysis. The patient inclusion flow chart is shown in .
Figure 1
Flow chart of patient enrollment. DST, drug susceptibility testing.
Flow chart of patient enrollment. DST, drug susceptibility testing.
Diagnostic performance of DNA microarray for RFP resistance
Among the 825 patients, 181 were RFP resistant (as detected by liquid culture), with 153 of these being detected by DNA microarray; 644 were RFP sensitive, with 609 of these being detected by DNA microarray. The difference in value between liquid culture and DNA microarray was –0.85 (95% CI: –2.73 to 1.04; P=0.45). For the detection of RFP resistance, the sensitivity and specificity of the DNA microarray were 0.84 and 0.94, respectively, with an AUC of 0.89 (95% CI: 0.87–0.91; ). The kappa coefficient between the DNA microarray and liquid culture was 0.78 (95% CI: 0.72–0.83; ).
Figure 2
The ROC curve of the CapitalBio DNA microarray for detecting RFP resistance. ROC, receiver operating characteristic; RFP, rifampicin.
Table 1
Diagnostic performance of DNA microarray for RFP resistance
Detection method
Results
Traditional liquid culture
Se
Spe
AUC (95% CI)
P
Difference value (95% CI, %)
P
Kappa (95% CI)
Sensitive
Resistant
DNA microarray
Sensitive
609
28
84.5%
94.5%
0.89 (0.87–0.91)
<0.001
−0.85 (−2.73 to 1.04)
0.45
0.78 (0.72–0.83)
Resistant
35
153
AUC, area under the curve; CI, confidential interval; RFP, rifampicin; Se, sensitivity; Spe, specificity.
The ROC curve of the CapitalBio DNA microarray for detecting RFP resistance. ROC, receiver operating characteristic; RFP, rifampicin.AUC, area under the curve; CI, confidential interval; RFP, rifampicin; Se, sensitivity; Spe, specificity.
Diagnostic performance of DNA microarray for INH resistance
Among the 825 patients, 250 were INH resistant, with 184 of these being detected by DNA microarray; 575 were INH sensitive, with 559 of these being detected by DNA microarray. The difference in value between liquid culture and DNA microarray was 6.06 (95% CI: 3.95–8.17; P<0.001). For the detection of RFP resistance, the sensitivity and specificity of DNA microarray were 0.73 and 0.97, respectively, with an AUC of 0.85 (95% CI: 0.82–0.87; ). The kappa coefficient between the DNA microarray and the liquid culture was 0.75 (95% CI: 0.70–0.80; ).
Figure 3
The ROC curve of the CapitalBio DNA microarray for detecting INH resistance. ROC, receiver operating characteristic; IHN, isonicotinic acid hydrazide.
Table 2
Diagnostic performance of DNA microarray for INH resistance
Detection method
Results
Traditional liquid culture
Se
Spe
AUC (95% CI)
P
Difference value (95% CI, %)
P
Kappa (95% CI)
Sensitive
Resistant
DNA microarray
Sensitive
559
66
0.73
0.97
0.85 (0.82–0.87)
<0.001
6.06 (3.95–8.17)
<0.001
0.75 (0.70–0.80)
Resistant
16
184
AUC, area under the curve; CI, confidential interval; INH, isoniazid; Se, sensitivity; Spe, specificity.
The ROC curve of the CapitalBio DNA microarray for detecting INH resistance. ROC, receiver operating characteristic; IHN, isonicotinic acid hydrazide.AUC, area under the curve; CI, confidential interval; INH, isoniazid; Se, sensitivity; Spe, specificity.
Discussion
In our current study, gene microarray technology was used to detect the resistance to RFP and/or INH in 825 pulmonary TB patients, with the traditional liquid culture method as the reference standard. The results showed that the gene microarray technology had good diagnostic performance for drug resistance in M. tuberculosis, and its detection results were in good agreement with those of the traditional method. Compared with the traditional method, the gene microarray technology is a simple, affordable, and reliable technique in clinical practice.
Recent research advances
Detection of RFP-resistant M. tuberculosis with DNA microarray
In 1999, Head et al. (14) attempted to use gene microarray technology to detect M. tuberculosis rifampicin resistance; they performed primer extension-based sequence scanning of the rpoB gene of M. tuberculosis and identified RFP-resistant clinical isolates. In 2001, Jing et al. (15) used gene microarray technology to detect M. tuberculosis resistance to RFP, and the specificity and sensitivity of the technique were high (with a detection efficiency of 83%). Gene microarray technology has been widely adopted by clinical laboratories thereafter (16-20). A meta-analysis (including 15 studies) in 2014 showed that the overall sensitivity of DNA microarray for detecting RFP resistance was 0.91 (95% CI: 0.89–0.92), the overall specificity was 0.96 (95% CI: 0.96–0.97), and the AUC was 0.97 (21). A recently published study by Zhang et al. (22) showed that the sensitivity and specificity of DNA microarray for detecting RFP resistance in patients with previously treated TB were 83.1% and 98.7%, respectively. Our results were consistent with the findings of previous studies. These evidences indicated that gene microarray technology is accurate and reliable and can be used to detect drug-resistant mutations of M. tuberculosis in clinical practice. In addition, compared with traditional liquid culture methods, gene microarray technology has the advantages of faster, simpler, and cheaper.
Detection of INH-resistant M. tuberculosis with DNA microarray
In 2004, Cui et al. (17) applied DNA microarray to detect M. tuberculosis resistant to RFP and INH, with 85 of 110 (sensitivity: 77.3%) strains resistant to INH and 22 of 30 (sensitivity: 73.3%) strains sensitive to INH were detected. In a study by Skotnikova et al. (23) in 2003, an attempt was made to analyze rpoB, katG, inhA, and oxyR/ahpC gene mutations in RFP- and INH-resistant M. tuberculosis using biochip technology. Thereafter, a large number of studies have detected INH-resistant M. tuberculosis with DNA microarray (16,24-27). Zhang et al. (28) assessed the performance of the CapitalBio DNA microarray in the detection of INH resistance in spinal tuberculosis using the BACT/MGIT 960 liquid clture results as referece standard. The microarray had a sensitivity of 80.0% and a specificity of 91.0% for INH resistance, and the mean turn-around time was 5.8 (range, 4–9) hours. A meta-analysis conducted in 2014 showed that the overall sensitivity of DNA microarray for detecting INH resistance was 0.79 (95% CI: 0.77–0.81), the overall specificity was 0.94 (95% CI: 0.93–0.95), and the AUC was 0.86 (21). The sensitivity and specificity of DNA microarray detection of INH resistance in our current study were consistent with the data from previous studies. In addition, the AUC was greater than 0.75, a generally accepted cutoff value (29), which indicates good diagnostic performance of the DNA microarray. Recently, Zhang et al. (22) tested 2,143 sputum specimens from previously treated patients in Changchun, China, for RFP and INH resistance-related gene mutations by using the BACT/MGIT 960 culture system and the CapitalBio DNA microarray (CapitalBio, China): the sensitivity and specificity of the DNA microarray for INH resistance were 79.9% and 99.6%, respectively. The same chip was used in our current study, and a similar sensitivity (73%) and specificity (97%) in detecting INH resistance were observed.
Limitations in research
Some limitations to our study should be noted. First, the retrospective design and the exclusion of patients with missing data might have led to bias. Second, our study was carried in a single center with a relatively small sample size, which might have limited the applicability of the study’s conclusions.In summary, DNA microarray is a rapid, accurate, and practical method for detecting drug-resistant TB in clinical settings. Traditional culture methods are time-consuming and have high technical laboratory requirements. In contrast, DNA microarray enables the early and rapid detection of drug-resistant mutations, which is particularly important for effective treatment of drug-resistant TB and the prevention and control of TB transmission. Future research should focus on improving the ability of detecting drug-resistant mutations in M. tuberculosis and establishing and optimizing surveillance systems, for which the CapitalBio DNA microarray may serve a critical role.The article’s supplementary files as
Authors: Ana Carolina Alba; Thomas Agoritsas; Michael Walsh; Steven Hanna; Alfonso Iorio; P J Devereaux; Thomas McGinn; Gordon Guyatt Journal: JAMA Date: 2017-10-10 Impact factor: 56.272
Authors: Mikashmi Kohli; Ian Schiller; Nandini Dendukuri; Keertan Dheda; Claudia M Denkinger; Samuel G Schumacher; Karen R Steingart Journal: Cochrane Database Syst Rev Date: 2018-08-27
Authors: O I Skotnikova; E Yu Nosova; O V Markova; O A Irtuganova; V N Krudu; S S Ginda; O V Golishcheva; M N Biryukova; E N Strel'tsova; O V Kalyanina; V I Litvinov; A M Moroz; S A Lapa; D A Gryadunov; V M Mikhailovich Journal: Bull Exp Biol Med Date: 2003-09 Impact factor: 0.804