| Literature DB >> 32461286 |
Joseph N Jarvis1,2,3, Mark W Tenforde3,4,5, Kwana Lechiile6,3, Thandi Milton3, Amber Boose3, Tshepo B Leeme6,3, Leabaneng Tawe3, Charles Muthoga6,3, Ivy Rukasha7, Fredah Mulenga8, Ikanyeng Rulaganyang6,3, Mooketsi Molefi9, Síle F Molloy10, Julia Ngidi7, Thomas S Harrison10, Nelesh P Govender7,11, Madisa Mine8.
Abstract
Higher cryptococcal antigen (CrAg) titers are strongly associated with mortality risk in individuals with HIV-associated cryptococcal disease. Rapid tests to quantify CrAg levels may provide important prognostic information and enable treatment stratification. We performed a laboratory-based validation of the IMMY semiquantitative cryptococcal antigen (CrAgSQ) lateral flow assay (LFA) against the current gold standard CrAg tests. We assessed the diagnostic accuracy of the CrAgSQ in HIV-positive individuals undergoing CrAg screening, determined the relationship between CrAgSQ scores and dilutional CrAg titers, assessed interrater reliability, and determined the clinical correlates of CrAgSQ scores. A total of 872 plasma samples were tested using both the CrAgSQ LFA and the conventional IMMY CrAg LFA, of which 692 were sequential samples from HIV-positive individuals undergoing CrAg screening and an additional 180 were known CrAg-positive plasma samples archived from prior studies. Interrater agreement in CrAgSQ reading was excellent (98.17% agreement, Cohen's kappa 0.962, P < 0.001). Using the IMMY CrAg LFA as a reference standard, CrAgSQ was 93.0% sensitive (95% confidence interval [CI] 80.9% to 98.5%) and 93.8% specific (95% CI, 91.7% to 95.6%). After reclassification of discordant results using CrAg enzyme immunoassay testing, the sensitivity was 98.1% (95% CI, 90.1% to 100%) and specificity 95.8% (95% CI, 93.9% to 97.2%). The median CrAg titers for semiquantitative score categories (1+ to 4+) were 1:10 (interquartile range [IQR], 1:5 to 1:20) in the CrAgSQ 1+ category, 1:40 (IQR, 1:20 to 1:80) in the CrAgSQ 2+ category, 1:640 (IQR, 1:160 to 1:2,560) in the CrAgSQ 3+ category, and 1:5,120 (IQR, 1:2,560 to 1:30,720) in the CrAgSQ 4+ category. Increasing CrAgSQ scores were strongly associated with 10-week mortality. The IMMY CrAgSQ test had high sensitivity and specificity compared to the results for the IMMY CrAg LFA and provided CrAg scores that were associated with both conventional CrAg titers and clinical outcomes.Entities:
Keywords: Cryptococcal meningitis; HIV; cryptococcal antigen; diagnostic accuracy; lateral flow assay; validation study
Mesh:
Substances:
Year: 2020 PMID: 32461286 PMCID: PMC7448662 DOI: 10.1128/JCM.00441-20
Source DB: PubMed Journal: J Clin Microbiol ISSN: 0095-1137 Impact factor: 5.948
FIG 1The IMMY semiquantitative CrAgSQ lateral flow assay (IMMY, Norman, OK, USA). Samples are diluted 1:1 with specimen diluent prior to testing (as is also the case with the conventional lateral flow assay). Scores indicating increasing cryptococcal antigen titers are derived from line intensity patterns as follows: T1 < T2 = 1+; T1 = T2 = 2+; T1 > T2 = 3+; only T1 = 4+; only C = 5+; and only T2 and C = negative. A score of 1+ indicates “low positive,” and a score of 5+ indicates “very high positive.”
FIG 2Schema of plasma samples and patient populations used in the diagnostic validation study.
Baseline characteristics of study participants
| Variable | Value [median (IQR) or % (no. of individuals)] |
|---|---|
| Cohort 1 | |
| Age (yrs) | 40 (33–46) |
| Sex (% male) | 57 (365) |
| CD4 count (cells/μl) | 91 (53–150) |
| Cryptococcal antigenemia (% positive) | 5.8 (37) |
| Testing location (% outpatients) | 88 (563) |
| ART status (% on ART) | 71 (451) |
| Prior cryptococcal meningitis (%) | 2 (13) |
| Cohort 2 | |
| Age (yrs) | 39 (34–44) |
| Sex (% male) | 59 (104) |
| CD4 count (cells/μl) | 41 (16–85) |
| Cryptococcal antigenemia (% positive) | 100 (180) |
| Testing location (% outpatients) | 49 (88) |
| ART status (% on ART) | 46 (82) |
| Prior cryptococcal meningitis (%) | 12 (21) |
IQR, interquartile range; CrAg, cryptococcal antigen; ART, antiretroviral therapy.
Sequential cohort of individuals with CD4 cell counts of ≤200 cells/μl whose test samples were obtained during a reflex CrAg screening program.
Cryptococcal antigen positive using the IMMY CrAg lateral flow assay (IMMY, Norman, OK, USA).
Among the participants, 451/638 (71%) were on ART, 32/638 (5%) defaulted ART, and 155/638 (24%) were ART naive. Viral loads were available for 448 of those on ART; 168 (38%) had a detectable viral load.
CrAg titer validation cohort that consisted of 111 known-CrAg-positive plasma samples from reflex cryptococcal antigen screening studies and 69 plasma samples from patients with cryptococcal meningitis enrolled in a clinical trial (21).
Among the participants, 82/180 (46%) were on ART, 13/180 (7%) defaulted ART, and 85/180 (47%) were ART naive. Viral loads were available for 55 of those on ART; 16 (29%) had a detectable viral load.
Diagnostic performance of the IMMY CrAgSQ LFA for interrater agreement
| Score from rater A | No. of tests with score from rater B | Total | ||||
|---|---|---|---|---|---|---|
| 0 | 1+ | 2+ | 3+ | 4+ | ||
| 0 | 610 | 0 | 0 | 0 | 0 | 610 |
| 1+ | 4 | 87 | 0 | 0 | 0 | 91 |
| 2+ | 0 | 3 | 15 | 0 | 0 | 18 |
| 3+ | 0 | 0 | 4 | 101 | 5 | 110 |
| 4+ | 0 | 0 | 0 | 0 | 43 | 43 |
| Total | 614 | 90 | 19 | 101 | 48 | 872 |
Diagnostic performance of the IMMY CrAgSQ LFA for interrater reliability
| Interrater reliability | % agreement | Cohen’s kappa | SE | ||
|---|---|---|---|---|---|
| Expected | Observed | ||||
| Unweighted | 52.11 | 98.17 | 0.962 | 0.022 | <0.0001 |
| Weighted | 72.07 | 99.54 | 0.983 | 0.028 | <0.0001 |
To account for the ordered categorical data and assess the degree of disagreement, disagreements were weighted in a linear way: with five categories, cases in adjacent categories were weighted by a factor of 0.75, those with a distance of two categories by a factor of 0.5, those with a distance of three categories by a factor of 0.25, and those with a distance of four categories by a factor of 0.
Diagnostic performance of the IMMY CrAgSQ LFA versus the conventional IMMY CrAg LFA for sensitivity, specificity, and positive and negative predictive values
| CrAgSQ LFA result | No. of tests with indicated result in CrAg LFA | Total | Value [% (95% CI)] for | ||||
|---|---|---|---|---|---|---|---|
| Positive | Negative | Sensitivity | Specificity | PPV | NPV | ||
| Positive | 40 | 40 | 80 | 93.0 (80.9–98.5) | 93.8 (91.7–95.6) | 50.0 (38.6–61.4) | 99.5 (98.6–99.9) |
| Negative | 3 | 609 | 612 | ||||
| Total | 43 | 649 | 692 | ||||
The conventional IMMY qualitative lateral flow assay (LFA) was used as the reference test against the IMMY semiquantitative LFA for CrAg testing.
PPV, positive predictive value; NPV, negative predictive value.
All CrAgSQ results of 1+ and above were considered positive.
FIG 3Relationship between CrAgSQ scores and cryptococcal antigen titers derived from serial dilutional testing with the IMMY lateral flow assay (panel 1). Samples with discordant CrAgSQ and IMMY lateral flow assay positive/negative results were retested using the IMMY cryptococcal antigen enzyme immunoassay (EIA) (panel 2). Box A indicates samples that were positive on IMMY lateral flow assay testing and negative on CrAgSQ testing. Three of these four samples were negative on EIA testing at the optical density cutoff of 0.265. Box B indicates the samples that were positive on CrAgSQ testing and negative on IMMY lateral flow assay testing. Thirteen of the forty samples were positive on EIA testing at the optical density cutoff of 0.265. −ve, negative; +ve, positive.
Diagnostic performance of the IMMY CrAgSQ LFA versus the conventional IMMY CrAg LFA for sensitivity, specificity, and positive and negative predictive values after reconciliation of discordant test results using EIA
| CrAgSQ result | No. of tests with indicated tiebreaker-adjusted CrAg result | Total | Value [% (95% CI)] for | ||||
|---|---|---|---|---|---|---|---|
| Positive | Negative | Sensitivity | Specificity | PPV | NPV | ||
| Positive | 53 | 27 | 80 | 98.1 (90.1–100) | 95.8 (93.9–97.2) | 66.3 (54.8–76.4) | 99.8 (99.1–100) |
| Negative | 1 | 611 | 612 | ||||
| Total | 54 | 638 | 692 | ||||
The reference standard was a composite cryptococcal antigen (CrAg) result derived from the conventional IMMY qualitative lateral flow assay (LFA) with discrepant conventional CrAG LFA/CrAgSQ (semiquantitative) LFA results reconciled using the IMMY enzyme immunoassay (EIA) as the tiebreaker test. See Fig. 3 for details.
PPV, positive predictive value; NPV, negative predictive value.
All CrAgSQ results of 1+ and above were considered positive.
FIG 4Associations between CrAgSQ score and baseline CNS disease (defined as a CrAg-positive cerebrospinal fluid sample) in the 189 CrAg-positive patients identified through reflex cryptococcal antigen screening (A), 10-week mortality in all participants (B), and 10-week mortality and loss to follow-up (C). Note that only 32% of CrAg-positive individuals underwent baseline CSF examination, and thus, these figures represent minimum estimates of baseline CNS disease.
Associations between IMMY CrAgSQ LFA titers and mortality
| Group analyzed | CrAgSQ score | % mortality (no. of deaths/total no. of participants) | Hazard ratio | 95% CI | |
|---|---|---|---|---|---|
| CrAg screening and RCT participants, including | |||||
| Confirmed deaths | 0 | 2.0 (11/554) | Base | <0.0001 | |
| 1+ | 5.1 (4/78) | 2.63 | 0.84–8.26 | ||
| 2+ | 11.8 (2/17) | 6.26 | 1.39–28.25 | ||
| 3+ | 18.8 (16/85) | 10.18 | 4.73–21.95 | ||
| 4+ | 45.2 (19/42) | 28.85 | 13.70–60.75 | ||
| Those dead or lost to follow-up | 0 | 4.9 (28/571) | Base | <0.0001 | |
| 1+ | 6.3 (5/79) | 1.29 | 0.50–3.34 | ||
| 2+ | 11.8 (2/17) | 2.45 | 0.59–10.31 | ||
| 3+ | 19.8 (17/86) | 4.12 | 2.30–7.67 | ||
| 4+ | 52.1 (25/48) | 14.1 | 8.19–24.17 | ||
| CrAG screening participants only, including | |||||
| Confirmed deaths | 0 | 2.0 (11/554) | Base | <0.0001 | |
| 1+ | 2.9 (2/68) | 1.75 | 0.50–6.13 | ||
| 2+ | 13.3 (2/15) | 5.70 | 1.29–25.27 | ||
| 3+ | 16.1 (9/56) | 6.85 | 3.00–15.62 | ||
| 4+ | 53.3 (8/15) | 31.80 | 13.01–77.31 | ||
| Those dead or lost to follow-up | 0 | 4.9 (28/571) | Base | <0.0001 | |
| 1+ | 4.4 (3/69) | 0.97 | 0.35–2.77 | ||
| 2+ | 13.3 (2/15) | 2.38 | 0.57–9.94 | ||
| 3+ | 17.5 (10/57) | 3.11 | 1.57–6.20 | ||
| 4+ | 65.0 (13/20) | 18.33 | 9.54–35.22 | ||
Derived from Cox proportional hazards model.
Analysis included participants in the two CrAg screening studies and the cryptococcal meningitis patients enrolled in the phase II treatment trial (21). RCT, randomized controlled trial.
Mortality at 10 weeks with loss to follow-ups censored.
Dead or lost to follow-up at 10 weeks: 25 patients (3%) were lost to follow-up prior to 10 weeks.
Analysis was restricted to participants in the two CrAg screening studies and excluded the cryptococcal meningitis patients enrolled in the phase II randomized controlled treatment trial (21).