Transrenal DNA-based diagnosis of Strongyloides stercoralis (Grassi, 1879) infection: Bayesian latent class modeling of test accuracy.

For epidemiological work with soil transmitted helminths the recommended diagnostic approaches are to examine fecal samples for microscopic evidence of the parasite. In addition to several logistical and processing issues, traditional diagnostic approaches have been shown to lack the sensitivity required to reliably identify patients harboring low-level infections such as those associated with effective mass drug intervention programs. In this context, there is a need to rethink the approaches used for helminth diagnostics. Serological methods are now in use, however these tests are indirect and depend on individual immune responses, exposure patterns and the nature of the antigen. However, it has been demonstrated that cell-free DNA from pathogens and cancers can be readily detected in patient's urine which can be collected in the field, filtered in situ and processed later for analysis. In the work presented here, we employ three diagnostic procedures-stool examination, serology (NIE-ELISA) and PCR-based amplification of parasite transrenal DNA from urine-to determine their relative utility in the diagnosis of S. stercoralis infections from 359 field samples from an endemic area of Argentina. Bayesian Latent Class analysis was used to assess the relative performance of the three diagnostic procedures. The results underscore the low sensitivity of stool examination and support the idea that the use of serology combined with parasite transrenal DNA detection may be a useful strategy for sensitive and specific detection of low-level strongyloidiasis.

Introduction

The soil-transmitted parasitic nematode Strongyloides stercoralis is increasingly recognized as a significant human pathogen that deserves consideration for inclusion in the public health interventions that are underway to control other medically important soil transmitted helminths (STH) [1] such as Ascaris lumbricoides, Trichuris trichiura and the hookworms Ancylostoma duodenale and Necator americanus [2, 3]. The current STH control strategy does not include S. stercoralis as a target for chemotherapy. One of factors that has negatively influenced the inclusion of S. stercoralis as a target in the STH control efforts is the limited ability to diagnose an infection based on the standard, WHO-recommended, microscopic identification of larval parasites from stool samples [4]. While highly specific when carried out by experienced technical personnel, the sensitivity of this approach is compromised by the unpredictable, intermittent release of small numbers of larvae by adult parasites residing in the intestine [5]. Because this parasite is difficult to diagnose, the prevalence of S. stercoralis infection in many regions is largely unknown. There is a clear need for an improved approach for the diagnosis of S. stercoralis infection to define prevalence and the impact of intervention measures in the field.

In recognition of this need for better diagnostics, serological methods have been devised [6]. While significant advances have been made in terms of sensitivity, detection of specific antibodies is still subject to individual response as well as the antigens used in the tests to measure anti-S. stercoralis antibodies [7]. For increased specificity, nucleic acid-based diagnosis of S. stercoralis from stool samples using qPCR has been introduced. Although specific and amenable to multiplexing for the parallel detection of other pathogens [8, 9], this process has limitations, again, due to the intermittent presence of small numbers of S. stercoralis larvae passed in the feces of most patients. Additionally, collection of stool specimens in the field is labor intensive, costly and cumbersome.

The use of cell-free DNA in blood and other bodily fluids as biomarkers has gained wide acceptance in clinical laboratories. Cell-free DNA is being applied as a diagnostic marker for cancer, prenatal diagnosis and in infectious diseases, including parasitic diseases such as malaria, trypanosomiasis, leishmaniasis, schistosomiasis, strongylodiasis, and filariasis [10-12]. While most methods use blood, cell-free DNA is also readily detected in urine [12-14], saliva [15], stool [16], and sputum [17]. Cell-free DNA that is initially released into the blood can pass through the glomerular barrier and appear as transrenal DNAs in the urine [13] as small fragments of ~150–300 bp [18]. The advantages of transrenal DNA-based diagnosis of infectious disease include: (a) urine collection is non-invasive, (b) urine is easy and cheap to collect and process, and, in theory, (c) transrenal DNA does not depend on the stage of the parasite or the tissue site of infection.

In the current study, we employed a Bayesian Latent Class modeling approach to examine the diagnostic utility of three methodologically distinct diagnostic procedures—traditional comprehensive stool based parasitology, serology that employed a specific recombinant S. stercoralis larval antigen for the detection of anti-parasite antibodies, and a PCR-based analysis of urine for the detection of transrenal parasite DNA [19]. The Bayesian approach was used to address issues of misclassification of data because of different diagnostic targets and, importantly, the lack of a gold standard, to calibrate the diagnostic procedures. The selective modeling approach within a Bayesian framework also allowed us to establish a set of principled, evidence-based expectations about the diagnostic accuracy of the three methods and the overall prevalence, before incorporating the evidence from the observed data with the goal of improving the accuracy in estimates of regional prevalence of S. stercoralis.

Methods

Study design and participants

Our study was a cross-sectional assessment of diagnostic tests in rural and urban communities in Northwestern Argentina, in the Departments of Oran, San Martin and Rivadavia in Salta province. Eligible communities were those assigned to a sanitary intervention program carried out by the teams from Universidad Nacional de Salta, the Regional Sanitarian Development Association NGO, ADESAR, and the Provincial Ministries of Public Health and First Infancy. The objectives of this collaborative network were to provide medical care and epidemiological surveillance of intestinal parasitic infections in remote villages of the Chaco and Yunga geographic regions. A total of 359 participants provided a stool, a urine, and a serum sample.

Ethics statement

The study was carried out and reported in accordance with the Standards for Reporting Diagnostic Accuracy (STARD-BLCM) guidelines [20]. Ethical approval for the study protocol and the informed consent form were obtained from Comité de Ética, Colegio Médico de Salta, Salta, Argentina dated 19 March 2015, and Johns Hopkins University (IRB number 6199) dated 30 April 2015. All participants provided written informed consent prior to sample collection. Parents or guardians provided informed consent on behalf of minor participants. All members of these communities were invited to participate and received anthelmintic treatment free of charge based on the results of stool analysis.

Sample size assessment

Prior to the data collection, we performed a Monte Carlo simulation study that generated datasets of n = 400 observations 2000 times using a latent class analysis model in (Mplus 7 [21] [22]). The sample size was based on these simulations. In the model, based on an earlier study [15], we assumed that the true Strongyloides prevalence was 30%. Stool examination sensitivity was estimated to be 30%-40%. DNA and serological test sensitivity and DNA detection sensitivity was estimated to be 95% and 85%, respectively, based on previous work [23]. In the model we considered simulations involving four different tests. We assumed that the true prevalence of Strongyloides infection was 30% with stool examination sensitivity 70%, DNA and serological test 95% and antigen capture sensitivity 85% [24]. In this same model we also assumed stool examination specificity 100%, DNA specificity 98%, and serology specificity 75% and antigen capture specificity at 80% [24]. All parameters and standard error biases did not exceed 10% for any parameters in the model.

Specimen collection and preparation

Stool

Each individual received a labeled sterile plastic container (no preservatives) and instructions on how to collect a stool sample. The stool samples were processed within 24 hours either in the laboratory at the Universidad Nacional de Salta in Salta city or at field laboratories assembled ad-hoc when in remote locations. The stool samples were analyzed using sedimentation-concentration, Harada Mori, McMaster´s and Baermann techniques for the microscopic identification of S. stercoralis and other helminths (Ascaris, hookworm, whipworm) [25]. Each participant provided a single stool sample.

Urine

Urine samples (~40 ml) were processed between one and two hours after collection by filtering through a conically-folded, 12.5 cm Whatman No. 3 filter disk. The filter disk was unfolded and dried at ambient temperature under a fly-proof cover, labeled for blind analysis, and stored in individual sealed plastic bags each with a desiccant sachet. The samples were sent to Johns Hopkins University in Baltimore for processing.

Serum

Blood samples (5 ml) were drawn by venipuncture, allowed to clot at ambient temperature and centrifuged. Serum was removed and aliquots stored at –20˚C. Anti-S. stercoralis antibody levels were analyzed with the in-house enzyme-linked immunosorbent assay (NIE-ELISA). NIE-ELISA detects IgG antibodies against a 31 kDa recombinant S. stercoralis L3 antigen, as has been described previously [7, 26, 27]. Patient sera were tested in duplicate and the mean of the results were used to calculated antibody concentration (in units/ml) by interpolation from a standard curve (eight serial dilutions of a known positive control serum). The cut off value for designating a sample as serum negative or serum positive (≥ 125 units/ml) was derived by construction of receiver operating curves (ROCs) calculated from ELISA results from 20 sera from stool positive patients and 20 sera from health normal patients from Salta Capital (non-endemic area for S. stercoralis).

DNA isolation and PCR amplification

The central regions of the filter papers containing the urine specimens were used to obtain 15 x 1.0 mm diameter discs using a paper punch. The discs were transferred to a 1.5 ml tube containing 800 μL of nuclease free water. After incubation at 95 0 C for 10 minutes, the samples were subjected to gentle agitation at room temperature overnight. The tubes were then centrifuged at 8000 rpm for two minutes and the supernatant was removed and processed using QIAmpDNA Blood Mini Kit (Qiagen, MD) according to manufacturer’s protocol.

The forward primer (SSC-F) 5’ CTC AGC TCC AGT AAA GCA ACA G 3’ and reverse primer (SSC-R) 5’AGC TGA ATC TGG AGA GTG AAG A 3’ used to amplify a 124 base pair product from S. stercoralis dispersed repetitive sequence AY028262 [23, 28]. PCR amplification was done in a 15 μL volume with Taq 2X Mastermix (New England Biolabs, Ipswich, MA), 0.75 μL of 10 μM of each primer, 1–2 μL (2–4 ng/μL) DNA made to volume with PCR grade water (Sigma-Aldrich, St. Louis, Missouri). The amplification protocol was: Initial denaturation at 95°C for 10 minutes followed by 35 cycles of 95°C for 1 minute, 63°C for 90 seconds 72°C for 1 minute with final extension at 72°C for 10 minutes. In all instances specimens were run against a case positive control, and S. stercoralis genomic DNA to ensure effective amplification and to ensure identification of the diagnostic band. Negative controls were filtered urine from non-infected donors and no-DNA/nuclease-free water. The PCR product was resolved on a 2% agarose gel stained with Ethidium Bromide (Sigma-Aldrich, St. Louis, Missouri). The origin of the PCR product amplified from the urine samples was confirmed by sequencing. All specimens were run through duplicate reactions and any anomalies were repeated to confirm the status of the sample.

Bayesian Latent Class Analysis (LCA)

In the absence of a gold standard for diagnosis of this infection and to take into account the inherent data misclassification, we fitted a latent class model using a Bayesian approach to assess the performance of the three diagnostic procedures used in this study. The basic idea behind the Bayesian approach is that all unknown quantities/model parameters such as the true sensitivity and specificity of each diagnostic test as well as the prevalence of the infection are believed to have a distribution that captures uncertainty about these parameter values. This uncertainty is captured by a distribution that is defined before observing the data and is called the prior distribution or prior. Prior data are derived from previous information from publications or experience in the field [7, 15]. Next, the observed evidence (i.e. the actual data) is expressed in terms of the likelihood function of the actual data. The actual data likelihood is then used to weigh the prior and this product yields the posterior distribution. Thus, the posterior distribution is a parameter comprised of the prior distribution and the likelihood function. Such a process allows simultaneous inferences to be made on all model parameters [29].

In our study, for each model parameter, the particular beta prior density was selected by matching the center of the range of the mean of the beta distribution according to Joseph et al. [29]. For stool sensitivity and specificity, we assumed a range of 20–40% (mean = 30%; beta parameters a = 1.9, b = 4.444) and a range of 95–100% (mean = 97.5%; beta parameters: a = 420.3, b = 10.7), respectively [7, 30]. For NIE-ELISA serology, we assumed a priori sensitivity of 81–88%, (mean = 84.5%; beta parameters a = 45.7, b = 15.1) and a specificity of 71–81%, (mean = 76%; beta parameters a = 68.2, b = 21.5) [26, 31]. For the diagnostic sensitivity and specificity for PCR DNA as well as prevalence by age groups we assumed non-informative priors which correspond to beta parameters a and b = 1. To account for age in the model for the prevalence of Strongyloides infection, <15 years old were considered children and ≥15 years represented adolescents and adults. As a sensitivity analysis, we also changed input values by 10% in each afore-mentioned prior, to evaluate the impact of priors on model outputs. As the examined tests in the present study are based on different biological measurements, we have assumed that they are not correlated to any substantial extent and thus that they are conditionally independent on the latent infection status (i.e. the latent class in the fitted model). The software we used to fit such a model was WinBUGS [32]. Multiple chains were run and results examined to ensure convergence.

Additional statistics

The percent total agreement between PCR and NIE-ELISA serology results was calculated and Cohn’s kappa statistic was used to assess the overall agreement in results [33]. Analyses were done using the ‘irr’ package in R. (https://cran.r-project.org/web/packages/irr/irr.pdf)

Results

Comparison of test results

Table 1 outlines the distribution of the 359 participants in the study by age group (<15 years and ≥15 years), sex, and environmental context (rural vs urban). In the patients examined, 222/359 (62%) were positive for one or more of the diagnostic tests (Table 2). Serology and the transrenal DNA detection assays defined prevalence of 38% and 31%, respectively. In contrast, stool examination identified only ~8% of the participants as harboring an infection with S. stercoralis. There were no significant differences in infection status by any of the demographic categories used in this study.

Table 1

Patient demographics.

Rural				Urban
<15 years		≥15 years		< 15 years		≥15 years
Male	Female	Male	Female	Male	Female	Male	Female
53 (14.76)*	70 (19.50)	32 (8.91)	78 (21.73)	50 (13.93)	64 (17.83)	3 (0.84)	9 (2.51)

*percentage of total participants

Table 2

Prevalence of Strongyloides stercoralis infection obtained by Urine-based DNA detection and NIE-ELISA serology and coprology.

Diagnostic test	Number positive	Number negative	Total	% Prevalence (95% CI)
DNA	110	249	359	30.4 (25.6–35.4)
NIE-ELISA	134	225	359	36.7 (28.6–38.6)
Stool	30	329	359	8.4 (5.5–11.2)

The concordance in the assay outcomes between stool examination, serology, and the transrenal DNA test was evaluated (Fig 1). While ~53% of the participants were seropositive or transrenal DNA positive, only ~15% (52/359) were double positive for antibodies and transrenal DNA. Of the 359 samples examined total percent agreement between DNA and serology was only 61%. The kappa statistic was 0.131 with p = 0.0122 indicating the poor agreement between the two methods. Of the 30 patients who had detectable levels of parasites in their stool samples, 20 (66%) and 22 (73%) were positive by serological or transrenal DNA analysis, respectively. Over half of the stool-positive patients were also positive for serology and transrenal DNA (~4% of all patients). Therefore, nearly 70% of the seropositive participants tested negative for detectable amounts of parasite DNA in their urine and ~60% of the patients who were DNA positive had no detectable antibodies that bound to epitopes on the 31 kDa S. stercoralis L3 antigen.

Fig 1

Venn diagram comparing the patient distribution of the 222 positive results of the transrenal DNA PCR, NEI ELISA serology and stool examination assays measuring Strongyloides stercoralis infection status.

Table 3 contains the results from the Bayesian LCA model estimates (i.e. posterior medians and 95% Credible Intervals (CrI), which are the Bayesian analogs of confidence intervals) for sensitivity and specificity for each of the three diagnostic tests and the prevalence of S. stercoralis infection for the two age groups. The S. stercoralis infection prevalence in persons <15 years was estimated as 13.5% (95% CrI 5.9–24.8) and for age ≥15 years this was estimated to be 19.8% (95% CrI 10.7–34.2). These estimates are based on Bayesian latent class modeling of collective values between the three diagnostic tests having taken into account associated measurement error from each test, not on the results of any one single test, and thus they are more accurate than the empirically calculated prevalence in Table 2. The estimate of sensitivity for serology slightly exceeded the estimate of the diagnostic sensitivity for urine-based PCR, but their 95% corresponding credible intervals overlapped, suggesting that the diagnostic performances of these two tests were similar. Specificity of urine based-PCR was estimated to be slightly higher than that estimated for serology, but, again, the 95% credible intervals overlapped with the corresponding estimate for serology. There was no substantial change in these results when the priors were altered by 10%. The Bayesian modeling results confirm the low sensitivity (43.6: 95% CrI: 25.7 to 70.4) and high specificity (97.9; 95% CrI: 96.5 to 98.9) of stool examination for S. stercoralis infection.

Table 3

Bayesian LCA estimates of sensitivity and specificity and Strongyloides stercoralis prevalence with 95% Credible Intervals (CrIs) for results of three diagnostic tests (n = 359).

Diagnostic indicator	Bayesian LCA Sensitivity	Bayesian LCA Specificity
Serology	76.7 (67.1 to 85.1)	71.6 (65.7 to 77.4)
Stool	43.6 (25.7 to70.4)	97.9 (96.5 to 98.9)
PCR in urine	74.7 (53.8 to 91.8)	77.1 (71.7 to 83.7)
Bayesian LCA Model based S. stercoralis prevalence in younger age group (< = 15 years old)	13.5 (5.9 to 24.8)
Bayesian LCA Model based S. stercoralis prevalence in older age group (>15 years old)	19.8 (10.7 to 34.2)

Discussion

Soil-transmitted and other helminth infections are of increasing global importance and are the focus of several wide spread mass drug administration efforts to reduce the level of morbidity inflicted on endemic populations by these parasites [2, 3, 34]. As these programs progress and the prevalence and intensity of infection declines because of these interventions, it is imperative to employ diagnostic strategies with increasing sensitivity and specificity to monitor and identify lingering infections. Decisions to prematurely suspend regional intervention efforts that are made based on the results of diagnostic tests that provide inaccurate assessments of prevalence and intensity are likely to undermine both short-term and long-term programmatic goals. Indeed, models indicate that helminth control programs that terminate prior to a solid control of transmission will result in reemergence and spread of the parasite into susceptible populations with detrimental public health consequences [35, 36]. Given the limited sensitivity of many of the standard methods used to monitor the prevalence of helminth infections, it is time to revise the diagnostic strategies for these parasites.

The goal of the work presented here was to determine if the detection of parasite-derived transrenal DNA has the potential to enhance the sensitivity of diagnosing S. stercoralis infection over an established and widely used serological assay or the standard parasitological stool analysis. Although it is clear from this work that detection of transrenal DNA and serology have an advantage over conventional stool analysis for the identification of infection, the relative merits of transrenal DNA and serological analysis are more difficult to conclude. While each test identified approximately the same number of participants as infected with S. stercoralis, only about 22% (53/243) were positive for both assays. It is tempting to conclude that direct detection of a S. stercoralis-derived molecule (transrenal DNA) is superior to the indirect measure of detecting antibodies that recognize a restricted set of epitopes associated with a single, stage-restricted parasite protein. However, in the absence of a ‘gold standard’ test, or set of reagents against which the accuracy of these two tests can be measured, such a determination cannot be made. The impact that a lack of gold standard tests has had on the development of molecular-based parasite diagnostics has been expertly reviewed elsewhere [29, 37–39]. The absence of a gold standard has prompted us [23] and others [29, 37] to employ Bayesian latent class modeling to generate estimates of specificity and sensitivity for parasite diagnostic tests. For the S. stercoralis diagnostic tests used in this study, latent class analysis confirms the low sensitivity of stool examination and concludes that the diagnostic performance of the NIE ELISA and transrenal DNA tests were similar in terms of diagnostic sensitivity and specificity (Table 3).

The limited concordance of the results from the serological and transrenal DNA tests can be of significant importance when MDA control efforts are evaluated. The low concordance may be due, in part, to the single molecule focus of these two assays. The NIE ELISA uses a recombinant form of a 31 kDa molecule expressed by infective S. stercoralis larvae [27] and was chosen for its favorable sensitivity and specificity profile [26] as well as its performance in clinical settings [7, 31]. The demonstrated utility of the NIE ELISA notwithstanding, both the sensitivity and specificity of this assay would likely benefit from the strategic inclusion of additional parasite molecules expressed by somatic cells of adults or released components of the parasite’s excretory/secretory products. Likewise, the transrenal DNA assay targets a single repeat sequence, the absence of which does not infer a negative diagnosis [23]. While it is possible that the clinical and/or parasitological status of certain patients preclude the passing parasite-derived transrenal DNAs, it is also likely that Strongyloides DNA was present in the urine but derived from other regions of the parasite’s genome. Identifying these additional transrenal sequences would provide an opportunity to devise a multiplex assay that amplifies several transrenal DNAs to enhance the diagnostic sensitivity and specificity of this approach.

The estimates for the half-life of cell-free DNA in the blood of humans range between 4 minutes and 12 hours (reviewed in [40]). Assuming that the proximate source of transrenal DNAs is the cell-free DNA in the blood, this short half-life indicates that detection of Strongyloides-derived DNA in the urine is measuring an ongoing infection. This rapid decay in the blood also suggests that testing for the presence of transrenal DNAs could be a sensitive tool to measure the efficacy of chemotherapeutic elimination of the parasite. In support of the utility of using transrenal DNAs as a marker of successful chemotherapy, Ibironke et al. [41] demonstrated that Schistosoma haematobium transrenal DNA was no longer detectable 14 days after treatment with praziquantel.

Diagnostic approaches that can accurately assess changes in disease burden and the impact of chemotherapeutic/public health for programs that are at different levels of control (breaking transmission, elimination, or post-elimination) are critical for strategic decision making. Following multiple rounds of treatment, MDA programs require highly sensitive assays to identify hot spots of residual transmission. In most cases, there is an unmet need to replace microscopy, which is not sufficiently sensitive to detect these low-level residual infections. At this time, no single nucleic acid, antigen detection or antibody approach appears to be able to provide an appropriately high-resolution picture of infection status. Given this, it may be time to consider coordinating the results of two or more molecular based assays for the diagnosis of STH’s, including strongyloidiasis. The results presented here suggest that the combined use of assays that detect transrenal DNA and antibodies may be a useful approach.