Validation of rK39 immunochromatographic test and direct agglutination test for the diagnosis of Mediterranean visceral leishmaniasis in Spain.

BACKGROUND: Visceral leishmaniasis (VL), the most severe form of leishmaniasis, is endemic in Europe with Mediterranean countries reporting endemic status alongside a worrying northward spread. Serological diagnosis, including immunochromatographic test based on the recombinant antigen rK39 (rK39-ICT) and a direct agglutination test (DAT) based on the whole parasite antigen, have been validated in regions with high VL burden, such as eastern Africa and the Indian subcontinent. To date, no studies using a large set of patients have performed an assessment of both methods within Europe. METHODOLOGY/PRINCIPAL
FINDINGS: We selected a range of clinical serum samples from patients with confirmed VL (including HIV co-infection), Chagas disease, malaria, other parasitic infections and negative samples (n = 743; years 2009-2015) to test the performance of rK39-ICT rapid test (Kalazar Detect Rapid Test; InBios International, Inc., USA) and DAT (ITM-DAT/VLG; Institute of Tropical Medicine Antwerp, Belgium). An in-house immunofluorescence antibody test (IFAT), was included for comparison. Estimated sensitivities for rK39-ICT and DAT in HIV-negative VL patients were 83.1% [75.1-91.2] and 84.2% [76.3-92.1], respectively. Sensitivity was reduced to 67.3% [52.7-82.0] for rK39 and increased to 91.3% [82.1-100.0] for DAT in HIV/VL co-infected patients. The in-house IFAT was more sensitive in HIV-negative VL patients, 84.2% [76.3-92.1] than in HIV/VL patients, 79.4% [73.3-96.2]. DAT gave 32 false positives in sera from HIV-negative VL suspects, compared to 0 and 2 for rK39 and IFAT, respectively, but correctly detected more HIV/VL patients (42/46) than rK39 (31/46) and IFAT (39/46).
CONCLUSIONS/SIGNIFICANCE: Though rK39-ICT and DAT exhibited acceptable sensitivity and specificity a combination with other tests is required for highly sensitive diagnosis of VL cases in Spain. Important variation in the performance of the tests were seen in patients co-infected with HIV or with other parasitic infections. This study can help inform the choice of serological test to be used when screening or diagnosing VL in a European Mediterranean setting.

Introduction

Visceral leishmaniasis (VL) is a life-threatening disease caused by protozoan parasites of the Leishmania donovani complex. It is widely endemic in South America, eastern Africa and Asia as well as in the Mediterranean basin [1]. More than 500 million people are at risk of acquiring leishmaniasis worldwide, with approximately 90% of the cases arising in rural areas of Bangladesh, Brazil, Ethiopia, India, Somalia, South Sudan and Sudan [2]. In Europe, nine countries report cases of VL annually accounting for less than 2% of the global burden [3], where cases are mostly confined to the Mediterranean countries, but a spread towards northern Europe is being reported as a result of a range of factors, including vector and parasite migration, and changes to the environment and climate [4]. In Spain, a VL outbreak of unprecedented magnitude occurred in the southwest of the capital Madrid between 2009–2013 [5,6], and the country was recently listed among the top 14 VL high-burden country [2].

Facing a possible (re-)emergence of leishmaniasis in Europe, it is important for national public health institutions to have established guidelines for clinical diagnosis of VL to support primary health care and epidemiological surveillance [3,7]. Parasitological confirmation through culturing and/or microscopy remains the gold standard for diagnosis, and gives the clearest indication of parasitic infection. The sensitivity of parasitological confirmation, however, depends on the sample used, where spleen and bone marrow aspirates yield the best results but these are obtained through invasive sampling procedures, with inherent complications, besides presenting variable sensitivity [8]. In addition, the absence of parasites in tissue sample does not necessarily indicate absence of infection. Nucleic acid amplification tools have shown to be more sensitive than microscopy or culture for VL diagnosis, even when using peripheral blood samples [9]. This technology is already available in many hospitals and reference centers in VL-endemic countries in Europe; unfortunately there is a consistent lack of standardization and a very high number of different protocols [9].

Serological tools provide a good diagnostic accuracy as long as they are used in combination with a standardized clinical case definition for VL [1]. Serological tests vary in the target antigen (whole parasite or recombinant protein), ease-of-use (rapid dipstick or necessity for some laboratory infrastructure), sensitivity, specificity, and cost. Underlying HIV infections, or other forms of immunosuppression, however, can affect their sensitivity [10].

The rK39 immunochromatographic test (rK39-ICT) and the direct agglutination test (DAT) have been widely validated in the VL endemic regions of eastern Africa and the Indian subcontinent, with rK39-ICT demonstrating varying sensitivity and specificity depending on the geographical setting [11-13].To our knowledge, no studies using a large set of patients have performed an assessment of both methods on human samples within Europe. To establish evidence on serological VL diagnostic performance in this region, we assessed the sensitivity and specificity of rK39-ICT, DAT and IFAT using historical serum samples collected in Spain from 2009–2015.

Methods

Ethics statement

The serum samples used in this study are anonymized and are part of a registered collection, as described below. No ethical approval was required.

Study site

The study was conducted at the WHO Collaborating Centre for Leishmaniasis, National Centre for Microbiology, Instituto de Salud Carlos III, Madrid, Spain (WHOCCL-ISCIII), which is also the national reference laboratory for leishmaniasis.

Characteristics of sera and study design

We used historical serum samples stored at -70°C at the WHOCCL-ISCIII. These samples are part of a collection registered at the National Biobank Register-Section Collections, Spain, with collection Reference ID: C.0000898. The serum samples in the collection are anonymized.

Samples from suspected VL cases are derived from patients with clinical suspicion of VL as defined in the protocol of the Spanish national network for epidemiological surveillance [14], and were referred from different hospitals to the WHOCCL-ISCIII for diagnosis from 2009–2015. Briefly, a suspected VL case in Spain is defined as a patient who presents with irregular prolonged fever plus splenomegaly and/or weight loss, which may be accompanied by hepatomegaly, lymphadenopathy, leukopenia, anemia and thrombocytopenia. Each suspected cases had multiple samples (whole blood, serum, bone marrow) taken to facilitate diagnosis. While in this study only serum samples were tested, we used all laboratory and clinical results available from each patient to classify them as “case” or “non-case”, and therefore define the reference diagnostic result (see parasitological confirmation below). Samples from VL suspects were further divided according to the HIV status of the patients. In addition, we chose samples from patients who were diagnosed with malaria, Chagas disease or other parasitic infections, as well as serum from healthy individuals (blood donors) from Spain, Belgium and Germany. All samples were anonymized and diagnostic test operators were blinded to the nature of the serum sample.

Serological diagnostic tests

The rK39-ICT (Kalazar Detect Rapid Test, Inbios International Inc., WA, USA), and the DAT with freeze-dried antigen (ITM-DAT/VL; Institute of Tropical Medicine, Antwerp, Belgium) were performed according to manufacturer’s instruction; with 20 and 1 μl serum respectively. DAT was performed by using the screening method, samples with a titer ≥ 1:3200 were considered positive [15]. An in house IFAT was performed by following a standard method [16]: the antigen was prepared from promastigotes of the L. infantum international reference strain MHOM/FR/78/LEM-75. Antibody binding was detected using fluorescein isothiocyanate-conjugated sheep anti-human immunoglobulin G (heavy and light chains). One μl serum was used. The threshold titer for positivity was ≥1/80. Test results were interpreted and recorded on a standardized form by at least two observers at the minimum reading times, where each observer was blinded to the other’s reading. Any test returning an invalid result or lack of agreement between observers was repeated.

Parasitological confirmation

As part of routine diagnosis VL suspect patients are tested at the WHOCCL-ISCIII by nested PCR of blood and bone marrow samples, bone marrow Giemsa microscopy and blood and bone marrow NNN culture, following procedures described elsewhere [17,18]. A serum sample from a VL suspect was defined as pertaining to a case when there was parasitological confirmation of Leishmania in blood and/or bone marrow aspirate in samples taken within 21 days before or after the serum sample was taken.

Statistical analysis

The statistical software R was used with the ‘epiR’ package to determine sensitivity, specificity, positive and negative predictive values [19,20]. Exact binomial confidence limits were calculated for test sensitivity, specificity, and positive and negative predictive values.

STARD checklist and workflow are provided as supplementary materials, S1 Table and S1 Fig respectively.

Results

A total of 743 samples from 2009–2015 were tested, of which 405 were suspected VL cases, and 338 samples as control group. Most samples were taken from March 2013 to January 2015 (Fig 1A) in hospitals from different regions in Spain, mostly from Madrid and the Mediterranean coast (Fig 1C).

Fig 1

Timeline and demographics of suspected visceral leishmaniasis (VL) cases tested at the WHOCCL-ISCIII, Spain, 2009–2015.

Panel A shows the number of VL cases and non-cases tested by month. Panel B shows the age and sex distribution of suspected VL cases and non-cases. Panel C maps the location of health centres in Spain where VL cases sought diagnosis (circles) and the number of VL cases per health centre (size of circle). Map tiles by Stamen Design, under CC BY 3.0. Data by OpenStreetMap, under ODbL.

Seventy percent of suspected cases were male, with an average age of 41 years (Fig 1B). Seventy-six patients were HIV positive, while 12 patients had immunosuppression related to organ transplantation (n = 11) and Crohn’s disease (n = 1). The composition of serum samples and the diagnostic test results is detailed in Table 1.

Table 1

Type and number of samples used in this study and diagnostic outcome from each test assessed.

		rK39-ICT		DAT		IFAT		Parasitological confirmation*
	N	pos	neg	pos	neg	pos	neg	pos	neg
Suspected VL	405	110	295	246	159	114	291	0	264
Cases	141	110	31	122	19	112	29	141	0
Non-cases	264	0	264	37	227	2	262	0	264
Control groups	338	1	337	4	334	15	323	NA	NA
Chagas disease	51	0	51	0	51	15	36	NA	NA
Malaria	55	1	54	2	53	0	55	NA	NA
Other parasitoses	57	0	57	2	55	0	57	NA	NA
Spanish blood donors	142	0	142	0	142	0	142	NA	NA
German blood donors	13	0	13	0	13	0	13	NA	NA
Belgian blood donors	20	0	20	0	20	0	20	NA	NA
Total	743	111	632	163	580	129	614

*Positive parasitological confirmation by either nested PCR in blood or bone marrow, Giemsa microscopy in bone marrow aspirate or NNN-culture of blood and/or bone marrow samples.; NA = not applicable, as parasitological confirmation for Leishmania infection was not performed in this group; pos = positive results; neg = negative result.

The sensitivity, specificity, positive and negative predictive values of each test are given in Table 2.

Table 2

Performance of rK39, DAT and IFAT on suspected visceral leishmaniasis samples in Spain, 2009–2015.

Sensitivity (Sn), specificity (Sp), positive predictive value (PPV), negative predictive value (NPV) with 95% confidence intervals [].

	rK39-ICT		DAT		IFAT
Sn	78.0%	[70.8–85.2]	86.5%	[80.5–92.5]	79.4%	[72.4–86.4]
Sp	100.0%	[99.8–100.0]	85.9%	[81.6–90.3]	99.2%	[98.0–100.0]
PPV	100.0%	[99.5–100.0]	76.7%	[69.8–83.6]	98.2%	[95.4–100.0]
NPV	89.5%	[85.8–93.1]	92.3%	[88.7–95.8]	90.0%	[86.4–93.6]

Sn: Sensitivity; Sp: specificity; PPV: positive predictive value; NPV: negative predictive value.

A sub group analysis according to the HIV status of the VL suspect patients is shown in Table 3.

Table 3

Sub group analysis on HIV status.

Performance of rK39, DAT and IFAT on suspected visceral leishmaniasis samples in Spain, 2010–2014. Sensitivity (Sn), specificity (Sp), positive predictive value (PPV), negative predictive value (NPV) with 95% confidence intervals [].

HIV POSITIVE (n = 76)	rK39-ICT		DAT		IFAT
Sn	67.3%	[52.7–82.0]	91.3%	[82.1–100]	79.4%	[73.3–96.2]
Sp	100.0%	[98.3–100]	83.3%	[68.3–98.3]	99.2%	[98.3–100]
PPV	100.0%	[98.4–100]	89.3%	[79.5–99.2]	98.2%	[98.7–100]
NPV	66.7%	[51.8–81.5]	86.2%	[71.9–100]	90.0%	[67.1–95.0]
HIV NEGATIVE(n = 329)	rK39-ICT		DAT		IFAT
Sn	83.1%	[75.1–91.2]	84.2%	[76.3–92.1]	84.2%	[76.3–92.1]
Sp	100.0%	[99.8–100]	86.3%	[81.7–90.9]	86.3%	[81.7–90.9]
PPV	100.0%	[99.4–100]	71.4%	[62.6–80.2]	71.4%	[62.6–80.2]
NPV	93.6%	[90.4–96.8]	93.1%	[89.5–96.7]	93.1%	[89.5–96.7]

Sn: Sensitivity; Sp: specificity; PPV: positive predictive value; NPV: negative predictive value.

rK39-ICT

The estimated sensitivity of rK39 was 78.0% [70.8–85.2] for all 405 suspected VL patients. Of the 95 HIV-negative VL cases, 79 were correctly diagnosed by rK39 giving a sensitivity of 83.1% [75.1–91.2]. The sensitivity dropped to 67.3 [52.7–82.0] in individuals with underlying HIV infection. Of the 602 negative samples (338 control subjects and 264 non-confirmed VL suspects), rK39 gave 1 false positive in a malaria patient.

DAT

The estimated sensitivity of DAT was 86.5% [80.5–92.5] for all 405 suspected VL patients. The sensitivity of DAT in HIV-negative VL suspects was 84.2% [76.3–92.1], rising to 91.3% [82.1–100.0] in individuals with underlying HIV infection. Of the 602 negative samples (338 control subjects and 264 non-confirmed VL suspects), DAT gave false positive results for 41 serum samples, including 2 individuals with malaria and two individuals with other parasitic infections.

IFAT

The estimated sensitivity of IFAT was 79.4% [72.4–86.4] for all 405 suspected VL patients. The sensitivity of IFAT in HIV-negative VL suspects was 84.2% [76.3–92.1] dropping to 79.4% [73.3–96.2] in VL suspects with HIV. Of the 602 negative samples (338 control subjects and 264 non-confirmed VL suspects), IFAT gave false positives for 2 non-confirmed VL suspects and 15 patients with Chagas disease.

Discussion

In this study, we assessed the sensitivity and specificity of rK39-ICT, DAT and IFAT on a varied set of historical serum samples collected in Spain from 2009–2015. The diagnostic performance of rK39-ICT and DAT has been largely evaluated in highly endemic country settings [12], with variable results in different geographic locations for rK39-ICT [21], and the performance in a European setting remains largely unknown. A multicenter study compared different diagnostic tests using samples from 26 HIV-negative and 11 HIV-positive VL patients from southern France [22]. This study evaluated a different rK39-ICT (IT-LEISH Bio Rad Laboratories, France) and DAT (the same as in our study), among other serological tests, and obtained a sensitivity of 88.5% for both in HIV-negative VL patients and 54.5% for DAT and 81.8% for rK39-ICT in HIV/VL patients. In a study from Italy with a sample size of 94 patients with suspected VL (21 patients were confirmed VL cases), the reported sensitivity of rK39-ICT was 52.4%, using a different manufacturer than in our study [23]. These results differed from our study, which are more in agreement with other large scale evaluations of rK39-ICT and DAT that show higher sensitivity for DAT in a setting with high HIV-co-infection rate [24].

The evaluation of diagnostic tools for visceral leishmaniasis in Europe is important as the burden of VL remains an issue for European public health officials [3]. We began addressing this issue using a large assembly of samples. Our results show lower sensitivity estimates when compared to published results on serological assay evaluation in South East Asia, the Americas and eastern Africa regions. In a meta-analysis of diagnostic performance, the combined sensitivity estimates of DAT and the rK39-ICT were 94.8% and 93.9%, respectively [25], while in our study, the estimated DAT and rK39-ICT sensitivity was at 86.5% and 78.0%, respectively. In a WHO led evaluation of rK39-ICT, the sensitivity estimates varied greatly from region to region: 67.6% in eastern Africa, 84.7% in Brazil and 99.6% on the Indian subcontinent [21].

The different performance of serological tests between European samples and those tested elsewhere is most likely due to the epidemiological landscape. Patients residing outside of Europe will have different anti-VL immunoglobulin titers, different age patterns of infection, immune and/or nutritional background and/or are exposed to higher parasite diversity [21]. A study analyzing L. donovani strains from African and Asian origin revealed extensive genetic diversity in coding sequences of rK39 homologues, which may provide an explanation for the different performance of rK39-ICT across regions [26]. In the Mediterranean region VL is caused by different genetic variants of L. infantum [27,28], whether this has an effect on the performance of rK39-ICT would be an interesting subject of study.

Our study sample reflects a population living in a southern European member state where samples are routinely submitted for laboratory diagnosis after clinical suspicion of VL. Of the 405 samples submitted between 2009 and 2015 and analyzed in this study, 34% were classified as cases. To expand our sample population and assess the performance of serological tests with respect to cross-reactivity, we further selected confirmed VL negative serum samples with varying immunological exposures, including Chagas disease, caused by another member of the Trypansomatidae family, as well as German and Belgian blood donors who are less likely to have had previous parasite exposure.

Although sensitivity and specificity varied between diagnostic tests, we found that the in house IFAT, rK39-ICT (Kalazar Detect from InBios International, Inc.) and DAT (ITM-DAT/VL, Institute of Tropical Medicine, Antwerp) are valid for VL diagnosis in Europe. The choice of test, however, is according to the epidemiological context and intended application. In the context of VL in Europe we find three main applications for serological tests: seroprevalence studies, clinical diagnosis and outbreak response tools.

Seroprevalence studies involve large-scale screening of samples to determine the burden of disease in a given population. Previous prevalence studies in Europe on blood donors have used different immunological and/or molecular tests [29-31]. Based on our results, we find DAT performed best for seroprevalence studies, with the ability to batch process samples, the acceptable costs, and the specificity and sensitivity values at 86% and 85%, respectively.

For clinical diagnosis, the choice of test depends partly on the immunological status of the patient. In our study, co-infection with HIV reduced the sensitivity of rK39-ICT, making it less applicable for a point-of-care test in HIV individuals in Spain. During the community outbreak of VL in Madrid, 16 out of 160 reported VL cases (10%) had HIV [5], and could therefore have been missed if rK39 was used as sole diagnostic. In a series of 73 VL patients (66% immunocompetent) from that outbreak, another rK39-ICT (SD BIOLINE Leishmania Ab, Standard Diagnostics, Inc., South Korea) showed 67% sensitivity and 100% positive predictive value [32]. To our surprise, in our study the DAT showed higher sensitivity in HIV-positive patients. Although a higher sensitivity in this group is somehow unexpected, it is important to highlight that DAT has returned acceptable sensitivity in the diagnosis of VL in HIV-positive patients, being superior to other serological tests [10,24,33-35]. It is difficult for us to find an explanation to this, and it could be suggested that the observed discrepancy may be due to the difference in the number of patients in each group; being only relevant for rK39-ICT (the only test using a single antigen), for which the different performance according to the HIV status is especially marked. A study specifically designed to assess differences in the diagnostic performance of the tests according to the HIV status would be necessary to address this properly. We did not conduct a separate analysis in patients with other immunosuppressive conditions as previous studies have shown that the diagnostic sensitivity of serological tests is not decreased in patients receiving solid organ transplants, which were 11 out of 12 of our suspected VL cases with immunosuppressive conditions other than HIV [36-38].

During outbreak settings such as those seen in Madrid in 2009–2013, point-of-care tests like rK39-RDT have the benefit of portability, simplicity and the speed of result, allowing quick identification and control of infection clusters. In our study we used all laboratory (PCR, culture, serology) and clinical results available from each patient to classify them as “case” or “non-case”. The reported sensitivities of the serological tests included in this study justify the algorithm proposed for VL diagnosis in the WHO European region, where rK39-ICT is first used in VL suspected cases and can be complemented with other serological or parasitological tests to ensure accurate diagnosis [3]. The rK39-ICT is a simple, fast, commercially available test that uses a less invasive sample. The application of this test for VL diagnosis and subsequent treatment of confirmed cases with liposomal amphotericin B, the reference treatment for VL in the WHO European Region [3], has shown to be cost-effective for Mediterranean VL management in Morocco [39].

In terms of cross reactivity, we found that all true negative serum samples from blood donors from Belgium, Germany and Spain were diagnosed as negative for VL by DAT and rK39-ICT. Some false positive results were obtained with Chagas disease patients and those with other parasitic infections, this was particularly pronounced for the IFAT, a widely used serological test for VL diagnosis in Europe. This can be explained by serological cross reactivity between trypanosomatids [40]. In order to account for this, other infections such as Chagas disease, malaria or other parasites should be routinely discarded to increase diagnostic accuracy. This is particularly important in diagnosing a patient who has resided in or visited a country endemic for other parasitic disease, such as is common in the Spanish migrant populations [41].

To the best of our knowledge this is the first large-scale evaluation of rK39-ICT and DAT for VL diagnosis in Europe. These results can inform public health practitioners in the region on the strengths and limitations of serological diagnosis. In addition to serology, however, PCR diagnosis should always be considered for confirmation of infection, and for the added benefit that molecular characterization brings.

Finding appropriate diagnostic solutions to VL is not only important to contain the burden of this Neglected Tropical Disease, but it will also help in the implementation of the United Nations Sustainable Development Goal of Universal Health Coverage [42].

STARD checklist.

Detailed list of items related to reporting of diagnostic accuracy studies.

(DOCX)

Click here for additional data file.

STARD workflow.

Details on the classification and workflow for testing samples in this study.

(PPTX)

Click here for additional data file.