Literature DB >> 34966976

Performance of bovine genital campylobacteriosis diagnostic tests in bulls from Uruguay: a Bayesian latent class model approach.

America Mederos1, Sébastien Buczinski2, Denise Galarraga3, Linda van der Graaf-van Bloois4.   

Abstract

The sensitivity (Se) and specificity (Sp) of three diagnostic tests for the detection of Campylobacter fetus venerealis (Cfv) using field samples were estimated using a Bayesian latent class model (BLCM), accounting for the absence of a gold standard. The tests included in this study were direct immunofluorescence antibody test (IFAT), polymerase chain reaction (PCR), and real-time PCR (RT-PCR). Twelve farms from two different populations were selected and bull prepuce samples were collected. The IFAT was performed according to the OIE Manual. The conventional PCR was performed as multiplex, targeting the gene nahE for C. fetus species identification and insertion element ISCfe1 for Cfv identification. The RT-PCR was performed as uniplex: one targeting the gene nahE for C. fetus and the other targeting the insertion ISCfe1 (ISC2) for Cfv. Results from the BLCM showed a median Se of 11.7% (Bayesian credibility interval (BCI): 1.93-29.79%), 53.7% (BCI: 23.1-95.0%), and 36.1% (BCI: 14.5-71.7%) for IFAT, PCR, and RT-PCR respectively. The Sp were 94.5% (BCI: 90.1-97.9%), 97.0% (BCI: 92.9-99.3%), and 98.4% (BCI: 95.3-99.7%) for IFAT, PCR, and RT-PCR respectively. The correlation between PCR and RT-PCR was positive and low in samples from both sampled population (0.63% vs 8.47%). These results suggest that diagnostic sensitivity of the studied tests is lower using field samples than using pure Cfv strains.
© 2021. The Author(s), under exclusive licence to Springer Nature B.V.

Entities:  

Keywords:  Beef cattle; Campylobacter fetus subspecies venerealis; Field samples; Latent class model

Mesh:

Year:  2021        PMID: 34966976      PMCID: PMC8716329          DOI: 10.1007/s11250-021-03039-w

Source DB:  PubMed          Journal:  Trop Anim Health Prod        ISSN: 0049-4747            Impact factor:   1.559


Introduction

Bovine genital campylobacteriosis (BGC) is a venereal disease affecting cattle herds. The causal agent is Campylobacter fetus (C. fetus) subspecies venerealis (Cfv). The main clinical sign of BGC is infertility, decreased pregnancy rates due to early embryonic death, and occasional abortions resulting in economic losses (Michi et al. 2016). In South America, BGC has been reported in Argentina, Brazil, Paraguay, and Uruguay (Campero 2000a; Foscolo et al. 2005; Repisso et al. 2005). Studies conducted in Argentina reported that the prevalence of Cfv at the farm level ranged from 9.8 to 15.3%, while at the animal level the prevalence of infected bulls ranged from 1 to 5% (Campero 2000a, b; Campero and Martínez 2010). In Uruguay, a survey conducted by Repisso et al. (2005) reported 37% and 28% C. fetus sp. prevalence for beef herds and bulls respectively. The diagnosis of BGC is by culture C. fetus isolates from preputial scrapings, cervical mucus or aborted fetus, and identification of the subspecies venerealis. The culture method is considered the golden standard and the prescribed diagnostic test for international trade (OIE 2017). However, there are many challenges to isolate Cfv from preputial samples. The micro-organism is slow-growing and requires strict micro-aerophilic conditions for growth and survival and lack sensitivity to detect infected bulls (García-Guerra et al. 2014). The direct immunofluorescent antibodies (IFAT) test is routinely applied, although it does not discriminate between subspecies venerealis and subspecies fetus. More recently, molecular tests have been developed as a promising fast and economic diagnostic tool for BGC detection, and C. fetus subspecies identification. At present, various PCR protocols are available in the published literature; some are targeting species C. fetus while others aim to differentiate subspecies Cfv and Cff (Abril et al. 2007; Hum et al. 1997; Tu et al. 2005; Wang et al. 2002). However, most of these published PCR protocols lack specificity or sensitivity to reliable classify C. fetus subspecies (van de Graaf-van Bloois et al. 2013). In the absence of an available golden standard test, it is difficult to determine unbiased estimates of new test’s accuracy if not accounting for reference standard test imperfection. Bayesian latent class methods (BLCMs) are useful to account for imperfect sensitivity and specificity of the reference standard tests. The BLCM approach is also a useful method since it incorporates some prior knowledge in the model that will therefore be updated with the new data that have been collected (McDonald and Hodgson 2018). The objective of this study was to evaluate the accuracy of three diagnostic tests (IFAT, conventional PCR, and RT-PCR) for the detection of C. fetus venerealis (Cfv) in field samples from beef bulls obtained from two different populations. We hypothesize that these tests have limited sensitivity in the day-to-day diagnosis of the disease BGC. To fulfill our objective, we developed a Bayesian LCM accounting for the absence of the gold standard test. This manuscript was elaborated following the Standards for the Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models (Kostoulas et al. 2017).

Materials and methods

Study population

A prospective study was designed and conducted between August 2014 and September 2016 in the Northern part of Uruguay. The samplings were conducted at two levels. The first was at the farm level and the second at the animal level. At the farm level, two populations of beef herds from extensive production systems were purposively selected based on relatively low (< 70%) or relatively high (> 85%) reproductive index (which positively correlates with pregnancy and calving rates), and history of absence or presence of BGC prior to the enrollment for the study. The criteria to categorize a farm having a low or high reproduction index were based on the Uruguayan National Livestock Registry (DIEA 2014) reporting an average pregnancy rate range between 65 and 76% for beef cattle during the last past 10 years. Population 1 (Pop 1) consisted of six farms with high pregnancy rate (> 80%) and a negative diagnosis of BGC using culture (Harwood et al. 2009; OIE 2017) and PCR (Abril et al. 2007; Hum et al. 2009). Population 2 (Pop 2) consisted of six farms with low pregnancy rates (< 70%) and high Cfv prevalence (> 10%) in bulls at the beginning of the study. Finally, at each farm, all bulls 2 years old and older were sampled using a bull scraping device (Tedesco et al. 1977). The bull samplings were performed before the breeding season, when the reproductive sound examination was performed and if the farmer agrees, 3 samplings per bull were conducted (10 to 15 days between each sampling). The samples were taken by veterinary practitioners following a specific protocol for ensuring sample quality. The research protocol was approved by the INIA ethics committee with the number 2015.41. Briefly, the scraping device was washed in 5-ml sterile PBS and after resting for 20 min, two 1-ml aliquots were taken from the supernatant: one for DNA extraction and other for IFAT. One drop of 10% formalin was added to the IFAT aliquot.

Laboratory tests

The IFAT was performed as described in the OIE manual (2017) and it is the routine diagnostic test for Cfv used in Uruguay. For the molecular tests, DNA was extracted using a commercial kit MagMax™ Pathogen RNA/DNA Kit (Applied Biosystems) designed for complex veterinary samples. The molecular test selection was based on having high sensitivity (Se) and specificity (Sp) according to published results. The setup and in-house validation of the molecular tests were performed using a set of reference strains and field isolates from aborted fetuses or bulls detected positive by the bacteriological culture at the Ministry of Agriculture Diagnostic Laboratory (DILAVE) in Uruguay. The reference strains provided by the Campylobacter reference laboratory were classified using MLST and the local strains were classified by phenotypical methods. Additionally, for RT-PCR, the cutoff for field samples was determined using samples from a population of negative bulls from free farms and samples from positive bulls that were considered Cfv-positive by culture method. The conventional PCR was performed as multiplex according to Abril et al. (2007) and modified by van der-Graaf et al. (2013), targeting the gene nahE for C. fetus species identification (Se = 100% and Sp = 100%) and insertion element ISCfe1 for Cfv identification (Se = 95% and Sp = 100% using DNA extracted from Campylobacter strains). The RT-PCR was performed following the protocols described by van de Graaf-van Bloois et al. (2013) with modification as uniplex for field samples, one reaction targeting the gene nahE specific for C. fetus, and other separate reaction targeting the insertion ISCfe1 (ISC2) for Cfv (Se = 100% and Sp = 98% for bacteriological cultures). When processing the field samples, the laboratory personnel were blind to the farm status.

Definition of test positivity classification

For IFAT, a sample that presented at least one fluorescent organism showing typical morphology of C. fetus was considered positive. The cutoff chosen to define a RT-PCR-positive result was a cycle threshold of (Ct) ≤ 32, corresponding to a detection limit of 2 × 10+3/µl for field samples. For conventional PCR, amplicons of 256 bp were considered specific for the target pathogen Cfv and 80 bp for Cf. A positive Cfv result was defined when amplicons of 256 bp and 80 bp were obtained. The data was included in the analysis if they have complete results for the three studied tests: direct immunofluorescence antibody test (IFAT), conventional polymerase chain reaction (PCR), and quantitative real-time PCR (RT-PCR). The Cohen’s kappa test was used to estimate the agreement between tests using STATA/IC 16.1 (2019).

Statistical analysis

The target condition was an infection of the bull by Cfv. This status was defined as latent since none of the diagnostic tests used could be considered a gold standard test.

Latent class model

We used a two-population and three-test latent class model approach. The two populations were a priori considered having different prevalence of infection due to their different reproductive indices and previous Cfv farm status. For the molecular tests, a conditional dependence was a priori modeled since they were based on the same biological phenomenon (i.e., detection of DNA) and performed using the same samples. The probabilities of each test result combination for the two populations were modeled using a multinomial distribution as previously mentioned (Branscum et al. 2005), based on test results probability patterns (immunofluorescence (IF), PCR, and RT-PCR) (Table 1).
Table 1

Description of the probabilities of the three test results in two populations

Probability of specific test resultsFull probability according to the three tests accuracy
P(IF + , PCR + , RTPCR +) = p*SeIF*(SePCR*SeRTPCR + covDp) + (1 − p)*(1 − SpIF)*((1 − SpPCR)*(1 − SpRTPCR) + covDn)
P (IF + , PCR + , RTPCR −)p*SeIF*(SePCR*[1 − SeRTPCR] − covDp) + (1 − p)*(1 − SpIF)*((1 − SpPCR)*SpRTPCR − covDn)
P(IF + , PCR − , RTPCR +)p*SeIF*((1-SePCR)*SeRTPCR − covDp) + (1 − p)*(1 − SpIF)*(SpPCR*(1 − SpRTPCR) − covDn)
P(IF + , PCR − , RTPCR −)p*SeIF*((1 − SePCR)*(1 − SeRTPCR) + covDp) + (1 − p)*(1 − SpIF)*(SpPCR*SpRTPCR + covDn)
P(IF − , PCR + , RTPCR +)p*(1 − SeIF)*(SePCR*SeRTPCR + covDp) + (1 − p)*SpIF*((1 − SpPCR)*(1 − SpRTPCR) + covDn)
P(IF − , PCR + , RTPCR −)p*(1 − SeIF)*(SePCR*(1 − SeRTPCR) − covDp) + (1 − p)*SpIF*((1 − SpPCR)*SpRTPCR − covDn)
P(IF − , PCR − , RTPCR +)p*(1 − SeIF)*((1 − SePCR)*SeRTPCR − covDp) + (1 − p)*SpIF*(SpPCR*(1 − SpRTPCR) − covDn)
P(IF − , PCR − , RTPCR −)p*(1 − SeIF)*((1 − SePCR)*(1 − SeRTPCR) + covDp) + (1 − p)*SpIF*(SpPCR*SpRTPCR + covDn)

P probability, IF immunofluorescence antibody test, PCR polymerase chain reaction, RT-PCR real-time PCR, Se sensitivity, Sp specificity, covDp covariance among infected bulls, covDn covariance among non-infected bulls

Description of the probabilities of the three test results in two populations P probability, IF immunofluorescence antibody test, PCR polymerase chain reaction, RT-PCR real-time PCR, Se sensitivity, Sp specificity, covDp covariance among infected bulls, covDn covariance among non-infected bulls The same approach was used for both populations assuming a different prevalence (p) (low vs high prevalence population) as well as a constant sensitivity and specificity across low and high prevalence population. The covariances between the two PCR tests were modeled as previously described (Dendukuri and Joseph 2001). The covariance among infected bulls (covDp) and non-infected bulls (covDn) was expressed as uniform distributions with specific bounds as follows: covDp ~ dUniform(0, min(SePCR, SeRTPCR)-SePCR*SeRTPCR). covDn ~ dUniform(0, min(SpPCR, SpRTPCR)-SpPCR*SpRTPCR).

Prior specification

Three experts were questioned a priori on the expected prevalence of infection in the two different populations. Beta distributions were obtained from best guesses and values, and the experts were 95% sure that the true value was below, using the PriorGen package from R (Kostoulas 2018). These priors were used in the main model (Model 1) and the best guess estimate of prevalence in the low risk herds was 10%, being 95% sure that the true value was below 20% (Beta (3.09, 27.79)). For the high-risk population, the best guess estimate was 40% being 95% sure it was lower than 70% (Beta (2.84, 4.25)). Some prior information was also available in the literature on the performance of the tests to detect Cfv using field samples (Se/Sp for IFAT and Sp for PCR and RT-PCR) (García-Guerra et al. 2014). The SeIF (IFAT) best guess was 70%, being 95% sure it was more than 10% (Beta (1.38, 1.16)), the best guess for SpIFAT was 80%, being 95% confident than it was higher than 50% (Beta (6.55, 2.64)). Since PCR and RT-PCR tests were anticipated to be highly specific, the best guesses for SpPCR and SpRT-PCR were 95% being 95% sure it was higher than 80% (Beta (21.2, 2.06)).

Model implementation

All the models were implemented in OpenBUGS (Lunn et al. 2009) using the R interface R2WinBUGS (Sturtz et al. 2005). Three chains with difference in its starting points were run for all modeling approaches. An initial burn-in of 50,000 iterations was a priori defined to ensure convergence of chains for posterior sampling. Thinning was adapted when needed for limiting autocorrelation between iterations when observed. The posteriors were derived from a total of 50.000 iterations. The deviance information criterion (DIC) was calculated as a general indicator of model fit. Convergence of the chains was visually checked and assessed using the Gelman Rubin diagnostic.

Sensitivity analyses

To determine the impact of the prior on the posterior densities, two additional models were ran using weakly informative priors on the prevalence or for the tests Se and Sp (Depaoli et al. 2020; Natesan Batley and Hedges 2021; Paradis et al. 2012). In model 2, we used relaxed estimates for the prevalence in the two populations. The same best guesses for both prevalences were used (10% and 40% for populations 1 and 2 respectively) but with a larger spread around the best guess than in the initial model (upper bound to 50% for the low-risk population and lower bound of 10% for the higher risk population). The same priors as model 1 were used for all test sensitivities and specificities. Finally, in model 3, we used informative priors used in model 1 for the prevalence with all non-informative priors for test sensitivities and specificities (Beta (1, 1)).

Results

The final database was obtained from 12 extensive beef farms and consisted of 156 and 111 bulls’ samples for Pop 1 and Pop 2, respectively. The main breeds were British (n = 9) and Continental (n = 3) breed cattle. The mean herd size was 493 breeding animals and varied from 140 to 1070 breeding cows and 3 to 35 bulls. For Pop 1, 3.03%, 1.5%, and 0.0% of the samples were positive for IFAT, PCR, and RT-PCT, respectively, and for Pop 2, 10.0%, 20.6%, and 12.4% of the samples were positive for IFAT, PCR, and RT-PCR, respectively. Table 2 presents the cross-classified data of the results for the three studied tests applied simultaneously to all samples, divided by population and sampled farms.
Table 2

Cross-tabulated results of immunofluorescence antibodies (IFAT), PCR, and real-time PCR (RT-PCR) for the detection of Campylobacter fetus venerealis, performed on 267 bulls from 12 farms from two populations defined as low prevalence (population 1) and high prevalence (population 2)

Farm noIFAT + , PCR + , RT-PCR + IFAT + , PCR + , RT-PCR-IFAT + , PCR-, RT-PCR + IFAT + , PCR-, RT-PCR-IFAT-, PCR + , RT-PCR + IFAT-, PCR + , RT-PCR-IFAT-, PCR-, RT-PCR + IFAT-, PCR-, RT-PCR-Total
Population 1
  4000002024
  8000000033
  900030008184
  1000000001212
  11000000044
  12000000099
  Total0003020111116
Population 2
  101001511018
  2000000044
  3000001146
  500000101314
  600069003449
  7000100001
  Total010710726592
Cross-tabulated results of immunofluorescence antibodies (IFAT), PCR, and real-time PCR (RT-PCR) for the detection of Campylobacter fetus venerealis, performed on 267 bulls from 12 farms from two populations defined as low prevalence (population 1) and high prevalence (population 2) Results from the Cohen’s kappa test demonstrated a moderate agreement between PCR and RT-PCR (kappa = 0.60; p = 0.000). There was not agreement between IFAT and the molecular tests.

Main informative model results

The beta prior’s distribution for Se, Sp, and prevalence for the models are presented above. The mean estimates for sensitivity and specificity along with 95% credible interval (BCI) for IFAT, PCR, and RT-PCR for the three models are given in Table 3 and Fig. 1. A small positive correlation between truly non-infected bulls (covDn) was observed for PCR and RT-PCR tests, and no specific covariance could be detected among infected bulls between the same two tests since the 95% BCI included zero.
Table 3

Prior densities and mean posterior estimates (95% Bayesian credibility interval) of sensitivity (Se) and specificity (SP) of IFAT, PCR, and RT-PCR for Campylobacter fetus venerealis detection in bulls. Informative model for two population and three tests

ParameterModels
Main model: informative model(Model 1)aMid-informative for prevalence(Model 2)bNon-informative for test accuracy(Model 3)c
Prior densitiesPosterior estimatesdPrior densitiesdPosterior estimatesdPrior densitiesPosterior estimatesd
Se-IFAT (%)β (1.38, 1.16)12.8 (1.93–29.79)β (1.38, 1.16)13.0 (1.59–31.78)β (1, 1)112.0 (1.3–28.3)
Se-PCR (%)β (1, 1)56.2 (23.17–95.09)β (1, 1)68.0 (29.0–97.3)β (1, 1)53.6 (22.6–93.5)
Se-RT-PCR (%)β (1, 1)38.7 (14.54–71.71)β (1, 1)49.0 (19.3–82.4)β (1)36.6 (14.2–69.8)
Sp-IFAT (%)β (1, 1)94.5 (90.18–97.94)β (1, 1)94.2 (90.0–97.4)β (1, 1)95.4 (90.0–99.0)
Sp-PCR (%)β (21.2, 2.06)97.0 (92.96–99.38)β (21.2, 2.06)96.4 (92.6–98.9)β (1, 1)97.6 (93.5–99.8)
Sp-RT-PCR (%)β (21.2, 2.06)98.2 (95.31–99.76)β (21.2, 2.06)98.3 (95.5–99.7)β (1, 1)98.9 (96.2–99.9)
Pi 1 (%)β (3.09, 27.79)3.9 (0.78–9.82)β (1, 1)0.3 (0.00–2.6)β (3.09, 27.79)4.1 (0.84–10.4)
Pi 2 (%)β (2.84, 4.25)34.7 (14.94–66.88)β (1, 1)27.3 (12.1–58.0)β (2.84, 4.25)37.7 (16.3–70.0)
CovDpe0.077 (− .0373–0.1678)0.054 (− 0.05–0.16)0.079 (− .03–0.17)
CovDnf0.0087 (0.00–3,07)0.008 (0.00–0.029)0.004 (0.00–0.022)
DIC40.337.638.0

IFAT immunofluorescence antibodies, PCR polymerase chain reaction, RT-PCR real-time PCR, DIC deviance information criterion

aPriors: P1 (prevalence) mean = 10.0, 95th = 20.0; P2 mean = 40.0, 95th = 70.0; SeIFAT mean = 70.0, 95th =  > 10.0; SpIFAT = 80.0; 95th =  > 50.0; SpPCR and RT-PCR mean = 95.0; 95th =  > 80.0

bPrior: P1 (prevalence) mean = 10.0, 95th = 50.0,; P2 mean = 40.0, 2.5th = 10.0; SeIFAT mean = 70.0, 95th =  > 10.0; SpIFAT = 80.0; 95th =  > 50.0; SpPCR and RT-PCR mean = 95.0; 95th =  > 80.0

cPriors: P1 (prevalence) mean = 10.0, 95th = 20.0; P2 mean = 40.0, 95th = 70.0

dPosteriors estimates are expressed as percentage for all variables but covDp and covDn, along with 95% Bayesian credibility intervals

eCovariance among positive population = covDp ~ dUniform(0, min(SePCR, SeRTPCR)-SePCR*SeRTPCR)

fCovariance among negative population = covDn ~ dUniform(0, min(SpPCR, SpRTPCR)-SpPCR*SpRTPCR)

Fig. 1

Presentation of the 95% percent credible intervals of posterior densities of test accuracies for the detection of bovine genital campylobacteriosis infection in Uruguayan bulls. The shaded area represents the 95% Bayesian credible intervals. The median estimate is also indicated as a thick line for the tests sensitivities (A) and specificities (B)

Prior densities and mean posterior estimates (95% Bayesian credibility interval) of sensitivity (Se) and specificity (SP) of IFAT, PCR, and RT-PCR for Campylobacter fetus venerealis detection in bulls. Informative model for two population and three tests IFAT immunofluorescence antibodies, PCR polymerase chain reaction, RT-PCR real-time PCR, DIC deviance information criterion aPriors: P1 (prevalence) mean = 10.0, 95th = 20.0; P2 mean = 40.0, 95th = 70.0; SeIFAT mean = 70.0, 95th =  > 10.0; SpIFAT = 80.0; 95th =  > 50.0; SpPCR and RT-PCR mean = 95.0; 95th =  > 80.0 bPrior: P1 (prevalence) mean = 10.0, 95th = 50.0,; P2 mean = 40.0, 2.5th = 10.0; SeIFAT mean = 70.0, 95th =  > 10.0; SpIFAT = 80.0; 95th =  > 50.0; SpPCR and RT-PCR mean = 95.0; 95th =  > 80.0 cPriors: P1 (prevalence) mean = 10.0, 95th = 20.0; P2 mean = 40.0, 95th = 70.0 dPosteriors estimates are expressed as percentage for all variables but covDp and covDn, along with 95% Bayesian credibility intervals eCovariance among positive population = covDp ~ dUniform(0, min(SePCR, SeRTPCR)-SePCR*SeRTPCR) fCovariance among negative population = covDn ~ dUniform(0, min(SpPCR, SpRTPCR)-SpPCR*SpRTPCR) Presentation of the 95% percent credible intervals of posterior densities of test accuracies for the detection of bovine genital campylobacteriosis infection in Uruguayan bulls. The shaded area represents the 95% Bayesian credible intervals. The median estimate is also indicated as a thick line for the tests sensitivities (A) and specificities (B)

Sensitivity analysis

Table 3 presents the results for the estimated parameters for non-informative priors for prevalence and non-informative for prevalence and Se and Sp, respectively. The overlaying posterior densities of accuracy estimates of model 1 vs model 2 and model 1 vs model 3 are presented in Fig. 2A and B respectively.
Fig. 2

A, B Overlaying of median estimates, 50 and 95% Bayesian credible intervals of the main model and models used for sensitivity analysis of test accuracies for the detection of bovine genital campylobacteriosis infection in Uruguayan bulls. The estimates interval width for Se/Sp of the 3 tests used for detection of bovine genital campylobacteriosis infection in Uruguayan bulls is represented in the upper line, versus model 2 estimates (lower line, panel A) and model 3 (lower line, panel B). The thick and thin line of the range indicate the 50th and 95th Bayesian credible interval range. The dot is indicating the median estimate. For model prior specification, see Table 2

A, B Overlaying of median estimates, 50 and 95% Bayesian credible intervals of the main model and models used for sensitivity analysis of test accuracies for the detection of bovine genital campylobacteriosis infection in Uruguayan bulls. The estimates interval width for Se/Sp of the 3 tests used for detection of bovine genital campylobacteriosis infection in Uruguayan bulls is represented in the upper line, versus model 2 estimates (lower line, panel A) and model 3 (lower line, panel B). The thick and thin line of the range indicate the 50th and 95th Bayesian credible interval range. The dot is indicating the median estimate. For model prior specification, see Table 2

Discussion and conclusion

In this work, we studied the sensitivity and specificity of diagnostic tests for Cfv using field samples. Due to the absence of a highly sensitive gold standard, we applied a Bayesian latent class model to analyze the Se and Sp of the studied tests. The scope of the study was not to model posterior parameters for prevalence. The results presented above indicated low sensitivity of the tests when applied to samples obtained directly from bulls. Results from all models estimated that RT-PCR has higher specificity to detect non-infected bulls with Cfv; however, conventional PCR has higher Se to detect Cfv from field samples. Our posterior findings were under the a priori classification of the two populations. The sensitivity analysis did not reveal large differences between the models since the mean estimates of the mid-informative models were included in the 95% BCI of the main model. The DIC difference between the models was lower than the 3–5 range which is generally considered a minimal difference to determine if a model is better than another (Adrion and Mansmann 2012). Interestingly, despite the convergence of the models, the sensitivity of PCR tests had a wide posterior distribution. Therefore, a wide uncertainty was observed for this parameter. However, both PCR and RT-PCR tests had a higher sensitivity than the IFAT test. When studying diagnostic Se and Sp, we follow the assumption that these parameters do not dependent on disease prevalence. However, some authors in the medical field suggest that test accuracy is dependent on population characteristics which also include prevalence characteristics (Leeflang et al. 2013). A lower prevalence means a narrower spectrum of disease manifestation which may impact the accuracy of the diagnostic tests employed. The test accuracy may also depend on possible unmeasured covariates among sampled populations as extensively discussed (Wang et al. 2017). Unfortunately, due to the relatively low number of infected bulls in Pop 2, and limited clinical information on the samples used, we could not explore this hypothesis. We cannot rule out that a specific unmeasured covariate could interfere with PCR sensitivity in our study. This could be a possible explanation of the wide credible interval observed for this parameter. As described above, we have selected two independent population of herds, one having a high and other having a low probability of being infected. However, in the infected herds, not all the bulls are positive since they became more susceptible with the age. This aspect introduces complexity to find populations for estimating the diagnostic sensitivity using imperfect tests classification. The work conducted by García-Guerra et al. (2014) used bull field samples to study several Cfv diagnostic test performance. Their results reported a Sp for RT-PCR lower than our study (85.0% vs 98.4%), but higher Se than our study (85.4% vs 36.1%) using artificially challenged bulls (n = 13) that were repeatedly sampled. Therefore, this result could not be extrapolated to field situations where naturally disease occurs, and particularly with lower bacteria load difficult to diagnose. A systematic review-meta-analysis conducted by us (data unpublished) identified four publications using IFAT to detect Cfv on field samples using bacteriological culture as reference test. From these studies, the estimated mean sensitivity was 77.8% (range: 43.7–99.7%), and mean specificity was 84.5% (range: 71.4–95.1%) (Cipolla et al. 1994; García-Guerra et al. 2014; Rocha et al. 2009; Ruckerbauer et al. 1974). Two studies describing PCR as index test and bacteriological culture as reference standard presented a mean Se of 93.6% (range: 87.5–99.8%) and mean Sp of 88.4% (range: 77.6–99.0%) for PCR (Groff et al. 2010; Schmidt et al. 2010). Another constraint that can affect the sensitivity of the diagnostic tests, particularly molecular ones, is that the field samples obtained from bull prepuce can be contaminated with dust, fecal material, and other microorganisms. Molecular tests are more efficient in detecting a low amount of the desired pathogens, although they are also very prone to inhibition by sample contaminants. The results from our BLCM suggest the complexity of Cfv detection using field samples, mainly bull scrapes, and highlight the difficulties in defining appropriately the study populations for diagnostic test accuracy. Increasing the sample size could improve the results, although the number of bulls per farm is limited. Repeated sampling of the same bulls over a specific timeframe could increase the chances of finding evidence of infection, although it will add more complexity to the models due to dependence. Latent class models allow estimating diagnostic test accuracy in the absence of a gold standard. Knowing the sensitivity and specificity of the tests could allow using more than one test in parallel (assuming conditional independence or accounting for dependence between the results) to increase Se, particularly in those herds where Cfv is suspected to be present.
  5 in total

Review 1.  Variation of a test's sensitivity and specificity with disease prevalence.

Authors:  Mariska M G Leeflang; Anne W S Rutjes; Johannes B Reitsma; Lotty Hooft; Patrick M M Bossuyt
Journal:  CMAJ       Date:  2013-06-24       Impact factor: 8.262

2.  STARD-BLCM: Standards for the Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models.

Authors:  Polychronis Kostoulas; Søren S Nielsen; Adam J Branscum; Wesley O Johnson; Nandini Dendukuri; Navneet K Dhand; Nils Toft; Ian A Gardner
Journal:  Prev Vet Med       Date:  2017-01-12       Impact factor: 2.670

3.  Understanding the effects of conditional dependence in research studies involving imperfect diagnostic tests.

Authors:  Zhuoyu Wang; Nandini Dendukuri; Lawrence Joseph
Journal:  Stat Med       Date:  2016-10-11       Impact factor: 2.373

4.  Bayesian estimation of the diagnostic accuracy of a multiplex real-time PCR assay and bacteriological culture for 4 common bovine intramammary pathogens.

Authors:  M-È Paradis; D Haine; B Gillespie; S P Oliver; S Messier; J Comeau; D T Scholl
Journal:  J Dairy Sci       Date:  2012-09-12       Impact factor: 4.034

5.  Vibriosis: demonstration of Vibrio fetus and Vibrio bubulus organisms in preputial fluid by immunofluorescence and cultural techniques.

Authors:  G M Ruckerbauer; K Malkin; D Mitchell; P Boulanger
Journal:  Can J Comp Med       Date:  1974-07
  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.