Accuracy of Tests for Diagnosis of Animal Tuberculosis: Moving Away from the Golden Calf (and towards Bayesian Models)

Gomez-Buendia, Alberto; Pozo, Pilar; Picasso-Risso, Catalina; Branscum, Adam; Perez, Andres; Alvarez, Julio

doi:https://doi.org/10.1155/2023/7615716

Transboundary and Emerging Diseases

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions Data Availability Ethical Approval Conflicts of Interest Authors’ Contributions Acknowledgments Supplementary Materials References Copyright Related Articles

Review Article | Open Access

Volume 2023 | Article ID 7615716 | https://doi.org/10.1155/2023/7615716

Accuracy of Tests for Diagnosis of Animal Tuberculosis: Moving Away from the Golden Calf (and towards Bayesian Models)

Alberto Gomez-Buendia,¹Pilar Pozo,¹Catalina Picasso-Risso,^2,3Adam Branscum,⁴Andres Perez,²and Julio Alvarez^1,5

Academic Editor: Andrew Byrne

Received21 Oct 2022

Revised17 Jan 2023

Accepted18 Jan 2023

Published21 Feb 2023

Abstract

The last decades have seen major efforts to develop new and improved tools to maximize our ability to detect tuberculosis-infected animals and advance towards the objective of disease control and ultimately eradication. Nevertheless, there is still uncertainty regarding test performance due to the wide range of specificity and especially sensitivity estimates published in the scientific literature. Here, we performed a systematic review of the literature on studies that evaluated the performance of tuberculosis diagnostic tests used in animals through Bayesian Latent Class Models (BLCMs), which do not require the application of a (fallible) reference procedure to classify animals as infected with tuberculosis or not. BLCM-based sensitivity and specificity estimates deviated from those obtained using a reference procedure for certain antemortem tests: an overall lower sensitivity of skin tests and serology and a higher sensitivity of interferon-gamma (IFN-γ) assays was reported. In the case of postmortem diagnostic tests, sensitivity estimates from BLCMs were similar to estimates from studies based on other methodologies. For specificity, the range of BLCM-based estimates was narrower than those based on a reference test, reaching values close to 100% (but lower in the case of IFN-γ assays). In conclusion, Bayesian methods have been increasingly applied for the evaluation of tuberculosis diagnostic tests in animals, yielding results that differ (sometimes substantially) from previously reported test performance in the literature, particularly for in vivo tests and sensitivity estimates. Newly developed models that allow adjustment for relevant factors (e.g., age, breed, region, and herd size) can contribute to the generation of more unbiased estimates of test performance. Nevertheless, although BLCMs for tuberculosis do not require the use of an imperfect reference procedure and are therefore not influenced by its limited performance, they require careful implementation, and transparent systematic reporting should be the norm.

1. Introduction

Bovine tuberculosis (bTB) is one of the most important diseases affecting cattle worldwide [1]. Because of its importance, over 636 million euros were invested between 2007 and 2020 in member states of the European Union on national bTB eradication, control, and surveillance programmes [2]. However, the disease is still endemic in several of the contributing member states [3, 4].

One of the main issues associated with the lack of success of eradication programs is the limited performance of bTB diagnostic tests [1, 5]. A recently published meta-analysis showed that estimates of specificity and particularly sensitivity are highly variable; for example, the median sensitivity for the single intradermal comparative cervical tuberculin skin test (SICCT) with standard interpretation reported in this study was 0.50, and was accompanied by a very wide 95% posterior interval (0.26–0.75) [6]. Low sensitivity is problematic since false negative-infected but undetected-animals that are not removed early may perpetuate the disease in a herd. However, false positive animals can be a major issue as well since although reported median specificity estimates for most tests are in general high (above 88%) [6], in scenarios with relatively low prevalence (as in most European regions), the positive predictive value of tests is necessarily low; thus, a limited specificity can lead to the unnecessary culling of noninfected animals and restriction of movements in a herd, undermining the confidence of stakeholders, and increasing the costs associated with the eradication program due to compensations for culled livestock paid by national governments.

The large variability observed in the sensitivity and specificity estimates of bTB diagnostic tests may be due to the wide disparity in study designs, particularly regarding the gold standard reference procedure used to classify an animal as infected or not. Ideally, a gold standard reference must be infallible (sensitivity and specificity equal to 100%). However, this is particularly unrealistic in the case of bTB, since all currently available diagnostic tests have important limitations in their ability to accurately detect infected animals. For instance, bacteriological culture, the most widely used reference procedure in the literature, can have perfect specificity (100%) but typically has low sensitivity, particularly in the early stages of disease [7]. In this context, the use of Bayesian Latent Class Models (BLCMs), which are not based on the comparison of a test result to a reference test, is particularly well suited [8–10]. Still, to date the number of studies that have used BLCMs for estimating the performance of bTB diagnostic tests is much lower than those based on an (imperfect) gold standard.

We conducted a systematic review of the scientific literature to identify studies that used BLCMs to estimate parameters of test accuracy for TB diagnostic techniques in the absence of a gold standard. Our specific aims were: (i) to describe the models and methodologies applied and quality of reporting in this field using published guidelines [11], (ii) to compare estimates of sensitivity and specificity obtained for different diagnostic tests, different species, and with different prior distributions, and (iii) to identify future opportunities to help establish the performance of diagnostic tests currently used in the field in different countries.

2. Materials and Methods

2.1. Systematic Review and Data Extraction

The literature search review was conducted according to the guidelines in PRISMA [12] and MOOSE [13], and carried out in the search engines PubMed (MEDLINE), Web of Science (WOS), and Scopus on the 14^th of March of 2022. The aim was to retrieve studies that assessed the accuracy of diagnostic tests for detection of tuberculosis in livestock or wildlife based on the use of BLCMs in the absence of a gold standard. The search strings used in each database were as follows:(i)(Animal OR Animals [MeSH]) AND (Bayes Theorem [MeSH] OR “Bayesian”) AND (“Mycobacterium tuberculosis complex” OR “Mycobacterium bovis” OR “Mycobacterium caprae” OR “bovine tuberculosis” OR “Tuberculosis, Bovine” [MeSH]) (PubMed)(ii)TS = (Animal AND Bayes AND (“Mycobacterium tuberculosis complex” OR “Mycobacterium bovis” OR “Mycobacterium caprae” OR bovine tuberculosis)) (WOS)(iii)TITLE-ABS-KEY (animal AND Bayes AND (“Mycobacterium tuberculosis complex” OR “Mycobacterium bovis” OR “Mycobacterium caprae” OR tuberculosis)) (Scopus).

Articles retrieved from each search were exported to a spreadsheet and duplicates were removed. The title and abstract of the remaining articles were screened by two authors (AGB and JA) according to the inclusion and exclusion criteria in Table 1.

References that did not fulfil these criteria according to both reviewers were removed. If there was a disagreement between the reviewers, a third author (PP) made the final decision.

In a second stage, the full text of the remaining references was reviewed by one author (AGB), for the extraction of the following information:(i)Year of publication(ii)Place where the study was conducted (where the population under study was located)(iii)Host species tested(iv)Sample size(v)Test(s) evaluated, cut-off points used, and kit where applicable(vi)Statistical model used (number of populations and tests, see below) and assumptions about the conditional independence or dependence between test results(vii)Statistical software used for Bayesian analysis(viii)Prior distributions used and source of information for their construction (where applicable)(ix)Posterior estimates for sensitivity and specificity and (when performed) prevalence(x)Use of sensitivity analysis to assess the impact of prior assumptions

The BLCMs used in each study were classified following the methodology proposed by [14] according to the number of tests applied (one, two, etc.), the number of populations under study (one, two, etc.), and whether the test results were assumed to be conditionally independent or dependent. Certain articles included the application of more than one BLCM (or the independent analysis of more than one population/test), in which case they were subdivided into several “trials” (i.e., independent analyses leading to independent results for a given population/test).

All relevant references cited in the reviewed articles were also screened following the same process. The flow of information for the different phases of the systematic review is shown in Figure 1.

In order to compare the estimates of different TB tests, an average posterior median (APM) and average 95% posterior probability interval (APPI), considering all median and lower and upper bounds for the 95% PPIs reported for each test, were calculated. To evaluate the relationship between prior and posterior distributions, the Spearman correlation coefficient between their 95% probability interval widths (PIWs) was calculated. For this, 95% prior PIWs were obtained by generating 100.000 random numbers from their beta distributions. The PIWs of the posterior distributions were calculated using the “epi.betabuster” function from the R package “epiR” [15] using the median and 5% percentile reported in the studies. Further, the degree of similarity between prior and posterior distributions was measured by estimating the percentage of overlap between the distributions using an in-house overlap function in R [16] (Supplementary Material 1). In addition, the Spearman correlation coefficient between the 95% posterior PIW and the sample size was calculated. All statistical analyses were performed in R [16].

2.2. STARD-BLCM Guidelines

Articles were assessed against the Standards for the Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models (STARD-BLCM [11], https://www.equator-network.org/reporting-guidelines/stard-blcm/). The STARD-BCLM guidelines consist of an extension of the original STARD-checklist [17] developed to facilitate complete and transparent reporting of diagnostic accuracy studies based on BLCMs in the absence of a gold standard. Three authors (AGB, CPR, and PP) evaluated in parallel each of the full texts selected in the literature review to determine whether they met each of the standards described in the checklist. When there was a disagreement, the options were discussed, and a consensus decision was reached.

3. Results

A total of 239 references were identified using the search engine programs (PubMed: n = 84; WOS: n = 74; Scopus: n = 81). Additionally, one European Food Safety Authority (EFSA) scientific opinion was included in the review, leaving 127 records after duplicates were removed.

After the first screening, 99 records were excluded because they discussed topics or were focused on populations not related with the objective of this review (animal movement and within and between-herds transmission models [n = 21, 21.2%], Mycobacterium tuberculosis complex genomics [n = 18, 18.2%], diagnostic test evaluation for other mycobacterial species [n = 13, 13.1%], Bayesian models for drug development against TB [n = 11, 11.1%], diagnostic tests for TB in humans [n = 9, 9.1%], spatial-temporal variations in animal TB [n = 9, 9.1%], new statistical methods for the evaluation of diagnostic tests within a Bayesian context [n = 5, 5.1%], and 13 other reasons affecting one article each [n = 13, 13.1%]).

Out of the 28 articles with the full text reviewed, three were discarded: two described the use of Bayesian models for a purpose other than the assessment of sensitivity and specificity in the absence of a gold standard [18, 19], and the third evaluated a novel BLCM by using TB as an example and not as the subject of study [20]. Consequently, 25 articles (19.7% out of the references initially found) were included in the systematic review.

The characteristics of the studies included in the systematic review are presented in Table 2. All 25 studies were published after January 2009 and originated from Europe (n = 11, 44%), North and South America (n = 6, 24.0%), Africa (n = 4, 16.0%), or Asia (n = 4, 16.0%). Most studies (n = 19, 76.0%) were focused on cattle, while the remaining were based on the analysis of wildlife (wild boar, badger, bison, meerkat, and elk) and swine.

Approximately two-thirds of the studies considered either only antemortem (n = 12, 48.0%) or postmortem tests (n = 5, 20.0%), whereas eight studies assessed the performance of both antemortem and postmortem tests (32.0%).

The antemortem tests evaluated in the studies were typically skin and serology-based tests (assessed in 13 articles each, 65.0% of the 20 studies considering antemortem tests) and IFN-γ assays (n = 11, 55.0%). Postmortem tests included direct polymerase chain reaction (PCR) tests (n = 10, 76.9% of the 13 studies considering postmortem tests), bacteriological culture (n = 9, 69.2%), meat inspection (n = 5, 38.5%), histopathological examination (n = 2, 15.4%), or a combination of culture and meat inspection (n = 1, 7.7%).

Bayesian modelling was typically implemented using WinBUGS (13/25, 52.0%), with the remaining studies using OpenBUGS (n = 7, 28.0%) or JAGS (n = 5, 20.0%). Priors for the sensitivity and specificity of each test under evaluation were generally based on previous literature (13, 52.0% of all the studies) or a combination of previously published estimates with expert opinion (7, 28.0%), while weakly informative priors were used for all tests evaluated in the remaining five (20.0%) studies. In 12 articles (48.0%), diffuse priors (uniform (0, 1) distributions) were used for the sensitivity and/or specificity of at least one test. Eighteen articles (72.0%) included a sensitivity analysis based on the replacement of informative priors by diffuse priors to assess the impact of prior selection as an additional analytic step.

Multiple studies (15, 60.0%) included more than one analysis (e.g., different models applied in different populations/tests), and therefore the 25 articles were divided into 71 trials. Among them, over two-thirds (49, 69.0%) considered conditional dependence between test results. Out of these, more than two-thirds (32/49, 65.3%) assessed the use of a skin test and an IFN-γ assay in parallel and based the assumption of conditional dependence on the consideration that both tests are designed to detect a cell-mediated immune response.

3.1. Antemortem Tests

The 264 Bayesian estimates of the performance of antemortem TB diagnostic tests extracted from the studies selected in the literature review are summarized in Table 3. One hundred and sixty (71.4%) of these estimates were obtained using BLCMs with informative priors. The posterior estimates for the sensitivity of skin purified protein derivative (PPD)-based tests had a wide range of values, varying between 40.0% and 93.0% (Figure 2). The highest APM sensitivity estimate (72.9%) among the skin-based tests was obtained for the caudal fold test (CFT). When only studies in cattle were considered, the APM for the sensitivity of CFT was similar (73.3%; 95% APPI: 58.3–89.4%). For specificity, overall the cervical skin tests had an APM of 99.2% (95% APPI: 98.7–99.5%), in contrast to CFT, which had the lowest APM (78.7%, 95% APPI: 64.3–94.1%).

Posterior estimates of the sensitivity and specificity of IFN-γ tests were highly variable depending on the kit used. BOVIGAM™ TB Kit (BOVIGAM) yielded a much higher estimated sensitivity compared to the ID Screen® Ruminant IFN-γ (IDVet, evaluated in just one study) and, in contrast, had a lower estimated specificity. Most of the APM sensitivity estimates for IFN-γ tests were higher than for skin tests, except for the only study assessing the performance of the IDVet test [21]. However, the APM estimates of specificity for IFN-γ tests were lower than those for skin tests (Figure 2).

In the case of serology-based tests, a wide range of estimated sensitivities and specificities was observed (Figure 2), potentially due to the large variety of species in which these tests were applied. In general, lower sensitivity estimates were reported than for the other antemortem tests, and higher estimated specificity was reported compared to those obtain for IFN-γ, but lower than for skin tests. These and additional numerical summaries are presented in Table 3.

Overall, posterior probability intervals were narrower for specificities than for sensitivities for all the assessed tests (Figure 2).

3.2. Postmortem Tests

Thirteen articles evaluated the performance of TB postmortem tests using BLCMs, of which 120 estimates were extracted. Of these, only 30.0% (36/120) were determined with Bayesian models that used informative prior distributions. The posterior probability intervals for the sensitivity of the postmortem tests were wide, while the posterior medians of specificity were 100% in most of the studies (Figure 3 and Table 4). Direct PCR had the highest APM sensitivity among all the postmortem tests (80.6%; 95% APPI: 54.4–92.3%), while meat inspection had the lowest (53.7%; 95% APPI: 49.9–54.8%). A higher APM for sensitivity was reported for cattle populations in the case of bacteriological culture, with an estimated sensitivity of 88.9% (95% APPI: 65.5–97.5%) compared to an overall estimate of 79.2% (95 APPI: 64.8–88.7%).

3.3. Prior and Posterior Distributions

For studies that used informative prior distributions for sensitivity and specificity parameters, the correlation between 95% prior and posterior probability interval widths was 0.53 for sensitivity and 0.41 for specificity (Figure 4). In general, prior probability intervals were wider for both sensitivity (median PIW = 0.37; interquartile range (IQR): 0.18–0.47) and specificity (median = 0.15; IQR: 0.06–0.20) than posterior probability intervals (median for sensitivity = 0.24, IQR: 0.10–0.40; median for specificity = 0.04; IQR: 0.01–0.10).

(a)

(b)

The overlap between prior and posterior distributions was higher for sensitivity (median overlap = 61.0%; 95% range: 55.3–66.7%) than for specificity (29.9%; 95% range: 23.6–36.2%), indicating that posterior distributions shifted away from the corresponding informative prior distributions as a result of information supplied by the data, particularly for the specificity (Figures 5 and 6). Lastly, there were moderate negative correlations between sample size and PIW for sensitivity (r = −0.27) and specificity (r = −0.64) (Supplementary Material 2).

3.4. STARD-BLCM Checklist Review

Fourteen (56.0%) articles were published after the release of the STARD-BLCM guidelines in 2017. Three of these articles submitted the checklist as supplementary information, while four others stated that the guidelines were followed.

Overall, 570 (81.4%) of the 700 possible evaluations performed on the articles selected in the systematic literature review (28 items applicable assessed in 25 articles) were considered fulfilled. The item that was most often not addressed satisfactorily was number 18 (“Intended sample size and how it was determined”), with only three studies reporting it. Also, items 19 (“Flow of participants, using a diagram”), 25 (“Report any adverse events from performing the tests under evaluation”), and 17 (“Any analyses of variability in diagnostic accuracy”) were seldom reported (12.0%, 36.0%, and 52.0%, respectively) compared with the other items (Figure 7). As stated in the STARD-BLCM checklist, item number 21 (“Distribution of the targeted conditions”) was not applicable in the evaluated studies, as the target condition to be detected is unknown, as well as item number 28 (“Registration number and name of registry”) as it applies to clinical trials, which is not the case for the studies assessed here.

4. Discussion

The limitations of currently available TB diagnostic tests are among the main factors hampering disease control [22, 23]. This problem is exacerbated by the lack of consensus on the accuracy of TB diagnostic tests, with widely different estimates being reported, likely due to differences in study design and study populations, protocols followed, and reference test used (or not) in the analysis. Given the limitations of all available reference tests for TB, here our purpose was to review the literature on the performance of TB diagnostic tests for studies that used Bayesian analysis in the absence of a reference procedure.

Even though there is still a limited number of studies using Bayesian latent class methodology compared to traditional gold-standard-based approaches (6 out of 113 papers found in a systematic review published in 2018 [6]), Bayesian methods have become more widespread in the last decade, with 14 of the 25 studies retrieved in this literature review being published in the last four years. As expected, studies were performed mostly on cattle (19/25), although several well-known wildlife reservoirs such as wild boar, deer, and badger were also considered (one article each). Interestingly, goats were not the subject of any study in our review, even though they constitute an important reservoir in several regions of the world [24–27]. Also as expected, diagnostic tests based on a cellular immune response were the most commonly assessed techniques, although the increasing usefulness of BLCMs for test evaluation is also demonstrated by its application in the new generation of serology-based tests recently developed for TB (13/25), which were the subject of most studies involving wildlife (5/6) [28, 29] in our review.

Although all studies included in our literature review used BLCMs for data analysis, several differences regarding the priors and specific models considered were found. Regarding prior distributions, almost half of the articles used diffuse priors for at least one of the tests considered, and five out of the 25 studies used only diffuse priors. While diffuse priors may be a reasonable option for the evaluation of newly developed tests [30], four of the five studies that used only diffuse priors evaluated well-established diagnostic techniques (skin tests or IFN-γ assays), and therefore published information or expert opinion was likely available [6, 29, 31]. Still, the impact of (informative) priors should always be assessed through a sensitivity analysis [11, 32], which was not done in seven out of the 25 studies.

The development of statistical software that allows fitting BLCMs has been crucial in increasing the application of these approaches. All the studies here were based on BLCMs with codes that are publicly available (e.g., https://cadms.vetmed.ucdavis.edu/diagnostic/software [14]), and were implemented using open-source Gibbs samplers (WinBUGS, OpenBUGS, and JAGS). Interestingly, the use of Stan [33, 34], another open-source statistical modelling software that allows fitting complex Bayesian models [35–37], has not been explored to date in our context.

Results for all antemortem and postmortem techniques were consistent to some extent, suggesting that in general most techniques (with the possible exception of CFT and the IFN-γ assay) had high specificity (>90% in 141/192 estimates) while sensitivity estimates were lower and more highly variable. Average posterior median estimates of the sensitivity of skin tests were at or below 70% except for CFT (73%). These estimates are lower than those obtained from the literature based on the use of a reference test, particularly for the SIT test, for which the median estimated sensitivity reported in a recent meta-analysis was 81% or 94% depending on the analysis [6], compared to the 64–70% range from BLCM-derived estimates described here. In the case of SICCT, Bayesian estimates of sensitivity were more consistent across studies than published frequentist estimates, with the former ranging between 52.5 and 66.6% (APPI for standard interpretation) or 66.8 and 75.6% (APPI for severe interpretation), whereas frequentist estimates ranged between 50 and 100% [5, 6, 31]. In contrast, Bayesian estimates for the specificity of the skin tests reviewed in this study agreed with previously reported values close to 100% [31, 38] with the exception of CFT. In this case, the frequentist and Bayesian estimates are different for both sensitivity and specificity, with frequentist estimates being higher (85.7% mean vs. 72.9% APM for sensitivity, and 92.8% mean vs. 78.7% APM for specificity) [39]. Counterintuitively, according to the APM, the SIT test using a severe interpretation was the most specific skin test, what could be due to the specific animal populations being tested, but in any case, APPIs for the specificity of most skin tests were largely similar (Table 3).

Interestingly, Bayesian estimates of sensitivity reported for IFN-γ tests were in general higher and more consistent (ranging from 71 to 90% [95% APPI]) than those obtained through comparison with a gold standard (with a 95% posterior interval of 49–82%) [6]. This could be in part due to the more recent nature of Bayesian studies that thus would have (i) been based on more optimized IFN-γ tests and (ii) evaluated using similar cut-off points (as opposed to some of the references based on a gold standard, some of which were published before the 2000s and were often based on widely different interpretation criteria). In contrast, Bayesian estimates of specificity were lower than those obtained using a gold standard. Some of these were based on testing officially tuberculosis free (OTF) populations, what would indicate that these OTF herds were systematically different in some unknown characteristics (or exposure to certain antigens) from the infected herds where IFN-γ test have been typically applied, thus limiting the external validity of these studies. Nevertheless, to date, few articles have studied the use of IFN-γ in OTF herds, and these were based on the use of different commercial kits, cut-offs, and population characteristics (e.g., production type and age) [40–43]. Other estimates based on the use of a gold standard (typically a postmortem test such as bacteriological culture) with limited sensitivity may have led to the misclassification of some truly infected animals and therefore should be interpreted with care since this would lead to underestimating the specificity of the test.

A wide range of serology-based test sensitivities were estimated through BLCMs (Figure 2), which could be attributable to the large number of species to which these tests were applied. BLCM-derived sensitivity estimates were lower than those obtained in previous studies, which reported sensitivity estimates above 63% [28, 44–47] when using bacteriological culture and the presence of visible lesions as the gold standard, or up to 75% when compared with IFN-γ [45, 48]. In contrast to the articles included here, these studies were performed in animal populations with a suspected high prevalence (i.e., high proportions of skin test or IFN-γ reactors, herds subjected to depopulation due to a TB outbreak) or subjected to experimental infections [46, 48]. Serology tests are known to perform very well in these high prevalence settings where the infection is typically at an advanced stage [49, 50], which could lead to an overestimation of their sensitivity for lower prevalence populations. In fact, sensitivity estimates below 35% have been reported in low-prevalence settings [28, 51], demonstrating how sensitivity varies depending on the prevalence of the population tested. Furthermore, sensitivity is known to increase due to the anamnestic effect of a skin test prior to the sampling, which was the case for some studies in our review [28, 46, 48], and this could also partially explain the difference between the estimates presented here and in previous literature. [28, 51] In contrast, specificity estimates obtained using BLCMs (ranging between 90–100%) were aligned with previous estimates obtained from TB-free cattle herds [5, 6, 28, 46, 48] and wildlife populations [52–54].

Regarding postmortem tests, meat inspection (i.e., abattoir surveillance) had the lowest sensitivity (53.7%; 95% APPI: 49.9–54.8%). BLCM estimates were consistent with other estimates [55, 56], with values at or below 60%, although other studies have reported even lower (<40%) estimates [57–60]. Differences between estimates from these studies may be attributable to multiple factors, such as the quantity and training of inspectors and the amount of time spent on each animal inspection [60–62], rather than to the methodology used to assess test performance, given that this diagnostic test is particularly difficult to standardize under field conditions. Regardless, passive surveillance has an important role as a monitoring tool, particularly when disease is absent or at very low levels, and therefore the continued assessment of its performance is highly relevant [63, 64]. Bacteriological culture has traditionally been used for the confirmation of TB and as a reference for the evaluation of other diagnostic techniques. Nowadays, direct PCR has been introduced in many laboratories as an alternative to culture for TB confirmation. Interestingly, both tests showed similar APM in terms of sensitivity, although specificity was slightly lower for direct PCR (but still close to 100%). Frequentist-based sensitivity estimates described in the literature are variable, ranging from 30 to 100% for culture [65–68] and 63 to 100% for direct PCR [69–72]. This heterogeneity between estimates from different studies was also observed in BLCM-based estimates (Figure 3), with median posterior sensitivity values for culture and direct PCR in tissues varying between 8 and 97% for culture and 61 and 91% for direct PCR depending on the study. These wide ranges could be due to the influence of several factors such as the presence of compatible visible lesions and differences in sample collection and preservation, as well as in the protocol followed [65, 66, 71, 73]. In any case, the similar diagnostic performance of culture and direct PCR found in our analyses, coupled with the significantly lower turnaround time for obtaining the results of the latter (days versus weeks), suggests direct PCR can be a useful alternative for postmortem confirmation of TB in the frame of eradication programs as evidenced by its inclusion in Commission Delegated Regulation (EU) 2020/689 (Article 9) as an official diagnostic test.

Even though results obtained for each of the diagnostic tests evaluated were somewhat consistent, indicating a higher sensitivity of IFN-γ assays compared with skin and serology tests while the specificity would be higher for skin tests, there was considerable variation between studies, with e.g., median sensitivity estimates for the IFN-γ assays (BOVIGAM) ranging from 55.7% to 95.8% (Figure 2). This could be due to the effect of local factors such as the presence of nontuberculous mycobacteria, herd size or the production type, and age of the animals, which also can influence estimates obtained through the comparison with a reference procedure [74–76]. However, the limited number of studies based on BLCMs conducted so far makes the identification of these local factors and the characterization of their impact challenging; nevertheless, they should be considered when interpreting the results.

Transparency in reporting is key for the evaluation of a study [77–80]. In the case of TB test accuracy BLCM studies, only one-fifth of the articles published after the STARD-BLCM guidelines were released (3/14 studies) provided the checklist as supplementary material, with other four indicating the guidelines were followed. Among the more problematic items in terms of compliance, the most relevant one was the lack of justification for sample sizes (only three out of 25 articles) and the assessment of variability in test performance in subpopulations, which could be important in the case of TB given the known effect of certain host characteristics (e.g., age and breed) [63, 81, 82] for which there is often available information but that was seldom incorporated in the analysis. Recently developed models that allow for the inclusion of covariates in the context of BLCMs could be a suitable analysis option [82–84]. Other items that were underreported, such as the flow diagram of participants or the occurrence of adverse events associated with test administration, are probably less significant in the assessment of TB diagnostic tests, which could explain why they were typically not reported.

5. Conclusions

Results from studies that used BLCMs to assess the performance of TB antemortem diagnostic tests deviated consistently from those obtained from analyses that used (imperfect) reference procedures, particularly with regards to their sensitivity: Bayesian posterior estimates of sensitivity were overall lower for skin tests and serology and higher for IFN-γ assays. In contrast, estimates based on BLCMs and the use of a reference test mostly agreed on the performance of postmortem TB diagnostic tests. Given the limitations of all available reference procedures for TB, BLCM-based estimates may more accurately reflect the performance of tests in the field, though the high variability observed between studies suggests test performance may be affected by multiple factors not related with the use of an imperfect reference procedure. Newly developed models that allow for the inclusion of some of these (often spatially structured) factors may help to produce accurate estimates of test performance in the future, thereby informing and optimizing control and eradication programs based on test-and-cull strategies.

Data Availability

All data supporting the findings of this study are included in the main article and the supplementary materials.

Ethical Approval

The authors confirm that the ethical policies of the journal, as noted on the journal’s author guidelines page, have been adhered to. No ethical approval was required as this is a review article with no original research data.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

AP and JA conceived and designed the study. AGB and JA conducted the screening of abstracts, and AGB, PP, and CPR the assessment of the full texts. AGB analyzed the data with the help and inputs from AB, AP, and JA. AGB and JA drafted the first version of the manuscript and received substantial feedback from all other authors.

Acknowledgments

This work was funded by the project Integrated Strategies for Tuberculosis Control and Eradication in Spain (ERATUB) (RTI2018-096010-B-C22, Ministerio de Ciencia, Innovación y Universidades, MICINN) and is a contribution to projects RTA2015-00043-C02-02 (Ministerio de Economía y Competitividad (MINECO) and PID2019-105155RB-C31 (MICINN), and to COST Action CA18208 (Novel tools for test evaluation and disease prevalence estimation). JA is the recipient of a Ramón y Cajal contract from the Spanish Ministry of Economy, Industry and Competitiveness (MINECO, RYC-2016-20422). Authors are grateful to Peter Craig (Durham University) for his help with the coding of the overlap function in R. An earlier version of this work was presented as an oral communication at the 16^th International Symposium of Veterinary Epidemiology and Economics (ISVEE) held in Halifax, Canada, in 2022 [85].

Supplementary Materials

Supplementary Material 1: Overlap in-house function performed in R to estimate the percentage of overlap between prior and posterior distributions. Supplementary Material 2: Correlation plots between sample size and posterior PIW (probability interval width) for sensitivity and specificity. Supplementary Material 3: Prior and posterior distributions of sensitivities of antemortem and postmortem diagnostic tests for tuberculosis based on informative priors. (Supplementary Materials)

References

J. Bezos, J. Álvarez, B. Romero, L. de Juan, and L. Domínguez, “Bovine tuberculosis: historical perspective,” Research in Veterinary Science, vol. 97, pp. S3–S4, 2014.
View at: Publisher Site | Google Scholar
European Commission, “Outcome of the evaluation procedure of the eradication, control and surveillance programmes submitted by Member States for Union financial contribution for 2020: list of the programmes technically approved and amount allocated to each programme,” 2020, https://food.ec.europa.eu/system/files/2020-01/cff_animal_vet-progs_guidance_progs_erad_wd-12728-2019.pdf.
View at: Google Scholar
A. R. Allen, R. A. Skuce, and A. W. Byrne, “Bovine tuberculosis in Britain and Ireland - a perfect storm? the confluence of potential ecological and epidemiological impediments to controlling a chronic infectious disease,” Frontiers in Veterinary Science, vol. 5, 2018.
View at: Publisher Site | Google Scholar
Mapa, “Informe final técnico-financiero sobre los resultados anuales de los Programas,” Nacionales de Erradicación de la Tuberculosis Bovina, 2020.
View at: Google Scholar
I. Schiller, B. Oesch, H. M. Vordermeier et al., “Bovine tuberculosis: a review of current and emerging diagnostic techniques in view of their relevance for disease control and eradication,” Transboundary and Emerging Diseases, vol. 57, 2010.
View at: Publisher Site | Google Scholar
J. Nuñez-Garcia, S. H. Downs, J. E. Parry et al., “Meta-analyses of the sensitivity and specificity of ante-mortem and post-mortem diagnostic tests for bovine tuberculosis in the UK and Ireland,” Preventive Veterinary Medicine, vol. 153, pp. 94–107, 2018.
View at: Publisher Site | Google Scholar
E. Gormley, L. A. L. Corner, E. Costello, and S. Rodriguez-Campos, “Bacteriological diagnosis and molecular strain typing of Mycobacterium bovis and Mycobacterium caprae,” Research in Veterinary Science, vol. 97, pp. S30–S40, 2014.
View at: Publisher Site | Google Scholar
C. Enøe, M. P. Georgiadis, and W. O. Johnson, “Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown,” Preventive Veterinary Medicine, vol. 45, no. 1–2, pp. 61–81, 2000.
View at: Publisher Site | Google Scholar
S. L. Hui and S. D. Walter, “Estimating the error rates of diagnostic tests,” Biometrics, vol. 36, no. 1, pp. 167–171, 1980.
View at: Google Scholar
L. Joseph, T. W. Gyorkos, and L. Coupal, “Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a Gold Standard,” American Journal of Epidemiology, vol. 141, no. 3, pp. 263–272, 1995.
View at: Publisher Site | Google Scholar
P. Kostoulas, S. S. Nielsen, A. J. Branscum et al., “STARD-BLCM: standards for the reporting of diagnostic accuracy studies that use bayesian latent class models,” Preventive Veterinary Medicine, vol. 138, pp. 37–47, 2017.
View at: Publisher Site | Google Scholar
D. Moher, A. Liberati, J. Tetzlaff et al., “Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement,” PLoS Medicine, vol. 6, no. 7, 2009.
View at: Publisher Site | Google Scholar
D. F. Stroup, J. A. Berlin, S. C. Morton et al., “Meta-analysis of observational studies in epidemiology. A proposal for reporting,” JAMA, vol. 283, no. 15, 2000.
View at: Google Scholar
A. J. Branscum, I. A. Gardner, and W. O. Johnson, “Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling,” Preventive Veterinary Medicine, vol. 68, no. 2–4, pp. 145–163, 2005.
View at: Publisher Site | Google Scholar
A. Mark Steven, E. Sergeant, T. Nunes et al., “Package “epiR” title tools for the analysis of epidemiological data,” 2021, https://cran.r-project.org/web/packages/epiR/epiR.pdf.
View at: Google Scholar
R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2019.
P. M. Bossuyt, J. B. Reitsma, D. E. Bruns et al., “Stard 2015: an updated list of essential items for reporting diagnostic accuracy studies,” BMJ, vol. 351, 2015.
View at: Publisher Site | Google Scholar
M. N. Islam, M. K. Khan, M. F. R. Khan, P. Kostoulas, A. K. M. Anisur Rahman, and M. M. Alam, “Risk factors and true prevalence of bovine tuberculosis in Bangladesh,” PLoS One, vol. 16, no. 2, 2021.
View at: Publisher Site | Google Scholar
K. Karolemeas, R. de la Rua-Domenech, R. Cooper et al., “Estimation of the relative sensitivity of the comparative tuberculin skin test in tuberculous cattle herds subjected to depopulation,” PLoS One, vol. 7, no. 8, 2012.
View at: Publisher Site | Google Scholar
M. L. Bermingham, I. G. Handel, E. J. Glass et al., “Hui and Walter’s latent-class model extended to estimate diagnostic test properties from surveillance data: a latent model for latent data,” Scientific Reports, vol. 5, pp. 1–14, 2015.
View at: Publisher Site | Google Scholar
M. L. de la Cruz, A. J. Branscum, J. Nacar et al., “Evaluation of the performance of the IDvet IFN-gamma test for diagnosis of bovine tuberculosis in Spain,” Frontiers in Veterinary Science, vol. 5, pp. 1–9, 2018.
View at: Publisher Site | Google Scholar
M. Good, D. Bakker, A. Duignan, and D. M. Collins, “The history of in vivo tuberculin testing in bovines: tuberculosis, a “One Health” issue,” Frontiers in Veterinary Science, vol. 5, no. 59, 2018.
View at: Publisher Site | Google Scholar
K. VanderWaal, E. A. Enns, C. Picasso et al., “Optimal surveillance strategies for bovine tuberculosis in a low-prevalence country,” Scientific Reports, vol. 7, no. 1, 2017.
View at: Publisher Site | Google Scholar
Efsa Biohaz Panel, “Scientific Opinion on the public health hazards to be covered by inspection of meat from sheep and goats,” EFSA Journal, vol. 11, no. 6, 2013.
View at: Publisher Site | Google Scholar
S. Guta, J. Casal, S. Napp et al., “Epidemiological investigation of bovine tuberculosis herd breakdowns in Spain 2009/2011,” PLoS One, vol. 9, no. 8, 2014.
View at: Publisher Site | Google Scholar
S. Napp, A. Allepuz, I. Mercader et al., “Evidence of goats acting as domestic reservoirs of bovine tuberculosis,” The Veterinary Record, vol. 172, no. 25, 2013.
View at: Publisher Site | Google Scholar
G. Zanardi, M. B. Boniotti, A. Gaffuri, B. Casto, M. Zanoni, and M. L. Pacciarini, “Tuberculosis transmission by Mycobacterium bovis in a mixed cattle and goat herd,” Research in Veterinary Science, vol. 95, no. 2, pp. 430–433, 2013.
View at: Publisher Site | Google Scholar
C. Casal, A. Díez-Guerrier, J. Álvarez et al., “Strategic use of serology for the diagnosis of bovine tuberculosis after intradermal skin testing,” Veterinary Microbiology, vol. 170, no. 3–4, pp. 342–351, 2014.
View at: Publisher Site | Google Scholar
M. A. Chambers, “Review of the diagnosis and study of tuberculosis in non-bovine wildlife species using immunological methods,” Transboundary and Emerging Diseases, vol. 56, no. 6–7, pp. 215–227, 2009.
View at: Publisher Site | Google Scholar
N. P. Lemoine, “Moving beyond noninformative priors: why and how to choose weakly informative priors in Bayesian analyses,” Oikos, vol. 128, no. 7, pp. 912–928, 2019.
View at: Publisher Site | Google Scholar
R. de la Rua-Domenech, A. T. Goodchild, H. M. Vordermeier, R. G. Hewinson, K. H. Christiansen, and R. S. Clifton-Hadley, “Ante mortem diagnosis of tuberculosis in cattle: a review of the tuberculin tests, γ-interferon assay and other ancillary diagnostic techniques,” Research in Veterinary Science, vol. 81, no. 2, pp. 190–210, 2006.
View at: Publisher Site | Google Scholar
M. Roos, T. G. Martins, L. Held, and H. Rue, “Sensitivity analysis for Bayesian hierarchical models,” Bayesian Anal, vol. 10, no. 2, 2013.
View at: Publisher Site | Google Scholar
B. Carpenter, A. Gelman, M. D. Hoffman et al., “Stan: a probabilistic programming language,” Journal of Statistical Software, vol. 76, no. 1, pp. 1–32, 2017.
View at: Publisher Site | Google Scholar
Stan Development Team, Stan Modelling Language Users Guide and Reference Manual, Version 2.26, Stan Development Team, Columbia, USA, 2021.
M. Betancourt, “A conceptual introduction to Hamiltonian Monte Carlo,” 2017, https://arxiv.org/abs/1701.02434.
View at: Google Scholar
M. D. Hoffman and A. Gelman, “The No-U-Turn Sampler: adaptively setting path lengths in Hamiltonian Monte Carlo,” Journal of Machine Learning Research, vol. 15, 2011.
View at: Google Scholar
R. M. Neal, in Handbook of Markov Chain Monte Carlo, Chapman and Hall/CRC, Boca Raton, FL, USA, 2011.
A. v. Goodchild, S. H. Downs, P. Upton, J. L. N. Wood, and R. de La Rua-Domenech, “Specificity of the comparative skin test for bovine tuberculosis in Great Britain,” The Veterinary Record, vol. 177, no. 10, 2015.
View at: Publisher Site | Google Scholar
M. W. Farnham, B. Norby, T. J. Goldsmith, and S. J. Wells, “Meta-analysis of field studies on bovine tuberculosis skin tests in United States cattle herds,” Preventive Veterinary Medicine, vol. 103, no. 2–3, pp. 234–242, 2012.
View at: Publisher Site | Google Scholar
M. C. Antognoli, M. D. Remmenga, S. D. Bengtson et al., “Analysis of the diagnostic accuracy of the gamma interferon assay for detection of bovine tuberculosis in U.S. herds,” Preventive Veterinary Medicine, vol. 101, no. 1–2, pp. 35–41, 2011.
View at: Publisher Site | Google Scholar
M. Cagiola, F. Feliziani, G. Severi, P. Pasquali, and D. Rutili, “Analysis of possible factors affecting the specificity of the gamma interferon test in tuberculosis-free cattle herds,” Clinical and Vaccine Immunology, vol. 11, no. 5, pp. 952–956, 2004.
View at: Publisher Site | Google Scholar
G. Ghielmetti, P. Landolt, U. Friedel et al., “Evaluation of three commercial interferon-γ assays in a bovine tuberculosis free population,” Frontiers in Veterinary Science, vol. 8, 2021.
View at: Publisher Site | Google Scholar
S. Lauzi, D. Passoto, M. Amadori, I. L. Archetti, G. Poli, and L. Bonizzi, “Evaluation of the specificity of the γ-interferon test in Italian bovine tuberculosis-free herds,” The Veterinary Journal, vol. 160, no. 1, pp. 17–24, 2000.
View at: Publisher Site | Google Scholar
C. Casal, J. A. Infantes, M. A. Risalde et al., “Antibody detection tests improve the sensitivity of tuberculosis diagnosis in cattle,” Research in Veterinary Science, vol. 112, pp. 214–221, 2017.
View at: Publisher Site | Google Scholar
L. McCallan, C. Brooks, C. Couzens, F. Young, J. McNair, and A. W. Byrne, “Assessment of serological tests for diagnosis of bovine tuberculosis,” The Veterinary Record, vol. 181, no. 4, 2017.
View at: Publisher Site | Google Scholar
W. R. Waters, B. M. Buddle, H. M. Vordermeier et al., “Development and evaluation of an enzyme-linked immunosorbent assay for use in the detection of bovine tuberculosis in cattle,” Clinical and Vaccine Immunology, vol. 18, no. 11, pp. 1882–1888, 2011.
View at: Publisher Site | Google Scholar
C. Whelan, E. Shuralev, G. O’Keeffe et al., “Multiplex immunoassay for serological diagnosis of Mycobacterium bovis infection in cattle,” Clinical and Vaccine Immunology, vol. 15, no. 12, pp. 1834–1838, 2008.
View at: Publisher Site | Google Scholar
C. Whelan, A. O. Whelan, E. Shuralev et al., “Performance of the enferplex TB assay with cattle in Great Britain and assessment of its suitability as a test to distinguish infected and vaccinated animals,” Clinical and Vaccine Immunology, vol. 17, no. 5, pp. 813–817, 2010.
View at: Publisher Site | Google Scholar
J. M. Pollock, M. D. Welsh, and J. McNair, “Immune responses in bovine tuberculosis: towards new strategies for the diagnosis and control of disease,” Veterinary Immunology and Immunopathology, vol. 108, no. 1–2, pp. 37–43, 2005.
View at: Publisher Site | Google Scholar
W. R. Waters, M. V. Palmer, T. C. Thacker et al., “Early antibody responses to experimental Mycobacterium bovis infection of cattle,” Clinical and Vaccine Immunology, vol. 13, no. 6, pp. 648–654, 2006.
View at: Publisher Site | Google Scholar
L. McCallan, C. Brooks, C. Barry et al., “Serological test performance for bovine tuberculosis in cattle from herds with evidence of on-going infection in Northern Ireland,” PLoS One, vol. 16, 2021.
View at: Publisher Site | Google Scholar
F. Cardoso-Toset, I. Luque, L. Carrasco et al., “Evaluation of five serologic assays for bovine tuberculosis surveillance in domestic free-range pigs from southern Spain,” Preventive Veterinary Medicine, vol. 137, pp. 101–104, 2017.
View at: Publisher Site | Google Scholar
M. A. Chambers, “Review of the diagnosis of tuberculosis in non-bovid wildlife species using immunological methods - an update of published work since 2009,” Transboundary and Emerging Diseases, vol. 60, pp. 14–27, 2013.
View at: Publisher Site | Google Scholar
R. Thomas and M. Chambers, “Review of methods used for diagnosing tuberculosis in captive and free-ranging non-bovid species (2012–2020),” Pathogens, vol. 10, no. 5, 2021.
View at: Publisher Site | Google Scholar
B. Asseged, Z. Woldesenbet, E. Yimer, and E. Lemma, “Evaluation of abattoir inspection for the diagnosis of Mycobacterium bovis infection in cattle at Addis Ababa abattoir,” Tropical Animal Health and Production, vol. 36, no. 6, pp. 537–546, 2004.
View at: Publisher Site | Google Scholar
D. Biffa, A. Bogale, and E. Skjerve, “Diagnostic efficiency of abattoir meat inspection service in Ethiopia to detect carcasses infected with Mycobacterium bovis: implications for public health,” BMC Public Health, vol. 10, 2010.
View at: Publisher Site | Google Scholar
A. Aylate, S. N. Shah, H. Aleme, and T. T. Gizaw, “Bovine tuberculosis: prevalence and diagnostic efficacy of routine meat inspection procedure in Woldiya municipality abattoir north Wollo zone, Ethiopia,” Tropical Animal Health and Production, vol. 45, no. 3, pp. 855–864, 2013.
View at: Publisher Site | Google Scholar
M. Bekele and I. Belay, “Evaluation of routine meat inspection procedure to detect bovine tuberculosis suggestive lesions in Jimma municipal abattoir, South West Ethiopia,” Global Veterinaria, vol. 6, no. 2, pp. 172–179, 2011.
View at: Google Scholar
L. Corner, L. Melville, K. McCubbin et al., “Efficiency of inspection procedures for the detection of tuberculous lesions in cattle,” Australian Veterinary Journal, vol. 67, no. 11, pp. 389–392, 1990.
View at: Publisher Site | Google Scholar
A. Garcia-Saenz, S. Napp, S. Lopez, J. Casal, and A. Allepuz, “Estimation of the individual slaughterhouse surveillance sensitivity for bovine tuberculosis in Catalonia (North-Eastern Spain),” Preventive Veterinary Medicine, vol. 121, no. 3–4, pp. 332–337, 2015.
View at: Publisher Site | Google Scholar
A. v. Pascual-Linaza, A. W. Gordon, L. A. Stringer, and F. D. Menzies, “Efficiency of slaughterhouse surveillance for the detection of bovine tuberculosis in cattle in Northern Ireland,” Epidemiology and Infection, vol. 145, no. 5, pp. 995–1005, 2017.
View at: Publisher Site | Google Scholar
P. W. Willeberg, C. G. McAloon, E. Houtsma, I. Higgins, T. A. Clegg, and S. J. More, “The herd-level sensitivity of abattoir surveillance for bovine tuberculosis: simulating the effects of current and potentially modified meat inspection procedures in Irish cattle,” Frontiers in Veterinary Science, vol. 5, 2018.
View at: Publisher Site | Google Scholar
P. Pozo, N. C. Cardenas, J. Bezos et al., “Evaluation of the performance of slaughterhouse surveillance for bovine tuberculosis detection in Castilla y Leon, Spain,” Preventive Veterinary Medicine, vol. 189, Article ID 105307, 2021.
View at: Publisher Site | Google Scholar
A. Shittu, R. S. Clifton-Hadley, E. R. Ely, P. U. Upton, and S. H. Downs, “Factors associated with bovine tuberculosis confirmation rates in suspect lesions found in cattle at routine slaughter in Great Britain, 2003-2008,” Preventive Veterinary Medicine, vol. 110, no. 3–4, pp. 395–404, 2013.
View at: Publisher Site | Google Scholar
L. A. L. Corner, E. Gormley, and D. U. Pfeiffer, “Primary isolation of Mycobacterium bovis from bovine tissues: conditions for maximising the number of positive cultures,” Veterinary Microbiology, vol. 156, no. 1–2, pp. 162–171, 2012.
View at: Publisher Site | Google Scholar
N. Hines, J. B. Payeur, and L. J. Hoffman, “Comparison of the recovery of Mycobacterium bovis isolates using the BACTEC MGIT 960 system, BACTEC 460 system, and middlebrook 7H10 and 7H11 solid media,” Journal of Veterinary Diagnostic Investigation, vol. 18, no. 3, pp. 243–250, 2006.
View at: Publisher Site | Google Scholar
S. Robbe-Austerman, D. M. Bravo, and B. Harris, “Comparison of the MGIT 960, BACTEC 460 TB and solid media for isolation of Mycobacterium bovis in United States veterinary specimens,” BMC Veterinary Research, vol. 9, no. 1, 2013.
View at: Publisher Site | Google Scholar
L. D. Stewart, J. McNair, L. McCallan, A. Gordon, and I. R. Grant, “Improved detection of Mycobacterium bovis infection in bovine lymph node tissue using Immunomagnetic Separation (IMS)-based methods,” PLoS One, vol. 8, no. 3, Article ID e58374, 2013.
View at: Publisher Site | Google Scholar
C. P. Araújo, A. L. A. R. Osório, K. S. G. Jorge et al., “Detection of Mycobacterium bovis in bovine and bubaline tissues using nested-PCR for TbD1,” PLoS One, vol. 9, no. 3, Article ID e91023, 2014.
View at: Publisher Site | Google Scholar
P. Costa, A. S. Ferreira, A. Amaro et al., “Enhanced detection of tuberculous mycobacteria in animal tissues using a semi-nested probe-based real-time PCR,” PLoS One, vol. 8, no. 11, Article ID e81337, 2013.
View at: Publisher Site | Google Scholar
V. Lorente-Leal, E. Liandris, E. Castellanos et al., “Validation of a Real-Time PCR for the detection of Mycobacterium tuberculosis complex members in bovine tissue samples,” Frontiers in Veterinary Science, vol. 6, no. 61, pp. 1–9, 2019.
View at: Publisher Site | Google Scholar
A. Parra, N. García, A. García et al., “Development of a molecular diagnostic test applied to experimental abattoir surveillance on bovine tuberculosis,” Veterinary Microbiology, vol. 127, no. 3–4, pp. 315–324, 2008.
View at: Publisher Site | Google Scholar
G. F. Yates, M. Price-Carter, K. Bland et al., “Comparison of the BBL mycobacteria growth indicator tube, the BACTEC 12B, and solid media for the isolation of Mycobacterium bovis,” Journal of Veterinary Diagnostic Investigation, vol. 29, no. 4, pp. 508–512, 2017.
View at: Publisher Site | Google Scholar
J. Álvarez, A. Perez, S. Marqués et al., “Risk factors associated with negative in-vivodiagnostic results in bovine tuberculosis-infected cattle in Spain,” BMC Veterinary Research, vol. 10, no. 1, 2014.
View at: Publisher Site | Google Scholar
M. L. de la Cruz, P. Pozo, A. Grau et al., “Assessment of the sensitivity of the bovine tuberculosis eradication program in a high prevalence region of Spain using scenario tree modeling,” Preventive Veterinary Medicine, vol. 173, 2019.
View at: Publisher Site | Google Scholar
E. Gormley, M. Doyle, A. Duignan, M. Good, S. J. More, and T. A. Clegg, “Identification of risk factors associated with disclosure of false positive bovine tuberculosis reactors using the gamma-interferon (IFNγ) assay,” Veterinary Research, vol. 44, no. 1, 2013.
View at: Publisher Site | Google Scholar
S. H. Downs, S. J. More, A. v. Goodchild et al., “Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS,” Preventive Veterinary Medicine, vol. 153, pp. 108–116, 2018.
View at: Publisher Site | Google Scholar
N. P. du Sert, A. Ahluwalia, S. Alam et al., “Reporting animal research: explanation and elaboration for the arrive guidelines 2.0,” PLoS Biology, vol. 18, no. 7, 2020.
View at: Publisher Site | Google Scholar
A. M. O’Connor, J. M. Sargeant, I. A. Gardner et al., “The reflect statement: methods and processes of creating reporting guidelines for randomized controlled trials for livestock and food safety,” Journal of Veterinary Internal Medicine, vol. 24, no. 1, pp. 57–64, 2010.
View at: Publisher Site | Google Scholar
J. M. Sargeant, A. M. O’connor, I. R. Dohoo et al., “Methods and processes of developing the strengthening the reporting of observational studies in epidemiology-veterinary (STROBE-Vet) statement,” Journal of Food Protection, vol. 79, no. 12, pp. 2211–2219, 2016.
View at: Publisher Site | Google Scholar
A. Lahuerta-Marin, J. McNair, R. Skuce et al., “Risk factors for failure to detect bovine tuberculosis in cattle from infected herds across Northern Ireland (2004-2010),” Research in Veterinary Science, vol. 107, pp. 233–239, 2016.
View at: Publisher Site | Google Scholar
M. J. H. O’Hagan, H. Ni, F. D. Menzies, A. v. Pascual-Linaza, A. Georgaki, and J. A. Stegeman, “Test characteristics of the tuberculin skin test and post-mortem examination for bovine tuberculosis diagnosis in cattle in Northern Ireland estimated by Bayesian latent class analysis with adjustments for covariates,” Epidemiology and Infection, vol. 147, pp. 1–8, 2019.
View at: Publisher Site | Google Scholar
G. Koop, C. A. Collar, N. Toft et al., “Risk factors for subclinical intramammary infection in dairy goats in two longitudinal field studies evaluated by Bayesian logistic regression,” Preventive Veterinary Medicine, vol. 108, no. 4, pp. 304–312, 2013.
View at: Publisher Site | Google Scholar
G. D. A. Pereira, F. Louzada, V. D. F. Barbosa, M. M. Ferreira-Silva, and H. Moraes-Souza, “A general latent class model for performance evaluation of diagnostic tests in the absence of a gold standard: an application to Chagas disease,” Computational and Mathematical Methods in Medicine, vol. 2012, Article ID 487502, 12 pages, 2012.
View at: Publisher Site | Google Scholar
A. Gomez-Buendia, P. Pozo, C. Picasso, A. J. Branscum, A. Perez, and J. Alvarez, “Accuracy of tests for diagnosis of animal tuberculosis: moving away from the golden calf (and towards bayesian models),” in Proceedings of the 16th International Symposium of Veterinary Epidemiology and Economics (ISVEE 16), International Society for Veterinary Epidemiology and Economics, Halifax, Canada, August, 2022.
View at: Google Scholar

Copyright

Copyright © 2023 Alberto Gomez-Buendia et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

562

Downloads

317

Citations