Home \ Outreach \


Does size really matter? How heterogeneous data can complicate interpretation of sensitivity and specificity estimates obtained through Bayesian latent class modelling

Conference in 17th International Symposium of Veterinary Epidemiology and Economics (ISVEE 17)

November 14th, 2024

Gómez-Buendía A., Denwood M., Saxmose-Nielsen S., Grau A., Nacar J., Minguez O., Romero B. and Alvarez J.

Alberto Gómez Buendía. Does size really matter?

The sub-optimal performance of diagnostic tests can undermine the success of bovine tuberculosis (bTB) eradication programs. Reported sensitivity and specificity estimates range from very low (40%) to very high (99%) due to the wide disparity in study designs, animal populations, and reference tests used in their evaluation. Given the lack of a perfect reference test, Bayesian Latent Class Models (BLCMs), which are not reliant on a gold standard, are best suited for assessment of tests. We applied BLCMs to determine the performance of two versions of the interferon-gamma (IFN-γ) assay for the diagnosis of bTB along with the effect of certain covariates (age, region, year, herd, production type, and results of other tests). IFN-γ tests were performed in over 250,000 animals from 1089 infected herds, representing all bTB-positive herds in Castilla y León, Spain, from 2017 to 2020. All animals were tested with the single intradermal tuberculin skin test and with one of two IFN-γ kits available in Spain (IDvet or Bovigam). Numerous models, including Hui-Walter extensions adjusting for covariates, were run. IFN-γ sensitivity estimates varied depending on the BLCM used but were consistently higher (>60%) than values for the Se of the skin test (<50%). The opposite was true for the specificity, with the skin test being the most specific (~100%), while IFN-γ estimates ranged from 96.7% (IDvet) to 98.5% (Bovigam), depending strongly on the BLCM applied. Estimates varied substantially depending on populations considered (defined by region or year of testing) and covariates included (e.g., higher Se of the skin test in younger animals while lower in the IFN-γ), which complicates the estimation of true test performance across populations. This work illustrates the challenges associated with managing extensive databases from national eradication surveillance programs




Participants:

Universidad ComplutenseServicio de Micobacterias (MYC). Centro de Vigilancia Sanitaria Veterinaria (VISAVET). Universidad Complutense (UCM).

University of CopenhagenDepartment of Veterinary and Animal Sciences. University of Copenhagen (UCPH).

Junta de Castilla y LeónConsejería de Agricultura y Ganadería. Junta de Castilla y León.

Junta de Castilla y LeónConsejería de Sanidad. Junta de Castilla y León.


Link to 17th International Symposium of Veterinary Epidemiology and Economics (ISVEE 17)





publiDB

17th International Symposium of Veterinary Epidemiology and Economics (ISVEE 17)


17th International Symposium of Veterinary Epidemiology and Economics (ISVEE 17)
November 11st-15th, 2024

TITLE: Does size really matter? How heterogeneous data can complicate interpretation of sensitivity and specificity estimates obtained through Bayesian latent class modelling


TYPE: Oral communication


AUTHORS: Gómez-Buendía A., Denwood M., Saxmose-Nielsen S., Grau A., Nacar J., Minguez O., Romero B. and Alvarez J.


First
Alberto Gómez Buendía
7th
Beatriz Romero Martínez
Last
Julio Álvarez Sánchez

DATE: November 14th, 2024


CITE THIS COMMUNICATION:

Gómez-Buendía A., Denwood M., Saxmose-Nielsen S., Grau A., Nacar J., Minguez O., Romero B. and Alvarez J. Does size really matter? How heterogeneous data can complicate interpretation of sensitivity and specificity estimates obtained through Bayesian latent class modelling. 17th International Symposium of Veterinary Epidemiology and Economics (ISVEE 17), International Society for Veterinary Epidemiology and Economics, November 14th, 2024. (Oral communication)


UNITS: