C S Kosack1, S Spijker2, J Halton2, M Bonnet3, S Nicholas4, K Chetcuti5, A Mesic6, W E Brant7, E Joekes8, S Andronikou9. 1. Médecins Sans Frontières, Diagnostic Network, Amsterdam, The Netherlands. Electronic address: cara.kosack@oca.msf.org. 2. Médecins Sans Frontières, Diagnostic Network, Amsterdam, The Netherlands. 3. Epicentre, Paris, France; Institute of Research for Development, UMR233, University of Montpellier, INSERM U1175, France. 4. Epicentre, Paris, France. 5. Department of Radiology, Alder Hey Children's Hospital, Liverpool, UK. 6. Médecins Sans Frontières, Public Health Department, Amsterdam, The Netherlands. 7. Department of Radiology and Medical Imaging, University of Virginia Health System, Charlottesville, VA, USA. 8. Diagnostic Imaging department, Royal Liverpool University Hospital & Liverpool School of Tropical Medicine, Liverpool, UK. 9. Department of Paediatric Radiology, University or Bristol and Bristol Royal Hospital for Children, Bristol, UK.
Abstract
AIM: To assess the impact of introducing a chest radiograph reading and recording system (CRRS) with a short training session, on the accuracy and inter-reader variability of tuberculosis (TB) interpretation of chest radiographs (CXRs) by a group of non-expert readers in a human immunodeficiency virus (HIV)-positive cohort. MATERIALS AND METHODS: A set of 139 CXRs was reviewed by a group of eight physicians pre- and post-intervention at two clinics in Shan State, Myanmar, providing HIV/TB diagnosis and treatment services. The results were compared against the consensus of expert radiologists for accuracy. RESULTS: Overall accuracy was similar pre- and post-intervention for most physicians with an average area under the receiver operating characteristic curve difference of 0.02 (95% confidence interval: -0.03, 0.07). The overall agreement among physicians was poor pre- and post-intervention (Fleiss κ=0.35 and κ=0.29 respectively). The assessment of agreement for specific disease patterns associated with active TB in HIV-infected patients showed that for intrinsically subtle findings, the agreement was generally poor but better for the more intrinsically obvious disease patterns: pleural effusion (Cohen's kappa range = 0.37-0.67) and milliary nodular pattern (Cohen's kappa range = 0.25-0.52). CONCLUSION: This study demonstrated limited impact of the introduction of a CRRS on CXR accuracy and agreement amongst non-expert readers. The role in which CXRs are used for TB diagnosis in a HIV-positive cohort in similar clinical contexts should be reviewed.
AIM: To assess the impact of introducing a chest radiograph reading and recording system (CRRS) with a short training session, on the accuracy and inter-reader variability of tuberculosis (TB) interpretation of chest radiographs (CXRs) by a group of non-expert readers in a human immunodeficiency virus (HIV)-positive cohort. MATERIALS AND METHODS: A set of 139 CXRs was reviewed by a group of eight physicians pre- and post-intervention at two clinics in Shan State, Myanmar, providing HIV/TB diagnosis and treatment services. The results were compared against the consensus of expert radiologists for accuracy. RESULTS: Overall accuracy was similar pre- and post-intervention for most physicians with an average area under the receiver operating characteristic curve difference of 0.02 (95% confidence interval: -0.03, 0.07). The overall agreement among physicians was poor pre- and post-intervention (Fleiss κ=0.35 and κ=0.29 respectively). The assessment of agreement for specific disease patterns associated with active TB in HIV-infectedpatients showed that for intrinsically subtle findings, the agreement was generally poor but better for the more intrinsically obvious disease patterns: pleural effusion (Cohen's kappa range = 0.37-0.67) and milliary nodular pattern (Cohen's kappa range = 0.25-0.52). CONCLUSION: This study demonstrated limited impact of the introduction of a CRRS on CXR accuracy and agreement amongst non-expert readers. The role in which CXRs are used for TB diagnosis in a HIV-positive cohort in similar clinical contexts should be reviewed.