Taha Yusuf Kuzan1, Burcu Güzelbey2, Nalan Turan Güzel3, Beyza Nur Kuzan4, Mehmet Semih Çakır5, Ceren Canbey2. 1. Department of Radiology, Sancaktepe Sehit Prof. Dr. Ilhan Varank Training and Research Hospital, Istanbul, Turkey. 2. Department of Pathology, Istanbul Training and Research Hospital, Istanbul, Turkey. 3. Department of Pathology, Sancaktepe Sehit Prof. Dr. Ilhan Varank Training and Research Hospital, Istanbul, Turkey. 4. Department of Radiology, School of Medicine, Marmara University, Istanbul, Turkey. 5. Department of Radiology, Istanbul Training and Research Hospital, Istanbul, Turkey.
Abstract
AIM: To examine the intra- and inter-observer variability for non-benign thyroid cytological subcategories according to the Bethesda classification system after the second review. METHODS: Between November 2018 and May 2019, thyroid fine needle aspiration biopsies of 381 nodules were retrospectively evaluated. Among them, 74 non-benign (category III-VI) thyroid biopsies, analyzed according to the Bethesda system (pathologist 1:40 vs pathologist 2:34) by two independent pathologists, were reassessed by the same pathologists and by a cytopathologist. In this observer-blinded study, weighted Cohen's kappa was used to assess the intra-observer agreement, and Krippendorff's alpha was used to assess the inter-observer agreement. RESULTS: At the first and second evaluations of pathologists 1 and 2, the percentage agreement was 62.5% for pathologist 1 and 58.8% for pathologist 2. The intra-observer agreement was substantial (κ = 0.705) for pathologist 1, and moderate (κ = 0.447) for pathologist 2. In the second evaluation of pathologist 1 and 2, which was compared with the cytopathologist, the agreement percentage of pathologist 1 with the cytopathologist was 50.0%, and that of pathologist 2 was 56.8%. The inter-observer agreement was below the lowest acceptable limit for an overall agreement (α = 0.634) among the three raters. The inter-observer agreement was only acceptable between the cytopathologist and the second pathologist, while it was low between the other raters. In the evaluation of the non-benign nodules, the mean category score of the cytopathologist was 3.22 and lower than both pathologists (3.73 and 3.58, respectively). CONCLUSIONS: The intra-observer agreement of pathologists was moderate-to-substantial in the evaluation of non-benign thyroid biopsies according to the Bethesda reporting system. However, the inter-observer agreement was below the lowest acceptable limit when the cytopathologist was taken as a reference.
AIM: To examine the intra- and inter-observer variability for non-benign thyroid cytological subcategories according to the Bethesda classification system after the second review. METHODS: Between November 2018 and May 2019, thyroid fine needle aspiration biopsies of 381 nodules were retrospectively evaluated. Among them, 74 non-benign (category III-VI) thyroid biopsies, analyzed according to the Bethesda system (pathologist 1:40 vs pathologist 2:34) by two independent pathologists, were reassessed by the same pathologists and by a cytopathologist. In this observer-blinded study, weighted Cohen's kappa was used to assess the intra-observer agreement, and Krippendorff's alpha was used to assess the inter-observer agreement. RESULTS: At the first and second evaluations of pathologists 1 and 2, the percentage agreement was 62.5% for pathologist 1 and 58.8% for pathologist 2. The intra-observer agreement was substantial (κ = 0.705) for pathologist 1, and moderate (κ = 0.447) for pathologist 2. In the second evaluation of pathologist 1 and 2, which was compared with the cytopathologist, the agreement percentage of pathologist 1 with the cytopathologist was 50.0%, and that of pathologist 2 was 56.8%. The inter-observer agreement was below the lowest acceptable limit for an overall agreement (α = 0.634) among the three raters. The inter-observer agreement was only acceptable between the cytopathologist and the second pathologist, while it was low between the other raters. In the evaluation of the non-benign nodules, the mean category score of the cytopathologist was 3.22 and lower than both pathologists (3.73 and 3.58, respectively). CONCLUSIONS: The intra-observer agreement of pathologists was moderate-to-substantial in the evaluation of non-benign thyroid biopsies according to the Bethesda reporting system. However, the inter-observer agreement was below the lowest acceptable limit when the cytopathologist was taken as a reference.
Authors: Lorenzo Scappaticcio; Pierpaolo Trimboli; Sergio Iorio; Maria Ida Maiorino; Miriam Longo; Laura Croce; Marcello Filograna Pignatelli; Sonia Ferrandes; Immacolata Cozzolino; Marco Montella; Andrea Ronchi; Renato Franco; Mario Rotondi; Giovanni Docimo; Katherine Esposito; Giuseppe Bellastella Journal: Front Endocrinol (Lausanne) Date: 2022-09-15 Impact factor: 6.055