Jinesa Moodley1, Phillip Williams2, Gabriela Gohla1, Pierre Major3, Michael Bonert1. 1. Pathology and Molecular Medicine, McMaster University, Hamilton, Ontario, Canada. 2. Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada. 3. Medical Oncology, McMaster University, Hamilton, Ontario, Canada.
Abstract
OBJECTIVE: Assess interpretative variation in Nottingham grading using control charts (CCs) and in silico kappa (ISK). METHODS: In house invasive breast cancer cases (2011-2019) at two institutions with a synoptic report were extracted. Pathologist interpretative rates (PIRs) were calculated and normed for Nottingham grade (G) and its components (tubular score (TS), nuclear score (NS), mitotic score (MS)) for pathologists interpreting >35 cases. ISKs were calculated using the ordered mutually exclusive category assumption (OMECA) and maximal categorical overlap assumption (MCOA). RESULTS: The study period included 1,994 resections. Ten pathologists each assessed 38-441 cases and together saw 1,636; these were further analyzed. The PIR medians (normed ranges) were: G1:24%(18-27%), G2:53%(43-56%) and G3:26%(19-33%). The MCOA ISK and the number of statistical outliers (p< 0.05/p< 0.001) to the group median interpretive rate (GMIR) for the ten pathologists was G1: 0.82(2/0 of 10), G2: 0.76(1/1), G3: 0.71(3/1), TS1: 0.79(1/0), TS2: 0.63(5/1), TS3: 0.66(5/1), NS1: 0.37(5/4), NS2: 0.60(4/3), NS3: 0.59(4/4), MS1: 0.78(3/1), MS2: 0.78(3/1), MS3: 0.77(2/0). The OMECA ISK was 0.62, 0.49, 0.69 and 0.71 for TS, NS, MS and G. CONCLUSIONS: The nuclear score has the most outliers. NS1 appears to be inconsistently used. ISK mirrors trends in conventional kappa studies. CCs and ISK allow insight into interpretive variation and may be essential for the next generation in quality.
OBJECTIVE: Assess interpretative variation in Nottingham grading using control charts (CCs) and in silico kappa (ISK). METHODS: In house invasive breast cancer cases (2011-2019) at two institutions with a synoptic report were extracted. Pathologist interpretative rates (PIRs) were calculated and normed for Nottingham grade (G) and its components (tubular score (TS), nuclear score (NS), mitotic score (MS)) for pathologists interpreting >35 cases. ISKs were calculated using the ordered mutually exclusive category assumption (OMECA) and maximal categorical overlap assumption (MCOA). RESULTS: The study period included 1,994 resections. Ten pathologists each assessed 38-441 cases and together saw 1,636; these were further analyzed. The PIR medians (normed ranges) were: G1:24%(18-27%), G2:53%(43-56%) and G3:26%(19-33%). The MCOA ISK and the number of statistical outliers (p< 0.05/p< 0.001) to the group median interpretive rate (GMIR) for the ten pathologists was G1: 0.82(2/0 of 10), G2: 0.76(1/1), G3: 0.71(3/1), TS1: 0.79(1/0), TS2: 0.63(5/1), TS3: 0.66(5/1), NS1: 0.37(5/4), NS2: 0.60(4/3), NS3: 0.59(4/4), MS1: 0.78(3/1), MS2: 0.78(3/1), MS3: 0.77(2/0). The OMECA ISK was 0.62, 0.49, 0.69 and 0.71 for TS, NS, MS and G. CONCLUSIONS: The nuclear score has the most outliers. NS1 appears to be inconsistently used. ISK mirrors trends in conventional kappa studies. CCs and ISK allow insight into interpretive variation and may be essential for the next generation in quality.
Authors: John S Meyer; Consuelo Alvarez; Clara Milikowski; Neal Olson; Irma Russo; Jose Russo; Andrew Glass; Barbara A Zehnbauer; Karen Lister; Reza Parwaresch Journal: Mod Pathol Date: 2005-08 Impact factor: 7.842
Authors: P Boiesen; P O Bendahl; L Anagnostaki; H Domanski; E Holm; I Idvall; S Johansson; O Ljungberg; A Ringberg; G Ostberg; M Fernö Journal: Acta Oncol Date: 2000 Impact factor: 4.089
Authors: Emad A Rakha; Jorge S Reis-Filho; Frederick Baehner; David J Dabbs; Thomas Decker; Vincenzo Eusebi; Stephen B Fox; Shu Ichihara; Jocelyne Jacquemier; Sunil R Lakhani; José Palacios; Andrea L Richardson; Stuart J Schnitt; Fernando C Schmitt; Puay-Hoon Tan; Gary M Tse; Sunil Badve; Ian O Ellis Journal: Breast Cancer Res Date: 2010-07-30 Impact factor: 6.466