Patricia A Carney1, Paul D Frederick2, Lisa M Reisch2, Linda Titus3,4,5, Stevan R Knezevich6, Martin A Weinstock7, Michael W Piepkorn8,9, Raymond L Barnhill10, David E Elder11, Donald L Weaver12, Joann G Elmore13. 1. Department of Family Medicine, Oregon Health & Science University, Portland, Oregon. 2. Department of Internal Medicine, University of Washington School of Medicine, Seattle, Washington. 3. Department of Epidemiology, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire. 4. Department of Pediatrics, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire. 5. Norris Cotton Cancer Center, Lebanon, New Hampshire. 6. Pathology Associates, Clovis, California. 7. Dermatology, The Warren Alpert Medical School of Brown University, Providence, Rhode Island. 8. Division of Dermatology, Department of Medicine, University of Washington School of Medicine, Seattle, Washington. 9. Dermatopathology Northwest, Bellevue, Washington. 10. Department of Pathology, Institut Curie, University of Paris Descartes, Paris, France. 11. Department of Pathology, University of Pennsylvania, Philadelphia, Pennsylvania. 12. Department of Pathology, University of Vermont, Burlington, Vermont. 13. Department of Internal Medicine, University of Washington, Seattle, Washington.
Abstract
BACKGROUND: Little is known about how pathologists process differences between actual and perceived interpretations. OBJECTIVE: To compare perceived and actual diagnostic agreement before and after educational interventions. METHODS: Pathologists interpreted test sets of skin and/or breast specimens that included benign, atypical, in situ and invasive lesions. Interventions involved self-directed learning, one skin and one breast, that showed pathologists how their interpretations compared to a reference diagnoses. Prior to the educational intervention, participants estimated how their interpretations would compare to the reference diagnoses. After the intervention, participants estimated their overall agreement with the reference diagnoses. Perceived and actual agreements were compared. RESULTS: For pathologists interpreting skin, mean actual agreement was 52.4% and overall pre- and postinterventional mean perceived agreement was 72.9% vs 54.2%, an overestimated mean difference of 20.5% (95% confidence interval [CI] 17.2% to 24.0%) and 1.8% (95% CI -0.5% to 4.1%), respectively. For pathologists interpreting breast, mean actual agreement was 75.9% and overall pre- and postinterventional mean perceived agreement was 81.4% vs 76.9%, an overestimation of 5.5% (95% CI 3.0% to 8.0%) and 1.0% (95% CI 0.0% to 2.0%), respectively. CONCLUSIONS: Pathologists interpreting breast tissue had improved comprehension of their performance after the intervention compared to pathologists interpreting skin lesions.
BACKGROUND: Little is known about how pathologists process differences between actual and perceived interpretations. OBJECTIVE: To compare perceived and actual diagnostic agreement before and after educational interventions. METHODS: Pathologists interpreted test sets of skin and/or breast specimens that included benign, atypical, in situ and invasive lesions. Interventions involved self-directed learning, one skin and one breast, that showed pathologists how their interpretations compared to a reference diagnoses. Prior to the educational intervention, participants estimated how their interpretations would compare to the reference diagnoses. After the intervention, participants estimated their overall agreement with the reference diagnoses. Perceived and actual agreements were compared. RESULTS: For pathologists interpreting skin, mean actual agreement was 52.4% and overall pre- and postinterventional mean perceived agreement was 72.9% vs 54.2%, an overestimated mean difference of 20.5% (95% confidence interval [CI] 17.2% to 24.0%) and 1.8% (95% CI -0.5% to 4.1%), respectively. For pathologists interpreting breast, mean actual agreement was 75.9% and overall pre- and postinterventional mean perceived agreement was 81.4% vs 76.9%, an overestimation of 5.5% (95% CI 3.0% to 8.0%) and 1.0% (95% CI 0.0% to 2.0%), respectively. CONCLUSIONS: Pathologists interpreting breast tissue had improved comprehension of their performance after the intervention compared to pathologists interpreting skin lesions.
Authors: Michael W Piepkorn; Raymond L Barnhill; David E Elder; Stevan R Knezevich; Patricia A Carney; Lisa M Reisch; Joann G Elmore Journal: J Am Acad Dermatol Date: 2013-10-28 Impact factor: 11.527
Authors: Joann G Elmore; Gary M Longton; Patricia A Carney; Berta M Geller; Tracy Onega; Anna N A Tosteson; Heidi D Nelson; Margaret S Pepe; Kimberly H Allison; Stuart J Schnitt; Frances P O'Malley; Donald L Weaver Journal: JAMA Date: 2015-03-17 Impact factor: 56.272
Authors: R P Braun; D Gutkowicz-Krusin; H Rabinovitz; A Cognetta; R Hofmann-Wellenhof; V Ahlgrimm-Siess; D Polsky; M Oliviero; I Kolm; P Googe; R King; V G Prieto; L French; A Marghoob; M Mihm Journal: Dermatology Date: 2012-03-20 Impact factor: 5.366
Authors: Stevan R Knezevich; Raymond L Barnhill; David E Elder; Michael W Piepkorn; Lisa M Reisch; Gaia Pocobelli; Patricia A Carney; Joann G Elmore Journal: J Am Acad Dermatol Date: 2014-09-16 Impact factor: 11.527
Authors: Lisa M Reisch; Patricia A Carney; Natalia V Oster; Donald L Weaver; Heidi D Nelson; Paul D Frederick; Joann G Elmore Journal: Am J Clin Pathol Date: 2015-12 Impact factor: 2.493
Authors: Patricia A Carney; Paul D Frederick; Lisa M Reisch; Stevan Knezevich; Michael W Piepkorn; Raymond L Barnhill; David E Elder; Berta M Geller; Linda Titus; Martin A Weinstock; Heidi D Nelson; Joann G Elmore Journal: J Am Acad Dermatol Date: 2015-11-11 Impact factor: 11.527
Authors: Natalia V Oster; Patricia A Carney; Kimberly H Allison; Donald L Weaver; Lisa M Reisch; Gary Longton; Tracy Onega; Margaret Pepe; Berta M Geller; Heidi D Nelson; Tyler R Ross; Aanna N A Tosteson; Joann G Elmore Journal: BMC Womens Health Date: 2013-02-05 Impact factor: 2.809
Authors: Joann G Elmore; Anna Na Tosteson; Margaret S Pepe; Gary M Longton; Heidi D Nelson; Berta Geller; Patricia A Carney; Tracy Onega; Kimberly H Allison; Sara L Jackson; Donald L Weaver Journal: BMJ Date: 2016-06-22