BACKGROUND: This study evaluates how residents' evaluations and self-evaluations of surgeon's teaching performance evolve after two cycles of evaluation, reporting, and feedback. Furthermore, the influence of over- and underestimating own performance on subsequent teaching performance was investigated. METHODS: In a multicenter cohort study, 351 surgeons evaluated themselves and were also evaluated by residents during annual evaluation periods for three subsequent years. At the end of each evaluation period, surgeons received a personal report summarizing the residents' feedback. Changes in each surgeon's teaching performance evaluated on a five-point scale were studied using growth models. The effect of surgeons over- or underestimating their own performance on the improvement of teaching performance was studied using adjusted multivariable regressions. RESULTS: Compared with the first (median score: 3.83, 20th to 80th percentile score: 3.46-4.16) and second (median: 3.82, 20th to 80th: 3.46-4.14) evaluation period, residents evaluated surgeon's teaching performance higher during the third evaluation period (median: 3.91, 20th to 80th: 3.59-4.27), p < 0.001. Surgeons did not alter self-evaluation scores over the three periods. Surgeons who overestimated their teaching performance received lower subsequent performance scores by residents (regression coefficient b: -0.08, 95 % confidence limits (CL): -0.18, 0.02) and self (b: -0.12, 95 % CL: -0.21, -0.02). Surgeons who underestimated their performance subsequently scored themselves higher (b: 0.10, 95 % CL: 0.03, 0.16), but were evaluated equally by residents. CONCLUSIONS: Residents' evaluation of surgeon's teaching performance was enhanced after two cycles of evaluation, reporting, and feedback. Overestimating own teaching performance could impede subsequent performance.
BACKGROUND: This study evaluates how residents' evaluations and self-evaluations of surgeon's teaching performance evolve after two cycles of evaluation, reporting, and feedback. Furthermore, the influence of over- and underestimating own performance on subsequent teaching performance was investigated. METHODS: In a multicenter cohort study, 351 surgeons evaluated themselves and were also evaluated by residents during annual evaluation periods for three subsequent years. At the end of each evaluation period, surgeons received a personal report summarizing the residents' feedback. Changes in each surgeon's teaching performance evaluated on a five-point scale were studied using growth models. The effect of surgeons over- or underestimating their own performance on the improvement of teaching performance was studied using adjusted multivariable regressions. RESULTS: Compared with the first (median score: 3.83, 20th to 80th percentile score: 3.46-4.16) and second (median: 3.82, 20th to 80th: 3.46-4.14) evaluation period, residents evaluated surgeon's teaching performance higher during the third evaluation period (median: 3.91, 20th to 80th: 3.59-4.27), p < 0.001. Surgeons did not alter self-evaluation scores over the three periods. Surgeons who overestimated their teaching performance received lower subsequent performance scores by residents (regression coefficient b: -0.08, 95 % confidence limits (CL): -0.18, 0.02) and self (b: -0.12, 95 % CL: -0.21, -0.02). Surgeons who underestimated their performance subsequently scored themselves higher (b: 0.10, 95 % CL: 0.03, 0.16), but were evaluated equally by residents. CONCLUSIONS: Residents' evaluation of surgeon's teaching performance was enhanced after two cycles of evaluation, reporting, and feedback. Overestimating own teaching performance could impede subsequent performance.
Authors: Noah Ivers; Gro Jamtvedt; Signe Flottorp; Jane M Young; Jan Odgaard-Jensen; Simon D French; Mary Ann O'Brien; Marit Johansen; Jeremy Grimshaw; Andrew D Oxman Journal: Cochrane Database Syst Rev Date: 2012-06-13
Authors: Benjamin C M Boerebach; Onyebuchi A Arah; Olivier R C Busch; Kiki M J M H Lombarts Journal: J Surg Educ Date: 2012 Jul-Aug Impact factor: 2.891
Authors: Renée M van der Leeuw; Karlijn Overeem; Onyebuchi A Arah; Maas Jan Heineman; Kiki M J M H Lombarts Journal: Acad Med Date: 2013-09 Impact factor: 6.893
Authors: Joan Sargeant; Elaine McNaughton; Stewart Mercer; Douglas Murphy; Patricia Sullivan; David A Bruce Journal: Med Teach Date: 2011 Impact factor: 3.650
Authors: David A Davis; Paul E Mazmanian; Michael Fordis; R Van Harrison; Kevin E Thorpe; Laure Perrier Journal: JAMA Date: 2006-09-06 Impact factor: 56.272
Authors: Joan Sargeant; Karen Mann; Douglas Sinclair; Cees Van der Vleuten; Job Metsemakers Journal: Adv Health Sci Educ Theory Pract Date: 2006-11-08 Impact factor: 3.853
Authors: Kevin W Eva; Heather Armson; Eric Holmboe; Jocelyn Lockyer; Elaine Loney; Karen Mann; Joan Sargeant Journal: Adv Health Sci Educ Theory Pract Date: 2011-04-06 Impact factor: 3.853
Authors: Renée E Stalmeijer; Diana H J M Dolmans; Ineke H A P Wolfhagen; Wim G Peters; Lieve van Coppenolle; Albert J J A Scherpbier Journal: Adv Health Sci Educ Theory Pract Date: 2009-09-25 Impact factor: 3.853
Authors: Thea van Roermund; Marie-Louise Schreurs; Henk Mokkink; Ben Bottema; Albert Scherpbier; Chris van Weel Journal: BMC Med Educ Date: 2013-07-16 Impact factor: 2.463
Authors: Kelly R Murphy; John E McManigle; Benjamin M Wildman-Tobriner; Amy Little Jones; Travis J Dekker; Barrett A Little; Joseph P Doty; Dean C Taylor Journal: J Healthc Leadersh Date: 2016-10-20
Authors: Milou E W M Silkens; Irene A Slootweg; Albert J J A Scherpbier; Maas Jan Heineman; Kiki M J M H Lombarts Journal: Perspect Med Educ Date: 2017-12
Authors: Milou E W M Silkens; Onyebuchi A Arah; Albert J J A Scherpbier; Maas Jan Heineman; Kiki M J M H Lombarts Journal: PLoS One Date: 2016-01-14 Impact factor: 3.240
Authors: Milou E W M Silkens; Kiki M J M H Lombarts; Albert J J A Scherpbier; Maas Jan Heineman; Onyebuchi A Arah Journal: BMC Med Educ Date: 2017-12-06 Impact factor: 2.463