BACKGROUND: Doctor performance assessments based on multi-source feedback (MSF) are increasingly central in professional self-regulation. Research has shown that simple MSF is often unproductive. It has been suggested that MSF should be delivered by a facilitator and combined with a portfolio. AIMS: To compare three methods of MSF for consultants in the Netherlands and evaluate the feasibility, topics addressed and perceived impact upon clinical practice. METHOD: In 2007, 38 facilitators and 109 consultants participated in the study. The performance assessment system was composed of (i) one of the three MSF methods, namely, Violato's Physician Achievement Review (PAR), the method developed by Ramsey et al. for the American Board of Internal Medicine (ABIM), or the Dutch Appraisal and Assessment Instrument (AAI), (ii) portfolio, (iii) assessment interview with a facilitator and (iv) personal development plan. The evaluation consisted of a postal survey for facilitators and consultants. Generalized estimating equations were used to assess the association between MSF method used and perceived impact. RESULTS: It takes on average 8 hours to conduct one assessment. The CanMEDS roles 'collaborator', 'communicator' and 'manager' were discussed in, respectively, 79, 74 and 71% of the assessment interviews. The 'health advocate role' was the subject of conversation in 35% of the interviews. Consultants are more satisfied with feedback that contains narrative comments. The perceived impact of MSF that includes coworkers' perspectives significantly exceeds the perceived impact of methods not including this perspective. CONCLUSIONS: Performance assessments based on MSF combined with a portfolio and a facilitator-led interview seem to be feasible in hospital settings. The perceived impact of MSF increases when it contains coworkers' perspectives.
BACKGROUND: Doctor performance assessments based on multi-source feedback (MSF) are increasingly central in professional self-regulation. Research has shown that simple MSF is often unproductive. It has been suggested that MSF should be delivered by a facilitator and combined with a portfolio. AIMS: To compare three methods of MSF for consultants in the Netherlands and evaluate the feasibility, topics addressed and perceived impact upon clinical practice. METHOD: In 2007, 38 facilitators and 109 consultants participated in the study. The performance assessment system was composed of (i) one of the three MSF methods, namely, Violato's Physician Achievement Review (PAR), the method developed by Ramsey et al. for the American Board of Internal Medicine (ABIM), or the Dutch Appraisal and Assessment Instrument (AAI), (ii) portfolio, (iii) assessment interview with a facilitator and (iv) personal development plan. The evaluation consisted of a postal survey for facilitators and consultants. Generalized estimating equations were used to assess the association between MSF method used and perceived impact. RESULTS: It takes on average 8 hours to conduct one assessment. The CanMEDS roles 'collaborator', 'communicator' and 'manager' were discussed in, respectively, 79, 74 and 71% of the assessment interviews. The 'health advocate role' was the subject of conversation in 35% of the interviews. Consultants are more satisfied with feedback that contains narrative comments. The perceived impact of MSF that includes coworkers' perspectives significantly exceeds the perceived impact of methods not including this perspective. CONCLUSIONS: Performance assessments based on MSF combined with a portfolio and a facilitator-led interview seem to be feasible in hospital settings. The perceived impact of MSF increases when it contains coworkers' perspectives.
Authors: Karlijn Overeem; Hub C Wollersheim; Onyebuchi A Arah; Juliette K Cruijsberg; Richard P T M Grol; Kiki M J M H Lombarts Journal: BMC Health Serv Res Date: 2012-03-26 Impact factor: 2.655
Authors: Rebecca Baines; Sam Regan de Bere; Sebastian Stevens; Jamie Read; Martin Marshall; Mirza Lalani; Marie Bryce; Julian Archer Journal: BMC Med Educ Date: 2018-07-31 Impact factor: 2.463
Authors: Elisabeth A M Pelgrim; Anneke W M Kramer; Henk G A Mokkink; Cees P M Van der Vleuten Journal: BMC Med Educ Date: 2012-10-18 Impact factor: 2.463
Authors: Carolin Sehlbach; Marjan J B Govaerts; Sharon Mitchell; Truus G J Teunissen; Frank W J M Smeenk; Erik W Driessen; Gernot G U Rohde Journal: Health Expect Date: 2019-11-20 Impact factor: 3.377