Judy A Shea1, Lisa M Bellini. 1. Department of Medicine, University of Pennsylvania, 1223 Blockley Hall, 423 Guardian Drive, Philadelphia, PA 19104-6021, USA. sheaja@mail.med.upenn.edu
Abstract
BACKGROUND: Because of the importance of faculty evaluation data for faculty development, promotion, reappointment, and remuneration, the quantity and characteristics of evaluation data need study. PURPOSES: To examine differences in evaluation ratings according to level of learner (student vs. resident) and time of year. METHODS: Retrospective analyses of 1,281 faculty evaluations provided for 132 faculty over a 12-month period by students and residents on inpatient medicine rotations. RESULTS: Faculty had an average of eight evaluations over a year. Students gave more favorable ratings than residents. Over the year, students became less critical and residents became more critical. Winners of teaching awards had better evaluations than other faculty. Standard errors around mean ratings for an individual faculty member were approximately 0.25 on a 4-point scale. CONCLUSIONS: The profile and precision of assessments for an individual will vary based on the number, timing, and source of ratings. Decisions based on similar data should be made with caution.
BACKGROUND: Because of the importance of faculty evaluation data for faculty development, promotion, reappointment, and remuneration, the quantity and characteristics of evaluation data need study. PURPOSES: To examine differences in evaluation ratings according to level of learner (student vs. resident) and time of year. METHODS: Retrospective analyses of 1,281 faculty evaluations provided for 132 faculty over a 12-month period by students and residents on inpatient medicine rotations. RESULTS: Faculty had an average of eight evaluations over a year. Students gave more favorable ratings than residents. Over the year, students became less critical and residents became more critical. Winners of teaching awards had better evaluations than other faculty. Standard errors around mean ratings for an individual faculty member were approximately 0.25 on a 4-point scale. CONCLUSIONS: The profile and precision of assessments for an individual will vary based on the number, timing, and source of ratings. Decisions based on similar data should be made with caution.
Authors: Maarten P M Debets; Renée A Scheepers; Benjamin C M Boerebach; Onyebuchi A Arah; Kiki M J M H Lombarts Journal: BMC Med Educ Date: 2020-09-22 Impact factor: 2.463