Martin H Leamon1, Laurie Fields. 1. Department of Psychiatry, University of California, Davis School of Medicine, Sacramento, California 95817, USA. mhleamon@ucdavis.edu
Abstract
BACKGROUND: Despite widespread use, misunderstandings persist about student evaluations of teaching. These evaluations have not been well examined in the common medical school setting of the multi-instructor, preclinical lecture course. PURPOSE: The study evaluated the psychometrics of a brief student evaluation of a teaching instrument developed for a multi-instructor 2nd-year course and described its application. METHODS: An 11-item instrument was developed and administered to 276 students to evaluate 27 lecturers per year in 3 years of an introductory clinical psychiatry course. A fully crossed research design allowed for a thorough analysis of variability in ratings. RESULTS: Generalizability analysis showed good reliability and relatively large Student x Lecturer interactions. Profile analysis generated distinct lecturer teaching profiles. CONCLUSIONS: Judicious use of a psychometrically sound student evaluation of a teaching instrument can be used to assist faculty and course development. Administering the evaluation instrument to an entire class produces no better reliability than administration to randomly selected subgroups of students.
BACKGROUND: Despite widespread use, misunderstandings persist about student evaluations of teaching. These evaluations have not been well examined in the common medical school setting of the multi-instructor, preclinical lecture course. PURPOSE: The study evaluated the psychometrics of a brief student evaluation of a teaching instrument developed for a multi-instructor 2nd-year course and described its application. METHODS: An 11-item instrument was developed and administered to 276 students to evaluate 27 lecturers per year in 3 years of an introductory clinical psychiatry course. A fully crossed research design allowed for a thorough analysis of variability in ratings. RESULTS: Generalizability analysis showed good reliability and relatively large Student x Lecturer interactions. Profile analysis generated distinct lecturer teaching profiles. CONCLUSIONS: Judicious use of a psychometrically sound student evaluation of a teaching instrument can be used to assist faculty and course development. Administering the evaluation instrument to an entire class produces no better reliability than administration to randomly selected subgroups of students.
Authors: Jung Eun Hwang; Na Jin Kim; Meiying Song; Yinji Cui; Eun Ju Kim; In Ae Park; Hye In Lee; Hye Jin Gong; Su Young Kim Journal: BMC Med Educ Date: 2017-12-12 Impact factor: 2.463
Authors: Tjark Müller; Diego Montano; Herbert Poinstingl; Katharina Dreiling; Sarah Schiekirka-Schwake; Sven Anders; Tobias Raupach; Nicole von Steinbüchel Journal: BMC Med Educ Date: 2017-08-18 Impact factor: 2.463