Sylvia Heeneman1,2, Suzanne Schut3,2, Jeroen Donkers3,2, Cees van der Vleuten3,2, Arno Muijtjens3,2. 1. a Department of Pathology , Maastricht University , Maastricht , The Netherlands. 2. c School of Health Professions Education, Faculty of Health, Medicine and Life Sciences , Maastricht University , Maastricht , The Netherlands. 3. b Department of Educational Development and Research , Maastricht University , Maastricht , The Netherlands.
Abstract
BACKGROUND: Progress tests (PT) are used to assess students on topics from all medical disciplines. Progress testing is usually one of the assessment methods of the cognitive domain. There is limited knowledge on how positioning of the PT in a program of assessment (PoA) influences students' PT scores, use of PT feedback and perceived learning value. METHODS: We compared PT total scores and use of a PT test feedback (ProF) system in two medical courses, where the PT is either used as a summative assessment or embedded in a comprehensive PoA and used formatively. In addition, an interview study was used to explore the students' perception on use of PT feedback and perceived learning value. RESULTS: PT total scores were higher, with considerable effect sizes (ESs) and students made more use of ProF when the PT was embedded in a comprehensive PoA. Analysis of feedback in the portfolio stimulated students to look for patterns in PT results, link the PT to other assessment results, follow-up on learning objectives, and integrate the PT in their learning for the entire PoA. CONCLUSIONS: Embedding the PT in an assessment program designed according to the principles of programmatic assessment positively affects PT total scores, use of PT feedback, and perceived learning value.
BACKGROUND: Progress tests (PT) are used to assess students on topics from all medical disciplines. Progress testing is usually one of the assessment methods of the cognitive domain. There is limited knowledge on how positioning of the PT in a program of assessment (PoA) influences students' PT scores, use of PT feedback and perceived learning value. METHODS: We compared PT total scores and use of a PT test feedback (ProF) system in two medical courses, where the PT is either used as a summative assessment or embedded in a comprehensive PoA and used formatively. In addition, an interview study was used to explore the students' perception on use of PT feedback and perceived learning value. RESULTS: PT total scores were higher, with considerable effect sizes (ESs) and students made more use of ProF when the PT was embedded in a comprehensive PoA. Analysis of feedback in the portfolio stimulated students to look for patterns in PT results, link the PT to other assessment results, follow-up on learning objectives, and integrate the PT in their learning for the entire PoA. CONCLUSIONS: Embedding the PT in an assessment program designed according to the principles of programmatic assessment positively affects PT total scores, use of PT feedback, and perceived learning value.
Authors: D R Rutgers; J P J van Schaik; C L J J Kruitwagen; C Haaring; W van Lankeren; A F van Raamt; O Ten Cate Journal: Med Sci Educ Date: 2020-05-13
Authors: Christopher J Harrison; Karen D Könings; Lambert W T Schuwirth; Valerie Wass; Cees P M van der Vleuten Journal: BMC Med Educ Date: 2017-04-28 Impact factor: 2.463
Authors: Suzanne Schut; Lauren A Maggio; Sylvia Heeneman; Jan van Tartwijk; Cees van der Vleuten; Erik Driessen Journal: Perspect Med Educ Date: 2020-10-21