Anita Acai1, Shelly-Anne Li2, Jonathan Sherbino3, Teresa M Chan3. 1. a Department of Psychology, Neuroscience & Behaviour and Office of Education Science, Department of Surgery, McMaster University , Hamilton , Ontario , Canada. 2. b Lawrence S. Bloomberg Faculty of Nursing, University of Toronto and The Hospital for Sick Children , Toronto , Ontario , Canada. 3. c Division of Emergency Medicine, Department of Medicine, and McMaster Education Research, Innovation and Theory Program, McMaster University , Hamilton , Ontario , Canada.
Abstract
Construct: The McMaster Modular Assessment Program (McMAP) is a programmatic workplace-based assessment (WBA) system that provides emergency medicine trainees with competency judgments through frequent task-specific and global daily assessments. Background: The longevity of McMAP relative to other programmatic WBA systems affords a unique view that precedes large-scale transitions to competency-based medical education (CBME), particularly in North America. Although prior work has described the perspective of residents using this system, the in-depth experiences of assessors using the system have yet to be explored. This perspective is important for understanding the validity of the competency judgments the system produces. Approach: We conducted a qualitative study that used semi-structured interviews analyzed using interpretive description (Thorne) to explore 16 attending physicians' experiences using McMAP. Data analysis was completed independently by 2 researchers, who met regularly to discuss codes and resolve any disagreements. Results: Having a structured assessment framework for a range of clinical tasks has helped encourage what attendings perceived to be more frequent and better-quality assessments, with the added advantages of being holistic, flexible, and learner-driven. However, attendings also perceived a number of challenges of McMAP and programmatic WBA more broadly. These included a reluctance to give and to document negative feedback, "gaming" of the system by both attendings and residents, and a variety of logistic and technology-related concerns. Conclusions: Based on our findings, we offer several key recommendations that can help programs maximize the benefits of programmatic WBA as they transition to CBME.
Construct: The McMaster Modular Assessment Program (McMAP) is a programmatic workplace-based assessment (WBA) system that provides emergency medicine trainees with competency judgments through frequent task-specific and global daily assessments. Background: The longevity of McMAP relative to other programmatic WBA systems affords a unique view that precedes large-scale transitions to competency-based medical education (CBME), particularly in North America. Although prior work has described the perspective of residents using this system, the in-depth experiences of assessors using the system have yet to be explored. This perspective is important for understanding the validity of the competency judgments the system produces. Approach: We conducted a qualitative study that used semi-structured interviews analyzed using interpretive description (Thorne) to explore 16 attending physicians' experiences using McMAP. Data analysis was completed independently by 2 researchers, who met regularly to discuss codes and resolve any disagreements. Results: Having a structured assessment framework for a range of clinical tasks has helped encourage what attendings perceived to be more frequent and better-quality assessments, with the added advantages of being holistic, flexible, and learner-driven. However, attendings also perceived a number of challenges of McMAP and programmatic WBA more broadly. These included a reluctance to give and to document negative feedback, "gaming" of the system by both attendings and residents, and a variety of logistic and technology-related concerns. Conclusions: Based on our findings, we offer several key recommendations that can help programs maximize the benefits of programmatic WBA as they transition to CBME.
Authors: Brent Thoma; Andrew K Hall; Kevin Clark; Nazanin Meshkat; Warren J Cheung; Pierre Desaulniers; Cheryl Ffrench; Allison Meiwald; Christine Meyers; Catherine Patocka; Lorri Beatty; Teresa M Chan Journal: J Grad Med Educ Date: 2020-08
Authors: Teresa M Chan; Stefanie S Sebok-Syer; Warren J Cheung; Martin Pusic; Christine Stehman; Michael Gottlieb Journal: AEM Educ Train Date: 2020-11-05
Authors: Suzanne Schut; Sylvia Heeneman; Beth Bierer; Erik Driessen; Jan van Tartwijk; Cees van der Vleuten Journal: Med Educ Date: 2020-04-06 Impact factor: 6.251
Authors: Suzanne Schut; Lauren A Maggio; Sylvia Heeneman; Jan van Tartwijk; Cees van der Vleuten; Erik Driessen Journal: Perspect Med Educ Date: 2020-10-21
Authors: Yusuf Yilmaz; Robert Carey; Teresa M Chan; Venkat Bandi; Shisong Wang; Robert A Woods; Debajyoti Mondal; Brent Thoma Journal: Can Med Educ J Date: 2021-09-14