BACKGROUND: Postgraduate medical education programs would benefit from a robust process for training and assessment of competence in resuscitation early in residency. OBJECTIVE: To describe and evaluate the Nightmares Course, a novel, competency-based, transitional curriculum and assessment program in resuscitation medicine at Queen's University in Kingston, Ontario, Canada. METHODS: First-year residents participated in the longitudinal Nightmares Course at Queen's University during the 2015-2016 academic year. An expert working group developed the entrustable professional activity and curricular design for the course. Formative feedback was provided following each simulation-based session, and we employed a summative objective structured clinical examination (OSCE) utilizing a modified Queen's Simulation Assessment Tool. A generalizability study and resident surveys were performed to evaluate the course and assessment process. RESULTS: A total of 40 residents participated in the course, and 23 (58%) participated in the OSCE. Eight of 23 (35%) did not meet the predetermined competency threshold and required remediation. The OSCE demonstrated an acceptable phi coefficient of 0.73. The approximate costs were $240 per Nightmares session, $10,560 for the entire 44-session curriculum, and $3,900 for the summative OSCE. CONCLUSIONS: The Nightmares Course demonstrated feasibility and acceptability, and is applicable to a broad array of postgraduate medical education programs. The entrustment-based assessment detected several residents not meeting a minimum competency threshold, and directed them to additional training.
BACKGROUND: Postgraduate medical education programs would benefit from a robust process for training and assessment of competence in resuscitation early in residency. OBJECTIVE: To describe and evaluate the Nightmares Course, a novel, competency-based, transitional curriculum and assessment program in resuscitation medicine at Queen's University in Kingston, Ontario, Canada. METHODS: First-year residents participated in the longitudinal Nightmares Course at Queen's University during the 2015-2016 academic year. An expert working group developed the entrustable professional activity and curricular design for the course. Formative feedback was provided following each simulation-based session, and we employed a summative objective structured clinical examination (OSCE) utilizing a modified Queen's Simulation Assessment Tool. A generalizability study and resident surveys were performed to evaluate the course and assessment process. RESULTS: A total of 40 residents participated in the course, and 23 (58%) participated in the OSCE. Eight of 23 (35%) did not meet the predetermined competency threshold and required remediation. The OSCE demonstrated an acceptable phi coefficient of 0.73. The approximate costs were $240 per Nightmares session, $10,560 for the entire 44-session curriculum, and $3,900 for the summative OSCE. CONCLUSIONS: The Nightmares Course demonstrated feasibility and acceptability, and is applicable to a broad array of postgraduate medical education programs. The entrustment-based assessment detected several residents not meeting a minimum competency threshold, and directed them to additional training.
Authors: L Michael Brunt; Valerie J Halpin; Mary E Klingensmith; Debra Tiemann; Brent D Matthews; Jennifer A Spitler; Richard A Pierce Journal: J Am Coll Surg Date: 2008-03-03 Impact factor: 6.113
Authors: Andrew Koch Hall; Jeffrey Damon Dagnone; Lauren Lacroix; William Pickett; Don Albert Klinger Journal: Simul Healthc Date: 2015-04 Impact factor: 1.929
Authors: Richard J Parent; Timothy A Plerhoples; Eliza E Long; Danielle M Zimmer; Mediget Teshome; Catherine J Mohr; Daphne P Ly; Tina Hernandez-Boussard; Myriam J Curet; Sanjeev Dutta Journal: J Am Coll Surg Date: 2010-06 Impact factor: 6.113
Authors: Richard H Blum; Daniel B Raemer; John S Carroll; Neelakantan Sunder; David M Felstein; Jeffrey B Cooper Journal: Med Educ Date: 2004-01 Impact factor: 6.251
Authors: J Damon Dagnone; Andrew K Hall; Stefanie Sebok-Syer; Don Klinger; Karen Woolfrey; Colleen Davison; John Ross; Gordon McNeil; Sean Moore Journal: Can Med Educ J Date: 2016-03-31
Authors: Shera Hosseini; Yusuf Yilmaz; Kaushal Shah; Michael Gottlieb; Christine R Stehman; Andrew K Hall; Teresa M Chan Journal: AEM Educ Train Date: 2022-06-23