M Kathryn Mutter1, Kathryn Pedersen2, Tim Cunningham3,4, James R Martindale5. 1. Department of Emergency Medicine, University of Virginia, 1215 Lee St, PO Box 800699, Charlottesville, VA 22908 USA. 2. Virginia Commonwealth University, Richmond, VA USA. 3. Practice & Innovation, Emory Healthcare, Atlanta, GA USA. 4. Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, GA USA. 5. University of Virginia School of Medicine, Charlottesville, VA USA.
Abstract
BACKGROUND: Many medical schools offer a culminating internship readiness experience. Curricula focus on particular knowledge and skills critical to internship, such as answering urgent nursing pages. Studies have shown student performance improvement with mock paging education programs, but the role of feedback versus self-regulated practice has not been studied. DESIGN AND METHODS: The interprofessional mock paging program included 156 medical students enrolled in a 4th-year internship readiness course and 44 master's level direct entry nursing students. Medical students were randomized to receive verbal feedback immediately after each of the three phone calls (intervention group) or delayed written feedback (control group) after the third phone call only. Specialty-specific case scenarios were developed and a single checklist for all scenarios was developed using the communication tool ISBAR. Medical students and nursing students had separate training sessions before the pages commenced. The nursing students administered the phone calls and evaluated the medical students by ISBAR checklist. An interrater reliability measure was obtained with physician observation of a selection of phone calls. RESULTS: After adjusting for the case effects (different case scenarios for different specialties), students showed no statistically significant differences on checklist scores for case 1 (first case, F = 1.491, df = 1, p = .224), but did show statistically significant differences on checklist scores for case 3 (final case, F = 12.238, df = 1, p = .001). Strong interrater reliability was found between the faculty physician and observed nursing students (ICC = .89). CONCLUSIONS: Immediate feedback significantly improves student checklist scores with a mock paging program. This finding suggests that coaching with feedback may have advantages above self-regulated learning.
BACKGROUND: Many medical schools offer a culminating internship readiness experience. Curricula focus on particular knowledge and skills critical to internship, such as answering urgent nursing pages. Studies have shown student performance improvement with mock paging education programs, but the role of feedback versus self-regulated practice has not been studied. DESIGN AND METHODS: The interprofessional mock paging program included 156 medical students enrolled in a 4th-year internship readiness course and 44 master's level direct entry nursing students. Medical students were randomized to receive verbal feedback immediately after each of the three phone calls (intervention group) or delayed written feedback (control group) after the third phone call only. Specialty-specific case scenarios were developed and a single checklist for all scenarios was developed using the communication tool ISBAR. Medical students and nursing students had separate training sessions before the pages commenced. The nursing students administered the phone calls and evaluated the medical students by ISBAR checklist. An interrater reliability measure was obtained with physician observation of a selection of phone calls. RESULTS: After adjusting for the case effects (different case scenarios for different specialties), students showed no statistically significant differences on checklist scores for case 1 (first case, F = 1.491, df = 1, p = .224), but did show statistically significant differences on checklist scores for case 3 (final case, F = 12.238, df = 1, p = .001). Strong interrater reliability was found between the faculty physician and observed nursing students (ICC = .89). CONCLUSIONS: Immediate feedback significantly improves student checklist scores with a mock paging program. This finding suggests that coaching with feedback may have advantages above self-regulated learning.
Authors: Kevin W Eva; John P W Cunnington; Harold I Reiter; David R Keane; Geoffrey R Norman Journal: Adv Health Sci Educ Theory Pract Date: 2004 Impact factor: 3.853
Authors: Cathy J Schwind; Margaret L Boehler; Stephen J Markwell; Reed G Williams; Michael J Brenner Journal: Acad Med Date: 2011-01 Impact factor: 6.893
Authors: Lauren A Heidemann; Samantha Kempner; Eric Walford; Ryan Chippendale; James T Fitzgerald; Helen K Morgan Journal: J Interprof Care Date: 2020-04-16 Impact factor: 2.338
Authors: David A Davis; Paul E Mazmanian; Michael Fordis; R Van Harrison; Kevin E Thorpe; Laure Perrier Journal: JAMA Date: 2006-09-06 Impact factor: 56.272
Authors: Adam C Frischknecht; Margaret L Boehler; Cathy J Schwind; Melissa E Brunsvold; Larry D Gruppen; Michael J Brenner; Linnea S Hauge Journal: Am J Surg Date: 2014-04-24 Impact factor: 2.565
Authors: Maaike A van Houten-Schat; Joris J Berkhout; Nynke van Dijk; Maaike D Endedijk; A Debbie C Jaarsma; Agnes D Diemers Journal: Med Educ Date: 2018-06-25 Impact factor: 6.251