Parth Vyasa1, Ross E Willis2, Brian J Dunkin3, Aimee K Gardner4. 1. Department of Surgery, University of Texas Southwestern Medical Center, Dallas, Texas. 2. Department of Surgery, University of Texas Health Sciences Center San Antonio, San Antonio, Texas. 3. Department of Surgery, Houston Methodist Hospital, Houston, Texas. 4. Department of Surgery, University of Texas Southwestern Medical Center, Dallas, Texas. Electronic address: aimee.gardner@utsouthwestern.edu.
Abstract
BACKGROUND: Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents' assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions-practice only (PO), self-observation (SO), or expert observation (EO)-on self-assessment accuracy. METHODS: Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. RESULTS: Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). DISCUSSION: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. SUMMARY: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.
RCT Entities:
BACKGROUND: Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents' assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions-practice only (PO), self-observation (SO), or expert observation (EO)-on self-assessment accuracy. METHODS: Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. RESULTS: Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). DISCUSSION: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. SUMMARY: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.
Authors: Michael A Scaffidi; Catharine M Walsh; Rishad Khan; Colleen H Parker; Ahmed Al-Mazroui; Michael Abunassar; Alexander W Grindal; Peter Lin; Christopher Wang; Robert Bechara; Samir C Grover Journal: Endosc Int Open Date: 2019-05-03