Aaron L Grant1, Claire Temple-Oberle2. 1. Tom Baker Cancer Centre, University of Calgary, Calgary, Alberta, Canada. Electronic address: aarongrant@rogers.com. 2. Tom Baker Cancer Centre, University of Calgary, Calgary, Alberta, Canada.
Abstract
OBJECTIVE: The purpose of this study is to determine the utility of self-assessment in microsurgical training using a previously validated rating scale. DESIGN: A prospective study of surgical residents taking a hands-on 5-day microsurgical training course. Learners completed multiple self-assessments of their technical skills using the University of Western Ontario Microsurgical Acquisition/Assessment instrument. Simultaneously, preceptors assessed the learners using the same scale. Self-assessment and preceptor scores were compared using the Pearson correlation coefficient (PCC). RESULTS: There was a significant agreement noted between the 32 preceptor assessments and 36 self-assessments that were completed. Correlation between scores for the knot-tying (PCC = 0.62) and anastomosis modules (PCC = 0.77) was good and excellent, respectively. Preceptor scores and self-scores improved over the duration of the course: for preceptors, knot-tying scores increased from 58% on day 1 to 78% on day 5 (p = 0.02) and anastomosis scores improved from 56% to 82% (p = 0.004); for self-scores, knot-tying scores increased from 44% to 81% (p = 0.001) and anastomosis scores from 49% to 84% (p = 0.001). Learners with greater experience (higher postgraduate year level) tended to have higher self as well as preceptor ratings, albeit not statistically significant. CONCLUSION: Self-assessment using the University of Western Ontario Microsurgical Acquisition/Assessment instrument has good to excellent agreement with preceptor-assessment scores suggesting good interrater reliability. Self-assessment using such tools may, therefore, be used along with preceptor supervision and assessment to potentially improve self-directed learning during these courses.
OBJECTIVE: The purpose of this study is to determine the utility of self-assessment in microsurgical training using a previously validated rating scale. DESIGN: A prospective study of surgical residents taking a hands-on 5-day microsurgical training course. Learners completed multiple self-assessments of their technical skills using the University of Western Ontario Microsurgical Acquisition/Assessment instrument. Simultaneously, preceptors assessed the learners using the same scale. Self-assessment and preceptor scores were compared using the Pearson correlation coefficient (PCC). RESULTS: There was a significant agreement noted between the 32 preceptor assessments and 36 self-assessments that were completed. Correlation between scores for the knot-tying (PCC = 0.62) and anastomosis modules (PCC = 0.77) was good and excellent, respectively. Preceptor scores and self-scores improved over the duration of the course: for preceptors, knot-tying scores increased from 58% on day 1 to 78% on day 5 (p = 0.02) and anastomosis scores improved from 56% to 82% (p = 0.004); for self-scores, knot-tying scores increased from 44% to 81% (p = 0.001) and anastomosis scores from 49% to 84% (p = 0.001). Learners with greater experience (higher postgraduate year level) tended to have higher self as well as preceptor ratings, albeit not statistically significant. CONCLUSION: Self-assessment using the University of Western Ontario Microsurgical Acquisition/Assessment instrument has good to excellent agreement with preceptor-assessment scores suggesting good interrater reliability. Self-assessment using such tools may, therefore, be used along with preceptor supervision and assessment to potentially improve self-directed learning during these courses.
Keywords:
Medical Knowledge; Patient Care; Practice-Based Learning and Improvement; University of Western Ontario Microsurgical Acquisition/Assessment instrument; global rating scale; microsurgery; self-assessment
Authors: Pablo García Feijoo; Fernando Carceller; Alberto Isla Guerrero; Miguel Sáez-Alegre; Maria Luisa Gandía González Journal: Front Surg Date: 2022-04-18