Hamza Asif1, Carter McInnis1, Frances Dang1, Henry Ajzenberg1, Peter L Wang2, Adam Mosa1, Gary Ko1, Boris Zevin3, Stephen Mann4, Andrea Winthrop3. 1. Undergraduate Medical Education Program, Queen's University, Kingston, Ontario, Canada. 2. Undergraduate Medical Education Program, Queen's University, Kingston, Ontario, Canada; Department of Medicine, Queen's University, Kingston, Ontario, Canada. 3. Department of Surgery, Kingston General Hospital, Kingston, Ontario, Canada. 4. Department of Surgery, Kingston General Hospital, Kingston, Ontario, Canada. Electronic address: steve.mann@kingstonhsc.ca.
Abstract
BACKGROUND: A major challenge with Competency Based Medical Education (CBME) is that of increased assessment burden on faculty. To reduce this burden, the accuracy and reliability of peer-assessment for surgical skills requires further exploration. METHODS: Forty-two second year medical students were video recorded while performing a simple interrupted suture and an instrument tie. Four novice raters underwent a short training session on the use of the Objective Structured Assessment of Technical Skills (OSATS) checklists. Videos of the suturing task were then independently assessed by the four novice raters and two expert raters on two occasions. Agreement between novice and expert rater scores was calculated using the intraclass correlation coefficient (ICC). RESULTS: For both simple interrupted suturing (ICC = 0.78, CI = 0.66-0.86, p < 0.001) and instrument ties (ICC = 0.87, CI = 0.80-0.92, p < 0.001), there was good agreement between novice and expert raters. CONCLUSIONS: Novice raters can be taught to use the OSATS checklists to assess peers on simple suturing and instrument tying tasks.
BACKGROUND: A major challenge with Competency Based Medical Education (CBME) is that of increased assessment burden on faculty. To reduce this burden, the accuracy and reliability of peer-assessment for surgical skills requires further exploration. METHODS: Forty-two second year medical students were video recorded while performing a simple interrupted suture and an instrument tie. Four novice raters underwent a short training session on the use of the Objective Structured Assessment of Technical Skills (OSATS) checklists. Videos of the suturing task were then independently assessed by the four novice raters and two expert raters on two occasions. Agreement between novice and expert rater scores was calculated using the intraclass correlation coefficient (ICC). RESULTS: For both simple interrupted suturing (ICC = 0.78, CI = 0.66-0.86, p < 0.001) and instrument ties (ICC = 0.87, CI = 0.80-0.92, p < 0.001), there was good agreement between novice and expert raters. CONCLUSIONS: Novice raters can be taught to use the OSATS checklists to assess peers on simple suturing and instrument tying tasks.
Authors: Francesca Palmisani; Patrick Sezen; Elisabeth Haag; Martin L Metzelder; Wilfried Krois Journal: Front Pediatr Date: 2022-08-30 Impact factor: 3.569