Ayca Toprak1, Ulemu Luhanga2, Sarah Jones3, Andrea Winthrop4, Laura McEwen5. 1. Department of Surgery, Queen's University, Kingston General Hospital, Victory 3, 76 Stuart St., Kingston, Ontario K7L 2V7, Canada; Faculty of Education, Queen's University, Duncan McArthur Hall, 511 Union Street, Kingston, Ontario, Canada. Electronic address: ayca.toprak@gmail.com. 2. Faculty of Education, Queen's University, Duncan McArthur Hall, 511 Union Street, Kingston, Ontario, Canada. 3. Division of Pediatric Surgery, Western University, London, Ontario, Canada. 4. Department of Surgery, Queen's University, Kingston General Hospital, Victory 3, 76 Stuart St., Kingston, Ontario K7L 2V7, Canada. 5. Postgraduate Medical Education, Queen's University, Kingston, Ontario, Canada.
Abstract
BACKGROUND: The Surgical Procedure Feedback Rubric (SPR) is a tool to document resident intraoperative performance and provide targeted feedback to support learning in a competency-based model of surgical education. It differs from other assessment tools because it defines performance criteria by increasing complexity through the use of behavioral anchors, thus embedding standards of performance within the tool. This study explores aspects of validity of the SPR as an assessment tool. METHODS: A 14-month observational study was conducted in 2 surgical training programs. Factor structure of the SPR was examined using exploratory factor analysis. Discriminative ability of the SPR was examined using analysis of variance. RESULTS: The SPR measures 3 factors: Operating Room Preparation, Technical skill, and intrinsic Competencies. Analysis of variance demonstrated the utility of the SPR to discriminate between intraoperative performances of residents by postgraduate training year. CONCLUSIONS: This study contributes to the validity argument for the SPR by providing evidence for construct and discriminative validity.
BACKGROUND: The Surgical Procedure Feedback Rubric (SPR) is a tool to document resident intraoperative performance and provide targeted feedback to support learning in a competency-based model of surgical education. It differs from other assessment tools because it defines performance criteria by increasing complexity through the use of behavioral anchors, thus embedding standards of performance within the tool. This study explores aspects of validity of the SPR as an assessment tool. METHODS: A 14-month observational study was conducted in 2 surgical training programs. Factor structure of the SPR was examined using exploratory factor analysis. Discriminative ability of the SPR was examined using analysis of variance. RESULTS: The SPR measures 3 factors: Operating Room Preparation, Technical skill, and intrinsic Competencies. Analysis of variance demonstrated the utility of the SPR to discriminate between intraoperative performances of residents by postgraduate training year. CONCLUSIONS: This study contributes to the validity argument for the SPR by providing evidence for construct and discriminative validity.