D Szalay1, H MacRae, G Regehr, R Reznick. 1. Faculty of Medicine, University of Toronto, Center for Research in Education at the University Health Network, Toronto, Ontario, Canada.
Abstract
BACKGROUND: This study examined whether an operative product and time to completion could serve as measures of technical skill. METHODS: Nine final-year (PGY5) and 11 penultimate-year (PGY4) general surgery residents participated in a 6-station bench model examination. Time to completion was recorded. Twelve faculty surgeons (2 per station) evaluated the quality of the final product using a 5-point scale. RESULTS: The mean interrater reliability was 0. 59 for product quality. Interstation reliability was 0.59 for analysis of the final product and 0.72 for time to completion. There was 63% and 78% agreement between attendings' ratings and product quality and time scores respectively. PGY5s' mean product quality score was 4.14 +/- 0.26, compared with 3.82 +/- 0.33 for PGY4s (P < 0.05). PGY5s' mean time was 110 +/- 19 minutes compared with PGY4s' 132 +/- 15 (P < 0.05). CONCLUSIONS: Analysis of the operative end product and time to completion offer efficient alternatives to on-line examiner scoring for bench model examinations of technical competence.
BACKGROUND: This study examined whether an operative product and time to completion could serve as measures of technical skill. METHODS: Nine final-year (PGY5) and 11 penultimate-year (PGY4) general surgery residents participated in a 6-station bench model examination. Time to completion was recorded. Twelve faculty surgeons (2 per station) evaluated the quality of the final product using a 5-point scale. RESULTS: The mean interrater reliability was 0. 59 for product quality. Interstation reliability was 0.59 for analysis of the final product and 0.72 for time to completion. There was 63% and 78% agreement between attendings' ratings and product quality and time scores respectively. PGY5s' mean product quality score was 4.14 +/- 0.26, compared with 3.82 +/- 0.33 for PGY4s (P < 0.05). PGY5s' mean time was 110 +/- 19 minutes compared with PGY4s' 132 +/- 15 (P < 0.05). CONCLUSIONS: Analysis of the operative end product and time to completion offer efficient alternatives to on-line examiner scoring for bench model examinations of technical competence.
Authors: Carol-Anne E Moulton; Adam Dubrowski; Helen Macrae; Brent Graham; Ethan Grober; Richard Reznick Journal: Ann Surg Date: 2006-09 Impact factor: 12.969
Authors: R Linke; A Leichtle; F Sheikh; C Schmidt; H Frenzel; H Graefe; B Wollenberg; J E Meyer Journal: Acta Otorhinolaryngol Ital Date: 2013-08 Impact factor: 2.124
Authors: Tomas Ros; Merrick J Moseley; Philip A Bloom; Larry Benjamin; Lesley A Parkinson; John H Gruzelier Journal: BMC Neurosci Date: 2009-07-24 Impact factor: 3.288