BACKGROUND: Decision making on the competency of surgical trainees to perform laparoscopic procedures has been hampered by the lack of reliable methods to evaluate operative performance. The goal of this study was to develop a feasible and reliable method of evaluation. METHODS: Twenty-nine senior surgical residents were videotaped performing a low anterior resection and a Nissen fundoplication in a pig. Ten blinded laparoscopists rated the videos independently on two scales. Rating time was minimized by allowing raters to fast-forward through the tapes at their discretion. Interrater reliability and the time required to rate a procedure were assessed. RESULTS: Rating time per procedure was a median of 15 min (range, 6-40). The mean interrater reliability for the two scales was 0.74. CONCLUSIONS: The use of videotapes of operations enabled multiple raters to assess a performance reliably and shortened assessment times by 80%. This assessment technique shows potential as a means of evaluating the performance of advanced laparoscopic procedures by surgical trainees.
BACKGROUND: Decision making on the competency of surgical trainees to perform laparoscopic procedures has been hampered by the lack of reliable methods to evaluate operative performance. The goal of this study was to develop a feasible and reliable method of evaluation. METHODS: Twenty-nine senior surgical residents were videotaped performing a low anterior resection and a Nissen fundoplication in a pig. Ten blinded laparoscopists rated the videos independently on two scales. Rating time was minimized by allowing raters to fast-forward through the tapes at their discretion. Interrater reliability and the time required to rate a procedure were assessed. RESULTS: Rating time per procedure was a median of 15 min (range, 6-40). The mean interrater reliability for the two scales was 0.74. CONCLUSIONS: The use of videotapes of operations enabled multiple raters to assess a performance reliably and shortened assessment times by 80%. This assessment technique shows potential as a means of evaluating the performance of advanced laparoscopic procedures by surgical trainees.
Authors: D J Scott; R V Rege; P C Bergen; W A Guo; R Laycock; S T Tesfay; R J Valentine; D B Jones Journal: J Laparoendosc Adv Surg Tech A Date: 2000-08 Impact factor: 1.878
Authors: D J Scott; P C Bergen; R V Rege; R Laycock; S T Tesfay; R J Valentine; D M Euhus; D R Jeyarajah; W M Thompson; D B Jones Journal: J Am Coll Surg Date: 2000-09 Impact factor: 6.113
Authors: Joseph B House; Suzanne Dooley-Hash; Terry Kowalenko; Athina Sikavitsas; Desiree M Seeyave; John G Younger; Stanley J Hamstra; Michele M Nypaver Journal: J Grad Med Educ Date: 2012-09