E M Bonrath1, B Zevin, N J Dedy, T P Grantcharov. 1. Division of General Surgery, St Michael's Hospital, University of Toronto, 30 Bond Street, Toronto, Ontario M5B 1W8, Canada. bonrathe@smh.ca
Abstract
BACKGROUND: Surgical error analysis is essential for investigating mechanisms of errors, events and adverse outcomes. Furthermore, it provides valuable information for formative feedback and quality control. The aim of the present study was to design and validate a technical error rating tool in laparoscopic surgery. METHODS: The framework consisted of nine task groups and four error modes. Unedited videos of laparoscopic Roux-en-Y gastric bypass procedures were rated and analysed. The Objective Structured Assessment of Technical Skill (OSATS) global rating scale was used to assess technical skills. The incidence of errors and of injuries (events) were the main outcome measures, and were used to calculate the reliability, and construct and concurrent validity of the instrument. RESULTS: Two observers analysed 25 procedures. Inter-rater reliability was high regarding total number of errors (intraclass correlation coefficient (ICC) 0·90) and events (ICC 0·85). The median (interquartile range) error rate was 35 (26-44) and the event rate 3 (2-3) per procedure. Error frequencies and OSATS scores correlated significantly in all operative steps (rs = -0·75 to -0·40, P = <0·001-0·046). Surgeons demonstrating high OSATS scores had lower median (i.q.r.) error rates than surgeons with low scores in three of four steps: measuring bowel (4 (2-7) versus 10 (9-11); P = 0·004), jejunojejunostomy formation (5 (2-6) versus 10 (9-11); P = 0·001) and pouch formation (4 (3-6) versus 9 (5-12); P = 0·004). CONCLUSION: The proposed error rating tool allows an objective and reliable assessment of operative performance in laparoscopic gastric bypass procedures.
BACKGROUND: Surgical error analysis is essential for investigating mechanisms of errors, events and adverse outcomes. Furthermore, it provides valuable information for formative feedback and quality control. The aim of the present study was to design and validate a technical error rating tool in laparoscopic surgery. METHODS: The framework consisted of nine task groups and four error modes. Unedited videos of laparoscopic Roux-en-Y gastric bypass procedures were rated and analysed. The Objective Structured Assessment of Technical Skill (OSATS) global rating scale was used to assess technical skills. The incidence of errors and of injuries (events) were the main outcome measures, and were used to calculate the reliability, and construct and concurrent validity of the instrument. RESULTS: Two observers analysed 25 procedures. Inter-rater reliability was high regarding total number of errors (intraclass correlation coefficient (ICC) 0·90) and events (ICC 0·85). The median (interquartile range) error rate was 35 (26-44) and the event rate 3 (2-3) per procedure. Error frequencies and OSATS scores correlated significantly in all operative steps (rs = -0·75 to -0·40, P = <0·001-0·046). Surgeons demonstrating high OSATS scores had lower median (i.q.r.) error rates than surgeons with low scores in three of four steps: measuring bowel (4 (2-7) versus 10 (9-11); P = 0·004), jejunojejunostomy formation (5 (2-6) versus 10 (9-11); P = 0·001) and pouch formation (4 (3-6) versus 9 (5-12); P = 0·004). CONCLUSION: The proposed error rating tool allows an objective and reliable assessment of operative performance in laparoscopic gastric bypass procedures.
Authors: Francisco Alba Mesa; Miguel Angel Sanchez Hurtado; Francisco Miguel Sanchez Margallo; Virginia Gomez Cabeza de Vaca; Andrzej L Komorowski Journal: World J Surg Date: 2015-02 Impact factor: 3.352