S K Sarker1, R Hutchinson, A Chang, C Vincent, A W Darzi. 1. Department of Surgical Oncology and Technology, St Mary's Hospital, Imperial College London, London, W2 1NY, United Kingdom. s.sarker@imperial.ac.uk
Abstract
BACKGROUND: Evaluation of technical skill is notoriously difficult because of the subjectivity and time-consuming expert analysis. No ongoing evaluation scheme exists to assess the continuing competency of surgeons. This study examined whether surgeons' self-assessment accurately reflects their actual surgical technique. METHODS: Hierarchical task analysis (HTA) of laparoscopic cholecystectomy was constructed. Ten expert surgeons were asked to modify the HTA for their own technique. The HTAs of these surgeons then were compared with their actual operations, which had been recorded and assessed by two observers. RESULTS: A total of 40 operations were assessed. All the gallbladders subjected to surgery were classified as grades 1 to 3. The mean interrater reliability for the two observers had a k value of 0.84 (p < 0.05), and the mean intrarater reliability between surgeons and observers had a k value of 0.79 (p < 0.05). CONCLUSIONS: Surgeons' self-evaluation is accurate for technical skills aspects of their operations. This study demonstrates that self-appraisal using HTA is feasible, accurate, and practical. The authors aim to increase the numbers in their study and also to recruit residents.
BACKGROUND: Evaluation of technical skill is notoriously difficult because of the subjectivity and time-consuming expert analysis. No ongoing evaluation scheme exists to assess the continuing competency of surgeons. This study examined whether surgeons' self-assessment accurately reflects their actual surgical technique. METHODS: Hierarchical task analysis (HTA) of laparoscopic cholecystectomy was constructed. Ten expert surgeons were asked to modify the HTA for their own technique. The HTAs of these surgeons then were compared with their actual operations, which had been recorded and assessed by two observers. RESULTS: A total of 40 operations were assessed. All the gallbladders subjected to surgery were classified as grades 1 to 3. The mean interrater reliability for the two observers had a k value of 0.84 (p < 0.05), and the mean intrarater reliability between surgeons and observers had a k value of 0.79 (p < 0.05). CONCLUSIONS: Surgeons' self-evaluation is accurate for technical skills aspects of their operations. This study demonstrates that self-appraisal using HTA is feasible, accurate, and practical. The authors aim to increase the numbers in their study and also to recruit residents.
Authors: Arun Nemani; Ganesh Sankaranarayanan; Jaisa S Olasky; Souheil Adra; Kurt E Roberts; Lucian Panait; Steven D Schwaitzberg; Daniel B Jones; Suvranu De Journal: Surg Endosc Date: 2014-03-12 Impact factor: 4.584
Authors: Roger D Dias; Marco A Zenati; Heather M Conboy; Lori A Clarke; Leon J Osterweil; George S Avrunin; Steven J Yule Journal: Ann Surg Date: 2021-08-01 Impact factor: 12.969
Authors: Jakob van Oldenrijk; Matthias U Schafroth; Mohit Bhandari; Wouter C Runne; Rudolf W Poolman Journal: BMC Musculoskelet Disord Date: 2008-06-24 Impact factor: 2.362