Ruth E Blackham1,2, Jeffrey M Hamdorf3,4. 1. CTEC, Medical School, The University of Western Australia, Perth, Western Australia. r-obs@scalpelandsword.com. 2. Western Surgical Health, Nedlands, Western Australia. r-obs@scalpelandsword.com. 3. CTEC, Medical School, The University of Western Australia, Perth, Western Australia. 4. Western Surgical Health, Nedlands, Western Australia.
Abstract
PURPOSE: The global rise in obesity has been accompanied by widespread uptake of the procedure of laparoscopic sleeve gastrectomy. Despite this, the key components for performance assessment have not been standardized for this procedure. The aim of this study was to develop and demonstrate the validity of a Sleeve Objective Structured Assessment of Technical Skill (SOSATS) scale for learning the procedure of laparoscopic sleeve gastrectomy (LSG). MATERIALS AND METHODS: The SOSATS evaluation tool was based upon critical steps of the LSG procedure. Both the SOSATS and the Global Rating Scale (GRS) component of the Objective Structured Assessment of Technical Skill (OSATS) tools were utilized in a prospective single-blinded observational study design of 26 video recordings of surgeons performing sleeve gastrectomies using a novel simulation. The surgeons were allocated into "novice" or "experienced" groups dependent on case-volume criteria. Surgical performance was assessed using both the GRS and SOSATS scales by blinded assessors of the video recordings. RESULTS: Face and content validity were demonstrated for key components of the simulated model. An overall positive correlation was established inferring concurrent validity between the accepted OSATS Global Rating Scale against the SOSATS procedural scale. Construct validity was established for a number of areas of the SOSATS scale. CONCLUSION: The SOSATS scale is shown to exhibit construct and concurrent validity in the simulated setting for the procedure of sleeve gastrectomy. Utilizing this scale to review surgical performance is potentially feasible and reliable but would require further research prior to use in high-stakes assessment processes such as credentialing.
PURPOSE: The global rise in obesity has been accompanied by widespread uptake of the procedure of laparoscopic sleeve gastrectomy. Despite this, the key components for performance assessment have not been standardized for this procedure. The aim of this study was to develop and demonstrate the validity of a Sleeve Objective Structured Assessment of Technical Skill (SOSATS) scale for learning the procedure of laparoscopic sleeve gastrectomy (LSG). MATERIALS AND METHODS: The SOSATS evaluation tool was based upon critical steps of the LSG procedure. Both the SOSATS and the Global Rating Scale (GRS) component of the Objective Structured Assessment of Technical Skill (OSATS) tools were utilized in a prospective single-blinded observational study design of 26 video recordings of surgeons performing sleeve gastrectomies using a novel simulation. The surgeons were allocated into "novice" or "experienced" groups dependent on case-volume criteria. Surgical performance was assessed using both the GRS and SOSATS scales by blinded assessors of the video recordings. RESULTS: Face and content validity were demonstrated for key components of the simulated model. An overall positive correlation was established inferring concurrent validity between the accepted OSATS Global Rating Scale against the SOSATS procedural scale. Construct validity was established for a number of areas of the SOSATS scale. CONCLUSION: The SOSATS scale is shown to exhibit construct and concurrent validity in the simulated setting for the procedure of sleeve gastrectomy. Utilizing this scale to review surgical performance is potentially feasible and reliable but would require further research prior to use in high-stakes assessment processes such as credentialing.