L Hull1, C Bicknell2, K Patel3, R Vyas3, I Van Herzeele4, N Sevdalis5, N Rudarakanchana2. 1. Imperial Patient Safety Translational Research Centre, Imperial College London, London, UK. Electronic address: louise.hull@klc.ac.uk. 2. Department of Surgery and Cancer, Imperial College London, London, UK; Vascular Unit, Imperial Healthcare NHS Trust, London, UK. 3. Department of Surgery and Cancer, Imperial College London, London, UK. 4. Department of Thoracic and Vascular Surgery, Ghent University Hospital, Ghent, Belgium. 5. Centre for Implementation Science, Health Services and Population Research Department, King's College London, London, UK.
Abstract
OBJECTIVE/ BACKGROUND: To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. METHODS: A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. RESULTS: OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. CONCLUSION: Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures.
OBJECTIVE/ BACKGROUND: To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. METHODS: A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. RESULTS: OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. CONCLUSION: Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures.
Authors: Tanika Kelay; Emmanuel Ako; Christopher Cook; Mohammad Yasin; Matthew Gold; Kah Leong Chan; Fernando Bello; Roger K Kneebone; Iqbal S Malik Journal: BMJ Simul Technol Enhanc Learn Date: 2018-11-29
Authors: Nicholas Raison; Thomas Wood; Oliver Brunckhorst; Takashige Abe; Talisa Ross; Ben Challacombe; Mohammed Shamim Khan; Giacomo Novara; Nicolo Buffi; Henk Van Der Poel; Craig McIlhenny; Prokar Dasgupta; Kamran Ahmed Journal: Surg Endosc Date: 2017-06-20 Impact factor: 4.584