BACKGROUND: The nontechnical and team skills of surgical teams are critical for safety and efficiency in the operating room. Assessment of nontechnical and team skills can facilitate improvement by encouraging both self-reflection and team reflection, identifying training needs, and informing operating room (OR) team training approaches. The observational teamwork assessment for surgery (OTAS) tool is a well-validated and robust tool for capturing teamwork in the operating room. The aims of the present study were to systematically adapt and refine the OTAS for German-speaking OR staff and to test the adapted assessment tool (OTAS-D) for psychometric properties and metric equivalence. METHODS: The study was carried out in three stages: at stage 1, OTAS was translated into German. At stage 2, experienced German OR experts (surgeons, OR nurses, anesthetists) were interviewed. At stage 3, two blinded assessors observed 11 general surgical operations (general surgical and vascular procedures) and interrater reliability was tested for refined OTAS-D behavioral exemplars and scorings. RESULTS: The German OR experts confirmed the applicability and content validity of the vast majority of translated behavioral exemplars. After their evaluation, 32 items were changed slightly, six were changed substantially, and one item was added. During observations, perfect and substantial interobserver agreement was found for 77 behavioral exemplars (67.1 % of the items, kappa coefficient >0.60). Rating at all OTAS behaviors showed acceptable levels of reliability (intraclass correlation coefficients >0.72). CONCLUSIONS: The OTAS-D is a tool for valid and reliable assessment of nontechnical skills that contribute to safe and effective surgical performance in ORs staffed by German-speaking professionals. Furthermore, our study serves as an example for systematically adapting and customizing well-established observational tools across different healthcare environments.
BACKGROUND: The nontechnical and team skills of surgical teams are critical for safety and efficiency in the operating room. Assessment of nontechnical and team skills can facilitate improvement by encouraging both self-reflection and team reflection, identifying training needs, and informing operating room (OR) team training approaches. The observational teamwork assessment for surgery (OTAS) tool is a well-validated and robust tool for capturing teamwork in the operating room. The aims of the present study were to systematically adapt and refine the OTAS for German-speaking OR staff and to test the adapted assessment tool (OTAS-D) for psychometric properties and metric equivalence. METHODS: The study was carried out in three stages: at stage 1, OTAS was translated into German. At stage 2, experienced German OR experts (surgeons, OR nurses, anesthetists) were interviewed. At stage 3, two blinded assessors observed 11 general surgical operations (general surgical and vascular procedures) and interrater reliability was tested for refined OTAS-D behavioral exemplars and scorings. RESULTS: The German OR experts confirmed the applicability and content validity of the vast majority of translated behavioral exemplars. After their evaluation, 32 items were changed slightly, six were changed substantially, and one item was added. During observations, perfect and substantial interobserver agreement was found for 77 behavioral exemplars (67.1 % of the items, kappa coefficient >0.60). Rating at all OTAS behaviors showed acceptable levels of reliability (intraclass correlation coefficients >0.72). CONCLUSIONS: The OTAS-D is a tool for valid and reliable assessment of nontechnical skills that contribute to safe and effective surgical performance in ORs staffed by German-speaking professionals. Furthermore, our study serves as an example for systematically adapting and customizing well-established observational tools across different healthcare environments.
Authors: Yinong Young-Xu; Julia Neily; Peter D Mills; Brian T Carney; Priscilla West; David H Berger; Lisa M Mazzia; Douglas E Paull; James P Bagian Journal: Arch Surg Date: 2011-12
Authors: Julia Neily; Peter D Mills; Yinong Young-Xu; Brian T Carney; Priscilla West; David H Berger; Lisa M Mazzia; Douglas E Paull; James P Bagian Journal: JAMA Date: 2010-10-20 Impact factor: 56.272
Authors: Steven Yule; Rhona Flin; Nicola Maran; David Rowley; George Youngson; Simon Paterson-Brown Journal: World J Surg Date: 2008-04 Impact factor: 3.352
Authors: Steven Yule; David Rowley; Rhona Flin; Nikki Maran; George Youngson; John Duncan; Simon Paterson-Brown Journal: ANZ J Surg Date: 2009-03 Impact factor: 1.872
Authors: Karen Mazzocco; Diana B Petitti; Kenneth T Fong; Doug Bonacum; John Brookey; Suzanne Graham; Robert E Lasky; J Bryan Sexton; Eric J Thomas Journal: Am J Surg Date: 2008-09-11 Impact factor: 2.565
Authors: Tanika Kelay; Emmanuel Ako; Christopher Cook; Mohammad Yasin; Matthew Gold; Kah Leong Chan; Fernando Bello; Roger K Kneebone; Iqbal S Malik Journal: BMJ Simul Technol Enhanc Learn Date: 2018-11-29