BACKGROUND: Effective teamwork is crucial for safe surgery. Failures in nontechnical and teamwork skills are frequently implicated in adverse events. The Observational Teamwork Assessment for Surgery (OTAS) tool assesses teamwork of the entire team in the operating room. Empirical testing of OTAS has yet to explore the content validity of the tool. STUDY DESIGN: This was a cross-sectional observational study. Data were collected in 30 procedures by 2 trained researchers. Five teamwork behaviors were scored (ie, communication, leadership, cooperation, coordination, and monitoring) and behavior exemplar completion was recorded (phase 1). Expert operating room personnel (5 surgeons, 5 anesthesiologists, and 5 scrub nurses) assessed the content validity of the OTAS exemplar behaviors. Finally, a panel of operating room patient-safety experts refined the exemplars (phase 2). RESULTS: In total, the observability (presence/absence) of 130 exemplars was assessed by 2 blinded observers in 30 general surgical cases. Observer agreement was high (Cohen's κ ≥ 0.41) for 83.85% (109 of 130) of exemplar behaviors; 60.77% (79 of 130) of exemplar behaviors were observed frequently with high observer agreement. The majority of the exemplars were rated by expert operating room practitioners and an expert panel as substantial contributors to teamwork and patient safety. Based on expert consensus, 21 behavior exemplars were removed from OTAS and an additional 23 were modified. CONCLUSIONS: The exemplars of OTAS demonstrated very good content validity. Taken together with recent evidence on the construct validity of the tool, these findings demonstrate that OTAS is psychometrically robust for capturing teamwork in the operating room.
BACKGROUND: Effective teamwork is crucial for safe surgery. Failures in nontechnical and teamwork skills are frequently implicated in adverse events. The Observational Teamwork Assessment for Surgery (OTAS) tool assesses teamwork of the entire team in the operating room. Empirical testing of OTAS has yet to explore the content validity of the tool. STUDY DESIGN: This was a cross-sectional observational study. Data were collected in 30 procedures by 2 trained researchers. Five teamwork behaviors were scored (ie, communication, leadership, cooperation, coordination, and monitoring) and behavior exemplar completion was recorded (phase 1). Expert operating room personnel (5 surgeons, 5 anesthesiologists, and 5 scrub nurses) assessed the content validity of the OTAS exemplar behaviors. Finally, a panel of operating room patient-safety experts refined the exemplars (phase 2). RESULTS: In total, the observability (presence/absence) of 130 exemplars was assessed by 2 blinded observers in 30 general surgical cases. Observer agreement was high (Cohen's κ ≥ 0.41) for 83.85% (109 of 130) of exemplar behaviors; 60.77% (79 of 130) of exemplar behaviors were observed frequently with high observer agreement. The majority of the exemplars were rated by expert operating room practitioners and an expert panel as substantial contributors to teamwork and patient safety. Based on expert consensus, 21 behavior exemplars were removed from OTAS and an additional 23 were modified. CONCLUSIONS: The exemplars of OTAS demonstrated very good content validity. Taken together with recent evidence on the construct validity of the tool, these findings demonstrate that OTAS is psychometrically robust for capturing teamwork in the operating room.
Authors: Nick Sevdalis; Helen W L Wong; Sonal Arora; Kamal Nagpal; Andrew Healey; George B Hanna; Charles A Vincent Journal: Surg Endosc Date: 2012-04-27 Impact factor: 4.584
Authors: Yue-Yung Hu; Sarah Henrickson Parker; Stuart R Lipsitz; Alexander F Arriaga; Sarah E Peyre; Katherine A Corso; Emilie M Roth; Steven J Yule; Caprice C Greenberg Journal: J Am Coll Surg Date: 2015-10-17 Impact factor: 6.113
Authors: Michael A Rosen; Aaron S Dietz; Ting Yang; Carey E Priebe; Peter J Pronovost Journal: J Am Med Inform Assoc Date: 2014-07-22 Impact factor: 4.497
Authors: Jay N Nathwani; Carly E Glarner; Katherine E Law; Robert J McDonald; Amy B Zelenski; Jacob A Greenberg; Eugene F Foley Journal: J Surg Educ Date: 2016-11-25 Impact factor: 2.891
Authors: Rachel D A Havyer; Majken T Wingo; Nneka I Comfere; Darlene R Nelson; Andrew J Halvorsen; Furman S McDonald; Darcy A Reed Journal: J Gen Intern Med Date: 2013-12-11 Impact factor: 5.128