Sallie J Weaver1, Eduardo Salas, Heidi B King. 1. Department of Psychology and Institute for Simulation & Training, University of Central Florida, Orlando, Florida, USA. sweaver@ist.ucf.edu
Abstract
BACKGROUND: Evaluation and measurement are the building blocks of effective skill development, transfer of training, maintenance and sustainment of effective team performance, and continuous improvement. Evaluation efforts have varied in their methods, time frame, measures, and design. On the basis of the existing body of work, 12 best practice principles were extrapolated from the science of evaluation and measurement into the practice of team training evaluation. Team training evaluation refers to efforts dedicated to enumerating the impact of training (1) across multiple dimensions, (2) across multiple settings, and (3) over time. Evaluations of efforts to optimize teamwork are often afterthoughts in an industry that is grounded in evidence-based practice. The best practices regarding team training evaluation are provided as practical reminders and guidance for continuing to build a balanced and robust body of evidence regarding the impact of team training in health care. THE 12 BEST PRACTICES: The best practices are organized around three phases of training: planning, implementation, and follow-up. Rooted in the science of team training evaluation and performance measurement, they range from Best Practice 1: Before designing training, start backwards: think about traditional frameworks for evaluation in reverse to Best Practice 7: Consider organizational, team, or other factors that may help (or hinder) the effects of training and then to Best Practice 12: Report evaluation results in a meaningful way, both internally and externally. CONCLUSIONS: Although the 12 best practices may be perceived as intuitive, they are intended to serve as reminders that the notion of evidence-based practice applies to quality improvement initiatives such as team training and team development as equally as it does to clinical intervention and improvement efforts.
BACKGROUND: Evaluation and measurement are the building blocks of effective skill development, transfer of training, maintenance and sustainment of effective team performance, and continuous improvement. Evaluation efforts have varied in their methods, time frame, measures, and design. On the basis of the existing body of work, 12 best practice principles were extrapolated from the science of evaluation and measurement into the practice of team training evaluation. Team training evaluation refers to efforts dedicated to enumerating the impact of training (1) across multiple dimensions, (2) across multiple settings, and (3) over time. Evaluations of efforts to optimize teamwork are often afterthoughts in an industry that is grounded in evidence-based practice. The best practices regarding team training evaluation are provided as practical reminders and guidance for continuing to build a balanced and robust body of evidence regarding the impact of team training in health care. THE 12 BEST PRACTICES: The best practices are organized around three phases of training: planning, implementation, and follow-up. Rooted in the science of team training evaluation and performance measurement, they range from Best Practice 1: Before designing training, start backwards: think about traditional frameworks for evaluation in reverse to Best Practice 7: Consider organizational, team, or other factors that may help (or hinder) the effects of training and then to Best Practice 12: Report evaluation results in a meaningful way, both internally and externally. CONCLUSIONS: Although the 12 best practices may be perceived as intuitive, they are intended to serve as reminders that the notion of evidence-based practice applies to quality improvement initiatives such as team training and team development as equally as it does to clinical intervention and improvement efforts.