PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.
PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.
Authors: Beverly W Henry; Danielle M McCarthy; Anna P Nannicelli; Nicholas P Seivert; John A Vozenilek Journal: Health Expect Date: 2013-10-07 Impact factor: 3.377
Authors: Michael A Rosen; Aaron S Dietz; Ting Yang; Carey E Priebe; Peter J Pronovost Journal: J Am Med Inform Assoc Date: 2014-07-22 Impact factor: 4.497
Authors: Brenda S Bray; Catrina R Schwartz; Peggy Soule Odegard; Dana P Hammer; Amy L Seybert Journal: Am J Pharm Educ Date: 2011-12-15 Impact factor: 2.047
Authors: Nathan Olson; Adriana Segura Olson; Kelly Williamson; Nicholas Hartman; Jeremy Branzetti; Patrick Lank Journal: AEM Educ Train Date: 2018-12-20
Authors: Sandra K Oza; Sandrijn van Schaik; Christy K Boscardin; Read Pierce; Edna Miao; Tai Lockspeiser; Darlene Tad-Y; Eva Aagaard; Anda K Kuo Journal: J Grad Med Educ Date: 2018-10