Joseph A Carpini1, Katrina Calvert2, Sean Carter2, Mathias Epee-Bekima2, Yee Leung3,4. 1. Management & Organisations Department, University of Western Australia Business School, Perth, Western Australia, Australia. 2. King Edward Memorial Hospital, Perth, Western Australia, Australia. 3. Department of the Western Australian Gynaecologic Cancer Service, King Edward Memorial Hospital, Perth, Western Australia, Australia. 4. School of Women's and Infant's Health, University of Western Australia, Perth, Western Australia, Australia.
Abstract
BACKGROUND: Simulation-based training is an effective method of enhancing the knowledge, skill, and technical abilities of individuals and teams encountering obstetric and gynaecologic emergencies. Simulation may also enhance the non-technical performance of teams resulting in improved patient outcomes. Although simulation-based training is widely recognised as an effective educational approach, issues around feasibility - the lack of simulation experts and malleable outcome measures of team performance - remain critical barriers to their implementation. AIM: To evaluate the psychometric properties of the Team Emergency Assessment Measure (TEAM) when used by medical professionals in simulated obstetric and gynaecological emergencies. METHODS: There were 151 participants (63% female; 60% consultants; 69% no previous simulation-based training) who observed three live high-fidelity obstetric and gynaecological resuscitation simulations and completed the TEAM. RESULTS: Confirmatory factor analysis evaluated the construct validity of the TEAM, yielding a second-order structure identified by 'leadership', 'teamwork', and 'team management'. Convergent validity was supported by the average item-to-scale total correlation which was 0.75, P < 0.001 and the average analysis of variance extracted (AVE) 0.88. The individual factors also yielded high factor-to-scale total correlations (mean [M] = 0.87), and AVE (M = 0.89). The internal reliability was high for the whole scale (average alpha = 0.92) and across the sub-factors (average alpha = 0.80). The inter-rater reliability was excellent (inter-class correlation coefficient 1 = 0.98). Participants with differing levels of simulation training experience did not significantly differ. CONCLUSION: The TEAM is a viable instrument for the assessment of non-technical performance during simulated obstetric and gynaecologic emergencies, thus enhancing the feasibility of simulation-based training.
BACKGROUND: Simulation-based training is an effective method of enhancing the knowledge, skill, and technical abilities of individuals and teams encountering obstetric and gynaecologic emergencies. Simulation may also enhance the non-technical performance of teams resulting in improved patient outcomes. Although simulation-based training is widely recognised as an effective educational approach, issues around feasibility - the lack of simulation experts and malleable outcome measures of team performance - remain critical barriers to their implementation. AIM: To evaluate the psychometric properties of the Team Emergency Assessment Measure (TEAM) when used by medical professionals in simulated obstetric and gynaecological emergencies. METHODS: There were 151 participants (63% female; 60% consultants; 69% no previous simulation-based training) who observed three live high-fidelity obstetric and gynaecological resuscitation simulations and completed the TEAM. RESULTS: Confirmatory factor analysis evaluated the construct validity of the TEAM, yielding a second-order structure identified by 'leadership', 'teamwork', and 'team management'. Convergent validity was supported by the average item-to-scale total correlation which was 0.75, P < 0.001 and the average analysis of variance extracted (AVE) 0.88. The individual factors also yielded high factor-to-scale total correlations (mean [M] = 0.87), and AVE (M = 0.89). The internal reliability was high for the whole scale (average alpha = 0.92) and across the sub-factors (average alpha = 0.80). The inter-rater reliability was excellent (inter-class correlation coefficient 1 = 0.98). Participants with differing levels of simulation training experience did not significantly differ. CONCLUSION: The TEAM is a viable instrument for the assessment of non-technical performance during simulated obstetric and gynaecologic emergencies, thus enhancing the feasibility of simulation-based training.