| Literature DB >> 28085922 |
Desmond McEwan1, Geralyn R Ruissen1, Mark A Eys2, Bruno D Zumbo3, Mark R Beauchamp1.
Abstract
The objective of this study was to conduct a systematic review and meta-analysis of teamwork interventions that were carried out with the purpose of improving teamwork and team performance, using controlled experimental designs. A literature search returned 16,849 unique articles. The meta-analysis was ultimately conducted on 51 articles, comprising 72 (k) unique interventions, 194 effect sizes, and 8439 participants, using a random effects model. Positive and significant medium-sized effects were found for teamwork interventions on both teamwork and team performance. Moderator analyses were also conducted, which generally revealed positive and significant effects with respect to several sample, intervention, and measurement characteristics. Implications for effective teamwork interventions as well as considerations for future research are discussed.Entities:
Mesh:
Year: 2017 PMID: 28085922 PMCID: PMC5234826 DOI: 10.1371/journal.pone.0169604
Source DB: PubMed Journal: PLoS One ISSN: 1932-6203 Impact factor: 3.240
Fig 1Results of Literature Search (PRISMA Flow Diagram).
Summary Results of Interventions Assessing the Effects of Teamwork Training on Teamwork.
| Study | Relative Weight | Effect Size (SE) | 95% CI (lower, upper) | ES with intervetion removed | ||
|---|---|---|---|---|---|---|
| Aaron 2014 [ | 2.43 | 1.432 (.35) | .74, 2.13 | 4.04 | < .001 | 0.67 |
| b | 2.48 | .869 (.33) | .22, 1.52 | 2.61 | .009 | 0.68 |
| Becker 2005 [ | 2.75 | .635 (.21) | .22, 1.05 | 3.02 | .003 | 0.69 |
| Beck-Jones 2004 [ | 2.70 | -.030 (.24) | -.50, .44 | -0.13 | .898 | 0.70 |
| b | 2.69 | -.003 (.24) | -.47, .47 | -0.01 | .990 | 0.70 |
| Beranek 2005 [ | 2.67 | .649 (.25) | .16, 1.13 | 2.62 | .009 | 0.68 |
| Bjornberg 2014 [ | 2.83 | .080 (.16) | -.23, .39 | 0.50 | .615 | 0.69 |
| Brannick 2005 [ | 2.72 | 1.229 (.23) | .79, 1.67 | 5.47 | < .001 | 0.69 |
| Bushe 1995 [ | 2.53 | .405 (.31) | -.20, 1.01 | 1.31 | .192 | 0.69 |
| b | 2.53 | .534 (.31) | -.08, 1.14 | 1.71 | .086 | 0.69 |
| Cheater 2005 [ | 2.82 | .336 (.17) | .00, .67 | 1.97 | .049 | 0.69 |
| Clay-Willaims 2013 [ | 2.04 | .531 (.51) | -.46, 1.53 | 1.05 | .296 | 0.69 |
| b | 2.06 | -.213 (.50) | -1.20, .77 | -0.43 | .671 | 0.70 |
| c | 2.12 | 0.000 (.48) | -.94, .94 | 0.00 | 1.00 | 0.70 |
| Dalenberg 2009 [ | 2.82 | 1.001 (.17) | .68, 1.33 | 6.02 | < .001 | 0.67 |
| Deneckere 2013 [ | 2.92 | .129 (.09) | -.04, .29 | 1.52 | .129 | 0.70 |
| Dibble 2010 [ | 2.92 | -.242 (.09) | -.42, -.07 | -2.72 | .007 | 0.71 |
| Eden 1986 [ | 2.92 | .427 (.09) | .07, .42 | 2.73 | .006 | 0.70 |
| Ellis 2005 [ | 2.88 | .792 (.13) | .54, 1.05 | 6.14 | < .001 | 0.68 |
| Emmert 2011 [ | 2.54 | .763 (.31) | .16, 1.36 | 2.48 | .013 | 0.68 |
| Entin 1999 [ | 2.32 | .771 (.40) | -.01, 1.55 | 1.93 | .054 | 0.68 |
| Friedlander 1967 [ | 2.72 | .495 (.22) | .06, .94 | 2.21 | .027 | 0.69 |
| Green 1994 [ | 1.91 | .665 (.56) | -.44, 1.76 | 1.19 | .236 | 0.68 |
| b | 1.87 | 1.058 (.58) | -.08, 2.20 | 1.82 | .069 | 0.68 |
| Jankouskas 2010 [ | 2.22 | .778 (.44) | -.08, 1.64 | 1.77 | .077 | 0.68 |
| Kim 2014 [ | 2.65 | .062 (.26) | -.45, .57 | 0.24 | .813 | 0.70 |
| Marshall 2009 [ | 2.70 | 3.277 (.33) | 2.65, 3.95 | 9.90 | < .001 | 0.61 |
| Martinez-Moreno 2015 [ | 2.86 | .503 (.14) | .23, .78 | 3.63 | < .001 | 0.69 |
| Morey 2002 [ | 2.93 | 1.896 (.08) | 1.75, 2.05 | 24.83 | < .001 | 0.64 |
| O’Leary 2011 [ | 2.82 | .426 (.17) | .10, .76 | 2.54 | .011 | 0.69 |
| Padmo Putri 2012 [ | 2.82 | -.097 (.17) | -.42, .23 | -0.58 | .561 | 0.71 |
| Prichard 2007 [ | 2.40 | 1.981 (.37) | 1.26, 2.70 | 5.381 | < .001 | 0.65 |
| Rapp 2007 [ | 2.61 | .535 (.28) | -.01, 1.08 | 1.93 | .053 | 0.69 |
| Shapiro 2004 [ | 2.03 | .689 (.52) | -.32, 1.70 | 1.34 | .181 | 0.68 |
| Smith-Jentsch 2008 [ | 2.63 | 1.103 (.27) | .58, 1.63 | 4.13 | < .001 | 0.67 |
| Thomas 2007 [ | 2.39 | .891 (.37) | .16, 1.62 | 2.40 | .016 | 0.68 |
| Volpe 1996 [ | 2.71 | .450 (.23) | .00, .90 | 1.97 | .049 | 0.69 |
| Weaver 2010 [ | 2.41 | .580 (.36) | -.13, 1.29 | 1.61 | .109 | 0.69 |
| Weller 2014 [ | 2.64 | 1.563 (.26) | 1.05, 2.08 | 5.92 | < .001 | 0.66 |
Note. a, b, c = intervention groups within study; SE = standard error; CI = confidence interval; ES = effect size.
* = Study identified as an outlier and removed from subsequent moderator analyses.
The final column marked ‘ES with study removed’ indicates the results of the sensitivity analysis for each respective intervention.
Fig 2Funnel Plot for Studies Assessing Teamwork.
Circles filled with black indicate outlier studies.
Summary Results of Interventions Assessing the Effects of Teamwork Training on Team Performance.
| Study | Relative Weight | Effect Size (SE) | 95% CI (lower, upper) | ES with intervention removed | ||
|---|---|---|---|---|---|---|
| Beck-Jones 2004 [ | 2.16 | .502 (.18) | .35, 1.04 | 3.91 | < .001 | 0.93 |
| b | 2.15 | .902 (.18) | .33, 1.30 | 3.83 | < .001 | 0.92 |
| Bjornberg 2014 [ | 2.24 | .466 (.16) | .15, .78 | 2.91 | .004 | 0.93 |
| Brannick 2005 [ | 2.20 | .237 (.21) | -.17, .64 | 1.15 | .249 | 0.94 |
| Brown 2003 [ | 2.25 | .267 (.15) | -.02, .56 | 1.80 | .072 | 0.94 |
| Buller 1986 [ | 1.33 | 1.435 (.77) | -0.08, 2.95 | 1.86 | .063 | 0.91 |
| b | 1.11 | 3.72 (.94) | 1.88, 5.56 | 3.96 | < .001 | 0.89 |
| C | 1.46 | 1.58 (.69) | .23, 2.94 | 2.30 | .022 | 0.91 |
| Bushe 1995 [ | 1.67 | 4.57 (.56) | 3.47, 5.66 | 8.19 | < .001 | 0.86 |
| b | 1.47 | 5.96 (.68) | 4.63, 7.29 | 8.75 | < .001 | 0.84 |
| Cannon-Bowers 1998 [ | 2.22 | .46 (.19) | .09, .82 | 2.45 | .014 | 0.93 |
| Chang 2008 [ | 2.04 | 1.344 (.33) | .70, 1.99 | 4.09 | < .001 | 0.91 |
| Dalenberg 2009 [ | 2.24 | .653 (.16) | .34, .97 | 4.06 | < .001 | 0.93 |
| Dibble 2010 [ | 2.29 | .181 (.09) | .01, .36 | 2.04 | .042 | 0.94 |
| Entin 1999 [ | 1.92 | .927 (.41) | .13, 1.72 | 2.88 | .022 | 0.92 |
| Fandt 1990 [ | 2.25 | .095 (.15) | -.19, .38 | 0.65 | .518 | 0.94 |
| Green 1994 [ | 1.67 | .655 (.56) | -.44, 1.75 | 1.17 | .243 | 0.92 |
| b | 1.62 | 1.212 (.59) | .05, 2.37 | 2.05 | .040 | 0.91 |
| Haslam 2009–1 [ | 2.08 | .223 (.30) | -.37, .82 | 0.73 | .464 | 0.93 |
| b | 2.06 | .690 (.31) | .07, 1.31 | 2.20 | .028 | 0.92 |
| Haslam 2009–2 [ | 2.02 | .941 (.34) | .27, 1.61 | 2.76 | .006 | 0.92 |
| b | 2.04 | .610 (.33) | -.03, 1.25 | 1.87 | .062 | 0.93 |
| c | 2.02 | .957 (.35) | .28, 1.63 | 2.78 | .005 | 0.92 |
| d | 2.03 | .963 (.34) | .31, 1.62 | 2.87 | .004 | 0.92 |
| Ikomi 1999 [ | 2.06 | 1.008 (.32) | .39, 1.63 | 3.18 | .001 | 0.92 |
| Jankouskas 2010 [ | 1.86 | -.173 (.44) | -1.04, .70 | -0.39 | .696 | 0.94 |
| Jarrett 2012 [ | 2.22 | .243 (.19) | -.12, .61 | 1.31 | .191 | 0.94 |
| b | 2.21 | .834 (.19) | .46, 1.21 | 4.34 | < .001 | 0.92 |
| c | 2.22 | .358 (.19) | -.01, .72 | 1.92 | .055 | 0.93 |
| d | 2.21 | .940 (.19) | .56, 1.32 | 4.84 | < .001 | 0.92 |
| Kring 2005 [ | 2.00 | .062 (.36) | -.64, .76 | 0.17 | .862 | 0.94 |
| b | 2.00 | -.092 (.36) | -.79, .61 | -0.26 | .795 | 0.94 |
| Longenecker 1994 [ | 2.03 | 1.89 (.33) | 1.24, 2.54 | 5.66 | < .001 | 0.90 |
| Morey 2002 [ | 2.29 | 2.781 (.09) | 2.61, 2.95 | 31.51 | < .001 | 0.80 |
| Padmo Putri 2012 [ | 2.23 | .542 (.17) | .21, .87 | 3.21 | .001 | 0.93 |
| Rapp 2007 [ | 2.12 | .254 (.27) | -.28, .79 | 0.93 | .353 | 0.93 |
| Schurig 2013 [ | 2.26 | .513 (.27) | -.02, 1.05 | 1.88 | .061 | 0.93 |
| b | 2.26 | .688 (.28) | .15, 1.23 | 2.49 | .013 | 0.93 |
| Siegel 1973 [ | 1.99 | .594 (.36) | -.11, 1.30 | 1.64 | .100 | 0.93 |
| Sikorski 2012 [ | 2.26 | .272 (.14) | -.01, .56 | 1.89 | .059 | 0.94 |
| Smith-Jentsch 2008 [ | 1.91 | 3.729 (.41) | 2.92, 4.54 | 9.07 | < .001 | 0.86 |
| Smith-Jentsch 1996 [ | 1.74 | .206 (.52) | -.81, 1.22 | 0.40 | .690 | 0.93 |
| b | 1.74 | .025 (.52) | -.99, 1.04 | 0.05 | .961 | 0.94 |
| c | 1.71 | .901 (.54) | -.15, 1.95 | 1.68 | .092 | 0.92 |
| Stout 1997 [ | 2.04 | .984 (.33) | .34, 1.63 | 3.00 | .003 | 0.92 |
| Villado 2013 [ | 2.19 | .834 (.22) | .41, 1.36 | 3.88 | < .001 | 0.92 |
| Volpe 1996 [ | 2.16 | .877 (.24) | .28, 1.12 | 3.70 | < .001 | 0.92 |
| Wegge 2005 [ | 1.91 | 1.004 (.41) | .19, 1.81 | 2.44 | .015 | 0.92 |
| b | 1.90 | .682 (.42) | -.14, 1.50 | 1.64 | .102 | 0.92 |
| c | 1.95 | .487 (.39) | -.28, 1.25 | 1.25 | .212 | 0.93 |
| .919 (.14) | .65, 1.19 | 6.72 |
Note. a, b, c, d = intervention groups within study; SE = standard error; CI = confidence interval; ES = effect size.
* = Study identified as an outlier and removed from subsequent moderator analyses.
The final column marked ‘ES with study removed’ indicates the results of the sensitivity analysis for each respective intervention.
Fig 3Funnel plot for studies assessing team performance.
Circles filled with black indicate outlier studies.
Moderator results for interventions assessing teamwork as the outcome variable.
| Moderator | K | Effect size (SE) | 95% CI | Z-value | p value | ||
|---|---|---|---|---|---|---|---|
| Context | 3.272(5), | ||||||
| Health care | 13 | 0.51 (0.15) | 0.20, 0.81 | 3.30 | 0.001 | ||
| Academia | 10 | 0.46 (0.17) | 0.14, 0.78 | 2.78 | 0.005 | ||
| Laboratory experiment | 6 | 0.51 (0.20) | 0.12, 0.89 | 2.55 | 0.011 | ||
| Military | 6 | 0.77 (0.23) | 0.33, 1.22 | 3.42 | 0.001 | ||
| Aviation | 1 | 1.23 (0.47) | 0.25, 2.21 | 2.46 | 0.014 | ||
| Industry | 1 | 0.50 (0.50) | -0.48, 1.47 | 0.99 | 0.321 | ||
| Team type | 4.04(1), | ||||||
| Intact | 13 | 0.33 (0.14) | 0.05, 0.60 | 2.35 | 0.019 | ||
| New | 24 | 0.67 (0.10) | 0.47, 0.87 | 6.58 | <0.001 | ||
| Method of intervention | 6.17(3), | ||||||
| Didactic education | 4 | 0.19 (0.19) | -0.20, 0.57 | 0.95 | 0.341 | ||
| Workshop | 18 | 0.50 (0.10) | 0.31, 0.70 | 4.96 | <0.001 | ||
| Simulation | 11 | 0.78 (0.16) | 0.48, 1.09 | 5.05 | <0.001 | ||
| Team Reviews | 4 | 0.64 (0.19) | 0.26, 1.01 | 3.34 | 0.001 | ||
| Teamwork dimensions targeted | |||||||
| Preparation | 20 | 0.75 (0.11) | 0.54, 0.95 | 7.09 | <0.001 | ||
| Execution | 21 | 0.64 (0.11) | 0.42, 0.86 | 5.70 | <0.001 | ||
| Reflection | 22 | 0.65 (0.11) | 0.43, 0.86 | 5.80 | <0.001 | ||
| Interpersonal dynamics | 11 | 0.69 (0.16) | 0.38, 1.00 | 4.33 | <0.001 | ||
| Number of dimensions targeted | 19.73(4), | ||||||
| One | 6 | 0.05 (0.16) | -0.26, 0.35 | 0.29 | 0.775 | ||
| Two | 11 | 0.65 (0.12) | 0.42, 0.89 | 5.39 | <0.001 | ||
| Three | 6 | 0.98 (0.16) | 0.66, 1.30 | 6.04 | <0.001 | ||
| Four | 7 | 0.57 (0.15) | 0.27, 0.87 | 3.70 | <0.001 | ||
| Type of teamwork measure | 16.86(1), | ||||||
| Third party | 45 | 0.80 (0.07) | 0.66, 0.94 | 10.92 | <0.001 | ||
| Self-report | 46 | 0.38 (0.07) | 0.25, 0.52 | 5.47 | <0.001 | ||
| Teamwork dimension measured | 2.98(1), | ||||||
| General | 27 | 0.71 (0.11) | 0.49, 0.93 | 6.36 | <0.001 | ||
| Preparation | 8 | 0.53 (0.19) | 0.16, 0.89 | 2.80 | 0.005 | ||
| Execution | 31 | 0.55 (0.10) | 0.35, 0.74 | 5.57 | <0.001 | ||
| Reflection | 12 | 0.70 (0.16) | 0.40, 1.01 | 4.50 | <0.001 | ||
| Interpersonal dynamics | 13 | 0.45 (0.14) | 0.17, 0.73 | 3.12 | 0.002 | ||
Note. The df of the Q-value represents the total number of combinations of the targeted dimensions minus 1.
a: The total k of this moderator is greater than 37 as many interventions targeted more than one dimension of teamwork. Because of this, each category within this moderator was analyzed independently (i.e., whether each teamwork dimension was targeted or not targeted in the intervention); as a result, it was not possible to calculate a Q value for this moderator.
b: The total k of this moderator is less than 37 as seven interventions were unclear in terms of the exact teamwork dimensions targeted.
c: The total k of this moderator is greater than 37 as many studies used more than one type of criterion measure of teamwork. Because of this, each category within this moderator was analyzed independently.
Moderator results for interventions assessing team performance as the outcome variable.
| Moderator | k | Effect size (SE) | 95% CI | Z value | p value | Q value (df), |
|---|---|---|---|---|---|---|
| Context | 16.94(5), | |||||
| Health care | 2 | 0.76 (0.31) | 0.15, 1.36 | 2.46 | 0.014 | |
| Laboratory experiment | 25 | 0.54 (0.07) | 0.41, 0.67 | 8.08 | <0.001 | |
| Aviation | 4 | 0.64 (0.18) | 0.28, 0.99 | 3.51 | <0.001 | |
| Military | 5 | 0.66 (0.17) | 0.34, 0.99 | 3.99 | <0.001 | |
| Industry | 3 | 1.76 (.32) | 1.13, 2.38 | 5.52 | <0.001 | |
| Academia | 6 | 0.40 (0.12) | 0.17, 0.63 | 3.35 | 0.001 | |
| Team type | 6.04(1), | |||||
| Intact | 6 | 0.99 (0.18) | 0.64, 1.33 | 5.63 | <0.001 | |
| New | 39 | 0.54 (0.06) | 0.42, 0.65 | 9.32 | <0.001 | |
| Method of intervention | 2.44(3), | |||||
| Didactic education | 4 | 0.41 (0.16) | 0.09, 0.74 | 2.52 | 0.012 | |
| Workshop | 24 | 0.55 (0.08) | 0.39, 0.71 | 6.87 | <0.001 | |
| Simulation | 7 | 0.57 (0.17) | 0.23, 0.90 | 3.30 | 0.001 | |
| Team Reviews | 10 | 0.69 (0.10) | 0.50, 0.89 | 6.88 | <0.001 | |
| Teamwork dimensions targeted | ||||||
| Preparation | 15 | 0.60 (0.07) | 0.46, 0.73 | 8.69 | <0.001 | |
| Execution | 26 | 0.52 (0.08) | 0.37, 0.66 | 6.87 | <0.001 | |
| Reflection | 22 | 0.55 (0.08) | 0.40, 0.70 | 7.17 | <0.001 | |
| Interpersonal dynamics | 6 | 0.57 (0.18) | 0.18, 0.95 | 2.88 | 0.004 | |
| Number of dimensions targeted | 3.98(4), | |||||
| One | 20 | 0.61 (0.09) | 0.44, 0.79 | 6.85 | <0.001 | |
| Two | 12 | 0.63 (0.12) | 0.40, 0.86 | 5.31 | <0.001 | |
| Three | 9 | 0.46 (0.11) | 0.24, 0.67 | 4.08 | <0.001 | |
| Four | 3 | 0.67 (0.25) | 0.19, 1.15 | 2.74 | 0.006 | |
| Type of team performance measure | 2.03(1), | |||||
| Third party | 31 | 0.56 (0.08) | 0.40, 0.72 | 6.79 | <0.001 | |
| Objective | 62 | 0.61 (0.06) | 0.48, 0.73 | 9.70 | <0.001 | |
Note. The df of the Q-value represents the total number of combinations of the targeted dimensions minus 1.
a: The total k of this moderator is greater than 45 as many interventions targeted more than one dimension of teamwork. Because of this, each category within this moderator was analyzed independently (i.e., whether each teamwork dimension was targeted or not targeted in the intervention); as a result, it was not possible to calculate a Q value for this moderator.
b: The total k of this moderator is less than 45 as one intervention was unclear in terms of the exact teamwork dimensions targeted.
c: The total k of this moderator is greater than 45 as many studies used more than one type of criterion measure of team performance. Because of this, each category within this moderator was analyzed independently.