| Literature DB >> 32183219 |
Carlos Fernández-Espínola1, Manuel Tomás Abad Robles1, Francisco Javier Giménez Fuentes-Guerra1.
Abstract
New models for teaching sports have arisen in the last years, characterised by the use of more contextualised situations, modified games, tactical awareness, transference of technical-tactical learning and different teaching progression, among other aspects. In this regard, small-sided games must be highlighted, due to their ability to integrate physical fitness, technique and tactical behaviour stimuli in similar conditions to the real game. Therefore, the aim of this systematic review was to analyse and describe the methodological possibilities that SSGs can provide regarding the teaching of technical-tactical aspects in team sports at young ages. The guidelines of the PRISMA declaration were followed with the purpose of conducting a systematic search. The search was performed in the databases Pubmed, Web of Science, Scopus and SportDiscus. From the 451 identified in an early phase, plus the 20 found in the references of other studies, only 47 met the inclusion criteria and were selected. The results yielded scientific evidence that justifies the use of small-sided games as a methodological resource for sports teaching at young ages. Among the main reasons, it can be highlighted that a reduction in the number of players and in the size of the pitch area increases the total ball contact per player and, therefore, the number of technical actions. Moreover, the intentional modification of certain rules helps to develop some sport training fundamentals.Entities:
Keywords: tactical behaviour; teaching for understanding; team sports; technique
Year: 2020 PMID: 32183219 PMCID: PMC7143077 DOI: 10.3390/ijerph17061884
Source DB: PubMed Journal: Int J Environ Res Public Health ISSN: 1660-4601 Impact factor: 3.390
Figure 1Flow chart.
Effects of small-sided games (SSGs) on technical-tactical aspects in football.
| Author/s [Sport] | Age | Type of SSG | Size (m) | t [B] (min) | Quality Score % | Results | |
|---|---|---|---|---|---|---|---|
| Mallo and Navarro, [ | 10 | 18.6 | 3 vs. 3 | 33 × 20 | 3 × 5′ [20′] | 85 | Players completed more ball contacts in the possession format than in the other two. The number of short passes was higher than in the third game format and the percentage of wrong passes was higher than in the second game format. |
| Olthof et al. [ | 148 | 12.5 to 17.9 | G+4 vs. 4+G | 40 × 30 | 4′ [4′] | 95 | There were a higher number of transitions, set pieces and shots on a small pitch. On a large pitch, intra- and inter-team distances were longer. |
| Almeida et al. [ | 16 | 12.61 14.86 | 4 vs. 4 | 30 × 20 | 10′ [5′] | 90 | Line goal mode increased the odds of regaining possession through tackle and decreased the odds of successful interceptions. Double goal mode decreased the odds of regaining possession through turnover and long plays. |
| Castellano et al. [ | 14 | 13.5 and 14.3 | G+6 vs. 6+G | 30 × 40 | 4 x 7′ [4′] | 85 | Some intra-team (e.g., team length) and inter-team (e.g., distance between centroids) variables increased when the pitch area increased. |
| Machado et al. [ | 14 | 13.82 | G+6 vs. 6+G | 52 × 32 | 30′ | 80 | The small-sided keeping possession game induced positional attacks, a higher number of players involved and greater use of the side areas. The goal scoring game induced faster offensive sequences, long passes and individual behaviours. |
| Silva, Duarte et al. [ | 20 | 16.3 | G+4 vs. 4+G | 36.8 × 23.8 | 7′ [7′] | 90 | The larger the pitch, the larger the effective playing area and the larger the area the team occupies. |
| Sánchez-Sánchez et al. [ | 22 | 17.2 | 4 vs. 4 | 30 × 40 | 4′[2′] | 85 | Greater number of dribbling situations during 4 vs. 4 with no goalkeeper compared with 4 vs. 4 with no goalkeeper but with internal or external wildcards. Greater number of successful actions compared with 4 vs. 4 with goalkeeper. |
| Serra-Olivares, González-Víllora, and García-López [ | 21 | 8 to 9 | 3 vs. 3 | 20 × 30 | 2 x 4′ [2′] | 75 | In the game format with higher number of goals, greater decision making (no significant difference) and better tactical adaptation were observed, since it was more difficult to keep possession and to advance to the goal in the standard game. |
| Serra-Olivares, González-Víllora, García-López, and Araújo [ | 21 | 8.7 | 3 vs. 3 | 22 × 32 | 2 × 4′ | 75 | No significant differences were found in the technical variables under study between the two types of game. |
| Díaz-Cidoncha et al. [ | 54 | NA | 5 vs. 5 | 20 × 30 | 20′ | 80 | The lower the number of players, the higher the number of touches per player and goalkeeper. The number of attacking plays, dribble and pass attempts was also higher in the 5 vs. 5 format. |
| Castelao et al. [ | 10 | NA | G+3 vs. 3+G | 36 × 27 | 8′ | 75 | In the 3vs3 format, higher scores were obtained in penetration, defensive coverage, shots at goal and shots at own goal, while higher scores were achieved in offensive unity and balance in the 5 vs. 5 format. No tactical differences were found. |
| Silva, Garganta et al. [ | 18 | NA | G+3 vs. 3+G | 30 × 19.5 | 8′ | 75 | Players displayed safer behaviours in larger formats and more aggressive ones in smaller formats. |
| Abrantes et al. [ | 16 | 15.75 | 3 vs. 3 | 20 × 30 | 4 × 4′ [6′] | 85 | The results were identical in both formats. |
| Casamichana and Castellano [ | 10 | 15.5 | G+5 vs. 5+G | 62 × 44 | 8′ [5′] | 90 | Most actions under study increased as the size of the pitch area was reduced. |
| Evangelos et al. [ | 9 | 17.2 | 3 vs. 3 | 20 × 25 | 4 × 3′ [12′] | 85 | A higher number of interceptions, dribbles and receives occur in supernumerary situations. More passes and turns are completed with an equal number of players or an additional offensive player. |
| Da Silva et al. [ | 16 | 13.5 | 3 vs. 3 | 30 × 30 | 3 × 4′ [9′] | 90 | There were a greater number of dribbles, crosses, shots and goals in the smallest format. |
| Katis and Kellis [ | 34 | 13 | G+3 vs. 3+G | 15 × 25 | 10 × 4′ [9′] | 92 | The number of short passes, kicks, dribbles, tackles and goals was higher in the smaller format. More long passes and headers were performed in the larger format. |
| Kelly and Drust [ | 8 | 18 | G+5 vs. 5+G | 30 × 20 | 16′ [8′] | 92 | The smaller the size, the higher the number of tackles and shots. |
| Jones and Drust [ | 8 | 7 | 4 vs. 4 | 30 × 25 | 90 | A reduction in the number of players increased the number of ball contacts per player. | |
| Almeida et al. [ | 8 | 12.8 | G+3 vs. 3+G | 40 × 30 | 3 × 10′ [15′] | 85 | In the 2-touch game format, a higher number of goals and shots on goal and a faster playing pattern were recorded. The 4-passes-to-score rule led to greater ball possession. |
| Rebelo et al. [ | 10 | 17.2 | 5 vs. 5 | 30 × 20 | 2 × 10′ [10′] | 85 | The ball-possession game induced a higher number of passes and ball touches on all pitch sizes. Fewer errors were made during the goal-scoring game on the small and medium pitch sizes. |
| Serra-Olivares et al. [ | 21 | 8 to 9 | 3 vs. 3 | 30 × 22 | 2 × 4′ [3′] | 70 | Decision-making and execution were more successful in the goal-scoring game. |
| Owen et al. [ | NA | 17.4 | 1 vs. 1 | 5 × 10; 10 × 15; 15 × 20 | 9′ [24′] | 75 | An increase in the number of players led to a decrease in the number of technical actions per player. No significant difference was found in any of the actions under study. |
| Machado et al. [ | 268 | 16.49 | G+3 vs. 3+G | 27 × 26 | 1 × 4′ | 90 | In 4 vs 4 format, players realise a similar quantity of tactical actions regardless of the positional role. However, the quality of tactical behaviour was significantly affected by the positional role. |
| Moreira et al. [ | 36 | 13.7 | 3 vs. 3 | 36 × 27 | 1 × 4′ [4′] | 85 | The reduction in the relative and absolute playing area elevated the frequency of offensive unity and the level of interaction between players. |
| Práxedes et al. [ | 19 | 10.63 | 5 vs. 5 + 1W | 15 × 10 | [NA] | 85 | The nonlinear pedagogy intervention programme improved the decision making and the execution. |
| Sousa et al. [ | 36 | 15.13 | 3 vs. 3 | 36 × 27 | 1 × 4′[4′] | 90 | Two-touch rule increased the ball circulation and reduced the tactical complexity of the defensive performance. |
| Clemente et al. [ | 16 | 10.1 | 3 vs. 3 | 15 × 20 | 3 × 3 [2′] | 80 | The smaller format increased significant the number of individual technical actions. |
| Folgado et al. [ | 20 | 14.1 | G+4 vs. 4+G | 30 × 40 | 1 × 6′[3′] | 85 | In the 30 × 40m pitch, results showed a lower distance between team centroids, higher number of shots and lateral passes. In the 40 × 30m pitch the players which covered more distance at higher intensities presented more passes and dribbles. |
| Machado et al. [ | 20 | 13.5 | G+3 vs. 3+G | 36 × 27 | 3 × 10′[10′] | 85 | In maintaining ball possession games, younger players presented greater difficulties in smaller format. The bigger format can be used in younger players to improve the tactical performance in progression to target games and representative games. |
M: Male; F: Female; G: Goalkeeper; B: Break; EW: External wildcard player; IW: External wildcard player; NA: Not available; m: metres; min: minutes.
Effects of SSGs on technical-tactical aspects in basketball.
| Author/s [Sport] | Age | Type of SSG | Size (m) | t [B] (min) | Quality Score % | Results | |
|---|---|---|---|---|---|---|---|
| Clemente et al. [ | 10 | 14.75 | 2 vs. 2 + 2W | 15 × 11 | 5′ [3′] | 85 | Smaller formats led to greater playing volume, number of attacks with ball and efficiency index and better score. |
| Conte et al. [ | 21 | 15.4 | 2 vs. 2 | 28 × 15 | 3 × 4′ [2′] | 90 | The 2vs2 format showed higher number of dribbles, passes, shots and turnovers compared with 4 vs. 4. |
| Klusemann et al. [ | 8[M] | 17.4 and 18.2 | 2 vs. 2 | 28 × 15 | 4 × 2.5′ [1′] | 85 | Participants performed ~60% more technical elements (per player) in 2 vs. 2 than in 4 vs. 4 situations. |
| Conte et al. [ | 23 | 15.5 | 4 vs. 4 | 28 × 15 | 3 × 4′ [2′] | 85 | The total number of passes, the number of correct and wrong passes and the number of interceptions were significantly higher in the no-dribble game. |
| Bredt et al. [ | 12 | 17.1 | 3 vs. 3 | 15 × 14 | 2 × 5′ [3′] | 85 | The space creation with ball, dribbled, space creation without the ball, set offenses, and fast breaks have high reliability in the 3 vs. 3 with man-to-man defense in half playing area than with man-to-man defenses in full playing area. |
M: Male; F: Female; G: Goalkeeper; B: Break; W: Wildcard player; m: metres; min: minutes.
Effects of SSGs on technical-tactical aspects in other sports.
| Author/s [Sport] | Age | Type of SSG | Size (m) | t [B] (min) | Quality Score % | Results | |
|---|---|---|---|---|---|---|---|
| Timmerman et al. [ | 25 | 12.2 | 8 vs. 8 | 77 × 47 | 25′ | 85 | Manipulation of the number of players led to an increase in successful passes, skilled and successful actions and also created an environment that enhanced decision making. |
| Timmerman, Savelsbergh, & Farrow [ | 13 | 13.2 | 3 vs. 3 | 28 × 17 | 2 × 7.5′ [2.5′] | 85 | Lowering the number of players elevated the technical actions. The possession game increased the number of passes and decreased dribbles and tackles. The two-goals game increased the goals the cage hockey game increased passing. |
| Clemente & Rocha [ | 8 | 18.25 | 2 vs. 2 | 10 × 7.5 | 5′ | 85 | The number of touches, dribbles and interceptions per player was higher when a smaller number of players were involved. |
| Gabbett et al. [ | 32 | 23.6 and 17.3 | 8 vs. 8 | 10 × 40 | 8′ | 80 | No significant difference was found in any of the variables. |
M: Male; F: Female; G: Goalkeeper; B: Break; NA: Not available; m: metres; min: minutes.
Effects of other variables of SSGs on technical–tactical aspects.
| Author/s [Sport] | Variable | Age | Type of SSG | Size (m) | t [B] (min) | Quality Score % | Results | |
|---|---|---|---|---|---|---|---|---|
| Da Silva et al. [ | Maturation | 16 | 13.5 | 3 vs. 3 | 30 × 30 | 3 × 4′ [9′] | 90 | No significant differences in technique were found with different maturation levels. |
| Almeida et al. [ | Training experience | 28 | 12.84 and 12.91 | G+3 vs. 3+G | 46 × 31 | 2 × 10′ [5′] | 75 | The more experienced players performed longer offensive sequences with greater ball circulation. By contrast, the less experienced players completed faster and more individual offensive sequences. |
| Klusemann et al. [ | Duration | 8[M] | 17.4 | 2 vs. 2 | 28 × 15 | 4 × 2.5′ [1′] | 85 | No significant differences in technique were found when modifying the work-to-rest ratio. |
| Conte et al. [ | Duration | 21 | 15.4 | 2 vs. 2 | 28 × 15 | 3 × 4′ [2′] | 90 | The continuous regime revealed higher number of dribbles than the intermittent regime. |
| Serra-Olivares et al. [ | Age and skill level | 21 | 8.3 | 3 vs. 3 | 22 × 32 | 2 × 4′ [1′] | 80 | Performance of older and more skilled players was significantly better in getting-free decisions and in passing decisions to keep the ball possession. |
| Barnabé et al. [ | Years of experience | 36 | 15.2 | G+5 vs. 5+G | 33 × 60 | 8′ | 90 | In offensive, defensive and mixed phases, older and more experienced players occupied a greater surface area and showed higher stretch index. |
| Christopher et al. [ | Duration | 12 | 15.8 | G+5 vs. 5+G | 50 × 32 | 8′ [0′] | 85 | There were more shots and goals in the 4- and 2-min formats. There were more successful passes in the continuous 8-min format. |
| Falces-Prieto et al. [ | Coach’s presence | 27 | 17.0 | G+6 vs. 6+G | NA | 6′ [5′] | 90 | The percentage of successful passes decreases while the percentage of unsuccessful passes increases in the coach’s presence. The number of successful control-conduction passes increases in the coach’s presence. |
| Olthof et al. [ | Age | 39 | 15.4 | G+5 vs. 5+G | 40 × 30 | 6′ | 90 | Older players showed significantly higher lateral stretch index and significantly lower length-per-width ratio than younger players. |
| González-Víllora et al. [ | Procedural and declarative knowledge | 16 | 14 | 7 vs. 7 | 64 × 44 | 2 × 4′ [3′] | Players acquired procedural knowledge earlier than declarative knowledge. Besides, they performed better at decision making than at execution. | |
| Folgado et al. [ | Age | 30 | 10.53 | G+3 vs. 3+G | 30 × 20 | 8′ [6′] | 85 | Older players showed higher level of collective tactical behaviour. |
| González-Víllora et al. [ | Type of knowledge | 14 | 11 to 12 | 5 vs. 5 | 52 × 40 | 2 × 4′ [3′] | 75 | Players showed greater procedural than declarative knowledge. They performed better at decision making than at execution. |
M: Male; F: Female; G: Goalkeeper; B: Break; NA: Not available; m: metres; min: minutes.
Summary and possible practical implications of the studies analysed with regard to technical–tactical fundamentals.
| Variables | Modifications | Effect | Possible Implications |
|---|---|---|---|
| Number of players | Lower number of players | Increased ball contact per player | Take it into account when working on individual technical aspects (e.g., pass, dribble). |
| Higher number of players | Increased number of long passes | The number of players can be increased in order to work on this aspect, both during the offensive and defensive phases. | |
| Size of pitch area | Greater playing area | Larger area occupied by the team and greater distances among players | Increasing the pitch area fosters collective tactical behaviour and game knowledge. |
| Smaller playing area | Higher number of technical actions and reduced possession | Coaches can make a training progression to work on individual playing. | |
| Playing rules | Limited number of ball contacts | Higher number of shots due to a faster playing pattern | Design a progression of increasing difficulty to work on play finishing. |
| Minimum number of passes required before shooting | Greater possession, players’ involvement and number of passes | Coaches can manipulate this rule to work on more positional than direct attacking sequences. | |
| Limited dribbling | Higher number of passes and interceptions | This can be used to improve the pass, as well as the defending action to prevent it. | |
| Keeping possession | More positional attacks, greater use of the area next to the touch lines and higher number of ball contacts per player | Take this rule into account to work on players’ spatial organisation and to increase participation. | |
| Different ways of scoring | Enhanced ball recovery, possession and advancement with ball | Depending on the way of scoring, different training fundamentals can be worked on. | |
| Duration | Continuous/Intermittent | Continuous playing seems to affect some technical–tactical elements | More studies are needed to provide more data in this regard. |
| Coach | Presence | Uncomfortable atmosphere that may affect decision making | It is important to know that the coach’s presence may affect the player. |
Manuscripts quality assessment.
| Studies | Objetive | Design | Method | Subjects | Random | Blinding Investigators | Blinding Subjetcs | Meausure Outcome | Sample Size | Analytic Methods | Variance | Controlled for Confounding | Results | Conclusions | Quality Score % |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mallo & Navarro 2008 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Olthof et al. 2018 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 2 | 2 | 2 | N/A | 2 | 2 | 0.95 |
| Almeida et al. 2016 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Castellano et al. 2017 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Machado et al. 2016 [ | 1 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.80 |
| Silva, Duarte et al. 2014 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Sánchez-Sánchez et al. 2017 [ | 2 | 2 | 0 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Serra-Olivares et al. 2015 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 1 | 1 | 2 | 1 | N/A | 2 | 2 | 0.75 |
| Serra-Olivares et al. 2015 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.75 |
| Díaz-Cidoncha et al. 2014 [ | 1 | 2 | 0 | 2 | N/A | N/A | N/A | 2 | 2 | 2 | 1 | N/A | 2 | 2 | 0.80 |
| Castelao et al. 2014 [ | 2 | 2 | 0 | 0 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.75 |
| Silva, Garganta et al. [ | 2 | 2 | 0 | 0 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.75 |
| Abrantes et al. 2012 [ | 2 | 2 | 0 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Casamichana & Castellano 2010 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Evangelos et al. 2012 [ | 2 | 2 | 0 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Da Silva et al. 2011 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Katis & Kellis 2009 [ | 2 | 2 | 1 | 2 | 2 | 2 | 2 | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.92 |
| Kelly & Drust [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Jones & Drust 2007 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Almeida et al. 2012 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Rebelo et al. 2011 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Serra-Olivares et al. 2017 [ | 1 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.80 |
| Owen et al. 2004 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | N/A | 1 | 1 | N/A | 2 | 1 | 0.72 |
| Machado et al, [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 2 | 2 | 2 | NA | 2 | 2 | 0.90 |
| Moreira et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Práxedes et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | NA | 2 | 2 | 0.85 |
| Sousa et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 2 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Clemente et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 1 | N/A | 2 | 2 | 0.80 |
| Folgado et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | NA | 2 | 2 | 0.85 |
| Machado et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | NA | 2 | 2 | 0.85 |
| Clemente et al. 2016 [ | 2 | 2 | 0 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Conte et al. 2016 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Klusemann et al. 2012 [ | 2 | 2 | 0 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Conte et al. 2015 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Bredt et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Timmerman et al. 2017 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Timmerman et al. [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Clemente y Rocha 2012 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 1 | N/A | 2 | 2 | 0.85 |
| Gabbett et al. 2012 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 1 | 1 | 2 | 2 | N/A | 2 | 2 | 0.80 |
| Serra-Olivares et al. 2011 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 1 | 1 | 1 | 1 | N/A | 2 | 2 | 0.70 |
| Barnabé et al. 2016 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Christopher et al. 2016 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| Falces-Prieto et al. 2015 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| Olthof et al. 2015 [ | 2 | 2 | 1 | 2 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.90 |
| González-Víllora et al. 2013 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 0 | N/A | 2 | 2 | 0.75 |
| Folgado et al. 2012 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 2 | N/A | 2 | 2 | 0.85 |
| González-Víllora et al. 2010 [ | 2 | 2 | 1 | 1 | N/A | N/A | N/A | 2 | 1 | 2 | 0 | N/A | 2 | 2 | 0.75 |
1 = Question/objective sufficiently described? 2 = Study design evident and appropriate?; 3 = Method of subject/comparison group selection or source of information/input variables described and appropriate?; 4 = Subject (and comparison group, if applicable) characteristics sufficiently described?; 5 If interventional and random allocation was possible, was it described?; 6 = If interventional and blinding of investigators was possible, was it reported?; 7 = If interventional and blinding of subjects was possible, was it reported?; 8 = Outcome and (if applicable) exposure measure(s) well defined and robust to measurement / misclassification bias? Means of assessment reported?; 9 = Sample size appropriate?; 10 = Analytic methods described/justified and appropriate?; 11 Some estimate of variance is reported for the main results?; 12 = Controlled for confounding?; 13= Results reported in sufficient detail?; 14 = Conclusions supported by the results?