| Literature DB >> 35519905 |
Amirreza Naseri1, Sepideh Seyedi-Sahebari1, Ata Mahmoodpoor2, Sarvin Sanaie3.
Abstract
Objectives: Probiotics are live microorganisms which when administered in adequate amounts confer a health benefit on the host. Because of the wide usage of antibiotics, acute changes in diet, and the stress of illness, critically ill patients' homeostasis of the gut microbiome can be disrupted during intensive care unit (ICU) confinement; probiotics are suggested as a beneficial intervention in critically ill patients. We tried to give an overview of the effects of probiotic supplements in critically ill patients based on published systematic reviews (SRs) and meta-analyses (MAs). Data sources: A systematic search was performed in four databases as well as hand searching. Study selection: The results were independently screened in two title/abstracts and full-text stages. Data extraction: Any reported outcomes in each study were extracted, using a data extraction table. Data synthesis: A wide range of outcomes of using probiotic supplements in critically ill patients have been reported in 20 included studies. Based on the current knowledge, we can say that probiotics may reduce the rate of ventilator-associated pneumonia, nosocomial pneumonia, the overall infection rate, duration of mechanical ventilation, and antibiotic use in critically ill patients, but there is not a significant association between using the probiotics and mortality, length of hospitalization, and incidence of diarrhea.Entities:
Keywords: Critical illness; Intensive care units; Probiotics; Systematic review; Umbrella review
Year: 2022 PMID: 35519905 PMCID: PMC9015916 DOI: 10.5005/jp-journals-10071-24129
Source DB: PubMed Journal: Indian J Crit Care Med ISSN: 0972-5229
Flowchart 1PRISMA flow diagram
Summary of the findings of the included studies
|
| ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
| |
| 1 | Petrof (2012)[ | Probiotics in the critically ill: A systematic review of the randomized trial evidence | 23 RCT | EMBASE, | Probiotics compared to a placebo | Own scoring system | Adult (≥ 18 yrs of age) critically ill patients | Infections | 11 | 981 | 44% | RR: 0.82 (0.69 to 0.99; |
| VAP | 7 | 1193 | 35% | RR: 0.75 (0.59 to 0.97; | ||||||||
| Hospital mortality | 14 | 1266 | 0% | RR: 0.97 (0.79 to 1.20; | ||||||||
| Hospital LoS | 11 | − | 69% | WMD: −0.68 (-4.46 to 3.11; | ||||||||
| ICU mortality | 6 | 569 | 0% | RR: 0.80 (0.59 to 1.09; | ||||||||
| ICU LoS | 12 | − | 94% | WMD: −3.45 (-9.0 to 2.11; | ||||||||
| Diarrhea | 12 | − | 5% | RR: 0.95 (0.80 to 1.13; | ||||||||
| 2 | Siempos (2010)[ | Impact of the administration of probiotics on the incidence of ventilator-associated pneumonia: a meta-analysis of randomized controlled trials | 5 RCT | PubMed, Scopus, Current Contents and the Cochrane Central Register of Controlled Trials | Probiotics (or synbiotic) vs control (placebo or other)–excluded articles that referred to pneumonia in critically ill patients in general without specific mention in VAP | Modified Jadad score | Adults undergoing MV | VAP | 5 | 689 | 39% | FEM OR: 0.61 (0.41 to 0.91; |
| ICU mortality | 4 | 481 | 0%, | FEM OR: 0.75 (0.47 to 1.21; | ||||||||
| Hospital mortality | 2 | 303 | 0% | FEM OR: 0.75 (0.46 to 1.24; | ||||||||
| ICU LoS | 3 | 368 | − | FEM WMD: −0.99 (-1.37 to −0.61; | ||||||||
| Duration of MV | 3 | 368 | − | FEM WMD: −0.01 (-0.31 to 0.29; | ||||||||
| Colonization of | 2 | 252 | 0% | FEM OR: 0.35 (0.13 to 0.93; | ||||||||
| Diarrhea | 2 | 324 | 42% | FEM OR: 0.61 (0.28 to 1.34; | ||||||||
| Bacteremia | 3 | None of the patients | ||||||||||
| 3 | Gu (2012)[ | Lack of Efficacy of Probiotics in Preventing Ventilator-associated Pneumonia | 7RCT | PUBMED EMBASE (FILTER: HUMAN, RCT) | Probiotics compared with a control (placebo or another active agent)–Data available on the incidence of VAP | Jadad scale | Adult patients undergoing mechanical ventilation | VAP | 7 | 1142 | 36.5% | OR: 0.82 (0.55 to 1.24; |
| ICU mortality | 4 | 727 | 0% | OR: 0.90 (0.65 to 1.27; | ||||||||
| Hospital mortality | 4 | 513 | 0% | OR: 0.71 (0.48 to 1.07; | ||||||||
| Urinary tract infection | 2 | 424 | 70% | OR: 2.20 (0.50 to 9.71; | ||||||||
| CRBSI | 2 | 424 | 70.6% | OR: 0.51 (0.13 to 2.01; | ||||||||
| Diarrhea | 2 | 426 | 0% | OR: 1.01 (0.60 to 1.70; | ||||||||
| ICU LoS | 4 | 305 | 0% | WMD: −0.41 (-3.54 to 2.73; | ||||||||
| Hospital LoS | 3 | 305 | 0% | WMD: −0.99 (-5.36 to 3.38; | ||||||||
| Duration of MV | 3 | 238 | − | WMD: −0.0.10 (-2.36 to 2.16; | ||||||||
| 4 | Bo (2014)[ | Probiotics for preventing ventilator-associated pneumonia | 8 RCT | CENTRAL MEDLINE and EMBASE | Probiotics (single or mixture of strains, any dosage regimen and any route of administration) with placebo or other controls–Data available on the incidence of VAP | Cochrane criteria | Adult ICU patients (≥ 18 years of age) receiving mechanical ventilation | VAP | 8 | 1018 | 46% | OR: 0.70 (0.52 to 0.95; |
| ICU mortality | 5 | 703 | 0% | OR: 0.84 (0.58 to 1.22; | ||||||||
| Hospital mortality | 4 | 524 | 0% | OR: 0.78 (0.54 to 1.14; | ||||||||
| Diarrhea | 4 | 618 | 14% | OR: 0.72 (0.47 to 1.09; | ||||||||
| ICU LoS | 4 | 369 | 77% | WMD: −1.6 (-6.53 to 3.33; | ||||||||
| Duration of MV | 2 | 203 | 92% | WMD: −6.15 (-18.77 to 6.47; | ||||||||
| Systematic antibiotic use | 1 | 259 | − | OR: 1.23 (0.51 to 2.96; | ||||||||
| Antibiotic use for VAP | 1 | 138 | − | WMD −3.00 (-6.04 to 0.04; | ||||||||
| Nosocomial probiotic infection | 6 | 861 | None of the patients. | |||||||||
| 5 | Wang (2013)[ | Probiotics for preventing ventilator-associated pneumonia: a systematic review and meta-analysis of high-quality randomized controlled trials | 5 RCT | WoS, PubMed, OVID and Cochrane | Comparing probiotics with placebo treatment in–Data available on the incidence of VAP and excluded using selective digestive decontamination-controlled group were | Jadad score | Adult patients undergoing MV | Incidence of VAP | 5 | 844 | − | RR: 0.94 (0.85 to 1.04; |
| Hospital mortality | 4 | 636 | 0% | RR: 0.81 (0.62 to 1.06; | ||||||||
| ICU mortality | 3 | 491 | 3.1% | RR: 0.84 (0.61 to 1.16; | ||||||||
| Length of stay in ICU | 3 | 365 | Q= 6.01 | ES: −3.22 (-9.14 to −2.70; | ||||||||
| Etiology of the infections | 3 | 118 | G+ bacterial infection RR: 1.21 (0.83 to 1.75; | |||||||||
| 6 | Liu (2012)[ | Probiotics’ effects on the incidence of nosocomial pneumonia in critically ill patients: a systematic review and meta-analysis | 12 RCT | PubMed, Cochrane, and EMBASE | Administration of probiotics vs placebo and that reported the incidence of NP or VAP–Probiotics could be administered either alone or in combination with prebiotics | Jadad score | Critically ill patients (admitted to an ICU or having recently undergone abdominal or another major surgical procedure) | Nosocomial pneumonia | 12 | 1546 | 46% | OR = 0.75 (0.57 to 0.97; |
| VAP | 54% | OR = 0.68 (0.42 to 1.11; | ||||||||||
| Nosocomial pneumonia in surgical critically ill patients | 41% | OR: 0.67 (0.45 to 1.01; | ||||||||||
| Hospital mortality | 9 | 1058 | 51% | OR = 0.93 (0.50 to 1.74; | ||||||||
| ICU mortality | 3 | 512 | 0% | OR = 0.84 (0.55 to 1.29; | ||||||||
| Hospital LoS | 8 | 1110 | 46% | WMD: −0.13 (-0.93 to 0.67; | ||||||||
| ICU LoS | 8 | 1093 | 68% | WMD: −0.72 (-1.73 to 0.29; | ||||||||
| Diarrhea | 6 | − | 0% | OR= 0.85 (0.58 to 1.26; | ||||||||
| Abdominal cramps | 3 | − | 0% | OR = 0.74 (0.47 to 1.17; | ||||||||
| 7 | Barraud (2013)[ | Impact of the administration of probiotics on mortality in critically ill adult patients | 13 RCT | PubMed, Scopus, and the Cochrane Central Register for Controlled Trials | Compared the administration of probiotics (and/or prebiotics or synbiotics) vs control (placebo or other)–Articles must also have reported on ICU or hospital mortality | Jadad score | Critically ill adult patients admitted to the ICU | ICU mortality | 9 | 1119 | 0% | OR: 0.85 (0.63 to 1.15; |
| Hospital mortality | 8 | 841 | 0% | OR: 0.90 (0.65 to 1.23; | ||||||||
| ICU-acquired infections | 9 | 969 | 80% | FEM OR: 0.80 (0.61 to 1.04; | ||||||||
| Antibiotics consumption | − | − | 0% | FEM WMD: −1.67; −3.62 to 0.28; | ||||||||
| ICU-acquired pneumonia | 10 | 1218 | 39% | FEM OR: 0.58 (0.42 to 0.79; | ||||||||
| ICU-acquired CRBSI | 3 | 486 | 62% | FEM OR: 0.52 (0.30 to 0.87; | ||||||||
| Diarrhea | 5 | 648 | OR: 0.72 (0.47 to 1.10; | |||||||||
| Duration of MV | 4 | 624 | 81% | WMD: −0.18 (-1.72 to 1.36; | ||||||||
| ICU LoS | 7 | 802 | 54% | WMD: −1.49 (-2.12 to −0.87; | ||||||||
| Hospital LoS | 6 | 685 | 0% | WMD: −0.45 (-1.41 to 0.52; | ||||||||
| Safety issues | 9 |
| ||||||||||
| 8 | Manzanares (2016)[ | Probiotic and synbiotic therapy in critical illness: a systematic review and meta-analysis | 30 RCT | MEDLINE, Embase, CINAHL, Cochrane | Probiotics alone or associated with prebiotics (synbiotics) compared to a placebo | Own criteria | Adult (≥18 years of age) critically ill patients— | New infections | 14 | 1233 | 36% | RR: 0.80 (0.68 to 0.95; |
| VAP | 9 | 1326 | 19% | RR: 0.74 (0.61 to 0.90; | ||||||||
| Hospital mortality | 17 | 1638 | 0% | RR: 0.98 (0.82 to 1.18; | ||||||||
| ICU LoS | 14 | − | 93% | WMD: −3.26 (-7.82 to 1.31; | ||||||||
| Hospital LoS | 9 | − | 74% | WMD: −0.58 (-3.66 to 2.50; | ||||||||
| Diarrhea | 9 | 1259 | 5% | RR: 0.97 (0.82 to 1.15; | ||||||||
| Antibiotic days | 4 | 470 | 32% | WMD: −1.12 (-1.72 to −0.51, | ||||||||
| 9 | Watkinson (2007)[ | The use of pre-pro- and synbiotics in adult intensive care unit patients: Systematic review | 8 RCT | Medline, CINAHL, Embase, CENTRAL and the UK National Research Register | Enteral pre-, pro or synbiotic compared with a control | Jadad score | Adult patients admitted to an ICU | Nosocomial infection | 5 | 363 | 78.8% | RR: 1.50 (0.74 to 3.06; |
| Hospital mortality | 8 | 961 | 0% | RR: 0.96 (0.78 to 1.17; | ||||||||
| ICU LoS | 3 | 125 | 0% | WMD: 0.03 (-0.44 to 0.51; | ||||||||
| Nosocomial pneumonia | 4 | 429 | 0% | RR:1.40 (0.75 to 2.64; | ||||||||
| 10 | Brenner (2017)[ | Growing literature but limited evidence: a systematic review regarding prebiotic and probiotic interventions for those with traumatic brain injury and/or post-traumatic stress disorder | OVID MEDLINE, EMBASE, OVID PsycINFO, WoS, CINAHL, and Cochrane Library | − | Taxonomy of Study Design Tool | This SR includes two high RoB studies of ICU patients with traumatic brain injury. In the first study which is performed in China[ | ||||||
| 11 | Chen (2018)[ | Probiotics are effective in decreasing the incidence of ventilator-associated pneumonia in adult patients: a meta-analysis of randomized controlled trials | 10 RCT | PubMed and WoS | A comparison of probiotics with placebo or other drugs | Cochrane criteria | Adult critically ill participants (≥ 18 years) | VAP | 10 | 1403 | 32% | FEM OR: 0.69 (0.54 to 0.88; |
| ICU mortality | 6 | 938 | 0% | FEM OR: 0.95 (0.67 to 1.33; | ||||||||
| Hospital mortality | 5 | 759 | 0% | FEM OR: 0.86 (0.62 to 1.18; | ||||||||
| Diarrhea | 4 | 618 | 14% | FEM OR: 0.72 (0.49 to 1.09, | ||||||||
| ICU stay | 4 | 432 | 79% | REM WMD: −1.74 (-6.74 to 3.27; | ||||||||
| Duration of MV | 2 | 215 | 93% | REM WMD: −6.21 (-18.83 to 6.41; | ||||||||
| Days of antibiotics for VAP | 2 | 381 | 31% | REM WMD: −1.48 (-2.90 to −0.07; | ||||||||
| 12 | Cooke (2020)[ | Effectiveness of complementary and alternative medicine interventions for sleep quality in adult intensive care patients: A systematic review | 17RCT | Medline (EBSCO Host), CINAHL, PsychINFO, Cochrane library and Scopus | Complementary and alternative medicine interventions | Cochrane criteria | Adult ICU patients | Authors didn't find any article about the effects of probiotics that met their incursion criteria. | ||||
| 13 | Didari (2014)[ | A systematic review of the safety of probiotics | 13 | PubMed, WoS, Google Scholar and Scopus | Probiotic use | − | Adult patients in ICU | Out of 13 of their included studies involving ICU patients, one RCT reported a few adverse events and bowel distension was reported in one case series study. Finally, in a study in critically ill adults with severe acute pancreatitis, an increase in mortality and bowel ischemia was reported with the use of a multispecies probiotic product (Ecologic 641). | ||||
| 14 | Fan (2019)[ | Synbiotics for prevention of ventilator-associated pneumonia: a probiotics strain-specific network meta-analysis | 14 RCT | PubMed, WoS, EMBASE, and Cochrane databases | Probiotics, either alone or in combination with other interventions; | Cochrane Handbook for Systematic Reviews | Patients who underwent mechanical ventilation | VAP | 14 | 2044 | 17% | OR: 0.69 (0.55 to 0.88; |
| Hospital mortality | 8 | 1114 | 0% | OR: 0.81 (0.61 to 1.06; | ||||||||
| ICU mortality | 9 | 1322 | 0% | OR: 0.89 (0.67 to 1.17; | ||||||||
| ICU LoS | 5 | 538 | 83% | WMD: −2.40 (-6.75 to 1.95; | ||||||||
| Diarrhea | 6 | 1003 | 34% | OR: 0.75 (0.51 to 1.10; | ||||||||
| 15 | Maia (2019)[ | Effects of probiotic therapy on serum inflammatory markers: A systematic review and meta-analysis | 58 (1 in ICU) | PubMed/MEDLINE, EMBASE and Cochrane Library | Probiotic therapy vs control | Jadad | Critically ill |
| ||||
| 16 | Whelan (2010)[ | Safety of probiotics in patients receiving nutritional support: a systematic review of case reports, randomized controlled trials, and nonrandomized trials | 72 Studies (21 in ICU) | MEDLINE, EMBASE, CINAHL, CENTRAL, Nutrition and Food Sciences, WoS | Patients receiving nutritional support | − | Adults in ICU | Only in one study a few side effects were reported and two patients in one study developed bowel distention. One trial reported few side effects, 11 studies reported no adverse events and 8 studies gave no information about safety. | ||||
| 17 | Roquilly (2014)[ | Pneumonia prevention to decrease mortality in intensive care unit. A systematic review and meta-analysis | 157 RCT (13 RCT) | MEDLINE and COCHRANE | Probiotic/Symbiotic | Cochrane criteria | Critically ill adult patients hospitalized in ICU and evaluating digestive prophylactic methods | Hospital mortality | 13 | 1569 | 23% | RR: 0.89 (0.66 to 1.18; |
| Hospital-acquired pneumonia | 12 | 1585 | 42% | RR: 0.76 (0.66 to 1.03; | ||||||||
| Duration of MV | 5 | 899 | 0% | WMD: −0.12 (-1.03 to 0.79; | ||||||||
| ICU LoS | 9 | 1275 | 46% | WMD: −1.08 (-2.19 to 0.03; | ||||||||
| 18 | Su (2020)[ | Probiotics for the prevention of ventilator-associated pneumonia: A meta-analysis of randomized controlled trials | 14 RCTs | PubMed, EMBASE, and Cochrane databases | Compared probiotics with placebo or standard therapy | Cochrane criteria | Adults receiving mechanical ventilation | VAP | 14 | 1575 | 43% | REM OR: 0.62 (0.45 to 0.85; |
| ICU mortality | 6 | 993 | 0% | REM OR: 0.95 (0.67-1.34; | ||||||||
| ICU LoS | 10 | 1,418 | 89% | REM MDW: −1.29 (–4.74 to 2.15; | ||||||||
| ICU LoS (sensitivity analysis) | 7 | 1103 | 43% | REM MDW: −0.77 (–2.58 to 1.04; | ||||||||
| Duration of MV | 8 | 1,197 | 78% | REM MDW: −2.37 (-4.67 to −0.08; | ||||||||
| Duration of MV (sensitivity) analysis | 6 | 897 | 25% | REM MDW: −0.91 (–2.20 to 0.38; | ||||||||
| Antibiotic use for VAP | 2 | 373 | 41% | REM MDW: −1.44 (–2.88 to −0.01; | ||||||||
| Diarrhea | 6 | 861 | 30% | REM OR: 0.72 (0.45 to 1.15; | ||||||||
| 19 | van Ruissen (2019)[ | Manipulation of the microbiome in critical illness probiotics as a preventive measure against ventilator-associated pneumonia | 8 RCTs | MEDLINE via PubMed and WoS | Excluded if probiotics were used in combination with a prebiotic or an antimicrobial agent | Cochrane criteria | Patients were over 18 years of age, admitted to an ICU and receiving invasive ventilation | Incidences of VAP |
| |||
| 20 | Weng (2017)[ | Probiotics for preventing ventilator-associated pneumonia in mechanically ventilated patients: A meta-analysis with trial sequential analysis | 13 RCT | PubMed, Embase, and CENTRAL | Comparing probiotics with control | Cochrane criteria | Mechanically ventilated patients | VAP | 13 | 1969 | 40% | RR: 0.73 (0.60 to 0.89; |
| VAP (Sensitivity analysis) | 10 | − | − | REM RR = 0.86 (0.66 to 0.97; | ||||||||
| 90-day mortality | 2 | 317 | 0% | FEM RR = 1.00 (0.72 to 1.37; | ||||||||
| Overall mortality | 9 | 1296 | 0% | FEM RR: 0.84 (0.70 to 1.02; | ||||||||
| Overall mortality (Sensitivity analysis) | 7 | − | − | RR = 0.86 (0.70 to 1.07; | ||||||||
| 28-day mortality | 2 | 317 | 0% | FEM RR: 1.06 (0.72 to 1.57; | ||||||||
| ICU mortality | 6 | 938 | 0% | FEM RR: 0.97 (0.74 to 1.27; | ||||||||
| ICU mortality (Sensitivity analysis) | 5 | − | − | RR = 0.96 (0.73 to 1.26; | ||||||||
| Hospital mortality | 6 | 877 | 0% | FEM RR = 0.81 (0.73 to 1.26; | ||||||||
| Hospital mortality (Sensitivity analysis) | 4 | − | − | RR = 0.83 (0.73 to 1.26; | ||||||||
| Diarrhea | 5 | 768 | 0% | FEM RR: 0.99 (0.83 to 1.19; | ||||||||
| ICU LoS | 5 | 538 | 83% | REM MD = −2.40 (-6.75 to 1.95; | ||||||||
| ICU LoS (Sensitivity analysis) | 3 | − | − | MD = −3.88 (-10.51 to 2.76; | ||||||||
| Hospital LoS | 4 | 682 | 79% | REM MD = −1.34 (-6.21 to 3.54; | ||||||||
| Hospital LoS (Sensitivity analysis) | 3 | − | − | MD= 1.47 (-6.21 to 3.54; | ||||||||
| Duration of MV | 4 | 512 | 83% | REM MD = −3.32 (-6.21 to 3.54; | ||||||||
| Duration of MV (Sensitivity analysis) | 3 | − | − | MD=-3.32 (-6.21 to 3.54; | ||||||||
RCT, randomized controlled trial; VAP, ventilator-associated pneumonia; LoS, length of stay; ICU, intensive care unit; MV, mechanical ventilation; RR, relative risk; OR, odds ratio; WMD, weighted mean difference; MD, mean difference; WoS, Web of Science; IL-6, interleukin 6; FEM, fixed-effect model; REM, random-effects model
Risk of bias in the included studies
|
|
| |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
|
|
| ||||||||||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
| 1 | Petrof et al. (2012) | Y | Y | Y | Y | Y | LOW | PY | Y | Y | Y | Y | LOW | PN | Y | PY | PY | Y | HIGH | Y | Y | N | Y | Y | N | HIGH | N | PY | Y | HIGH |
| 2 | Siempos et al. (2010) | Y | N | Y | Y | Y | HIGH | Y | Y | PN | Y | Y | HIGH | Y | Y | Y | Y | PN | HIGH | Y | Y | Y | Y | N | N | HIGH | N | Y | Y | HIGH |
| 3 | Gu et al. (2012) | Y | Y | PY | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | PN | HIGH | Y | Y | N | Y | Y | Y | HIGH | N | Y | Y | HIGH |
| 4 | Bo et al. (2015) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | Y | LOW | Y | Y | Y | LOW |
| 5 | Wang et al. (2013) | Y | Y | y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | Y | LOW | Y | Y | Y | LOW |
| 6 | Liu et al. (2012) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | N | Y | Y | Y | HIGH | N | Y | Y | HIGH |
| 7 | Barraud et al. (2013) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | PN | HIGH | Y | Y | N | Y | N | N | HIGH | N | Y | Y | HIGH |
| 8 | Manzanares et al. (2016) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | PN | HIGH | PN | Y | Y | PY | Y | HIGH | Y | Y | Y | Y | Y | Y | LOW | N | Y | Y | HIGH |
| 9 | Watkinson et al. (2007) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | N | HIGH | Y | Y | Y | Y | PN | HIGH | Y | Y | N | Y | N | N | HIGH | N | Y | Y | HIGH |
| 10 | Brenner et al. (2017) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | Y | LOW | Y | Y | Y | LOW |
| 11 | Chen et al. (2018) | Y | Y | Y | Y | Y | LOW | N | Y | Y | Y | Y | HIGH | PN | Y | Y | Y | PN | HIGH | Y | Y | N | Y | N | N | HIGH | N | Y | Y | HIGH |
| 12 | Cooke et al. (2020) | Y | Y | Y | Y | Y | LOW | Y | PN | Y | Y | N | HIGH | PN | Y | Y | Y | Y | HIGH | Y | Y | Y | Y | Y | Y | LOW | N | Y | Y | HIGH |
| 13 | Didari et al. (2014) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | PN | HIGH | PN | Y | Y | N | N | HIGH | Y | Y | Y | Y | Y | Y | LOW | N | Y | Y | HIGH |
| 14 | Fan et al. (2019) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | Y | LOW | Y | Y | Y | LOW |
| 15 | Maia et al. (2019) | Y | Y | y | Y | Y | LOW | Y | Y | N | N | PN | HIGH | Y | Y | Y | Y | PN | HIGH | Y | Y | N | Y | Y | Y | HIGH | N | Y | Y | HIGH |
| 16 | Whelan et al. (2010) | Y | Y | N | Y | Y | HIGH | Y | Y | N | Y | Y | HIGH | Y | Y | Y | N | N | HIGH | Y | Y | N | Y | Y | N | HIGH | N | Y | Y | HIGH |
| 17 | Roquilly etal. (2014) | Y | Y | N | Y | Y | HIGH | N | Y | N | Y | PN | HIGH | Y | N | Y | Y | Y | HIGH | Y | Y | N | Y | N | N | HIGH | N | Y | Y | HIGH |
| 18 | Su et al. (2020) | Y | Y | Y | Y | Y | LOW | Y | PN | Y | Y | Y | HIGH | Y | Y | Y | Y | Y | LOW | Y | Y | N | Y | Y | Y | HIGH | N | Y | Y | HIGH |
| 19 | van Ruissen etal. (2019) | Y | Y | Y | Y | Y | LOW | Y | Y | PN | Y | PN | HIGH | PN | Y | Y | Y | PN | HIGH | Y | Y | Y | Y | Y | N | HIGH | N | Y | Y | HIGH |
| 20 | Weng et al. (2017) | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | Y | LOW | Y | Y | Y | Y | PN | HIGH | Y | Y | N | Y | Y | N | HIGH | N | Y | Y | HIGH |
Y, yes; PY, probably yes; PN, probably no; N, no; Nl, no information
Fig. 1Summary of the risk of bias assessment based on ROBIS tool. P, phase; D, domain; Q, question