Susan Armijo-Olivo1, Jorge Fuentes, Bruno R da Costa, Humam Saltaji, Christine Ha, Greta G Cummings. 1. From the Department of Physical Therapy, University of Alberta, Edmonton, Alberta, Canada (SA-O, JF); Catholic University of Maule, Department of Physical Therapy, Talca, Chile (JF); Institute of Primary Health Care, Universitat Bern, Gesellschaftstrasse, Bern, Switzerland (BRdC); and School of Dentistry (HS), Rehabilitation Research Center (CH), and Edmonton Clinic Health Academy (GGC), University of Alberta, Edmonton, Alberta, Canada.
Abstract
OBJECTIVE: The aim of this study was to examine whether blinding of participants, assessors, health providers, and statisticians have an effect on treatment effect estimates in physical therapy (PT) trials. DESIGN: This was a meta-epidemiological study. Randomized controlled trials in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analyses of PT interventions. Assessments of blinding in PT trials were conducted independently following established guidelines. RESULTS: Three hundred ninety-three trials and 43 meta-analyses that included 44,622 patients contributed to this study. Only a quarter of the trials were adequately blinded (n = 80; 20%). Most individual components of blinding as well as what they were blinded to were also poorly reported. Although trials with inappropriate blinding of assessors and participants tended to underestimate treatment effects when compared with trials with appropriate blinding of assessors and participants, the difference was not statistically significant (effect size, -0.07; 95% confidence interval, -0.22 to 0.08; effect size, -0.12; 95% confidence interval, -0.30 to 0.06, respectively). CONCLUSIONS: The lack of statistical significance between blinding and effect sizes should not be interpreted as meaning that an impact of blinding on effect size is not present in PT. More empirical evidence in a larger sample is needed to determine which biases are likely to influence reported effect sizes of PT trials and under which conditions.
OBJECTIVE: The aim of this study was to examine whether blinding of participants, assessors, health providers, and statisticians have an effect on treatment effect estimates in physical therapy (PT) trials. DESIGN: This was a meta-epidemiological study. Randomized controlled trials in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analyses of PT interventions. Assessments of blinding in PT trials were conducted independently following established guidelines. RESULTS: Three hundred ninety-three trials and 43 meta-analyses that included 44,622 patients contributed to this study. Only a quarter of the trials were adequately blinded (n = 80; 20%). Most individual components of blinding as well as what they were blinded to were also poorly reported. Although trials with inappropriate blinding of assessors and participants tended to underestimate treatment effects when compared with trials with appropriate blinding of assessors and participants, the difference was not statistically significant (effect size, -0.07; 95% confidence interval, -0.22 to 0.08; effect size, -0.12; 95% confidence interval, -0.30 to 0.06, respectively). CONCLUSIONS: The lack of statistical significance between blinding and effect sizes should not be interpreted as meaning that an impact of blinding on effect size is not present in PT. More empirical evidence in a larger sample is needed to determine which biases are likely to influence reported effect sizes of PT trials and under which conditions.
Authors: Fabio Efficace; David Cella; Neil K Aaronson; Melanie Calvert; Francesco Cottone; Massimo Di Maio; Francesco Perrone; Francesco Sparano; Eva-Maria Gamper; Marco Vignetti; Johannes M Giesinger Journal: J Natl Cancer Inst Date: 2022-03-08 Impact factor: 11.816
Authors: Humam Saltaji; Susan Armijo-Olivo; Greta G Cummings; Maryam Amin; Bruno R da Costa; Carlos Flores-Mir Journal: BMC Med Res Methodol Date: 2018-05-18 Impact factor: 4.615
Authors: Erik Lenguerrand; Neil Artz; Elsa Marques; Emily Sanderson; Kristina Lewis; James Murray; Tarique Parwez; Wendy Bertram; Andrew D Beswick; Amanda Burston; Rachael Gooberman-Hill; Ashley W Blom; Vikki Wylde Journal: Arthritis Care Res (Hoboken) Date: 2020-05-18 Impact factor: 4.794
Authors: Jodi L Young; Daniel I Rhon; Rutger M J de Zoete; Joshua A Cleland; Suzanne J Snodgrass Journal: Braz J Phys Ther Date: 2017-11-04 Impact factor: 3.377
Authors: Felicity A Braithwaite; Julie L Walters; Lok Sze Katrina Li; G Lorimer Moseley; Marie T Williams; Maureen P McEvoy Journal: PeerJ Date: 2018-07-31 Impact factor: 2.984
Authors: Helene Moustgaard; Gemma L Clayton; Hayley E Jones; Isabelle Boutron; Lars Jørgensen; David R T Laursen; Mette F Olsen; Asger Paludan-Müller; Philippe Ravaud; Jelena Savović; Jonathan A C Sterne; Julian P T Higgins; Asbjørn Hróbjartsson Journal: BMJ Date: 2020-01-21