Susan Armijo-Olivo1, Greta G Cummings2, Jorge Fuentes3, Humam Saltaji4, Christine Ha5, Annabritt Chisholm6, Dion Pasichnyk7, Todd Rogers8. 1. S. Armijo-Olivo, BScPT, MScPT, PhD, CLEAR (Connecting Leadership and Research) Outcomes Research Program, Department of Physical Therapy, Faculty of Rehabilitation Medicine, University of Alberta, 3-48 Corbett Hall, Edmonton, Alberta, Canada T6G 2G4. sla4@ualberta.ca susanarmijo@gmail.com. 2. G.G. Cummings, PhD, RN, FCAHS, CLEAR Outcomes Research Program, University of Alberta, Edmonton Clinic Health Academy, University of Alberta. 3. J. Fuentes, BPT, PhD, MSc, Department of Physical Therapy, Faculty of Rehabilitation Medicine, University of Alberta, and Department of Physical Therapy, Catholic University of Maule, Talca, Chile. 4. H. Saltaji, DDS, MSc(Ortho), Orthodontic Graduate Program, Faculty of Medicine and Dentistry, School of Dentistry, University of Alberta. 5. C. Ha, BSc, Rehabilitation Research Center, Faculty of Rehabilitation Medicine, University of Alberta. 6. A. Chisholm, BSc, Alberta Research Centre for Health Evidence, Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta. 7. D. Pasichnyk, MSc(Epidemiology), Quality Management in Clinical Research, University of Alberta. 8. T. Rogers, PhD, Centre for Research in Applied Measurement and Evaluation, University of Alberta.
Abstract
BACKGROUND: Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. OBJECTIVE: The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). DESIGN: A methodological research design was used, and an EFA was performed. METHODS: Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. RESULTS: Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. LIMITATION: Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. CONCLUSIONS: To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items.
BACKGROUND: Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. OBJECTIVE: The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). DESIGN: A methodological research design was used, and an EFA was performed. METHODS: Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. RESULTS: Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. LIMITATION: Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. CONCLUSIONS: To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items.
Authors: Lesley Wood; Matthias Egger; Lise Lotte Gluud; Kenneth F Schulz; Peter Jüni; Douglas G Altman; Christian Gluud; Richard M Martin; Anthony J G Wood; Jonathan A C Sterne Journal: BMJ Date: 2008-03-03
Authors: Anne M Moseley; Mark R Elkins; Robert D Herbert; Christopher G Maher; Catherine Sherrington Journal: J Clin Epidemiol Date: 2009-03-17 Impact factor: 6.437
Authors: J Revuz; D Moyse; F Poli; H Pawin; M Faure; M Chivot; C Beylot; B Dréno Journal: J Eur Acad Dermatol Venereol Date: 2008-07 Impact factor: 6.166
Authors: Eveline Nüesch; Sven Trelle; Stephan Reichenbach; Anne W S Rutjes; Elizabeth Bürgi; Martin Scherer; Douglas G Altman; Peter Jüni Journal: BMJ Date: 2009-09-07
Authors: Susan Armijo-Olivo; Humam Saltaji; Bruno R da Costa; Jorge Fuentes; Christine Ha; Greta G Cummings Journal: BMJ Open Date: 2015-09-03 Impact factor: 2.692