Alan A Montgomery1, Margaret P Astin, Tim J Peters. 1. Bristol Randomised Trials Collaboration, School of Social and Community Medicine, University of Bristol, UK. alan.a.montgomery@bristol.ac.uk
Abstract
BACKGROUND: Standards for the reporting of factorial randomised trials remain to be established. We aimed to review the quality of reporting of methodological aspects of published factorial trials of complex interventions in community settings. METHODS: We searched MEDLINE, EMBASE, PsychInfo and the Cochrane Controlled Trials Register to identify factorial randomised trials of complex interventions in community settings from January 2000 to August 2009. We also conducted a citation search of two review papers published in 2003. Data were extracted by two reviewers on 22 items relating to study design, analysis and presentation. RESULTS: We identified 5941 unique titles, from which 116 full papers were obtained and 76 were included in the review. The included trials reflected a broad range of target conditions and types of intervention. The median sample size was 400 (interquartile range 191-1001). Most (88%) trials employed a 2 × 2 factorial design. Few trials (21%) explicitly stated the rationale for using a factorial design. Reporting of aspects of design, analysis or presentation specific to factorial trials was variable, but there was no evidence that reporting of these aspects was different for trials published before or after 2003. However, for CONSORT items that apply generally to the reporting of all trials, there was some evidence that later studies were more likely to report employing an intention-to-treat (ITT) approach (78% vs 52%), present appropriate between-group estimates of effect (88% vs 63%), and present standard errors or 95% confidence intervals for such estimates (78% vs 56%). Interactions between interventions and some measure of the precision associated with such effects were reported in only 14 (18%) trials. CONCLUSIONS: Reports of factorial trials of complex interventions in community settings vary in the amount of information they provide regarding important methodological aspects of design and analysis. This variability supports the extension of CONSORT guidelines to include the specific reporting of factorial trials.
BACKGROUND: Standards for the reporting of factorial randomised trials remain to be established. We aimed to review the quality of reporting of methodological aspects of published factorial trials of complex interventions in community settings. METHODS: We searched MEDLINE, EMBASE, PsychInfo and the Cochrane Controlled Trials Register to identify factorial randomised trials of complex interventions in community settings from January 2000 to August 2009. We also conducted a citation search of two review papers published in 2003. Data were extracted by two reviewers on 22 items relating to study design, analysis and presentation. RESULTS: We identified 5941 unique titles, from which 116 full papers were obtained and 76 were included in the review. The included trials reflected a broad range of target conditions and types of intervention. The median sample size was 400 (interquartile range 191-1001). Most (88%) trials employed a 2 × 2 factorial design. Few trials (21%) explicitly stated the rationale for using a factorial design. Reporting of aspects of design, analysis or presentation specific to factorial trials was variable, but there was no evidence that reporting of these aspects was different for trials published before or after 2003. However, for CONSORT items that apply generally to the reporting of all trials, there was some evidence that later studies were more likely to report employing an intention-to-treat (ITT) approach (78% vs 52%), present appropriate between-group estimates of effect (88% vs 63%), and present standard errors or 95% confidence intervals for such estimates (78% vs 56%). Interactions between interventions and some measure of the precision associated with such effects were reported in only 14 (18%) trials. CONCLUSIONS: Reports of factorial trials of complex interventions in community settings vary in the amount of information they provide regarding important methodological aspects of design and analysis. This variability supports the extension of CONSORT guidelines to include the specific reporting of factorial trials.
Authors: David Moher; Sally Hopewell; Kenneth F Schulz; Victor Montori; Peter C Gøtzsche; P J Devereaux; Diana Elbourne; Matthias Egger; Douglas G Altman Journal: BMJ Date: 2010-03-23
Authors: Guowei Li; Meha Bhatt; Mei Wang; Lawrence Mbuagbaw; Zainab Samaan; Lehana Thabane Journal: Proc Natl Acad Sci U S A Date: 2018-03-12 Impact factor: 11.205