Lauren Greenberg1, Vipul Jairath2, Rupert Pearse3, Brennan C Kahan4. 1. Pragmatic Clinical Trials Unit, Queen Mary University of London, UK. 2. Department of Medicine, Western University, London, Ontario, Canada; Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada. 3. Adult Critical Care Unit, Royal London Hospital, London E1 1BB, UK. 4. Pragmatic Clinical Trials Unit, Queen Mary University of London, UK. Electronic address: b.kahan@qmul.ac.uk.
Abstract
OBJECTIVES: Results from randomized trials can depend on the statistical analysis approach used. It is important to prespecify the analysis approach in the trial protocol to avoid selective reporting of analyses based on those which provide the most favourable results. We undertook a review of published trial protocols to assess how often the statistical analysis of the primary outcome was adequately prespecified. METHODS: We searched protocols of randomized trials indexed in PubMed in November 2016. We identified whether the following aspects of the statistical analysis approach for the primary outcome were adequately prespecified: (1) analysis population; (2) analysis model; (3) use of covariates; and (4) method of handling missing data. RESULTS: We identified 99 eligible protocols. Very few protocols adequately prespecified the analysis population (8/99, 8%), analysis model (27/99, 27%), covariates (40/99, 40%), or approach to handling missing data (10/99, 10%). Most protocols did not adequately predefine any of these four aspects of their statistical analysis approach (39%) or predefined only one aspect (36%). No protocols adequately predefined all four aspects of the analysis. CONCLUSION: The statistical analysis approach is rarely prespecified in published trial protocols. This may allow selective reporting of results based on different analyses.
OBJECTIVES: Results from randomized trials can depend on the statistical analysis approach used. It is important to prespecify the analysis approach in the trial protocol to avoid selective reporting of analyses based on those which provide the most favourable results. We undertook a review of published trial protocols to assess how often the statistical analysis of the primary outcome was adequately prespecified. METHODS: We searched protocols of randomized trials indexed in PubMed in November 2016. We identified whether the following aspects of the statistical analysis approach for the primary outcome were adequately prespecified: (1) analysis population; (2) analysis model; (3) use of covariates; and (4) method of handling missing data. RESULTS: We identified 99 eligible protocols. Very few protocols adequately prespecified the analysis population (8/99, 8%), analysis model (27/99, 27%), covariates (40/99, 40%), or approach to handling missing data (10/99, 10%). Most protocols did not adequately predefine any of these four aspects of their statistical analysis approach (39%) or predefined only one aspect (36%). No protocols adequately predefined all four aspects of the analysis. CONCLUSION: The statistical analysis approach is rarely prespecified in published trial protocols. This may allow selective reporting of results based on different analyses.
Authors: Bart Hiemstra; Frederik Keus; Jørn Wetterslev; Christian Gluud; Iwan C C van der Horst Journal: BMC Med Res Methodol Date: 2019-12-09 Impact factor: 4.615