BACKGROUND: Interim analyses of randomised controlled trials are sometimes published before the final results are available. In several cases, the treatment effects were noticeably different after patient recruitment and follow-up completed. We therefore conducted a literature review of peer-reviewed journals to compare the reported treatment effects between interim and final publications and to examine the magnitude of the difference. METHODS: We performed an electronic search of MEDLINE from 1990 to 2014 (keywords: 'clinical trial' OR 'clinical study' AND 'random*' AND 'interim' OR 'preliminary'), and we manually identified the corresponding final publication. Where the electronic search produced a final report in which the abstract cited interim results, we found the interim publication. We also manually searched every randomised controlled trial in eight journals, covering a range of impact factors and general medical and specialist publications (1996-2014). All paired articles were checked to ensure that the same comparison between interventions was available in both. RESULTS: In all, 63 studies are included in our review, and the same quantitative comparison was available in 58 of these. The final treatment effects were smaller than the interim ones in 39 (67%) trials and the same size or larger in 19 (33%). There was a marked reduction, defined as a ≥20% decrease in the size of the treatment effect from interim to final analysis, in 11 (19%) trials compared to a marked increase in 3 (5%), p = 0.057. The magnitude of percentage change was larger in trials where commercial support was reported, and increased as the proportion of final events at the interim report decreased in trials where commercial support was reported (interaction p = 0.023). There was no evidence of a difference between trials that stopped recruitment at the interim analysis where this was reported as being pre-specified versus those that were not pre-specified (interaction p = 0.87). CONCLUSION: Published interim trial results were more likely to be associated with larger treatment effects than those based on the final report. Publishing interim results should be discouraged, in order to have reliable estimates of treatment effects for clinical decision-making, regulatory authority reviews and health economic analyses. Our work should be expanded to include conference publications and manual searches of additional journal publications.
BACKGROUND: Interim analyses of randomised controlled trials are sometimes published before the final results are available. In several cases, the treatment effects were noticeably different after patient recruitment and follow-up completed. We therefore conducted a literature review of peer-reviewed journals to compare the reported treatment effects between interim and final publications and to examine the magnitude of the difference. METHODS: We performed an electronic search of MEDLINE from 1990 to 2014 (keywords: 'clinical trial' OR 'clinical study' AND 'random*' AND 'interim' OR 'preliminary'), and we manually identified the corresponding final publication. Where the electronic search produced a final report in which the abstract cited interim results, we found the interim publication. We also manually searched every randomised controlled trial in eight journals, covering a range of impact factors and general medical and specialist publications (1996-2014). All paired articles were checked to ensure that the same comparison between interventions was available in both. RESULTS: In all, 63 studies are included in our review, and the same quantitative comparison was available in 58 of these. The final treatment effects were smaller than the interim ones in 39 (67%) trials and the same size or larger in 19 (33%). There was a marked reduction, defined as a ≥20% decrease in the size of the treatment effect from interim to final analysis, in 11 (19%) trials compared to a marked increase in 3 (5%), p = 0.057. The magnitude of percentage change was larger in trials where commercial support was reported, and increased as the proportion of final events at the interim report decreased in trials where commercial support was reported (interaction p = 0.023). There was no evidence of a difference between trials that stopped recruitment at the interim analysis where this was reported as being pre-specified versus those that were not pre-specified (interaction p = 0.87). CONCLUSION: Published interim trial results were more likely to be associated with larger treatment effects than those based on the final report. Publishing interim results should be discouraged, in order to have reliable estimates of treatment effects for clinical decision-making, regulatory authority reviews and health economic analyses. Our work should be expanded to include conference publications and manual searches of additional journal publications.
Entities:
Keywords:
Randomised controlled trials; clinical decision-making; final analysis; interim analysis; published results; treatment effects
Authors: Joseph E Gaugler; Rachel Zmora; Lauren L Mitchell; Jessica M Finlay; Colleen M Peterson; Hayley McCarron; Eric Jutkowitz Journal: Gerontologist Date: 2019-01-09