BACKGROUND: Many published accounts of clinical trials report no differences between the treatment arms, while being underpowered to find differences. This study determined how the authors of these reports interpreted their findings. STUDY DESIGN: We examined 54 reports of surgical trials chosen randomly from a database of 110 influential trials conducted in 2008. Seven that reported having adequate statistical power (β ≥ 0.9) were excluded from further analysis, as were the 32 that reported significant differences between the treatment arms. We examined the remaining 15 to see whether the authors interpreted their negative findings appropriately. Appropriate interpretations discussed the lack of power and/or called for larger studies. RESULTS: Three of the 7 trials that did not report an a priori power calculation offered inappropriate interpretations, as did 3 of the 8 trials that reported an a priori power < 0.90. However, we examined only a modest number of trial reports from 1 year. CONCLUSIONS: Negative findings in underpowered trials were often interpreted as showing the equivalence of the treatment arms with no discussion of the issue of being underpowered. This may lead clinicians to accept new treatments that have not been validated.
BACKGROUND: Many published accounts of clinical trials report no differences between the treatment arms, while being underpowered to find differences. This study determined how the authors of these reports interpreted their findings. STUDY DESIGN: We examined 54 reports of surgical trials chosen randomly from a database of 110 influential trials conducted in 2008. Seven that reported having adequate statistical power (β ≥ 0.9) were excluded from further analysis, as were the 32 that reported significant differences between the treatment arms. We examined the remaining 15 to see whether the authors interpreted their negative findings appropriately. Appropriate interpretations discussed the lack of power and/or called for larger studies. RESULTS: Three of the 7 trials that did not report an a priori power calculation offered inappropriate interpretations, as did 3 of the 8 trials that reported an a priori power < 0.90. However, we examined only a modest number of trial reports from 1 year. CONCLUSIONS: Negative findings in underpowered trials were often interpreted as showing the equivalence of the treatment arms with no discussion of the issue of being underpowered. This may lead clinicians to accept new treatments that have not been validated.
Authors: Danielle M Wenner; Baruch A Brody; Anna F Jarman; Jacob M Kolman; Nelda P Wray; Carol M Ashton Journal: J Am Coll Surg Date: 2012-07-21 Impact factor: 6.113
Authors: Carol M Ashton; Nelda P Wray; Anna F Jarman; Jacob M Kolman; Danielle M Wenner; Baruch A Brody Journal: J Med Ethics Date: 2011-03-23 Impact factor: 2.903
Authors: Matthew D Barber; Steven Kleeman; Mickey M Karram; Marie Fidela R Paraiso; Mark D Walters; Sandip Vasavada; Mark Ellerkmann Journal: Obstet Gynecol Date: 2008-03 Impact factor: 7.661
Authors: Henning Kelbaek; Christian J Terkelsen; Steffen Helqvist; Jens F Lassen; Peter Clemmensen; Lene Kløvgaard; Anne Kaltoft; Thomas Engstrøm; Hans E Bøtker; Kari Saunamäki; Lars R Krusell; Erik Jørgensen; Hans-Henrik T Hansen; Evald H Christiansen; Jan Ravkilde; Lars Køber; Klaus F Kofoed; Leif Thuesen Journal: J Am Coll Cardiol Date: 2008-03-04 Impact factor: 24.094