Literature DB >> 19160345

Publication bias in clinical trials due to statistical significance or direction of trial results.

Sally Hopewell1, Kirsty Loudon, Mike J Clarke, Andrew D Oxman, Kay Dickersin.   

Abstract

BACKGROUND: The tendency for authors to submit, and of journals to accept, manuscripts for publication based on the direction or strength of the study findings has been termed publication bias.
OBJECTIVES: To assess the extent to which publication of a cohort of clinical trials is influenced by the statistical significance, perceived importance, or direction of their results. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library [Online] Issue 2, 2007), MEDLINE (1950 to March Week 2 2007), EMBASE (1980 to Week 11 2007) and Ovid MEDLINE In-Process & Other Non-Indexed Citations (March 21 2007). We also searched the Science Citation Index (April 2007), checked reference lists of relevant articles and contacted researchers to identify additional studies. SELECTION CRITERIA: Studies containing analyses of the association between publication and the statistical significance or direction of the results (trial findings), for a cohort of registered clinical trials. DATA COLLECTION AND ANALYSIS: Two authors independently extracted data. We classified findings as either positive (defined as results classified by the investigators as statistically significant (P < 0.05), or perceived as striking or important, or showing a positive direction of effect) or negative (findings that were not statistically significant (P >/= 0.05), or perceived as unimportant, or showing a negative or null direction in effect). We extracted information on other potential risk factors for failure to publish, when these data were available. MAIN
RESULTS: Five studies were included. Trials with positive findings were more likely to be published than trials with negative or null findings (odds ratio 3.90; 95% confidence interval 2.68 to 5.68). This corresponds to a risk ratio of 1.78 (95% CI 1.58 to 1.95), assuming that 41% of negative trials are published (the median among the included studies, range = 11% to 85%). In absolute terms, this means that if 41% of negative trials are published, we would expect that 73% of positive trials would be published.Two studies assessed time to publication and showed that trials with positive findings tended to be published after four to five years compared to those with negative findings, which were published after six to eight years. Three studies found no statistically significant association between sample size and publication. One study found no significant association between either funding mechanism, investigator rank, or sex and publication. AUTHORS'
CONCLUSIONS: Trials with positive findings are published more often, and more quickly, than trials with negative findings.

Mesh:

Year:  2009        PMID: 19160345      PMCID: PMC8276556          DOI: 10.1002/14651858.MR000006.pub3

Source DB:  PubMed          Journal:  Cochrane Database Syst Rev        ISSN: 1361-6137


  41 in total

Review 1.  Publication and related biases.

Authors:  F Song; A J Eastwood; S Gilbody; L Duley; A J Sutton
Journal:  Health Technol Assess       Date:  2000       Impact factor: 4.014

2.  Direction and impact of language bias in meta-analyses of controlled trials: empirical study.

Authors:  Peter Jüni; Franziska Holenstein; Jonathan Sterne; Christopher Bartlett; Matthias Egger
Journal:  Int J Epidemiol       Date:  2002-02       Impact factor: 7.196

3.  Association between time interval to publication and statistical significance.

Authors:  Kay Dickersin; Carin M Olson; Drummond Rennie; Deborah Cook; Annette Flanagin; Qi Zhu; Jennifer Reiling; Brian Pace
Journal:  JAMA       Date:  2002-06-05       Impact factor: 56.272

Review 4.  Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications.

Authors:  Hans Melander; Jane Ahlqvist-Rastad; Gertie Meijer; Björn Beermann
Journal:  BMJ       Date:  2003-05-31

5.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles.

Authors:  An-Wen Chan; Asbjørn Hróbjartsson; Mette T Haahr; Peter C Gøtzsche; Douglas G Altman
Journal:  JAMA       Date:  2004-05-26       Impact factor: 56.272

6.  Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research.

Authors:  An-Wen Chan; Karmela Krleza-Jerić; Isabelle Schmid; Douglas G Altman
Journal:  CMAJ       Date:  2004-09-28       Impact factor: 8.262

7.  Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors.

Authors:  Catherine D De Angelis; Jeffrey M Drazen; Frank A Frizelle; Charlotte Haug; John Hoey; Richard Horton; Sheldon Kotzin; Christine Laine; Ana Marusic; A John P M Overbeke; Torben V Schroeder; Harold C Sox; Martin B Van Der Weyden
Journal:  Lancet       Date:  2005 May 28-Jun 3       Impact factor: 79.321

Review 8.  How important is publication bias? A synthesis of available data.

Authors:  K Dickersin
Journal:  AIDS Educ Prev       Date:  1997-02

9.  Publication bias and clinical trials.

Authors:  K Dickersin; S Chan; T C Chalmers; H S Sacks; H Smith
Journal:  Control Clin Trials       Date:  1987-12

Review 10.  Time to publication for results of clinical trials.

Authors:  S Hopewell; M Clarke; L Stewart; J Tierney
Journal:  Cochrane Database Syst Rev       Date:  2007-04-18
View more
  236 in total

Review 1.  Statins for multiple sclerosis.

Authors:  Jin Wang; Yousheng Xiao; Man Luo; Hongye Luo
Journal:  Cochrane Database Syst Rev       Date:  2011-12-07

Review 2.  Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes.

Authors:  Gerd Flodgren; Marie-Pascale Pomey; Sarah A Taber; Martin P Eccles
Journal:  Cochrane Database Syst Rev       Date:  2011-11-09

3.  Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: from Francis Bacon to the WHO.

Authors:  Kay Dickersin; Iain Chalmers
Journal:  J R Soc Med       Date:  2011-12       Impact factor: 5.344

Review 4.  Steps in the undertaking of a systematic review in orthopaedic surgery.

Authors:  Dario Sambunjak; Miljenko Franić
Journal:  Int Orthop       Date:  2011-12-24       Impact factor: 3.075

Review 5.  The contribution of systematic reviews to the practice of pediatric nephrology.

Authors:  Elisabeth Hodson; Jonathan C Craig
Journal:  Pediatr Nephrol       Date:  2012-04-04       Impact factor: 3.714

6.  What comparative effectiveness research is needed? A framework for using guidelines and systematic reviews to identify evidence gaps and research priorities.

Authors:  Tianjing Li; S Swaroop Vedula; Roberta Scherer; Kay Dickersin
Journal:  Ann Intern Med       Date:  2012-03-06       Impact factor: 25.391

7.  [Trial registration for the improvement of transparency in scientific research. The German Association of Urology now enables registration in the register network of the WHO].

Authors:  F Kunath; C Becker; S Jena; J J Meerpohl; G Antes; B Wullich
Journal:  Urologe A       Date:  2012-09       Impact factor: 0.639

8.  Are results from pharmaceutical-company-sponsored studies available to the public?

Authors:  Rafael Dal-Ré; Alejandro Pedromingo; Manuel García-Losa; Juan Lahuerta; Rafael Ortega
Journal:  Eur J Clin Pharmacol       Date:  2010-09-16       Impact factor: 2.953

Review 9.  Survival of hard-on-hard bearings in total hip arthroplasty: a systematic review.

Authors:  Michael G Zywiel; Siraj A Sayeed; Aaron J Johnson; Thomas P Schmalzried; Michael A Mont
Journal:  Clin Orthop Relat Res       Date:  2011-06       Impact factor: 4.176

Review 10.  Local opinion leaders: effects on professional practice and health care outcomes.

Authors:  Gerd Flodgren; Elena Parmelli; Gaby Doumit; Melina Gattellari; Mary Ann O'Brien; Jeremy Grimshaw; Martin P Eccles
Journal:  Cochrane Database Syst Rev       Date:  2011-08-10
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.