Literature DB >> 25040652

Significance chasing in research practice: causes, consequences and possible solutions.

Jennifer J Ware1, Marcus R Munafò.   

Abstract

BACKGROUND AND AIMS: The low reproducibility of findings within the scientific literature is a growing concern. This may be due to many findings being false positives which, in turn, can misdirect research effort and waste money.
METHODS: We review factors that may contribute to poor study reproducibility and an excess of 'significant' findings within the published literature. Specifically, we consider the influence of current incentive structures and the impact of these on research practices.
RESULTS: The prevalence of false positives within the literature may be attributable to a number of questionable research practices, ranging from the relatively innocent and minor (e.g. unplanned post-hoc tests) to the calculated and serious (e.g. fabrication of data). These practices may be driven by current incentive structures (e.g. pressure to publish), alongside the preferential emphasis placed by journals on novelty over veracity. There are a number of potential solutions to poor reproducibility, such as new publishing formats that emphasize the research question and study design, rather than the results obtained. This has the potential to minimize significance chasing and non-publication of null findings.
CONCLUSIONS: Significance chasing, questionable research practices and poor study reproducibility are the unfortunate consequence of a 'publish or perish' culture and a preference among journals for novel findings. It is likely that top-down change implemented by those with the ability to modify current incentive structure (e.g. funders and journals) will be required to address problems of poor reproducibility.
© 2014 Society for the Study of Addiction.

Entities:  

Keywords:  False positive; fraud; pre-registration; publication bias; reproducibility; significance chasing

Mesh:

Year:  2014        PMID: 25040652      PMCID: PMC4962906          DOI: 10.1111/add.12673

Source DB:  PubMed          Journal:  Addiction        ISSN: 0965-2140            Impact factor:   6.526


  32 in total

1.  Measuring the prevalence of questionable research practices with incentives for truth telling.

Authors:  Leslie K John; George Loewenstein; Drazen Prelec
Journal:  Psychol Sci       Date:  2012-04-16

2.  Persistence of contradicted claims in the literature.

Authors:  Athina Tatsioni; Nikolaos G Bonitsis; John P A Ioannidis
Journal:  JAMA       Date:  2007-12-05       Impact factor: 56.272

3.  US studies may overestimate effect sizes in softer research.

Authors:  Daniele Fanelli; John P A Ioannidis
Journal:  Proc Natl Acad Sci U S A       Date:  2013-08-26       Impact factor: 11.205

4.  Bias in genetic association studies: effects of research location and resources.

Authors:  Marcus R Munafò; Angela S Attwood; Jonathan Flint
Journal:  Psychol Med       Date:  2008-08       Impact factor: 7.723

5.  Retracted science and the retraction index.

Authors:  Ferric C Fang; Arturo Casadevall
Journal:  Infect Immun       Date:  2011-08-08       Impact factor: 3.441

6.  Why Science Is Not Necessarily Self-Correcting.

Authors:  John P A Ioannidis
Journal:  Perspect Psychol Sci       Date:  2012-11

7.  Retraction record rocks community.

Authors:  David Cyranoski
Journal:  Nature       Date:  2012-09-20       Impact factor: 49.962

8.  "Positive" results increase down the Hierarchy of the Sciences.

Authors:  Daniele Fanelli
Journal:  PLoS One       Date:  2010-04-07       Impact factor: 3.240

9.  Deep impact: unintended consequences of journal rank.

Authors:  Björn Brembs; Katherine Button; Marcus Munafò
Journal:  Front Hum Neurosci       Date:  2013-06-24       Impact factor: 3.169

10.  Local literature bias in genetic epidemiology: an empirical evaluation of the Chinese literature.

Authors:  Zhenglun Pan; Thomas A Trikalinos; Fotini K Kavvoura; Joseph Lau; John P A Ioannidis
Journal:  PLoS Med       Date:  2005-11-22       Impact factor: 11.069

View more
  9 in total

1.  Subgroup analysis as a source of spurious findings: an illustration using new data on alcohol intake and coronary heart disease.

Authors:  Steven Bell; Mika Kivimäki; G David Batty
Journal:  Addiction       Date:  2015-01       Impact factor: 6.526

2.  Prevalence of Decreased Sound Tolerance (Hyperacusis) in Individuals With Autism Spectrum Disorder: A Meta-Analysis.

Authors:  Zachary J Williams; Evan Suzman; Tiffany G Woynaroski
Journal:  Ear Hear       Date:  2021 Sep/Oct       Impact factor: 3.562

3.  Using the concept of "deserved trust" to strengthen the value and integrity of biomedical research.

Authors:  Mark Yarborough
Journal:  Account Res       Date:  2020-12-26       Impact factor: 3.057

Review 4.  ENIGMA and the individual: Predicting factors that affect the brain in 35 countries worldwide.

Authors:  Paul M Thompson; Ole A Andreassen; Alejandro Arias-Vasquez; Carrie E Bearden; Premika S Boedhoe; Rachel M Brouwer; Randy L Buckner; Jan K Buitelaar; Kazima B Bulayeva; Dara M Cannon; Ronald A Cohen; Patricia J Conrod; Anders M Dale; Ian J Deary; Emily L Dennis; Marcel A de Reus; Sylvane Desrivieres; Danai Dima; Gary Donohoe; Simon E Fisher; Jean-Paul Fouche; Clyde Francks; Sophia Frangou; Barbara Franke; Habib Ganjgahi; Hugh Garavan; David C Glahn; Hans J Grabe; Tulio Guadalupe; Boris A Gutman; Ryota Hashimoto; Derrek P Hibar; Dominic Holland; Martine Hoogman; Hilleke E Hulshoff Pol; Norbert Hosten; Neda Jahanshad; Sinead Kelly; Peter Kochunov; William S Kremen; Phil H Lee; Scott Mackey; Nicholas G Martin; Bernard Mazoyer; Colm McDonald; Sarah E Medland; Rajendra A Morey; Thomas E Nichols; Tomas Paus; Zdenka Pausova; Lianne Schmaal; Gunter Schumann; Li Shen; Sanjay M Sisodiya; Dirk J A Smit; Jordan W Smoller; Dan J Stein; Jason L Stein; Roberto Toro; Jessica A Turner; Martijn P van den Heuvel; Odile L van den Heuvel; Theo G M van Erp; Daan van Rooij; Dick J Veltman; Henrik Walter; Yalin Wang; Joanna M Wardlaw; Christopher D Whelan; Margaret J Wright; Jieping Ye
Journal:  Neuroimage       Date:  2015-12-04       Impact factor: 6.556

5.  Coping with the Conflict-of-Interest Pandemic by Listening to and Doubting Everyone, Including Yourself.

Authors:  Lynn T Kozlowski
Journal:  Sci Eng Ethics       Date:  2015-05-30       Impact factor: 3.525

6.  Researchers' Individual Publication Rate Has Not Increased in a Century.

Authors:  Daniele Fanelli; Vincent Larivière
Journal:  PLoS One       Date:  2016-03-09       Impact factor: 3.240

7.  Failed attempts to improve the reliability of the alcohol visual probe task following empirical recommendations.

Authors:  Andrew Jones; Paul Christiansen; Matt Field
Journal:  Psychol Addict Behav       Date:  2018-11-26

8.  Four erroneous beliefs thwarting more trustworthy research.

Authors:  Mark Yarborough; Robert Nadon; David G Karlin
Journal:  Elife       Date:  2019-07-29       Impact factor: 8.140

9.  Menagerie: A text-mining tool to support animal-human translation in neurodegeneration research.

Authors:  Caroline J Zeiss; Dongwook Shin; Brent Vander Wyk; Amanda P Beck; Natalie Zatz; Charles A Sneiderman; Halil Kilicoglu
Journal:  PLoS One       Date:  2019-12-17       Impact factor: 3.240

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.