Literature DB >> 29531091

The preregistration revolution.

Brian A Nosek1,2, Charles R Ebersole2, Alexander C DeHaven3, David T Mellor3.   

Abstract

Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction is appreciated conceptually but is not respected in practice. Mistaking generation of postdictions with testing of predictions reduces the credibility of research findings. However, ordinary biases in human reasoning, such as hindsight bias, make it hard to avoid this mistake. An effective solution is to define the research questions and analysis plan before observing the research outcomes-a process called preregistration. Preregistration distinguishes analyses and outcomes that result from predictions from those that result from postdictions. A variety of practical strategies are available to make the best possible use of preregistration in circumstances that fall short of the ideal application, such as when the data are preexisting. Services are now available for preregistration across all disciplines, facilitating a rapid increase in the practice. Widespread adoption of preregistration will increase distinctiveness between hypothesis generation and hypothesis testing and will improve the credibility of research findings.

Entities:  

Keywords:  confirmatory analysis; exploratory analysis; methodology; open science; preregistration

Mesh:

Year:  2018        PMID: 29531091      PMCID: PMC5856500          DOI: 10.1073/pnas.1708274114

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   12.779


  30 in total

1.  Understanding and using the implicit association test: I. An improved scoring algorithm.

Authors:  Anthony G Greenwald; Brian A Nosek; Mahzarin R Banaji
Journal:  J Pers Soc Psychol       Date:  2003-08

Review 2.  Simultaneous and selective inference: Current successes and future challenges.

Authors:  Yoav Benjamini
Journal:  Biom J       Date:  2010-11-19       Impact factor: 2.207

3.  Normative dissonance in science: results from a national survey of u.s. Scientists.

Authors:  Melissa S Anderson; Brian C Martinson; Raymond De Vries
Journal:  J Empir Res Hum Res Ethics       Date:  2007-12       Impact factor: 1.742

4.  The Rules of the Game Called Psychological Science.

Authors:  Marjan Bakker; Annette van Dijk; Jelte M Wicherts
Journal:  Perspect Psychol Sci       Date:  2012-11

5.  Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science.

Authors:  Roger Giner-Sorolla
Journal:  Perspect Psychol Sci       Date:  2012-11

6.  Detecting and avoiding likely false-positive findings - a practical guide.

Authors:  Wolfgang Forstmeier; Eric-Jan Wagenmakers; Timothy H Parker
Journal:  Biol Rev Camb Philos Soc       Date:  2016-11-23

7.  Improving transparency and reproducibility through registration: The status of intervention trials published in clinical psychology journals.

Authors:  Lukasz Cybulski; Evan Mayo-Wilson; Sean Grant
Journal:  J Consult Clin Psychol       Date:  2016-09

8.  Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency.

Authors:  Mallory C Kidwell; Ljiljana B Lazarević; Erica Baranski; Tom E Hardwicke; Sarah Piechowski; Lina-Sophia Falkenberg; Curtis Kennett; Agnieszka Slowik; Carina Sonnleitner; Chelsey Hess-Holden; Timothy M Errington; Susann Fiedler; Brian A Nosek
Journal:  PLoS Biol       Date:  2016-05-12       Impact factor: 8.029

9.  A test of the diffusion model explanation for the worst performance rule using preregistration and blinding.

Authors:  Gilles Dutilh; Joachim Vandekerckhove; Alexander Ly; Dora Matzke; Andreas Pedroni; Renato Frey; Jörg Rieskamp; Eric-Jan Wagenmakers
Journal:  Atten Percept Psychophys       Date:  2017-04       Impact factor: 2.199

10.  Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time.

Authors:  Robert M Kaplan; Veronica L Irvin
Journal:  PLoS One       Date:  2015-08-05       Impact factor: 3.240

View more
  169 in total

1.  The New Statistics for Better Science: Ask How Much, How Uncertain, and What Else is Known.

Authors:  Robert J Calin-Jageman; Geoff Cumming
Journal:  Am Stat       Date:  2019-03-20       Impact factor: 8.710

2.  A survey on the attitudes of parents with young children on in-home monitoring technologies and study designs for infant research.

Authors:  Laurel A Fish; Emily J H Jones
Journal:  PLoS One       Date:  2021-02-05       Impact factor: 3.240

3.  The registration continuum in clinical science: A guide toward transparent practices.

Authors:  Stephen D Benning; Rachel L Bachrach; Edward A Smith; Andrew J Freeman; Aidan G C Wright
Journal:  J Abnorm Psychol       Date:  2019-08

4.  Competition for priority harms the reliability of science, but reforms can help.

Authors:  Leonid Tiokhin; Minhua Yan; Thomas J H Morgan
Journal:  Nat Hum Behav       Date:  2021-01-28

5.  The preregistration revolution needs to distinguish between predictions and analyses.

Authors:  Alison Ledgerwood
Journal:  Proc Natl Acad Sci U S A       Date:  2018-10-19       Impact factor: 11.205

6.  Reply to Ledgerwood: Predictions without analysis plans are inert.

Authors:  Brian A Nosek; Charles R Ebersole; Alexander C DeHaven; David T Mellor
Journal:  Proc Natl Acad Sci U S A       Date:  2018-10-19       Impact factor: 11.205

7.  The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research.

Authors:  Nathalie Percie du Sert; Viki Hurst; Amrita Ahluwalia; Sabina Alam; Marc T Avey; Monya Baker; William J Browne; Alejandra Clark; Innes C Cuthill; Ulrich Dirnagl; Michael Emerson; Paul Garner; Stephen T Holgate; David W Howells; Natasha A Karp; Stanley E Lazic; Katie Lidster; Catriona J MacCallum; Malcolm Macleod; Esther J Pearl; Ole H Petersen; Frances Rawle; Penny Reynolds; Kieron Rooney; Emily S Sena; Shai D Silberberg; Thomas Steckler; Hanno Würbel
Journal:  Exp Physiol       Date:  2020-07-14       Impact factor: 2.969

8.  The ARRIVE guidelines 2.0: updated guidelines for reporting animal research.

Authors:  Nathalie Percie du Sert; Viki Hurst; Amrita Ahluwalia; Sabina Alam; Marc T Avey; Monya Baker; William J Browne; Alejandra Clark; Innes C Cuthill; Ulrich Dirnagl; Michael Emerson; Paul Garner; Stephen T Holgate; David W Howells; Natasha A Karp; Stanley E Lazic; Katie Lidster; Catriona J MacCallum; Malcolm Macleod; Esther J Pearl; Ole H Petersen; Frances Rawle; Penny Reynolds; Kieron Rooney; Emily S Sena; Shai D Silberberg; Thomas Steckler; Hanno Würbel
Journal:  J Physiol       Date:  2020-07-14       Impact factor: 5.182

Review 9.  Integrating explanation and prediction in computational social science.

Authors:  Jake M Hofman; Duncan J Watts; Susan Athey; Filiz Garip; Thomas L Griffiths; Jon Kleinberg; Helen Margetts; Sendhil Mullainathan; Matthew J Salganik; Simine Vazire; Alessandro Vespignani; Tal Yarkoni
Journal:  Nature       Date:  2021-06-30       Impact factor: 49.962

10.  Automatic Imitation in Comorbid PTSD & Alcohol Use Disorder and Controls: an RCT of Intranasal Oxytocin.

Authors:  Tyler E Morrison; Lize De Coster; Christopher S Stauffer; Jin Wen; Elnaz Ahmadi; Kevin Delucchi; Aoife O'Donovan; Josh Woolley
Journal:  Psychoneuroendocrinology       Date:  2020-07-04       Impact factor: 4.905

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.