Literature DB >> 29961413

The Creativity-Verification Cycle in Psychological Science: New Methods to Combat Old Idols.

Eric-Jan Wagenmakers1, Gilles Dutilh2, Alexandra Sarafoglou1.   

Abstract

Over the years, researchers in psychological science have documented and investigated a host of powerful cognitive fallacies, including hindsight bias and confirmation bias. Researchers themselves may not be immune to these fallacies and may unwittingly adjust their statistical analysis to produce an outcome that is more pleasant or better in line with prior expectations. To shield researchers from the impact of cognitive fallacies, several methodologists are now advocating preregistration-that is, the creation of a detailed analysis plan before data collection or data analysis. One may argue, however, that preregistration is out of touch with academic reality, hampering creativity and impeding scientific progress. We provide a historical overview to show that the interplay between creativity and verification has shaped theories of scientific inquiry throughout the centuries; in the currently dominant theory, creativity and verification operate in succession and enhance one another's effectiveness. From this perspective, the use of preregistration to safeguard the verification stage will help rather than hinder the generation of fruitful new ideas.

Entities:  

Keywords:  empirical cycle; philosophy of science; preregistration

Mesh:

Year:  2018        PMID: 29961413      PMCID: PMC6041759          DOI: 10.1177/1745691618771357

Source DB:  PubMed          Journal:  Perspect Psychol Sci        ISSN: 1745-6916


  13 in total

1.  Hindsight not equal to foresight: the effect of outcome knowledge on judgment under uncertainty. 1975.

Authors:  B Fischhoff
Journal:  Qual Saf Health Care       Date:  2003-08

2.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles.

Authors:  An-Wen Chan; Asbjørn Hróbjartsson; Mette T Haahr; Peter C Gøtzsche; Douglas G Altman
Journal:  JAMA       Date:  2004-05-26       Impact factor: 56.272

3.  Blind analysis: Hide results to seek the truth.

Authors:  Robert MacCoun; Saul Perlmutter
Journal:  Nature       Date:  2015-10-08       Impact factor: 49.962

4.  An Agenda for Purely Confirmatory Research.

Authors:  Eric-Jan Wagenmakers; Ruud Wetzels; Denny Borsboom; Han L J van der Maas; Rogier A Kievit
Journal:  Perspect Psychol Sci       Date:  2012-11

5.  Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?

Authors:  Harold Pashler; Eric-Jan Wagenmakers
Journal:  Perspect Psychol Sci       Date:  2012-11

6.  The meaning of "significance" for different types of research [translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han L. J. van der Maas]. 1969.

Authors:  A D de Groot
Journal:  Acta Psychol (Amst)       Date:  2014-03-03

7.  SCIENTIFIC STANDARDS. Promoting an open research culture.

Authors:  B A Nosek; G Alter; G C Banks; D Borsboom; S D Bowman; S J Breckler; S Buck; C D Chambers; G Chin; G Christensen; M Contestabile; A Dafoe; E Eich; J Freese; R Glennerster; D Goroff; D P Green; B Hesse; M Humphreys; J Ishiyama; D Karlan; A Kraut; A Lupia; P Mabry; T A Madon; N Malhotra; E Mayo-Wilson; M McNutt; E Miguel; E Levy Paluck; U Simonsohn; C Soderberg; B A Spellman; J Turitto; G VandenBos; S Vazire; E J Wagenmakers; R Wilson; T Yarkoni
Journal:  Science       Date:  2015-06-26       Impact factor: 47.728

8.  The preregistration revolution.

Authors:  Brian A Nosek; Charles R Ebersole; Alexander C DeHaven; David T Mellor
Journal:  Proc Natl Acad Sci U S A       Date:  2018-03-13       Impact factor: 12.779

9.  A test of the diffusion model explanation for the worst performance rule using preregistration and blinding.

Authors:  Gilles Dutilh; Joachim Vandekerckhove; Alexander Ly; Dora Matzke; Andreas Pedroni; Renato Frey; Jörg Rieskamp; Eric-Jan Wagenmakers
Journal:  Atten Percept Psychophys       Date:  2017-04       Impact factor: 2.199

10.  Registered reports: a new publishing initiative at Cortex.

Authors:  Christopher D Chambers
Journal:  Cortex       Date:  2012-12-26       Impact factor: 4.027

View more
  4 in total

Review 1.  Addressing the theory crisis in psychology.

Authors:  Klaus Oberauer; Stephan Lewandowsky
Journal:  Psychon Bull Rev       Date:  2019-10

Review 2.  The past, present and future of Registered Reports.

Authors:  Christopher D Chambers; Loukia Tzavella
Journal:  Nat Hum Behav       Date:  2021-11-15

Review 3.  Mapping Phenomena Relevant to Adolescent Emotion Regulation: A Text-Mining Systematic Review.

Authors:  Caspar J van Lissa
Journal:  Adolesc Res Rev       Date:  2021-05-21

4.  Open science saves lives: lessons from the COVID-19 pandemic.

Authors:  Lonni Besançon; Nathan Peiffer-Smadja; Corentin Segalas; Haiting Jiang; Paola Masuzzo; Cooper Smout; Eric Billy; Maxime Deforet; Clémence Leyrat
Journal:  BMC Med Res Methodol       Date:  2021-06-05       Impact factor: 4.615

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.