Literature DB >> 34811490

Psychologists update their beliefs about effect sizes after replication studies.

Alex D McDiarmid1, Alexa M Tullett2, Cassie M Whitt3, Simine Vazire4, Paul E Smaldino5, Jeremy E Stephens3.   

Abstract

Self-correction-a key feature distinguishing science from pseudoscience-requires that scientists update their beliefs in light of new evidence. However, people are often reluctant to change their beliefs. We examined belief updating in action by tracking research psychologists' beliefs in psychological effects before and after the completion of four large-scale replication projects. We found that psychologists did update their beliefs; they updated as much as they predicted they would, but not as much as our Bayesian model suggests they should if they trust the results. We found no evidence that psychologists became more critical of replications when it would have preserved their pre-existing beliefs. We also found no evidence that personal investment or lack of expertise discouraged belief updating, but people higher on intellectual humility updated their beliefs slightly more. Overall, our results suggest that replication studies can contribute to self-correction within psychology, but psychologists may underweight their evidentiary value.
© 2021. The Author(s), under exclusive licence to Springer Nature Limited.

Entities:  

Mesh:

Year:  2021        PMID: 34811490     DOI: 10.1038/s41562-021-01220-7

Source DB:  PubMed          Journal:  Nat Hum Behav        ISSN: 2397-3374


  15 in total

Review 1.  The case for motivated reasoning.

Authors:  Z Kunda
Journal:  Psychol Bull       Date:  1990-11       Impact factor: 17.737

2.  Why Science Is Not Necessarily Self-Correcting.

Authors:  John P A Ioannidis
Journal:  Perspect Psychol Sci       Date:  2012-11

3.  Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015.

Authors:  Colin F Camerer; Anna Dreber; Felix Holzmeister; Teck-Hua Ho; Jürgen Huber; Magnus Johannesson; Michael Kirchler; Gideon Nave; Brian A Nosek; Thomas Pfeiffer; Adam Altmejd; Nick Buttrick; Taizan Chan; Yiling Chen; Eskil Forsell; Anup Gampa; Emma Heikensten; Lily Hummer; Taisuke Imai; Siri Isaksson; Dylan Manfredi; Julia Rose; Eric-Jan Wagenmakers; Hang Wu
Journal:  Nat Hum Behav       Date:  2018-08-27

Review 4.  How to never be wrong.

Authors:  Samuel J Gershman
Journal:  Psychon Bull Rev       Date:  2019-02

5.  Contextual sensitivity in scientific reproducibility.

Authors:  Jay J Van Bavel; Peter Mende-Siedlecki; William J Brady; Diego A Reinero
Journal:  Proc Natl Acad Sci U S A       Date:  2016-05-23       Impact factor: 11.205

6.  Evaluating replicability of laboratory experiments in economics.

Authors:  Colin F Camerer; Anna Dreber; Eskil Forsell; Teck-Hua Ho; Jürgen Huber; Magnus Johannesson; Michael Kirchler; Johan Almenberg; Adam Altmejd; Taizan Chan; Emma Heikensten; Felix Holzmeister; Taisuke Imai; Siri Isaksson; Gideon Nave; Thomas Pfeiffer; Michael Razen; Hang Wu
Journal:  Science       Date:  2016-03-03       Impact factor: 47.728

7.  Feeling validated versus being correct: a meta-analysis of selective exposure to information.

Authors:  William Hart; Dolores Albarracín; Alice H Eagly; Inge Brechan; Matthew J Lindberg; Lisa Merrill
Journal:  Psychol Bull       Date:  2009-07       Impact factor: 17.737

8.  Publication bias and the canonization of false facts.

Authors:  Silas Boye Nissen; Tali Magidson; Kevin Gross; Carl T Bergstrom
Journal:  Elife       Date:  2016-12-20       Impact factor: 8.140

9.  Meta-analyses are no substitute for registered replications: a skeptical perspective on religious priming.

Authors:  Michiel van Elk; Dora Matzke; Quentin F Gronau; Maime Guan; Joachim Vandekerckhove; Eric-Jan Wagenmakers
Journal:  Front Psychol       Date:  2015-09-15

10.  Replication, Communication, and the Population Dynamics of Scientific Discovery.

Authors:  Richard McElreath; Paul E Smaldino
Journal:  PLoS One       Date:  2015-08-26       Impact factor: 3.240

View more
  1 in total

Review 1.  Predictors and consequences of intellectual humility.

Authors:  Tenelle Porter; Abdo Elnakouri; Ethan A Meyers; Takuya Shibayama; Eranda Jayawickreme; Igor Grossmann
Journal:  Nat Rev Psychol       Date:  2022-06-27
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.