Literature DB >> 26348332

Is psychology suffering from a replication crisis? What does "failure to replicate" really mean?

Scott E Maxwell1, Michael Y Lau2, George S Howard1.   

Abstract

Psychology has recently been viewed as facing a replication crisis because efforts to replicate past study findings frequently do not show the same result. Often, the first study showed a statistically significant result but the replication does not. Questions then arise about whether the first study results were false positives, and whether the replication study correctly indicates that there is truly no effect after all. This article suggests these so-called failures to replicate may not be failures at all, but rather are the result of low statistical power in single replication studies, and the result of failure to appreciate the need for multiple replications in order to have enough power to identify true effects. We provide examples of these power problems and suggest some solutions using Bayesian statistics and meta-analysis. Although the need for multiple replication studies may frustrate those who would prefer quick answers to psychology's alleged crisis, the large sample sizes typically needed to provide firm evidence will almost always require concerted efforts from multiple investigators. As a result, it remains to be seen how many of the recently claimed failures to replicate will be supported or instead may turn out to be artifacts of inadequate sample sizes and single study replications. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

Mesh:

Year:  2015        PMID: 26348332     DOI: 10.1037/a0039400

Source DB:  PubMed          Journal:  Am Psychol        ISSN: 0003-066X


  104 in total

1.  Unbiased and efficient log-likelihood estimation with inverse binomial sampling.

Authors:  Bas van Opheusden; Luigi Acerbi; Wei Ji Ma
Journal:  PLoS Comput Biol       Date:  2020-12-23       Impact factor: 4.475

2.  Increasing Literacy in Quantitative Methods: The Key to the Future of Canadian Psychology.

Authors:  Alyssa Counsell; Robert A Cribbie; Lisa L Harlow
Journal:  Can Psychol       Date:  2016-08

Review 3.  The Role of Pharmacogenomics in Bipolar Disorder: Moving Towards Precision Medicine.

Authors:  Claudia Pisanu; Urs Heilbronner; Alessio Squassina
Journal:  Mol Diagn Ther       Date:  2018-08       Impact factor: 4.074

4.  Results Blind Science Publishing.

Authors:  Joseph J Locascio
Journal:  Basic Appl Soc Psych       Date:  2017-11-08

5.  Directed forgetting in rats: Evidence for active memory control?

Authors:  Chiaki Tanaka; Hayato Yahagi; Tohru Taniuchi
Journal:  Learn Behav       Date:  2019-12       Impact factor: 1.986

6.  Contextual sensitivity in scientific reproducibility.

Authors:  Jay J Van Bavel; Peter Mende-Siedlecki; William J Brady; Diego A Reinero
Journal:  Proc Natl Acad Sci U S A       Date:  2016-05-23       Impact factor: 11.205

7.  A Guide to Conducting a Meta-Analysis.

Authors:  Mike W-L Cheung; Ranjith Vijayakumar
Journal:  Neuropsychol Rev       Date:  2016-05-21       Impact factor: 7.444

8.  Methods of Detecting Insufficient Effort Responding: Comparisons and Practical Recommendations.

Authors:  Maxwell Hong; Jeffrey T Steedle; Ying Cheng
Journal:  Educ Psychol Meas       Date:  2019-07-31       Impact factor: 2.821

9.  Heterogeneity in Association Between Cognitive Function and Gait Speed Among Older Adults: An Integrative Data Analysis Study.

Authors:  Elizabeth P Handing; Stephen R Rapp; Shyh-Huei Chen; W Jack Rejeski; Marie Wiberg; Karen Bandeen-Roche; Suzanne Craft; Dalane Kitzman; Edward H Ip
Journal:  J Gerontol A Biol Sci Med Sci       Date:  2021-03-31       Impact factor: 6.053

10.  Editorial: Advancing Research on Child and Adolescent Psychopathology.

Authors:  Paul J Frick
Journal:  J Abnorm Child Psychol       Date:  2018-01
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.