Literature DB >> 30264238

Redefine or justify? Comments on the alpha debate.

Jan de Ruiter1.   

Abstract

Benjamin et al. (Nature Human Behaviour 2, 6-10, 2017) proposed improving the reproducibility of findings in psychological research by lowering the alpha level of our conventional null hypothesis significance tests from .05 to .005, because findings with p-values close to .05 represent insufficient empirical evidence. They argued that findings with a p-value between 0.005 and 0.05 should still be published, but not called "significant" anymore. This proposal was criticized and rejected in a response by Lakens et al. (Nature Human Behavior 2, 168-171, 2018), who argued that instead of lowering the traditional alpha threshold to .005, we should stop using the term "statistically significant," and require researchers to determine and justify their alpha levels before they collect data. In this contribution, I argue that the arguments presented by Lakens et al. against the proposal by Benjamin et al. are not convincing. Thus, given that it is highly unlikely that our field will abandon the NHST paradigm any time soon, lowering our alpha level to .005 is at this moment the best way to combat the replication crisis in psychology.

Entities:  

Keywords:  Alpha; Evidence; Reproducibility; Significance

Mesh:

Year:  2019        PMID: 30264238     DOI: 10.3758/s13423-018-1523-9

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  5 in total

1.  The Rules of the Game Called Psychological Science.

Authors:  Marjan Bakker; Annette van Dijk; Jelte M Wicherts
Journal:  Perspect Psychol Sci       Date:  2012-11

2.  On the Reproducibility of Psychological Science.

Authors:  Valen E Johnson; Richard D Payne; Tianying Wang; Alex Asher; Soutrik Mandal
Journal:  J Am Stat Assoc       Date:  2016-10-07       Impact factor: 5.033

3.  MAKING REPLICATION MAINSTREAM.

Authors:  Rolf A Zwaan; Alexander Etz; Richard E Lucas; M Brent Donnellan
Journal:  Behav Brain Sci       Date:  2017-10-25       Impact factor: 12.579

4.  A Bayesian Perspective on the Reproducibility Project: Psychology.

Authors:  Alexander Etz; Joachim Vandekerckhove
Journal:  PLoS One       Date:  2016-02-26       Impact factor: 3.240

5.  PSYCHOLOGY. Estimating the reproducibility of psychological science.

Authors: 
Journal:  Science       Date:  2015-08-28       Impact factor: 47.728

  5 in total
  1 in total

1.  Apophenia and anesthesia: how we sometimes change our practice prematurely.

Authors:  Neil A Hanson; Matthew B Lavallee; Robert H Thiele
Journal:  Can J Anaesth       Date:  2021-05-07       Impact factor: 6.713

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.