Literature DB >> 18087943

A practical solution to the pervasive problems of p values.

Eric-Jan Wagenmakers1.   

Abstract

In the field of psychology, the practice of p value null-hypothesis testing is as widespread as ever. Despite this popularity, or perhaps because of it, most psychologists are not aware of the statistical peculiarities of the p value procedure. In particular, p values are based on data that were never observed, and these hypothetical data are themselves influenced by subjective intentions. Moreover, p values do not quantify statistical evidence. This article reviews these p value problems and illustrates each problem with concrete examples. The three problems are familiar to statisticians but may be new to psychologists. A practical solution to these p value problems is to adopt a model selection perspective and use the Bayesian information criterion (BIC) for statistical inference (Raftery, 1995). The BIC provides an approximation to a Bayesian hypothesis test, does not require the specification of priors, and can be easily calculated from SPSS output.

Mesh:

Year:  2007        PMID: 18087943     DOI: 10.3758/bf03194105

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  30 in total

1.  The Importance of Complexity in Model Selection.

Authors: 
Journal:  J Math Psychol       Date:  2000-03       Impact factor: 2.223

2.  Bayesian Model Selection and Model Averaging.

Authors: 
Journal:  J Math Psychol       Date:  2000-03       Impact factor: 2.223

Review 3.  Toward a method of selecting among computational models of cognition.

Authors:  Mark A Pitt; In Jae Myung; Shaobo Zhang
Journal:  Psychol Rev       Date:  2002-07       Impact factor: 8.934

4.  The roles of the convex hull and the number of potential intersections in performance on visually presented traveling salesperson problems.

Authors:  Douglas Vickers; Michael D Lee; Matthew Dry; Peter Hughes
Journal:  Mem Cognit       Date:  2003-10

5.  Likelihood ratios: a simple and flexible statistic for empirical psychologists.

Authors:  Scott Glover; Peter Dixon
Journal:  Psychon Bull Rev       Date:  2004-10

6.  Inequality constrained analysis of variance: a Bayesian approach.

Authors:  Irene Klugkist; Olav Laudy; Herbert Hoijtink
Journal:  Psychol Methods       Date:  2005-12

7.  Replication and p Intervals: p Values Predict the Future Only Vaguely, but Confidence Intervals Do Much Better.

Authors:  Geoff Cumming
Journal:  Perspect Psychol Sci       Date:  2008-07

8.  p values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate.

Authors:  S N Goodman
Journal:  Am J Epidemiol       Date:  1993-03-01       Impact factor: 4.897

9.  Design and analysis of randomized clinical trials requiring prolonged observation of each patient. I. Introduction and design.

Authors:  R Peto; M C Pike; P Armitage; N E Breslow; D R Cox; S V Howard; N Mantel; K McPherson; J Peto; P G Smith
Journal:  Br J Cancer       Date:  1976-12       Impact factor: 7.640

10.  Interim analyses of data as they accumulate in laboratory experimentation.

Authors:  John Ludbrook
Journal:  BMC Med Res Methodol       Date:  2003-08-21       Impact factor: 4.615

View more
  466 in total

1.  Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don't know P.

Authors:  Michael J Lew
Journal:  Br J Pharmacol       Date:  2012-07       Impact factor: 8.739

2.  Too good to be true: publication bias in two prominent studies from experimental psychology.

Authors:  Gregory Francis
Journal:  Psychon Bull Rev       Date:  2012-04

3.  Effects of musicality and motivational orientation on auditory category learning: a test of a regulatory-fit hypothesis.

Authors:  J Devin McAuley; Molly J Henry; Alan Wedd; Timothy J Pleskac; Joseph Cesario
Journal:  Mem Cognit       Date:  2012-02

Review 4.  Minimum description length model selection of multinomial processing tree models.

Authors:  Hao Wu; Jay I Myung; William H Batchelder
Journal:  Psychon Bull Rev       Date:  2010-06

5.  Training a non-native vowel contrast with a distributional learning paradigm results in improved perception and production.

Authors:  Heather Kabakoff; Gretchen Go; Susannah V Levi
Journal:  J Phon       Date:  2019-12-13

6.  Resource depletion does not influence prospective memory in college students.

Authors:  Jill Talley Shelton; Michael J Cahill; Hillary G Mullet; Michael K Scullin; Gilles O Einstein; Mark A McDaniel
Journal:  Conscious Cogn       Date:  2013-09-08

7.  Value-based attentional capture affects multi-alternative decision making.

Authors:  Sebastian Gluth; Mikhail S Spektor; Jörg Rieskamp
Journal:  Elife       Date:  2018-11-05       Impact factor: 8.140

8.  A developmental-based motivational intervention to reduce alcohol and marijuana use among non-treatment-seeking young adults: a randomized controlled trial.

Authors:  Michael D Stein; Celeste M Caviness; Emily F Morse; Kristin R Grimone; Daniel Audet; Debra S Herman; Ethan Moitra; Bradley J Anderson
Journal:  Addiction       Date:  2017-10-16       Impact factor: 6.526

9.  Expectancy effects in feedback processing are explained primarily by time-frequency delta not theta.

Authors:  Adreanna T M Watts; Matthew D Bachman; Edward M Bernat
Journal:  Biol Psychol       Date:  2017-09-01       Impact factor: 3.251

10.  Likelihood-free Bayesian analysis of memory models.

Authors:  Brandon M Turner; Simon Dennis; Trisha Van Zandt
Journal:  Psychol Rev       Date:  2013-04-15       Impact factor: 8.934

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.