Literature DB >> 31113309

The reign of the p-value is over: what alternative analyses could we employ to fill the power vacuum?

Lewis G Halsey1.   

Abstract

The p-value has long been the figurehead of statistical analysis in biology, but its position is under threat. p is now widely recognized as providing quite limited information about our data, and as being easily misinterpreted. Many biologists are aware of p's frailties, but less clear about how they might change the way they analyse their data in response. This article highlights and summarizes four broad statistical approaches that augment or replace the p-value, and that are relatively straightforward to apply. First, you can augment your p-value with information about how confident you are in it, how likely it is that you will get a similar p-value in a replicate study, or the probability that a statistically significant finding is in fact a false positive. Second, you can enhance the information provided by frequentist statistics with a focus on effect sizes and a quantified confidence that those effect sizes are accurate. Third, you can augment or substitute p-values with the Bayes factor to inform on the relative levels of evidence for the null and alternative hypotheses; this approach is particularly appropriate for studies where you wish to keep collecting data until clear evidence for or against your hypothesis has accrued. Finally, specifically where you are using multiple variables to predict an outcome through model building, Akaike information criteria can take the place of the p-value, providing quantified information on what model is best. Hopefully, this quick-and-easy guide to some simple yet powerful statistical options will support biologists in adopting new approaches where they feel that the p-value alone is not doing their data justice.

Entities:  

Keywords:  AIC; Bayesian; confidence intervals; effect size; statistical analysis

Mesh:

Year:  2019        PMID: 31113309      PMCID: PMC6548726          DOI: 10.1098/rsbl.2019.0174

Source DB:  PubMed          Journal:  Biol Lett        ISSN: 1744-9561            Impact factor:   3.703


  33 in total

1.  Of P-values and Bayes: a modest proposal.

Authors:  S N Goodman
Journal:  Epidemiology       Date:  2001-05       Impact factor: 4.822

2.  Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences.

Authors:  Felix D Schönbrodt; Eric-Jan Wagenmakers; Michael Zehetleitner; Marco Perugini
Journal:  Psychol Methods       Date:  2015-12-14

3.  Stepwise model fitting and statistical inference: turning noise into signal pollution.

Authors:  Roger Mundry; Charles L Nunn
Journal:  Am Nat       Date:  2009-01       Impact factor: 3.926

4.  Show the data, don't conceal them.

Authors:  G B Drummond; S L Vowler
Journal:  J Physiol       Date:  2011-04-15       Impact factor: 5.182

5.  Scientists rise up against statistical significance.

Authors:  Valentin Amrhein; Sander Greenland; Blake McShane
Journal:  Nature       Date:  2019-03       Impact factor: 49.962

6.  Recurring controversies about P values and confidence intervals revisited.

Authors:  Aris Spanos
Journal:  Ecology       Date:  2014-03       Impact factor: 5.499

7.  Rejoinder.

Authors:  Paul A Murtaugh
Journal:  Ecology       Date:  2014-03       Impact factor: 5.499

8.  Comment on Murtaugh.

Authors:  Michael Lavine
Journal:  Ecology       Date:  2014-03       Impact factor: 5.499

Review 9.  Considering aspects of the 3Rs principles within experimental animal biology.

Authors:  Lynne U Sneddon; Lewis G Halsey; Nic R Bury
Journal:  J Exp Biol       Date:  2017-09-01       Impact factor: 3.312

Review 10.  An investigation of the false discovery rate and the misinterpretation of p-values.

Authors:  David Colquhoun
Journal:  R Soc Open Sci       Date:  2014-11-19       Impact factor: 2.963

View more
  36 in total

Review 1.  Big-Data Science in Porous Materials: Materials Genomics and Machine Learning.

Authors:  Kevin Maik Jablonka; Daniele Ongari; Seyed Mohamad Moosavi; Berend Smit
Journal:  Chem Rev       Date:  2020-06-10       Impact factor: 60.622

2.  CORR Insights®: What Are the Implications of Alternative Alpha Thresholds for Hypothesis Testing in Orthopaedics?

Authors:  Daniel P O'Connor
Journal:  Clin Orthop Relat Res       Date:  2019-10       Impact factor: 4.176

3.  Sensory pollutants alter bird phenology and fitness across a continent.

Authors:  Masayuki Senzaki; Clinton D Francis; Jesse R Barber; Jennifer N Phillips; Neil H Carter; Caren B Cooper; Mark A Ditmer; Kurt M Fristrup; Christopher J W McClure; Daniel J Mennitt; Luke P Tyrrell; Jelena Vukomanovic; Ashley A Wilson
Journal:  Nature       Date:  2020-11-11       Impact factor: 49.962

4.  Validity of transcranial Doppler ultrasonography-determined dynamic cerebral autoregulation estimated using transfer function analysis.

Authors:  Hironori Watanabe; Takuro Washio; Shotaro Saito; Ai Hirasawa; Rina Suzuki; Shigeki Shibata; R Matthew Brothers; Shigehiko Ogoh
Journal:  J Clin Monit Comput       Date:  2022-01-24       Impact factor: 2.502

Review 5.  Interpreting Results from Statistical Hypothesis Testing: Understanding the Appropriate P-value.

Authors:  Eiki Tsushima
Journal:  Phys Ther Res       Date:  2022-05-13

Review 6.  Introducing a depression-like syndrome for translational neuropsychiatry: a plea for taxonomical validity and improved comparability between humans and mice.

Authors:  Mathias V Schmidt; Jan M Deussing; Iven-Alex von Mücke-Heim; Lidia Urbina-Treviño; Joeri Bordes; Clemens Ries
Journal:  Mol Psychiatry       Date:  2022-09-14       Impact factor: 13.437

7.  Novel Methodological Tools for Behavioral Interventions: The Case of HRV-Biofeedback. Sham Control and Quantitative Physiology-Based Assessment of Training Quality and Fidelity.

Authors:  Ewa Ratajczak; Marcin Hajnowski; Mateusz Stawicki; Włodzisław Duch
Journal:  Sensors (Basel)       Date:  2021-05-25       Impact factor: 3.576

8.  How Robust are the Evidences that Formulate Surviving Sepsis Guidelines? An Analysis of Fragility and Reverse Fragility of Randomized Controlled Trials that were Referred in these Guidelines.

Authors:  Nang S Choupoo; Saurabh K Das; Priyam Saikia; Samarjit Dey; Sumit Ray
Journal:  Indian J Crit Care Med       Date:  2021-07

9.  Seasonal variation in the diel activity of a dung beetle assemblage.

Authors:  Jorge M Lobo; Eva Cuesta
Journal:  PeerJ       Date:  2021-07-12       Impact factor: 2.984

10.  Identifying HbA1c trajectories and modifiable risk factors of trajectories in 5- to 9-year-olds with recent-onset type 1 diabetes from the United States.

Authors:  Susana R Patton; Keith Feldman; Shideh Majidi; Amy Noser; Mark A Clements
Journal:  Diabet Med       Date:  2021-07-16       Impact factor: 4.213

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.