Literature DB >> 30265768

A tail of two sides: Artificially doubled false positive rates in neuroimaging due to the sidedness choice with t-tests.

Gang Chen1, Robert W Cox1, Daniel R Glen1, Justin K Rajendra1, Richard C Reynolds1, Paul A Taylor1.   

Abstract

One-sided t-tests are widely used in neuroimaging data analysis. While such a test may be applicable when investigating specific regions and prior information about directionality is present, we argue here that it is often mis-applied, with severe consequences for false positive rate (FPR) control. Conceptually, a pair of one-sided t-tests conducted in tandem (e.g., to test separately for both positive and negative effects), effectively amounts to a two-sided t-test. However, replacing the two-sided test with a pair of one-sided tests without multiple comparisons correction essentially doubles the intended FPR of statements made about the same study; that is, the actual family-wise error (FWE) of results at the whole brain level would be 10% instead of the 5% intended by the researcher. Therefore, we strongly recommend that, unless otherwise explicitly justified, two-sided t-tests be applied instead of two simultaneous one-sided t-tests. Published 2018. This article is a U.S. Government work and is in the public domain in the USA.

Entities:  

Keywords:  false positive rate; family-wise error; null hypothesis significance testing; one- and two-sided testing

Mesh:

Year:  2018        PMID: 30265768      PMCID: PMC6328330          DOI: 10.1002/hbm.24399

Source DB:  PubMed          Journal:  Hum Brain Mapp        ISSN: 1065-9471            Impact factor:   5.038


  10 in total

1.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages.

Authors:  R W Cox
Journal:  Comput Biomed Res       Date:  1996-06

2.  A tail of two sides: Artificially doubled false positive rates in neuroimaging due to the sidedness choice with t-tests.

Authors:  Gang Chen; Robert W Cox; Daniel R Glen; Justin K Rajendra; Richard C Reynolds; Paul A Taylor
Journal:  Hum Brain Mapp       Date:  2018-09-28       Impact factor: 5.038

3.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates.

Authors:  Anders Eklund; Thomas E Nichols; Hans Knutsson
Journal:  Proc Natl Acad Sci U S A       Date:  2016-06-28       Impact factor: 11.205

4.  FMRI group analysis combining effect estimates and their variances.

Authors:  Gang Chen; Ziad S Saad; Audrey R Nath; Michael S Beauchamp; Robert W Cox
Journal:  Neuroimage       Date:  2011-12-30       Impact factor: 6.556

5.  NeuroVault.org: A repository for sharing unthresholded statistical maps, parcellations, and atlases of the human brain.

Authors:  Krzysztof J Gorgolewski; Gael Varoquaux; Gabriel Rivera; Yannick Schwartz; Vanessa V Sochat; Satrajit S Ghosh; Camille Maumet; Thomas E Nichols; Jean-Baptiste Poline; Tal Yarkoni; Daniel S Margulies; Russell A Poldrack
Journal:  Neuroimage       Date:  2015-04-11       Impact factor: 6.556

Review 6.  Is the statistic value all we should care about in neuroimaging?

Authors:  Gang Chen; Paul A Taylor; Robert W Cox
Journal:  Neuroimage       Date:  2016-10-10       Impact factor: 6.556

7.  Handling Multiplicity in Neuroimaging Through Bayesian Lenses with Multilevel Modeling.

Authors:  Gang Chen; Yaqiong Xiao; Paul A Taylor; Justin K Rajendra; Tracy Riggins; Fengji Geng; Elizabeth Redcay; Robert W Cox
Journal:  Neuroinformatics       Date:  2019-10

8.  Exploring fMRI Results Space: 31 Variants of an fMRI Analysis in AFNI, FSL, and SPM.

Authors:  Ruth Pauli; Alexander Bowring; Richard Reynolds; Gang Chen; Thomas E Nichols; Camille Maumet
Journal:  Front Neuroinform       Date:  2016-07-05       Impact factor: 4.081

9.  Minimum statistical standards for submissions to Neuroimage: Clinical.

Authors:  J P Roiser; D E Linden; M L Gorno-Tempinin; R J Moran; B C Dickerson; S T Grafton
Journal:  Neuroimage Clin       Date:  2016-11-02       Impact factor: 4.881

10.  Toward open sharing of task-based fMRI data: the OpenfMRI project.

Authors:  Russell A Poldrack; Deanna M Barch; Jason P Mitchell; Tor D Wager; Anthony D Wagner; Joseph T Devlin; Chad Cumba; Oluwasanmi Koyejo; Michael P Milham
Journal:  Front Neuroinform       Date:  2013-07-08       Impact factor: 4.081

  10 in total
  16 in total

1.  A tail of two sides: Artificially doubled false positive rates in neuroimaging due to the sidedness choice with t-tests.

Authors:  Gang Chen; Robert W Cox; Daniel R Glen; Justin K Rajendra; Richard C Reynolds; Paul A Taylor
Journal:  Hum Brain Mapp       Date:  2018-09-28       Impact factor: 5.038

2.  The Aging Brain and Executive Functions Revisited: Implications from Meta-analytic and Functional-Connectivity Evidence.

Authors:  Marisa K Heckner; Edna C Cieslik; Simon B Eickhoff; Julia A Camilleri; Felix Hoffstaedter; Robert Langner
Journal:  J Cogn Neurosci       Date:  2021-08-01       Impact factor: 3.225

3.  Handling Multiplicity in Neuroimaging Through Bayesian Lenses with Multilevel Modeling.

Authors:  Gang Chen; Yaqiong Xiao; Paul A Taylor; Justin K Rajendra; Tracy Riggins; Fengji Geng; Elizabeth Redcay; Robert W Cox
Journal:  Neuroinformatics       Date:  2019-10

4.  A comprehensive macaque fMRI pipeline and hierarchical atlas.

Authors:  Benjamin Jung; Paul A Taylor; Jakob Seidlitz; Caleb Sponheim; Pierce Perkins; Leslie G Ungerleider; Daniel Glen; Adam Messinger
Journal:  Neuroimage       Date:  2021-03-28       Impact factor: 7.400

5.  Linking personality and brain anatomy: a structural MRI approach to Reinforcement Sensitivity Theory.

Authors:  Jesús Adrián-Ventura; Víctor Costumero; Maria Antònia Parcet; César Ávila
Journal:  Soc Cogn Affect Neurosci       Date:  2019-03-05       Impact factor: 3.436

6.  Cluster failure revisited: Impact of first level design and physiological noise on cluster false positive rates.

Authors:  Anders Eklund; Hans Knutsson; Thomas E Nichols
Journal:  Hum Brain Mapp       Date:  2018-10-15       Impact factor: 5.038

7.  Reply to Chen et al.: Parametric methods for cluster inference perform worse for two-sided t-tests.

Authors:  Anders Eklund; Hans Knutsson; Thomas E Nichols
Journal:  Hum Brain Mapp       Date:  2018-12-07       Impact factor: 5.038

8.  Multiple testing correction over contrasts for brain imaging.

Authors:  Bianca A V Alberton; Thomas E Nichols; Humberto R Gamba; Anderson M Winkler
Journal:  Neuroimage       Date:  2020-03-19       Impact factor: 6.556

9.  Exploring the impact of analysis software on task fMRI results.

Authors:  Alexander Bowring; Camille Maumet; Thomas E Nichols
Journal:  Hum Brain Mapp       Date:  2019-05-02       Impact factor: 5.038

10.  Anterior cingulate cortex differently modulates frontoparietal functional connectivity between resting-state and working memory tasks.

Authors:  Xin Di; Heming Zhang; Bharat B Biswal
Journal:  Hum Brain Mapp       Date:  2020-01-06       Impact factor: 5.038

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.