Literature DB >> 27562761

Confirming the appearance of excess success: Reply to van Boxtel and Koch (2016).

Gregory Francis1.   

Abstract

van Boxtel and Koch (Psychonomic Bulletin & Review. doi: 10.3758/s13423-016-1010-0 , 2016) reported finding problems in the Test for Excess Success (TES) analysis in Francis (Psychonomic Bulletin & Review, 21, 1180-1187, 2014). They argued that their findings undermined the general analysis and the conclusions of the specific TES analysis for their article (van Boxtel & Koch in Psychological Science, 23(4), 410-418, 2012). As shown in this paper, their reported problems reflect misunderstandings about both the general properties of a TES analysis and how it was applied to their specific set of findings. Another look at the findings and theoretical claims in van Boxtel and Koch (Psychological Science, 23(4), 410-418, 2012) confirms the appearance of excess success.

Keywords:  Statistical inference; Statistics; Visual perception

Year:  2016        PMID: 27562761     DOI: 10.3758/s13423-016-1137-z

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  12 in total

1.  Measuring the prevalence of questionable research practices with incentives for truth telling.

Authors:  Leslie K John; George Loewenstein; Drazen Prelec
Journal:  Psychol Sci       Date:  2012-04-16

2.  Visual rivalry without spatial conflict.

Authors:  Jeroen J A van Boxtel; Christof Koch
Journal:  Psychol Sci       Date:  2012-03-05

3.  False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.

Authors:  Joseph P Simmons; Leif D Nelson; Uri Simonsohn
Journal:  Psychol Sci       Date:  2011-10-17

4.  Reevaluating excess success in psychological science.

Authors:  Jeroen J A van Boxtel; Christof Koch
Journal:  Psychon Bull Rev       Date:  2016-10

5.  HARKing: hypothesizing after the results are known.

Authors:  N L Kerr
Journal:  Pers Soc Psychol Rev       Date:  1998

6.  An exploratory test for an excess of significant findings.

Authors:  John P A Ioannidis; Thomas A Trikalinos
Journal:  Clin Trials       Date:  2007       Impact factor: 2.486

7.  P-curve: a key to the file-drawer.

Authors:  Uri Simonsohn; Leif D Nelson; Joseph P Simmons
Journal:  J Exp Psychol Gen       Date:  2013-07-15

8.  The ironic effect of significant results on the credibility of multiple-study articles.

Authors:  Ulrich Schimmack
Journal:  Psychol Methods       Date:  2012-08-27

9.  A (fascinating) litmus test for human retino- vs. non-retinotopic processing.

Authors:  Marco Boi; Haluk Oğmen; Joseph Krummenacher; Thomas U Otto; Michael H Herzog
Journal:  J Vis       Date:  2009-12-05       Impact factor: 2.240

10.  The frequency of excess success for articles in Psychological Science.

Authors:  Gregory Francis
Journal:  Psychon Bull Rev       Date:  2014-10
View more
  1 in total

Review 1.  Implications of "Too Good to Be True" for Replication, Theoretical Claims, and Experimental Design: An Example Using Prominent Studies of Racial Bias.

Authors:  Gregory Francis
Journal:  Front Psychol       Date:  2016-09-22
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.