Literature DB >> 25800521

Small telescopes: detectability and the evaluation of replication results.

Uri Simonsohn1.   

Abstract

This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to which the replication results are consistent with an effect size big enough to have been detectable in the original study. The approach is demonstrated by examining replications of three well-known findings. Its benefits include the following: (a) differentiating "unsuccessful" replication attempts (i.e., studies yielding p > .05) that are too noisy from those that actively indicate the effect is undetectably different from zero, (b) "protecting" true findings from underpowered replications, and (c) arriving at intuitively compelling inferences in general and for the revisited replications in particular.
© The Author(s) 2015.

Keywords:  hypothesis testing; open materials; replication; statistical power

Mesh:

Year:  2015        PMID: 25800521     DOI: 10.1177/0956797614567341

Source DB:  PubMed          Journal:  Psychol Sci        ISSN: 0956-7976


  98 in total

1.  Value-based attentional capture affects multi-alternative decision making.

Authors:  Sebastian Gluth; Mikhail S Spektor; Jörg Rieskamp
Journal:  Elife       Date:  2018-11-05       Impact factor: 8.140

2.  Making sense of the noise: Replication difficulties of Correll's (2008) modulation of 1/f noise in a racial bias task.

Authors:  Christine Madurski; Etienne P LeBel
Journal:  Psychon Bull Rev       Date:  2015-08

3.  Illusory inconsistencies in judgment: Stimulus-evoked reference sets and between-subjects designs.

Authors:  Lim M Leong; Craig R M McKenzie; Shlomi Sher; Johannes Müller-Trede
Journal:  Psychon Bull Rev       Date:  2019-04

4.  Rethinking research reproducibility.

Authors:  Ulrich Dirnagl
Journal:  EMBO J       Date:  2018-12-05       Impact factor: 11.598

5.  What can be learned from growth mindset controversies?

Authors:  David S Yeager; Carol S Dweck
Journal:  Am Psychol       Date:  2020-12

6.  Gambling, Risk-Taking, and Antisocial Behavior: A Replication Study Supporting the Generality of Deviance.

Authors:  Sandeep Mishra; Martin L Lalumière; Robert J Williams
Journal:  J Gambl Stud       Date:  2017-03

7.  A field experiment shows that subtle linguistic cues might not affect voter behavior.

Authors:  Alan S Gerber; Gregory A Huber; Daniel R Biggers; David J Hendry
Journal:  Proc Natl Acad Sci U S A       Date:  2016-06-13       Impact factor: 11.205

8.  An Attempt to Conceptually Replicate the Dissociation between Syntax and Semantics during Sentence Comprehension.

Authors:  Matthew Siegelman; Idan A Blank; Zachary Mineroff; Evelina Fedorenko
Journal:  Neuroscience       Date:  2019-06-11       Impact factor: 3.590

9.  No evidence for unethical amnesia for imagined actions: A failed replication and extension.

Authors:  Matthew L Stanley; Brenda W Yang; Felipe De Brigard
Journal:  Mem Cognit       Date:  2018-07

10.  Interpersonal-level discrimination indices, sociodemographic factors, and telomere length in African-Americans and Whites.

Authors:  Danielle L Beatty Moody; Daniel K Leibel; Taylor M Darden; Jason J Ashe; Shari R Waldstein; Leslie I Katzel; Hans B Liu; Nan-Ping Weng; Michele K Evans; Alan B Zonderman
Journal:  Biol Psychol       Date:  2018-12-13       Impact factor: 3.251

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.