Literature DB >> 29173233

Fact or fiction: reducing the proportion and impact of false positives.

D Stahl1, A Pickles1.   

Abstract

False positive findings in science are inevitable, but are they particularly common in psychology and psychiatry? The evidence that we review suggests that while not restricted to our field, the problem is acute. We describe the concept of researcher 'degrees-of-freedom' to explain how many false-positive findings arise, and how the various strategies of registration, pre-specification, and reporting standards that are being adopted both reduce and make these visible. We review possible benefits and harms of proposed statistical solutions, from tougher requirements for significance, to Bayesian and machine learning approaches to analysis. Finally we consider the organisation and methods for replication and systematic review in psychology and psychiatry.

Keywords:  Bayes' factor; cross-validation; external validation; false positives; meta-analyses; replication crisis; researcher degrees-of-freedom; statistical learning

Mesh:

Year:  2017        PMID: 29173233     DOI: 10.1017/S003329171700294X

Source DB:  PubMed          Journal:  Psychol Med        ISSN: 0033-2917            Impact factor:   7.723


  2 in total

1.  Open Science Is Liberating and Can Foster Creativity.

Authors:  Willem E Frankenhuis; Daniel Nettle
Journal:  Perspect Psychol Sci       Date:  2018-07

2.  Relationship between jumping to conclusions and clinical outcomes in people at clinical high-risk for psychosis.

Authors:  Ana Catalan; Stefania Tognin; Matthew J Kempton; Daniel Stahl; Gonzalo Salazar de Pablo; Barnaby Nelson; Christos Pantelis; Anita Riecher-Rössler; Rodrigo Bressan; Neus Barrantes-Vidal; Marie-Odile Krebs; Merete Nordentoft; Stephan Ruhrmann; Gabriele Sachs; Bart P F Rutten; Jim van Os; Lieuwe de Haan; Mark van der Gaag; Lucia R Valmaggia; Philip McGuire
Journal:  Psychol Med       Date:  2020-10-06       Impact factor: 10.592

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.