Literature DB >> 31976420

An Overview of Scientific Reproducibility: Consideration of Relevant Issues for Behavior Science/Analysis.

Sean Laraway1, Susan Snycerski1, Sean Pradhan2, Bradley E Huitema3.   

Abstract

For over a decade, the failure to reproduce findings in several disciplines, including the biomedical, behavioral, and social sciences, have led some authors to claim that there is a so-called "replication (or reproducibility) crisis" in those disciplines. The current article examines: (a) various aspects of the reproducibility of scientific studies, including definitions of reproducibility; (b) published concerns about reproducibility in the scientific literature and public press; (c) variables involved in assessing the success of attempts to reproduce a study; (d) suggested factors responsible for reproducibility failures; (e) types of validity of experimental studies and threats to validity as they relate to reproducibility; and (f) evidence for threats to reproducibility in the behavior science/analysis literature. Suggestions for improving the reproducibility of studies in behavior science and analysis are described throughout. © Association for Behavior Analysis International 2019.

Keywords:  Construct validity; Effect size measures; Null hypothesis significance testing; Replication; Reproducibility; Statistical conclusion validity; Statistical power

Year:  2019        PMID: 31976420      PMCID: PMC6701706          DOI: 10.1007/s40614-019-00193-3

Source DB:  PubMed          Journal:  Perspect Behav Sci        ISSN: 2520-8969


  82 in total

1.  Visual inspection of data revisited: Do the eyes still have it?

Authors:  G S Fisch
Journal:  Behav Anal       Date:  1998

2.  Is psychology suffering from a replication crisis? What does "failure to replicate" really mean?

Authors:  Scott E Maxwell; Michael Y Lau; George S Howard
Journal:  Am Psychol       Date:  2015-09

3.  Statistical inference for individual organism research: mixed blessing or curse?

Authors:  J Michael
Journal:  J Appl Behav Anal       Date:  1974

4.  The (mis)reporting of statistical results in psychology journals.

Authors:  Marjan Bakker; Jelte M Wicherts
Journal:  Behav Res Methods       Date:  2011-09

5.  The new statistics: why and how.

Authors:  Geoff Cumming
Journal:  Psychol Sci       Date:  2013-11-12

6.  Effect sizes and p values: what should be reported and what should be replicated?

Authors:  A G Greenwald; R Gonzalez; R J Harris; D Guthrie
Journal:  Psychophysiology       Date:  1996-03       Impact factor: 4.016

Review 7.  When more data steer us wrong: replications with the wrong dependent measure perpetuate erroneous conclusions.

Authors:  Caren M Rotello; Evan Heit; Chad Dubé
Journal:  Psychon Bull Rev       Date:  2015-08

8.  Response to Comment on "Estimating the reproducibility of psychological science".

Authors:  Christopher J Anderson; Štěpán Bahník; Michael Barnett-Cowan; Frank A Bosco; Jesse Chandler; Christopher R Chartier; Felix Cheung; Cody D Christopherson; Andreas Cordes; Edward J Cremata; Nicolas Della Penna; Vivien Estel; Anna Fedor; Stanka A Fitneva; Michael C Frank; James A Grange; Joshua K Hartshorne; Fred Hasselman; Felix Henninger; Marije van der Hulst; Kai J Jonas; Calvin K Lai; Carmel A Levitan; Jeremy K Miller; Katherine S Moore; Johannes M Meixner; Marcus R Munafò; Koen I Neijenhuijs; Gustav Nilsonne; Brian A Nosek; Franziska Plessow; Jason M Prenoveau; Ashley A Ricker; Kathleen Schmidt; Jeffrey R Spies; Stefan Stieger; Nina Strohminger; Gavin B Sullivan; Robbie C M van Aert; Marcel A L M van Assen; Wolf Vanpaemel; Michelangelo Vianello; Martin Voracek; Kellylynn Zuni
Journal:  Science       Date:  2016-03-04       Impact factor: 47.728

9.  Comment on "Estimating the reproducibility of psychological science".

Authors:  Daniel T Gilbert; Gary King; Stephen Pettigrew; Timothy D Wilson
Journal:  Science       Date:  2016-03-04       Impact factor: 47.728

10.  Replication, falsification, and the crisis of confidence in social psychology.

Authors:  Brian D Earp; David Trafimow
Journal:  Front Psychol       Date:  2015-05-19
View more
  8 in total

1.  Quantitative Techniques and Graphical Representations for Interpreting Results from Alternating Treatment Design.

Authors:  Rumen Manolov; René Tanious; Patrick Onghena
Journal:  Perspect Behav Sci       Date:  2021-05-13

Review 2.  Advances in human oxytocin measurement: challenges and proposed solutions.

Authors:  Benjamin A Tabak; Gareth Leng; Angela Szeto; Karen J Parker; Joseph G Verbalis; Toni E Ziegler; Mary R Lee; Inga D Neumann; Armando J Mendez
Journal:  Mol Psychiatry       Date:  2022-08-23       Impact factor: 13.437

3.  Assessing kinesthetic proprioceptive function of the upper limb: a novel dynamic movement reproduction task using a robotic arm.

Authors:  Kristof Vandael; Tasha R Stanton; Ann Meulders
Journal:  PeerJ       Date:  2021-05-03       Impact factor: 2.984

4.  The case for formal methodology in scientific reform.

Authors:  Berna Devezer; Danielle J Navarro; Joachim Vandekerckhove; Erkan Ozge Buzbas
Journal:  R Soc Open Sci       Date:  2021-03-31       Impact factor: 2.963

5.  Exploring COVID-19 research credibility among Spanish scientists.

Authors:  Eduardo Garcia-Garzon; Ariadna Angulo-Brunet; Oscar Lecuona; Juan Ramón Barrada; Guido Corradi
Journal:  Curr Psychol       Date:  2022-02-28

6.  A proposal for the assessment of replication of effects in single-case experimental designs.

Authors:  Rumen Manolov; René Tanious; Belén Fernández-Castilla
Journal:  J Appl Behav Anal       Date:  2022-04-25

7.  The consecutive controlled case series: Design, data-analytics, and reporting methods supporting the study of generality.

Authors:  Louis P Hagopian
Journal:  J Appl Behav Anal       Date:  2020-03-03

8.  Improving Mental Health Services: A 50-Year Journey from Randomized Experiments to Artificial Intelligence and Precision Mental Health.

Authors:  Leonard Bickman
Journal:  Adm Policy Ment Health       Date:  2020-09
  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.