Literature DB >> 31976421

Replication Research, Publication Bias, and Applied Behavior Analysis.

Matt Tincani1, Jason Travers2.   

Abstract

The "replication crisis" describes recent difficulties in replicating studies in various scientific fields, most notably psychology. The available evidence primarily documents replication failures for group research designs. However, we argue that contingencies of publication bias that led to the "replication crisis" also operate on applied behavior analysis (ABA) researchers who use single-case research designs (SCRD). This bias strongly favors publication of SCRD studies that show strong experimental effect, and disfavors publication of studies that show less robust effect. The resulting research literature may unjustifiably inflate confidence about intervention effects, limit researchers' ability to delineate intervention boundary conditions, and diminish the credibility of our science. To counter problems of publication bias in ABA, we recommend that journals that publish SCRD research establish journal standards for publication of noneffect studies; that our research community adopt open sharing of SCRD protocols and data; and that members of our community routinely publish systematic literature reviews that include gray (i.e., unpublished) research. © Association for Behavior Analysis International 2019.

Keywords:  Applied behavior analysis; Behavior science; File drawer effect; Publication bias; Replication; Single-case design

Year:  2019        PMID: 31976421      PMCID: PMC6701502          DOI: 10.1007/s40614-019-00191-5

Source DB:  PubMed          Journal:  Perspect Behav Sci        ISSN: 2520-8969


  40 in total

1.  Classroom application of a trial-based functional analysis.

Authors:  Sarah E Bloom; Brian A Iwata; Jennifer N Fritz; Eileen M Roscoe; Abbey B Carreau
Journal:  J Appl Behav Anal       Date:  2011

2.  An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science.

Authors: 
Journal:  Perspect Psychol Sci       Date:  2012-11

3.  Why Science Is Not Necessarily Self-Correcting.

Authors:  John P A Ioannidis
Journal:  Perspect Psychol Sci       Date:  2012-11

4.  The discounting model selector: Statistical software for delay discounting applications.

Authors:  Shawn P Gilroy; Christopher T Franck; Donald A Hantula
Journal:  J Exp Anal Behav       Date:  2017-05-03       Impact factor: 2.468

5.  The effects of a stimulus-stimulus pairing procedure on the unprompted vocalizations of a young child diagnosed with autism.

Authors:  Matthew P Normand; Melissa L Knoll
Journal:  Anal Verbal Behav       Date:  2006

Review 6.  Evidence-Based Practices for Children, Youth, and Young Adults with Autism Spectrum Disorder: A Comprehensive Review.

Authors:  Connie Wong; Samuel L Odom; Kara A Hume; Ann W Cox; Angel Fettig; Suzanne Kucharczyk; Matthew E Brock; Joshua B Plavnick; Veronica P Fleury; Tia R Schultz
Journal:  J Autism Dev Disord       Date:  2015-07

Review 7.  Meta-Analysis of Single-Case Research Design Studies on Instructional Pacing.

Authors:  Matt Tincani; Marilyn De Mers
Journal:  Behav Modif       Date:  2016-04-11

8.  Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability.

Authors:  Brian A Nosek; Jeffrey R Spies; Matt Motyl
Journal:  Perspect Psychol Sci       Date:  2012-11

9.  PSYCHOLOGY. Estimating the reproducibility of psychological science.

Authors: 
Journal:  Science       Date:  2015-08-28       Impact factor: 47.728

10.  Why most published research findings are false.

Authors:  John P A Ioannidis
Journal:  PLoS Med       Date:  2005-08-30       Impact factor: 11.613

View more
  10 in total

1.  A Systematic Review of Linguistic and Verbal Behavior Outcomes of Pivotal Response Treatment.

Authors:  Heather J Forbes; Jason C Travers; Jenee Vickers Johnson
Journal:  J Autism Dev Disord       Date:  2020-03

2.  Meta-Analytic Methods to Detect Publication Bias in Behavior Science Research.

Authors:  Art Dowdy; Donald A Hantula; Jason C Travers; Matt Tincani
Journal:  Perspect Behav Sci       Date:  2021-07-21

Review 3.  A Neuroeconomics Approach to Obesity.

Authors:  Ohad Dan; Emily K Wertheimer; Ifat Levy
Journal:  Biol Psychiatry       Date:  2021-09-29       Impact factor: 12.810

4.  Cereal Deal: How the Physical Appearance of Others Affects Attention to Healthy Foods.

Authors:  Tobias Otterbring; Kerstin Gidlöf; Kristian Rolschau; Poja Shams
Journal:  Perspect Behav Sci       Date:  2020-02-19

5.  A Decade Review of Two Potential Analysis Altering Variables in Graph Construction.

Authors:  Corey Peltier; Reem Muharib; April Haas; Art Dowdy
Journal:  J Autism Dev Disord       Date:  2021-03-24

6.  Social Class Priming Effect on Prosociality: Evidence from Explicit and Implicit Measures.

Authors:  Shan Zhang; Xinlei Zang; Sainan Zhang; Feng Zhang
Journal:  Int J Environ Res Public Health       Date:  2022-03-27       Impact factor: 3.390

7.  A proposal for the assessment of replication of effects in single-case experimental designs.

Authors:  Rumen Manolov; René Tanious; Belén Fernández-Castilla
Journal:  J Appl Behav Anal       Date:  2022-04-25

8.  A Cultural Generalization: An Effective Training for Staff Integrity on DTT in the Application of the PEAK in Brazil.

Authors:  Daiton J M de Souza; Corey L Robertson; Tyler C Ré
Journal:  Behav Anal Pract       Date:  2022-09-15

9.  Applied Behavior Analysis in Children and Youth with Autism Spectrum Disorders: A Scoping Review.

Authors:  Mojgan Gitimoghaddam; Natalia Chichkine; Laura McArthur; Sarabjit S Sangha; Vivien Symington
Journal:  Perspect Behav Sci       Date:  2022-05-18

10.  The consecutive controlled case series: Design, data-analytics, and reporting methods supporting the study of generality.

Authors:  Louis P Hagopian
Journal:  J Appl Behav Anal       Date:  2020-03-03
  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.