Jason Chow1, Hongyang Zhao2, Micheal Sandbank3, Kristen Bottema-Beutel4, Tiffany Woynaroski5. 1. Department of Counseling, Higher Education, and Special Education, University of Maryland at College Park. 2. Department of Human Development and Quantitative Methodology, University of Maryland at College Park. 3. Department of Special Education, University of Texas at Austin. 4. Department of Teaching, Curriculum, and Society, Boston College. 5. Department of Hearing and Speech Sciences, Vanderbilt University Medical Center.
Abstract
OBJECTIVE: The purpose of this study is to present a set of empirically derived effect size distributions to provide field-based benchmarks for interpreting the observed effects of interventions for young children on the autism spectrum, and for planning future studies. METHOD: We generated effect size distributions and reported quartile values for each by outcome domain, and by boundedness, proximity, and assessment approach using 1552 effect sizes from 144 early childhood autism intervention studies gathered for a previously published meta-analysis. RESULTS: Quartile values represent considerable heterogeneity in effect size distributions across outcome domains, as well as variability as a function of outcome boundedness, proximity, and assessment approach. CONCLUSIONS: Our results serve as field- and outcome-specific benchmarks (e.g., contextual guides for small, medium, and large effects) that will help autism intervention researchers easily incorporate information from relevant prior empirical literature when conducting power analyses to plan for future studies. Benchmarks will also assist researchers seeking to interpret the magnitude of observed effects in clinical trials relative to the broader distribution of intervention effects on similar outcomes. Nuanced discussions that contextualize study findings in light of relevant empirical benchmarks will better assist practitioners in understanding the magnitude and scope of demonstrated change relative to studies with similar outcomes and selecting interventions for clinical practice. We discuss the limitations of these data, our analyses, as well as directions for future work.
OBJECTIVE: The purpose of this study is to present a set of empirically derived effect size distributions to provide field-based benchmarks for interpreting the observed effects of interventions for young children on the autism spectrum, and for planning future studies. METHOD: We generated effect size distributions and reported quartile values for each by outcome domain, and by boundedness, proximity, and assessment approach using 1552 effect sizes from 144 early childhood autism intervention studies gathered for a previously published meta-analysis. RESULTS: Quartile values represent considerable heterogeneity in effect size distributions across outcome domains, as well as variability as a function of outcome boundedness, proximity, and assessment approach. CONCLUSIONS: Our results serve as field- and outcome-specific benchmarks (e.g., contextual guides for small, medium, and large effects) that will help autism intervention researchers easily incorporate information from relevant prior empirical literature when conducting power analyses to plan for future studies. Benchmarks will also assist researchers seeking to interpret the magnitude of observed effects in clinical trials relative to the broader distribution of intervention effects on similar outcomes. Nuanced discussions that contextualize study findings in light of relevant empirical benchmarks will better assist practitioners in understanding the magnitude and scope of demonstrated change relative to studies with similar outcomes and selecting interventions for clinical practice. We discuss the limitations of these data, our analyses, as well as directions for future work.
Authors: Paul J Yoder; Kristen Bottema-Beutel; Tiffany Woynaroski; Rameela Chandrasekhar; Michael Sandbank Journal: Evid Based Commun Assess Interv Date: 2013