Adam R Kinney1, Aaron M Eakman2, James E Graham2. 1. Rocky Mountain Mental Illness Research, Education, and Clinical Center, Department of Veterans Affairs, Aurora, Colorado; Department of Physical Medicine and Rehabilitation, University of Colorado Anschutz Medical Campus, Aurora, Colorado. Electronic address: Adam.Kinney@va.gov. 2. Department of Occupational Therapy, Colorado State University, Fort Collins, Colorado.
Abstract
OBJECTIVE: First, to establish empirically-based effect size interpretation guidelines for rehabilitation treatment effects. Second, to evaluate statistical power in rehabilitation research. DATA SOURCES: The Cochrane Database of Systematic Reviews was searched through June 2019. STUDY SELECTION: Meta-analyses included in the Cochrane Database of Systematic Reviews with "rehabilitation" as a keyword and clearly evaluated a rehabilitation intervention. DATA EXTRACTION: We extracted Cohen's d effect sizes and associated sample sizes for treatment and comparison groups. Two independent investigators classified the interventions into 4 categories using the Rehabilitation Treatment Specification System. The 25th, 50th, and 75th percentile values within the effect size distribution were used to establish interpretation guidelines for small, medium, and large effects, respectively. A priori power analyses established sample sizes needed to detect the empirically-based values for small, medium, and large effects. Post-hoc power analyses using median sample sizes revealed whether the "typical" rehabilitation study was sufficiently powered to detect the empirically-based values. Post hoc power analyses established the statistical power of each test based on the sample size and reported effect size. DATA SYNTHESIS: We analyzed 3381 effect sizes extracted from 99 meta-analyses. Interpretation guidelines for small effects ranged from 0.08 to 0.15; medium effects ranged from 0.19 to 0.36; and large effects ranged from 0.41 to 0.67. We present sample sizes needed to detect these values based on a priori power analyses. Post hoc power analyses revealed that a "typical" rehabilitation study lacks sufficient power to detect the empirically-based values. Post hoc power analyses using reported sample sizes and effects indicated the studies were underpowered, with median power ranging from 0.14 to 0.23. CONCLUSIONS: This study presented novel and empirically-based interpretation guidelines for small, medium, and large rehabilitation treatment effects. The observed effect size distributions differed across intervention categories, indicating that researchers should use category-specific guidelines. Furthermore, many published rehabilitation studies are underpowered. Published by Elsevier Inc.
OBJECTIVE: First, to establish empirically-based effect size interpretation guidelines for rehabilitation treatment effects. Second, to evaluate statistical power in rehabilitation research. DATA SOURCES: The Cochrane Database of Systematic Reviews was searched through June 2019. STUDY SELECTION: Meta-analyses included in the Cochrane Database of Systematic Reviews with "rehabilitation" as a keyword and clearly evaluated a rehabilitation intervention. DATA EXTRACTION: We extracted Cohen's d effect sizes and associated sample sizes for treatment and comparison groups. Two independent investigators classified the interventions into 4 categories using the Rehabilitation Treatment Specification System. The 25th, 50th, and 75th percentile values within the effect size distribution were used to establish interpretation guidelines for small, medium, and large effects, respectively. A priori power analyses established sample sizes needed to detect the empirically-based values for small, medium, and large effects. Post-hoc power analyses using median sample sizes revealed whether the "typical" rehabilitation study was sufficiently powered to detect the empirically-based values. Post hoc power analyses established the statistical power of each test based on the sample size and reported effect size. DATA SYNTHESIS: We analyzed 3381 effect sizes extracted from 99 meta-analyses. Interpretation guidelines for small effects ranged from 0.08 to 0.15; medium effects ranged from 0.19 to 0.36; and large effects ranged from 0.41 to 0.67. We present sample sizes needed to detect these values based on a priori power analyses. Post hoc power analyses revealed that a "typical" rehabilitation study lacks sufficient power to detect the empirically-based values. Post hoc power analyses using reported sample sizes and effects indicated the studies were underpowered, with median power ranging from 0.14 to 0.23. CONCLUSIONS: This study presented novel and empirically-based interpretation guidelines for small, medium, and large rehabilitation treatment effects. The observed effect size distributions differed across intervention categories, indicating that researchers should use category-specific guidelines. Furthermore, many published rehabilitation studies are underpowered. Published by Elsevier Inc.
Authors: Alberto Romano; Elena Ippolito; Camilla Risoli; Edoardo Malerba; Martina Favetta; Andrea Sancesario; Meir Lotan; Daniel Sender Moran Journal: J Clin Med Date: 2022-01-22 Impact factor: 4.241
Authors: Casey Little; Connor Moore; Emily Bean; Denise M Peters; Ryan S McGinnis; Susan L Kasser Journal: Gait Posture Date: 2022-03-03 Impact factor: 2.746
Authors: Ines Buchholz; You-Shan Feng; Maresa Buchholz; Lewis E Kazis; Thomas Kohlmann Journal: Health Qual Life Outcomes Date: 2021-05-04 Impact factor: 3.186