Kristen M Cunanan1, Bradley P Carlin2, Kevin A Peterson3. 1. Department of Epidemiology & Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA kristenmay206@gmail.com. 2. Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, USA. 3. Department of Family Medicine and Community Health, University of Minnesota Medical School, Minneapolis, MN, USA.
Abstract
BACKGROUND: Many clinical trial designs are impractical for community-based clinical intervention trials. Stepped wedge trial designs provide practical advantages, but few descriptions exist of their clinical implementational features, statistical design efficiencies, and limitations. OBJECTIVES: Enhance efficiency of stepped wedge trial designs by evaluating the impact of design characteristics on statistical power for the British Columbia Telehealth Trial. METHODS: The British Columbia Telehealth Trial is a community-based, cluster-randomized, controlled clinical trial in rural and urban British Columbia. To determine the effect of an Internet-based telehealth intervention on healthcare utilization, 1000 subjects with an existing diagnosis of congestive heart failure or type 2 diabetes will be enrolled from 50 clinical practices. Hospital utilization is measured using a composite of disease-specific hospital admissions and emergency visits. The intervention comprises online telehealth data collection and counseling provided to support a disease-specific action plan developed by the primary care provider. The planned intervention is sequentially introduced across all participating practices. We adopt a fully Bayesian, Markov chain Monte Carlo-driven statistical approach, wherein we use simulation to determine the effect of cluster size, sample size, and crossover interval choice on type I error and power to evaluate differences in hospital utilization. RESULTS: For our Bayesian stepped wedge trial design, simulations suggest moderate decreases in power when crossover intervals from control to intervention are reduced from every 3 to 2 weeks, and dramatic decreases in power as the numbers of clusters decrease. Power and type I error performance were not notably affected by the addition of nonzero cluster effects or a temporal trend in hospitalization intensity. CONCLUSION/LIMITATIONS: Stepped wedge trial designs that intervene in small clusters across longer periods can provide enhanced power to evaluate comparative effectiveness, while offering practical implementation advantages in geographic stratification, temporal change, use of existing data, and resource distribution. Current population estimates were used; however, models may not reflect actual event rates during the trial. In addition, temporal or spatial heterogeneity can bias treatment effect estimates.
RCT Entities:
BACKGROUND: Many clinical trial designs are impractical for community-based clinical intervention trials. Stepped wedge trial designs provide practical advantages, but few descriptions exist of their clinical implementational features, statistical design efficiencies, and limitations. OBJECTIVES: Enhance efficiency of stepped wedge trial designs by evaluating the impact of design characteristics on statistical power for the British Columbia Telehealth Trial. METHODS: The British Columbia Telehealth Trial is a community-based, cluster-randomized, controlled clinical trial in rural and urban British Columbia. To determine the effect of an Internet-based telehealth intervention on healthcare utilization, 1000 subjects with an existing diagnosis of congestive heart failure or type 2 diabetes will be enrolled from 50 clinical practices. Hospital utilization is measured using a composite of disease-specific hospital admissions and emergency visits. The intervention comprises online telehealth data collection and counseling provided to support a disease-specific action plan developed by the primary care provider. The planned intervention is sequentially introduced across all participating practices. We adopt a fully Bayesian, Markov chain Monte Carlo-driven statistical approach, wherein we use simulation to determine the effect of cluster size, sample size, and crossover interval choice on type I error and power to evaluate differences in hospital utilization. RESULTS: For our Bayesian stepped wedge trial design, simulations suggest moderate decreases in power when crossover intervals from control to intervention are reduced from every 3 to 2 weeks, and dramatic decreases in power as the numbers of clusters decrease. Power and type I error performance were not notably affected by the addition of nonzero cluster effects or a temporal trend in hospitalization intensity. CONCLUSION/LIMITATIONS: Stepped wedge trial designs that intervene in small clusters across longer periods can provide enhanced power to evaluate comparative effectiveness, while offering practical implementation advantages in geographic stratification, temporal change, use of existing data, and resource distribution. Current population estimates were used; however, models may not reflect actual event rates during the trial. In addition, temporal or spatial heterogeneity can bias treatment effect estimates.
Authors: Steven E Bellan; Juliet R C Pulliam; Carl A B Pearson; David Champredon; Spencer J Fox; Laura Skrip; Alison P Galvani; Manoj Gambhir; Ben A Lopman; Travis C Porco; Lauren Ancel Meyers; Jonathan Dushoff Journal: Lancet Infect Dis Date: 2015-04-14 Impact factor: 25.071
Authors: Andrew J Copas; James J Lewis; Jennifer A Thompson; Calum Davey; Gianluca Baio; James R Hargreaves Journal: Trials Date: 2015-08-17 Impact factor: 2.279
Authors: Kelsey L Grantham; Jessica Kasza; Stephane Heritier; John B Carlin; Andrew B Forbes Journal: BMC Med Res Methodol Date: 2022-04-13 Impact factor: 4.615
Authors: Lila J Finney Rutten; Kathryn J Ruddy; Linda L Chlan; Joan M Griffin; Jeph Herrin; Aaron L Leppin; Deirdre R Pachman; Jennifer L Ridgeway; Parvez A Rahman; Curtis B Storlie; Patrick M Wilson; Andrea L Cheville Journal: Trials Date: 2020-06-05 Impact factor: 2.279