Guangyu Tong1,2, Karen H Seal3,4, William C Becker5,6, Fan Li1, James D Dziura1,7, Peter N Peduzzi1, Denise A Esserman1. 1. Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA. 2. Yale Center for Analytical Sciences, Yale School of Public Health, New Haven, CT, USA. 3. San Francisco VA Health Care System, Integrative Health Service, San Francisco, CA, USA. 4. Department of Medicine and Psychiatry, University of California-San Francisco, San Francisco, CA, USA. 5. Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA. 6. VA Connecticut Healthcare System, Pain Research, Informatics, Multimorbidities and Education Center of Innovation, West Haven, CT, USA. 7. Department of Emergency Medicine, Yale School of Medicine, New Haven, CT, USA.
Abstract
BACKGROUND/AIMS: When participants in individually randomized group treatment trials are treated by multiple clinicians or in multiple group treatment sessions throughout the trial, this induces partially nested clusters which can affect the power of a trial. We investigate this issue in the Whole Health Options and Pain Education trial, a three-arm pragmatic, individually randomized clinical trial. We evaluate whether partial clusters due to multiple visits delivered by different clinicians in the Whole Health Team arm and dynamic participant groups due to changing group leaders and/or participants across treatment sessions during treatment delivery in the Primary Care Group Education arm may impact the power of the trial. We also present a Bayesian approach to estimate the intraclass correlation coefficients. METHODS: We present statistical models for each treatment arm of Whole Health Options and Pain Education trial in which power is estimated under different intraclass correlation coefficients and mapping matrices between participants and clinicians or treatment sessions. Power calculations are based on pairwise comparisons. In practice, sample size calculations depend on estimates of the intraclass correlation coefficients at the treatment sessions and clinician levels. To accommodate such complexities, we present a Bayesian framework for the estimation of intraclass correlation coefficients under different participant-to-session and participant-to-clinician mapping scenarios. We simulated continuous outcome data based on various clinical scenarios in Whole Health Options and Pain Education trial using a range of intraclass correlation coefficients and mapping matrices and used Gibbs samplers with conjugate priors to obtain posteriors of the intraclass correlation coefficients under those different scenarios. Posterior means and medians and their biases are calculated for the intraclass correlation coefficients to evaluate the operating characteristics of the Bayesian intraclass correlation coefficient estimators. RESULTS: Power for Whole Health Team versus Primary Care Group Education is sensitive to the intraclass correlation coefficient in the Whole Health Team arm. In these two arms, an increased number of clinicians, more evenly distributed workload of clinicians, or more homogeneous treatment group sizes leads to increased power. Our simulation study for the intraclass correlation coefficient estimation indicates that the posterior mean intraclass correlation coefficient estimator has less bias when the true intraclass correlation coefficients are large (i.e. 0.10), but when the intraclass correlation coefficient is small (i.e. 0.01), the posterior median intraclass correlation coefficient estimator is less biased. CONCLUSION: Knowledge of intraclass correlation coefficients and the structure of clustering are critical to the design of individually randomized group treatment trials with partially nested clusters. We demonstrate that the intraclass correlation coefficient of the Whole Health Team arm can affect power in the Whole Health Options and Pain Education trial. A Bayesian approach provides a flexible procedure for estimating the intraclass correlation coefficients under complex scenarios. More work is needed to educate the research community about the individually randomized group treatment design and encourage publication of intraclass correlation coefficients to help inform future trial designs.
BACKGROUND/AIMS: When participants in individually randomized group treatment trials are treated by multiple clinicians or in multiple group treatment sessions throughout the trial, this induces partially nested clusters which can affect the power of a trial. We investigate this issue in the Whole Health Options and Pain Education trial, a three-arm pragmatic, individually randomized clinical trial. We evaluate whether partial clusters due to multiple visits delivered by different clinicians in the Whole Health Team arm and dynamic participant groups due to changing group leaders and/or participants across treatment sessions during treatment delivery in the Primary Care Group Education arm may impact the power of the trial. We also present a Bayesian approach to estimate the intraclass correlation coefficients. METHODS: We present statistical models for each treatment arm of Whole Health Options and Pain Education trial in which power is estimated under different intraclass correlation coefficients and mapping matrices between participants and clinicians or treatment sessions. Power calculations are based on pairwise comparisons. In practice, sample size calculations depend on estimates of the intraclass correlation coefficients at the treatment sessions and clinician levels. To accommodate such complexities, we present a Bayesian framework for the estimation of intraclass correlation coefficients under different participant-to-session and participant-to-clinician mapping scenarios. We simulated continuous outcome data based on various clinical scenarios in Whole Health Options and Pain Education trial using a range of intraclass correlation coefficients and mapping matrices and used Gibbs samplers with conjugate priors to obtain posteriors of the intraclass correlation coefficients under those different scenarios. Posterior means and medians and their biases are calculated for the intraclass correlation coefficients to evaluate the operating characteristics of the Bayesian intraclass correlation coefficient estimators. RESULTS: Power for Whole Health Team versus Primary Care Group Education is sensitive to the intraclass correlation coefficient in the Whole Health Team arm. In these two arms, an increased number of clinicians, more evenly distributed workload of clinicians, or more homogeneous treatment group sizes leads to increased power. Our simulation study for the intraclass correlation coefficient estimation indicates that the posterior mean intraclass correlation coefficient estimator has less bias when the true intraclass correlation coefficients are large (i.e. 0.10), but when the intraclass correlation coefficient is small (i.e. 0.01), the posterior median intraclass correlation coefficient estimator is less biased. CONCLUSION: Knowledge of intraclass correlation coefficients and the structure of clustering are critical to the design of individually randomized group treatment trials with partially nested clusters. We demonstrate that the intraclass correlation coefficient of the Whole Health Team arm can affect power in the Whole Health Options and Pain Education trial. A Bayesian approach provides a flexible procedure for estimating the intraclass correlation coefficients under complex scenarios. More work is needed to educate the research community about the individually randomized group treatment design and encourage publication of intraclass correlation coefficients to help inform future trial designs.
Authors: Karen H Seal; Brian Borsari; Jennifer Tighe; Beth E Cohen; Kevin Delucchi; Benjamin J Morasco; Yongmei Li; Emily Sachs; Linda Abadjian; Erin C Watson; Jennifer K Manuel; Lea Vella; Jodie Trafton; Amanda Midboe Journal: Contemp Clin Trials Date: 2018-12-17 Impact factor: 2.226
Authors: Sherri L Pals; David M Murray; Catherine M Alfano; William R Shadish; Peter J Hannan; William L Baker Journal: Am J Public Health Date: 2008-06-12 Impact factor: 9.308
Authors: David M Murray; Monica Taljaard; Elizabeth L Turner; Stephanie M George Journal: Annu Rev Public Health Date: 2019-12-23 Impact factor: 21.981
Authors: Karen H Seal; William C Becker; Jennifer L Murphy; Natalie Purcell; Lauren M Denneson; Benjamin J Morasco; Aaron M Martin; Kavitha Reddy; Theresa Van Iseghem; Erin E Krebs; Jacob M Painter; Hildi Hagedorn; Jeffrey M Pyne; John Hixon; Shira Maguen; Thomas C Neylan; Brian Borsari; Beth DeRonne; Carolyn Gibson; Marianne S Matthias; Joseph W Frank; Akshaya Krishnaswamy; Yongmei Li; Daniel Bertenthal; Allan Chan; Alejandro Nunez; Nicole McCamish Journal: Pain Med Date: 2020-12-12 Impact factor: 3.750