Benjamin R Saville1,2, Donald A Berry1,3, Nicholas S Berry1, Kert Viele1,4, Scott M Berry1,5. 1. Berry Consultants, LLC, Austin, TX, USA. 2. Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, USA. 3. Department of Biostatistics, University of Texas MD Anderson Cancer Center, TX, USA. 4. Department of Biostatistics, University of Kentucky, Lexington, KY, USA. 5. Department of Biostatistics, University of Kansas Medical Center, Kansas City, KS, USA.
Abstract
BACKGROUND: Multi-arm platform trials investigate multiple agents simultaneously, typically with staggered entry and exit of experimental treatment arms versus a shared control arm. In such settings, there is considerable debate whether to limit analyses for a treatment arm to concurrent randomized control subjects or to allow comparisons to both concurrent and non-concurrent (pooled) control subjects. The potential bias from temporal drift over time is at the core of this debate. METHODS: We propose time-adjusted analyses, including a "Bayesian Time Machine," to model potential temporal drift in the entire study population, such that primary analyses can incorporate all randomized control subjects from the platform trial. We conduct a simulation study to assess performance relative to utilizing concurrent or pooled controls. RESULTS: In multi-arm platform trials with staggered entry, analyses adjusting for temporal drift (either Bayesian or frequentist) have superior estimation of treatment effects and favorable testing properties compared to analyses using either concurrent or pooled controls. The Bayesian Time Machine generally provides estimates with greater precision and smaller mean square error than alternative approaches, at the risk of small bias and small Type I error inflation. CONCLUSIONS: The Bayesian Time Machine provides a compromise between bias and precision by smoothing estimates across time and leveraging all available data for the estimation of treatment effects. Prior distributions controlling the behavior of dynamic smoothing across time must be pre-specified and carefully calibrated to the unique context of each trial, appropriately accounting for the population, disease, and endpoints.
BACKGROUND: Multi-arm platform trials investigate multiple agents simultaneously, typically with staggered entry and exit of experimental treatment arms versus a shared control arm. In such settings, there is considerable debate whether to limit analyses for a treatment arm to concurrent randomized control subjects or to allow comparisons to both concurrent and non-concurrent (pooled) control subjects. The potential bias from temporal drift over time is at the core of this debate. METHODS: We propose time-adjusted analyses, including a "Bayesian Time Machine," to model potential temporal drift in the entire study population, such that primary analyses can incorporate all randomized control subjects from the platform trial. We conduct a simulation study to assess performance relative to utilizing concurrent or pooled controls. RESULTS: In multi-arm platform trials with staggered entry, analyses adjusting for temporal drift (either Bayesian or frequentist) have superior estimation of treatment effects and favorable testing properties compared to analyses using either concurrent or pooled controls. The Bayesian Time Machine generally provides estimates with greater precision and smaller mean square error than alternative approaches, at the risk of small bias and small Type I error inflation. CONCLUSIONS: The Bayesian Time Machine provides a compromise between bias and precision by smoothing estimates across time and leveraging all available data for the estimation of treatment effects. Prior distributions controlling the behavior of dynamic smoothing across time must be pre-specified and carefully calibrated to the unique context of each trial, appropriately accounting for the population, disease, and endpoints.