Amalia S Magaret1, Mark Warden2, Noah Simon3, Sonya Heltshe4, George Z Retsch-Bogart5, Bonnie W Ramsey4, Nicole Mayer-Hamblett6. 1. Cystic Fibrosis Therapeutics Development Network Coordinating Center, Seattle Children's Hospital, Seattle, WA, United States of America; Department of Pediatrics, University of Washington, Seattle, WA, United States of America; Department of Biostatistics, University of Washington, Seattle, WA, United States of America. Electronic address: amalia.magaret@seattlechildrens.org. 2. Department of Epidemiology, University of Washington, Seattle, WA, United States of America. 3. Cystic Fibrosis Therapeutics Development Network Coordinating Center, Seattle Children's Hospital, Seattle, WA, United States of America; Department of Biostatistics, University of Washington, Seattle, WA, United States of America. 4. Cystic Fibrosis Therapeutics Development Network Coordinating Center, Seattle Children's Hospital, Seattle, WA, United States of America; Department of Pediatrics, University of Washington, Seattle, WA, United States of America. 5. Department of Pediatrics, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States of America. 6. Cystic Fibrosis Therapeutics Development Network Coordinating Center, Seattle Children's Hospital, Seattle, WA, United States of America; Department of Pediatrics, University of Washington, Seattle, WA, United States of America; Department of Biostatistics, University of Washington, Seattle, WA, United States of America.
Abstract
BACKGROUND: Given future challenges in conducting large randomized, placebo controlled trials for future CF therapeutics development, we evaluated the potential for using external historical controls to either enrich or replace traditional concurrent placebo groups in CF trials. METHODS: The study included data from sequentially completed, randomized, controlled clinical trials, EPIC and OPTIMIZE respectively, evaluating optimal antibiotic therapy to reduce the risk of pulmonary exacerbation in children with early Pseudomonas aeruginosa infection. The primary treatment effect in OPTIMIZE, the risk of pulmonary exacerbation associated with azithromycin, was re-estimated in alternative designs incorporating varying numbers of participants from the earlier trial (EPIC) as historical controls. Bias and precision of these estimates were characterized. Propensity scores were derived to adjust for baseline differences across study populations, and both Poisson and Cox regression were used to estimate treatment efficacy. RESULTS: Replacing 86 OPTIMIZE placebo participants with 304 controls from EPIC to mimic a fully historically controlled trial resulted an 8% reduction in risk of pulmonary exacerbations (Hazard ratio (HR):0.92 95% CI 0.61, 1.34) when not adjusting for key baseline differences between study populations. After adjustment, a 37% decrease in risk of exacerbation (HR:0.63, 95% CI 0.50, 0.80) was estimated, comparable to the estimate from the original trial comparing the 86 placebo participants to 77 azithromycin participants on azithromycin (45%, HR:0.55, 95% CI: 0.34, 0.86). Other adjusted approaches provided similar estimates for the efficacy of azithromycin in reducing exacerbation risk: pooling all controls from both studies provided a HR of 0.60 (95% x`CI 0.46, 0.77) and augmenting half the OPTIMIZE placebo participants with EPIC controls gave a HR 0.63 (95% CI 0.48, 0.82). CONCLUSIONS: The potential exists for future CF trials to utilize historical control data. Careful consideration of both the comparability of controls and of optimal methods can reduce the potential for biased estimation of treatment effects.
BACKGROUND: Given future challenges in conducting large randomized, placebo controlled trials for future CF therapeutics development, we evaluated the potential for using external historical controls to either enrich or replace traditional concurrent placebo groups in CF trials. METHODS: The study included data from sequentially completed, randomized, controlled clinical trials, EPIC and OPTIMIZE respectively, evaluating optimal antibiotic therapy to reduce the risk of pulmonary exacerbation in children with early Pseudomonas aeruginosa infection. The primary treatment effect in OPTIMIZE, the risk of pulmonary exacerbation associated with azithromycin, was re-estimated in alternative designs incorporating varying numbers of participants from the earlier trial (EPIC) as historical controls. Bias and precision of these estimates were characterized. Propensity scores were derived to adjust for baseline differences across study populations, and both Poisson and Cox regression were used to estimate treatment efficacy. RESULTS: Replacing 86 OPTIMIZE placebo participants with 304 controls from EPIC to mimic a fully historically controlled trial resulted an 8% reduction in risk of pulmonary exacerbations (Hazard ratio (HR):0.92 95% CI 0.61, 1.34) when not adjusting for key baseline differences between study populations. After adjustment, a 37% decrease in risk of exacerbation (HR:0.63, 95% CI 0.50, 0.80) was estimated, comparable to the estimate from the original trial comparing the 86 placebo participants to 77 azithromycin participants on azithromycin (45%, HR:0.55, 95% CI: 0.34, 0.86). Other adjusted approaches provided similar estimates for the efficacy of azithromycin in reducing exacerbation risk: pooling all controls from both studies provided a HR of 0.60 (95% x`CI 0.46, 0.77) and augmenting half the OPTIMIZE placebo participants with EPIC controls gave a HR 0.63 (95% CI 0.48, 0.82). CONCLUSIONS: The potential exists for future CF trials to utilize historical control data. Careful consideration of both the comparability of controls and of optimal methods can reduce the potential for biased estimation of treatment effects.
Authors: N Mayer-Hamblett; S van Koningsbruggen-Rietschel; D P Nichols; D R VanDevanter; J C Davies; T Lee; A G Durmowicz; F Ratjen; M W Konstan; K Pearson; S C Bell; J P Clancy; J L Taylor-Cousar; K De Boeck; S H Donaldson; D G Downey; P A Flume; P Drevinek; C H Goss; I Fajac; A S Magaret; B S Quon; S M Singleton; J M VanDalfsen; G Z Retsch-Bogart Journal: J Cyst Fibros Date: 2020-06-07 Impact factor: 5.482
Authors: M Alan Brookhart; Sebastian Schneeweiss; Kenneth J Rothman; Robert J Glynn; Jerry Avorn; Til Stürmer Journal: Am J Epidemiol Date: 2006-04-19 Impact factor: 4.897
Authors: Nicholas S Downing; Jenerius A Aminawung; Nilay D Shah; Harlan M Krumholz; Joseph S Ross Journal: JAMA Date: 2014 Jan 22-29 Impact factor: 56.272
Authors: Miriam M Treggiari; George Retsch-Bogart; Nicole Mayer-Hamblett; Umer Khan; Michal Kulich; Richard Kronmal; Judy Williams; Peter Hiatt; Ronald L Gibson; Terry Spencer; David Orenstein; Barbara A Chatfield; Deborah K Froh; Jane L Burns; Margaret Rosenfeld; Bonnie W Ramsey Journal: Arch Pediatr Adolesc Med Date: 2011-09
Authors: Harry G M Heijerman; Edward F McKone; Damian G Downey; Eva Van Braeckel; Steven M Rowe; Elizabeth Tullis; Marcus A Mall; John J Welter; Bonnie W Ramsey; Charlotte M McKee; Gautham Marigowda; Samuel M Moskowitz; David Waltz; Patrick R Sosnay; Christopher Simard; Neil Ahluwalia; Fengjuan Xuan; Yaohua Zhang; Jennifer L Taylor-Cousar; Karen S McCoy Journal: Lancet Date: 2019-10-31 Impact factor: 79.321
Authors: Dave P Nichols; Anthony G Durmowicz; Ann Field; Patrick A Flume; Donald R VanDevanter; Nicole Mayer-Hamblett Journal: Ann Am Thorac Soc Date: 2019-05
Authors: Nicole Mayer-Hamblett; George Retsch-Bogart; Margaret Kloster; Frank Accurso; Margaret Rosenfeld; Gary Albers; Philip Black; Perry Brown; AnneMarie Cairns; Stephanie D Davis; Gavin R Graff; Gwendolyn S Kerby; David Orenstein; Rachael Buckingham; Bonnie W Ramsey Journal: Am J Respir Crit Care Med Date: 2018-11-01 Impact factor: 30.528