Steven E Bellan1, Juliet R C Pulliam2, Carl A B Pearson3, David Champredon4, Spencer J Fox5, Laura Skrip6, Alison P Galvani7, Manoj Gambhir8, Ben A Lopman9, Travis C Porco10, Lauren Ancel Meyers11, Jonathan Dushoff12. 1. Center for Computational Biology and Bioinformatics, The University of Texas at Austin, Austin, TX, USA. Electronic address: steve.bellan@gmail.com. 2. Department of Biology, University of Florida, Gainesville, FL, USA; Emerging Pathogens Institute, University of Florida, Gainesville, FL, USA. 3. Emerging Pathogens Institute, University of Florida, Gainesville, FL, USA. 4. School of Computational Science and Engineering, McMaster University, Hamilton, ON, Canada. 5. Department of Integrative Biology, The University of Texas at Austin, Austin, TX, USA. 6. Center for Infectious Disease Modeling and Analysis, Yale School of Public Health, Yale University, New Haven, CT, USA. 7. Center for Infectious Disease Modeling and Analysis, Yale School of Public Health, Yale University, New Haven, CT, USA; Department of Ecology and Evolution, Yale University, New Haven, CT, USA. 8. Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, Australia; Division of Preparedness and Emerging Infections, National Center for Emerging and Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, Atlanta, GA, USA; IHRC Inc, Atlanta, GA, USA. 9. Division of Viral Diseases, National Center for Immunization and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, GA, USA; Rollins School of Public Health, Emory University, Atlanta, GA, USA. 10. Francis I Proctor Foundation, University of California, San Francisco, CA, USA; Department of Ophthalmology, University of California, San Francisco, CA, USA; Department of Epidemiology & Biostatistics, University of California, San Francisco, CA, USA. 11. Department of Integrative Biology, The University of Texas at Austin, Austin, TX, USA; The Santa Fe Institute, Santa Fe, NM, USA. 12. Department of Biology, McMaster University, Hamilton, ON, Canada.
Abstract
BACKGROUND: Safe and effective vaccines could help to end the ongoing Ebola virus disease epidemic in parts of west Africa, and mitigate future outbreaks of the virus. We assess the statistical validity and power of randomised controlled trial (RCT) and stepped-wedge cluster trial (SWCT) designs in Sierra Leone, where the incidence of Ebola virus disease is spatiotemporally heterogeneous, and is decreasing rapidly. METHODS: We projected district-level Ebola virus disease incidence for the next 6 months, using a stochastic model fitted to data from Sierra Leone. We then simulated RCT and SWCT designs in trial populations comprising geographically distinct clusters at high risk, taking into account realistic logistical constraints, and both individual-level and cluster-level variations in risk. We assessed false-positive rates and power for parametric and non-parametric analyses of simulated trial data, across a range of vaccine efficacies and trial start dates. FINDINGS: For an SWCT, regional variation in Ebola virus disease incidence trends produced increased false-positive rates (up to 0·15 at α=0·05) under standard statistical models, but not when analysed by a permutation test, whereas analyses of RCTs remained statistically valid under all models. With the assumption of a 6-month trial starting on Feb 18, 2015, we estimate the power to detect a 90% effective vaccine to be between 49% and 89% for an RCT, and between 6% and 26% for an SWCT, depending on the Ebola virus disease incidence within the trial population. We estimate that a 1-month delay in trial initiation will reduce the power of the RCT by 20% and that of the SWCT by 49%. INTERPRETATION: Spatiotemporal variation in infection risk undermines the statistical power of the SWCT. This variation also undercuts the SWCT's expected ethical advantages over the RCT, because an RCT, but not an SWCT, can prioritise vaccination of high-risk clusters. FUNDING: US National Institutes of Health, US National Science Foundation, and Canadian Institutes of Health Research.
BACKGROUND: Safe and effective vaccines could help to end the ongoing Ebola virus disease epidemic in parts of west Africa, and mitigate future outbreaks of the virus. We assess the statistical validity and power of randomised controlled trial (RCT) and stepped-wedge cluster trial (SWCT) designs in Sierra Leone, where the incidence of Ebola virus disease is spatiotemporally heterogeneous, and is decreasing rapidly. METHODS: We projected district-level Ebola virus disease incidence for the next 6 months, using a stochastic model fitted to data from Sierra Leone. We then simulated RCT and SWCT designs in trial populations comprising geographically distinct clusters at high risk, taking into account realistic logistical constraints, and both individual-level and cluster-level variations in risk. We assessed false-positive rates and power for parametric and non-parametric analyses of simulated trial data, across a range of vaccine efficacies and trial start dates. FINDINGS: For an SWCT, regional variation in Ebola virus disease incidence trends produced increased false-positive rates (up to 0·15 at α=0·05) under standard statistical models, but not when analysed by a permutation test, whereas analyses of RCTs remained statistically valid under all models. With the assumption of a 6-month trial starting on Feb 18, 2015, we estimate the power to detect a 90% effective vaccine to be between 49% and 89% for an RCT, and between 6% and 26% for an SWCT, depending on the Ebola virus disease incidence within the trial population. We estimate that a 1-month delay in trial initiation will reduce the power of the RCT by 20% and that of the SWCT by 49%. INTERPRETATION: Spatiotemporal variation in infection risk undermines the statistical power of the SWCT. This variation also undercuts the SWCT's expected ethical advantages over the RCT, because an RCT, but not an SWCT, can prioritise vaccination of high-risk clusters. FUNDING: US National Institutes of Health, US National Science Foundation, and Canadian Institutes of Health Research.
Authors: Katie Ewer; Tommy Rampling; Navin Venkatraman; Georgina Bowyer; Danny Wright; Teresa Lambe; Egeruan B Imoukhuede; Ruth Payne; Sarah Katharina Fehling; Thomas Strecker; Nadine Biedenkopf; Verena Krähling; Claire M Tully; Nick J Edwards; Emma M Bentley; Dhanraj Samuel; Geneviève Labbé; Jing Jin; Malick Gibani; Alice Minhinnick; Morven Wilkie; Ian Poulton; Natalie Lella; Rachel Roberts; Felicity Hartnell; Carly Bliss; Kailan Sierra-Davidson; Jonathan Powlson; Eleanor Berrie; Richard Tedder; Francois Roman; Iris De Ryck; Alfredo Nicosia; Nancy J Sullivan; Daphne A Stanley; Olivier T Mbaya; Julie E Ledgerwood; Richard M Schwartz; Loredana Siani; Stefano Colloca; Antonella Folgori; Stefania Di Marco; Riccardo Cortese; Edward Wright; Stephan Becker; Barney S Graham; Richard A Koup; Myron M Levine; Ariane Volkmann; Paul Chaplin; Andrew J Pollard; Simon J Draper; W Ripley Ballou; Alison Lawrie; Sarah C Gilbert; Adrian V S Hill Journal: N Engl J Med Date: 2015-01-28 Impact factor: 91.245
Authors: Peter H Kilmarx; Kevin R Clarke; Patricia M Dietz; Mary J Hamel; Farah Husain; Jevon D McFadden; Benjamin J Park; David E Sugerman; Joseph S Bresee; Jonathan Mermin; James McAuley; Amara Jambai Journal: MMWR Morb Mortal Wkly Rep Date: 2014-12-12 Impact factor: 17.586
Authors: Juliet R C Pulliam; Steve E Bellan; Manoj Gambhir; Lauren Ancel Meyers; Jonathan Dushoff Journal: Lancet Infect Dis Date: 2015-09-20 Impact factor: 25.071
Authors: Katherine E Atkins; Abhishek Pandey; Natasha S Wenzel; Laura Skrip; Dan Yamin; Tolbert G Nyenswah; Mosoka Fallah; Luke Bawo; Jan Medlock; Frederick L Altice; Jeffrey Townsend; Martial L Ndeffo-Mbah; Alison P Galvani Journal: Am J Trop Med Hyg Date: 2016-02-29 Impact factor: 2.345
Authors: Natalie E Dean; Pierre-Stéphane Gsell; Ron Brookmeyer; Victor De Gruttola; Christl A Donnelly; M Elizabeth Halloran; Momodou Jasseh; Martha Nason; Ximena Riveros; Conall H Watson; Ana Maria Henao-Restrepo; Ira M Longini Journal: Sci Transl Med Date: 2019-07-03 Impact factor: 17.956