Jerome I Tokars1, Melissa A Rolfes2, Ivo M Foppa3, Carrie Reed2. 1. Influenza Division, Centers for Disease Control and Prevention, USA. Electronic address: jit1@cdc.gov. 2. Influenza Division, Centers for Disease Control and Prevention, USA. 3. Battelle, Atlanta, GA, USA.
Abstract
INTRODUCTION: To evaluate the public health benefit of yearly influenza vaccinations, CDC estimates the number of influenza cases and hospitalizations averted by vaccine. Available input data on cases and vaccinations is aggregated by month and the estimation model is intentionally simple, raising concerns about the accuracy of estimates. METHODS: We created a synthetic dataset with daily counts of influenza cases and vaccinations, calculated "true" averted cases using a reference model applied to the daily data, aggregated the data by month to simulate data that would actually be available, and evaluated the month-level data with seven test methods (including the current method). Methods with averted case estimates closest to the reference model were considered most accurate. To examine their performance under varying conditions, we re-evaluated the test methods when synthetic data parameters (timing of vaccination relative to cases, vaccination coverage, infection rate, and vaccine effectiveness) were varied over wide ranges. Finally, we analyzed real (i.e., collected by surveillance) data from 2010 to 2017 comparing the current method used by CDC with the best-performing test methods. RESULTS: In the synthetic dataset (population 1 million persons, vaccination uptake 55%, seasonal infection risk without vaccination 12%, vaccine effectiveness 48%) the reference model estimated 28,768 averted cases. The current method underestimated averted cases by 9%. The two best test methods estimated averted cases with <1% error. These two methods also worked well when synthetic data parameters were varied over wide ranges (≤6.2% error). With the real data, these two methods estimated numbers of averted cases that are a median 8% higher than the currently-used method. CONCLUSIONS: We identified two methods for estimating numbers of influenza cases averted by vaccine that are more accurate than the currently-used algorithm. These methods will help us to better assess the benefits of influenza vaccination. Published by Elsevier Ltd.
INTRODUCTION: To evaluate the public health benefit of yearly influenza vaccinations, CDC estimates the number of influenza cases and hospitalizations averted by vaccine. Available input data on cases and vaccinations is aggregated by month and the estimation model is intentionally simple, raising concerns about the accuracy of estimates. METHODS: We created a synthetic dataset with daily counts of influenza cases and vaccinations, calculated "true" averted cases using a reference model applied to the daily data, aggregated the data by month to simulate data that would actually be available, and evaluated the month-level data with seven test methods (including the current method). Methods with averted case estimates closest to the reference model were considered most accurate. To examine their performance under varying conditions, we re-evaluated the test methods when synthetic data parameters (timing of vaccination relative to cases, vaccination coverage, infection rate, and vaccine effectiveness) were varied over wide ranges. Finally, we analyzed real (i.e., collected by surveillance) data from 2010 to 2017 comparing the current method used by CDC with the best-performing test methods. RESULTS: In the synthetic dataset (population 1 million persons, vaccination uptake 55%, seasonal infection risk without vaccination 12%, vaccine effectiveness 48%) the reference model estimated 28,768 averted cases. The current method underestimated averted cases by 9%. The two best test methods estimated averted cases with <1% error. These two methods also worked well when synthetic data parameters were varied over wide ranges (≤6.2% error). With the real data, these two methods estimated numbers of averted cases that are a median 8% higher than the currently-used method. CONCLUSIONS: We identified two methods for estimating numbers of influenza cases averted by vaccine that are more accurate than the currently-used algorithm. These methods will help us to better assess the benefits of influenza vaccination. Published by Elsevier Ltd.
Authors: Stephanie A Irving; James G Donahue; David K Shay; Tina L Ellis-Coyle; Edward A Belongia Journal: Vaccine Date: 2009-09-01 Impact factor: 3.641
Authors: Rebekah H Borse; Sundar S Shrestha; Anthony E Fiore; Charisma Y Atkins; James A Singleton; Carolyn Furlow; Martin I Meltzer Journal: Emerg Infect Dis Date: 2013-03 Impact factor: 6.883
Authors: Lisa A Grohskopf; Leslie Z Sokolow; Karen R Broder; Emmanuel B Walter; Joseph S Bresee; Alicia M Fry; Daniel B Jernigan Journal: MMWR Recomm Rep Date: 2017-08-25
Authors: Brendan Flannery; Jessie R Chung; Edward A Belongia; Huong Q McLean; Manjusha Gaglani; Kempapura Murthy; Richard K Zimmerman; Mary Patricia Nowalk; Michael L Jackson; Lisa A Jackson; Arnold S Monto; Emily T Martin; Angie Foust; Wendy Sessions; LaShondra Berman; John R Barnes; Sarah Spencer; Alicia M Fry Journal: MMWR Morb Mortal Wkly Rep Date: 2018-02-16 Impact factor: 17.586
Authors: Melissa A Rolfes; Ivo M Foppa; Shikha Garg; Brendan Flannery; Lynnette Brammer; James A Singleton; Erin Burns; Daniel Jernigan; Sonja J Olsen; Joseph Bresee; Carrie Reed Journal: Influenza Other Respir Viruses Date: 2018-02-14 Impact factor: 4.380
Authors: Deliana Kostova; Carrie Reed; Lyn Finelli; Po-Yung Cheng; Paul M Gargiullo; David K Shay; James A Singleton; Martin I Meltzer; Peng-Jun Lu; Joseph S Bresee Journal: PLoS One Date: 2013-06-19 Impact factor: 3.240
Authors: Melissa A Rolfes; Brendan Flannery; Jessie R Chung; Alissa O'Halloran; Shikha Garg; Edward A Belongia; Manjusha Gaglani; Richard K Zimmerman; Michael L Jackson; Arnold S Monto; Nisha B Alden; Evan Anderson; Nancy M Bennett; Laurie Billing; Seth Eckel; Pam Daily Kirley; Ruth Lynfield; Maya L Monroe; Melanie Spencer; Nancy Spina; H Keipp Talbot; Ann Thomas; Salina M Torres; Kimberly Yousey-Hindes; James A Singleton; Manish Patel; Carrie Reed; Alicia M Fry Journal: Clin Infect Dis Date: 2019-11-13 Impact factor: 20.999