Mary Patricia Nowalk1, Helen Eleni Aslanidou D'Agostino2, Richard K Zimmerman3, Sean G Saul3, Michael Susick3, Jonathan M Raviotta3, Theresa M Sax2, G K Balasubramani2. 1. University of Pittsburgh School of Medicine, Department of Family Medicine, Suite 520 Schenley Place, 4420 Bayard St, Pittsburgh, PA 15260, USA. Electronic address: tnowalk@pitt.edu. 2. University of Pittsburgh Graduate School of Public Health, Department of Epidemiology, Suite 600 Schenley Place, 4420 Bayard St, Pittsburgh, PA 15260, USA. 3. University of Pittsburgh School of Medicine, Department of Family Medicine, Suite 520 Schenley Place, 4420 Bayard St, Pittsburgh, PA 15260, USA.
Abstract
INTRODUCTION: Many vaccination studies rely on self-reported vaccination status, with its inherent biases. Accuracy of influenza vaccination self-report has been evaluated periodically, typically using the medical record as the gold standard. The burgeoning of electronic medical records (EMRs) and immunization information systems (IISs) and the rise of adult vaccine administration in community pharmacies suggest the need for a reevaluation of self-reported vaccination status. METHODS: Vaccination data from self-report, the state IIS, the health system EMR and other sources were compared for participants in outpatient and inpatient influenza vaccine effectiveness studies for four seasons (2016-2017 to 2019-2020). Agreement among the sources was calculated along with sensitivity and specificity. Tests for trend assessed changes in completeness of the Pennsylvania - Statewide IIS (PA-SIIS) data over time. RESULTS: With self-report as the gold standard, agreement with the local EMR, PA-SIIS, and all sources was 62%, 77% and 85%, respectively. Sensitivity of the EMR was 42% (95% CI = 41, 43) and specificity was 91% (90, 92). With PA-SIIS-as the gold standard, agreement with the local EMR and all sources was 77% and 78%, respectively. Sensitivity of all sources combined was 96% (95, 97) and specificity was (63% (62, 64). Capture of influenza vaccinations in the IIS has not consistently improved over time, with a significant increase among children (P = 0.001), no change among working-age adults and a decrease among older adults (P = 0.004). However, PA-SIIS provided the largest percentage of verified vaccines (69.3%) compared with EMR (43.3%) and other sources (12.4%). CONCLUSION: Both self-report and PA-SIIS are good estimates of actual vaccine uptake. When high accuracy data are required, such as for vaccine effectiveness studies, triangulation using multiple sources should be conducted.
INTRODUCTION: Many vaccination studies rely on self-reported vaccination status, with its inherent biases. Accuracy of influenza vaccination self-report has been evaluated periodically, typically using the medical record as the gold standard. The burgeoning of electronic medical records (EMRs) and immunization information systems (IISs) and the rise of adult vaccine administration in community pharmacies suggest the need for a reevaluation of self-reported vaccination status. METHODS: Vaccination data from self-report, the state IIS, the health system EMR and other sources were compared for participants in outpatient and inpatient influenza vaccine effectiveness studies for four seasons (2016-2017 to 2019-2020). Agreement among the sources was calculated along with sensitivity and specificity. Tests for trend assessed changes in completeness of the Pennsylvania - Statewide IIS (PA-SIIS) data over time. RESULTS: With self-report as the gold standard, agreement with the local EMR, PA-SIIS, and all sources was 62%, 77% and 85%, respectively. Sensitivity of the EMR was 42% (95% CI = 41, 43) and specificity was 91% (90, 92). With PA-SIIS-as the gold standard, agreement with the local EMR and all sources was 77% and 78%, respectively. Sensitivity of all sources combined was 96% (95, 97) and specificity was (63% (62, 64). Capture of influenza vaccinations in the IIS has not consistently improved over time, with a significant increase among children (P = 0.001), no change among working-age adults and a decrease among older adults (P = 0.004). However, PA-SIIS provided the largest percentage of verified vaccines (69.3%) compared with EMR (43.3%) and other sources (12.4%). CONCLUSION: Both self-report and PA-SIIS are good estimates of actual vaccine uptake. When high accuracy data are required, such as for vaccine effectiveness studies, triangulation using multiple sources should be conducted.
Authors: James L Hadler; Tai N Baker; Vikki Papadouka; Anne Marie France; Christopher Zimmerman; Kara A Livingston; Jane R Zucker Journal: J Infect Dis Date: 2012-05-02 Impact factor: 5.226
Authors: Jill M Ferdinands; Manjusha Gaglani; Emily T Martin; Don Middleton; Arnold S Monto; Kempapura Murthy; Fernanda P Silveira; H Keipp Talbot; Richard Zimmerman; Elif Alyanak; Courtney Strickland; Sarah Spencer; Alicia M Fry Journal: J Infect Dis Date: 2019-09-13 Impact factor: 5.226
Authors: Ruth Koepke; Ashley B Petit; Roman A Ayele; Jens C Eickhoff; Stephanie L Schauer; Matthew J Verdon; Daniel J Hopfensperger; James H Conway; Jeffrey P Davis Journal: J Public Health Manag Pract Date: 2015 May-Jun
Authors: Richard Kent Zimmerman; Mahlon Raymund; Janine E Janosky; Mary Patricia Nowalk; Michael J Fine Journal: Vaccine Date: 2003-03-28 Impact factor: 3.641
Authors: Sharon K Greene; Ping Shi; M Maya Dutta-Linn; Jo Ann Shoup; Virginia L Hinrichsen; Paula Ray; James D Nordin; Leslie Kuckler; Eric S Weintraub; W Katherine Yih Journal: Am J Prev Med Date: 2009-12 Impact factor: 5.043