Peter G Szilagyi1, Christina Albertin1, Alejandra Casillas2, Rebecca Valderrama1, O Kenrik Duru2, Michael K Ong3,4, Sitaram Vangala5, Chi-Hong Tseng5, Cynthia M Rand6, Sharon G Humiston7, Sharon Evans8, Michael Sloyan8, Carlos Lerner1. 1. Department of Pediatrics, UCLA (University of California, Los Angeles) Mattel Children's Hospital, UCLA. 2. Department of Medicine, David Geffen School of Medicine, UCLA. 3. Department of Medicine, Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, California. 4. Fielding School of Public Health, Department of Health Policy and Management, UCLA. 5. Department of Medicine Statistics Core, David Geffen School of Medicine, UCLA. 6. Department of Pediatrics, University of Rochester School of Medicine and Dentistry, Rochester, New York. 7. Department of Pediatrics, Children's Mercy, Kansas City, Missouri. 8. Department of Information Services and Solutions, UCLA Health System, Los Angeles, California.
Abstract
Importance: Influenza vaccination rates across the US are low. Because few practices send patient reminders for influenza vaccination, a scalable patient reminder system is needed. Objective: To evaluate the effect of patient reminders sent via a health care system's electronic health record patient portal on influenza vaccination rates. Design, Setting, and Participants: This pragmatic, 4-arm randomized clinical trial was performed from October 1, 2018, to March 31, 2019, across the UCLA (University of California, Los Angeles) health care system. A total of 164 205 patients in 52 primary care practices who had used the patient portal within 12 months were included. Interventions: Patients due for an influenza vaccine were sent a letter via the patient portal of the health care system reminding them about the importance of influenza vaccination, safety of the vaccine, and morbidity associated with influenza. Patients were randomized within primary care practices to 1 of 4 study groups (no reminder [n = 41 070] vs 1 reminder [n = 41 055], 2 reminders [n = 41 046], or 3 reminders [n = 41 034]). Main Outcomes and Measures: The primary outcome was receipt of 1 or more influenza vaccines as documented in the electronic health record, which was supplemented with influenza vaccination data from external sources (eg, pharmacies). Secondary outcomes were influenza vaccination rates among subgroups and influenza vaccinations self-reported by patients in reply to the portal-based query as having been received elsewhere. Results:A total of 164 205 patients (mean [SD] age, 46.2 [19.6] years; 95 779 [58.3%] female) were randomly allocated to 1 of the 4 study arms. In the primary analysis across all ages and not including patient self-reported vaccinations in reply to portal reminders, influenza vaccination rates were 37.5% for those receiving no reminders, 38.0% for those receiving 1 reminder (P = .008 vs no reminder), 38.2% for those receiving 2 reminders (P = .03 vs no reminder), and 38.2% for those receiving 3 reminders (P = .02 vs no reminder). In the secondary analysis not including patient self-reported vaccinations, among adults aged 18 to 64 years (vaccination rates: 32.0% in the control group, 32.8% in the 1-reminder group, 32.8% in the 2-reminder group, and 32.8% in the 3-reminder group; P = .001), male patients (vaccination rates: 37.3% vs 38.3%, 38.6%, and 38.8%; P = .001), non-Hispanic patients (vaccination rates: 37.6% vs 38.2%, 38.3%, and 38.2%; P = .004), and those who were not vaccinated in the prior 2 years (vaccination rates: 15.3% vs 15.9%, 16.3%, and 16.1%; P < .001), vaccination rates were higher in the portal reminder groups than in the control group; the findings in these 3 subgroups mirrored the findings in the entire population. When self-reported vaccinations received elsewhere were included, influenza vaccination rates were 1.4 to 2.9 percentage points higher in the portal reminder groups, with a dose-response effect (0 reminders: 15 537 [37.8%]; 1 reminder: 16 097 [39.2%]; 2 reminders: 16 426 [40.0%]; and 3 reminders: 16 714 [40.7%]; P < .001). Conclusions and Relevance: Generic patient portal reminders were effective in minimally increasing influenza vaccination rates, but more intensive or more targeted patient motivational strategies appear to be needed. Trial Registration: ClinicalTrials.gov Identifier: NCT03666026.
RCT Entities:
Importance: Influenza vaccination rates across the US are low. Because few practices send patient reminders for influenza vaccination, a scalable patient reminder system is needed. Objective: To evaluate the effect of patient reminders sent via a health care system's electronic health record patient portal on influenza vaccination rates. Design, Setting, and Participants: This pragmatic, 4-arm randomized clinical trial was performed from October 1, 2018, to March 31, 2019, across the UCLA (University of California, Los Angeles) health care system. A total of 164 205 patients in 52 primary care practices who had used the patient portal within 12 months were included. Interventions: Patients due for an influenza vaccine were sent a letter via the patient portal of the health care system reminding them about the importance of influenza vaccination, safety of the vaccine, and morbidity associated with influenza. Patients were randomized within primary care practices to 1 of 4 study groups (no reminder [n = 41 070] vs 1 reminder [n = 41 055], 2 reminders [n = 41 046], or 3 reminders [n = 41 034]). Main Outcomes and Measures: The primary outcome was receipt of 1 or more influenza vaccines as documented in the electronic health record, which was supplemented with influenza vaccination data from external sources (eg, pharmacies). Secondary outcomes were influenza vaccination rates among subgroups and influenza vaccinations self-reported by patients in reply to the portal-based query as having been received elsewhere. Results: A total of 164 205 patients (mean [SD] age, 46.2 [19.6] years; 95 779 [58.3%] female) were randomly allocated to 1 of the 4 study arms. In the primary analysis across all ages and not including patient self-reported vaccinations in reply to portal reminders, influenza vaccination rates were 37.5% for those receiving no reminders, 38.0% for those receiving 1 reminder (P = .008 vs no reminder), 38.2% for those receiving 2 reminders (P = .03 vs no reminder), and 38.2% for those receiving 3 reminders (P = .02 vs no reminder). In the secondary analysis not including patient self-reported vaccinations, among adults aged 18 to 64 years (vaccination rates: 32.0% in the control group, 32.8% in the 1-reminder group, 32.8% in the 2-reminder group, and 32.8% in the 3-reminder group; P = .001), male patients (vaccination rates: 37.3% vs 38.3%, 38.6%, and 38.8%; P = .001), non-Hispanic patients (vaccination rates: 37.6% vs 38.2%, 38.3%, and 38.2%; P = .004), and those who were not vaccinated in the prior 2 years (vaccination rates: 15.3% vs 15.9%, 16.3%, and 16.1%; P < .001), vaccination rates were higher in the portal reminder groups than in the control group; the findings in these 3 subgroups mirrored the findings in the entire population. When self-reported vaccinations received elsewhere were included, influenza vaccination rates were 1.4 to 2.9 percentage points higher in the portal reminder groups, with a dose-response effect (0 reminders: 15 537 [37.8%]; 1 reminder: 16 097 [39.2%]; 2 reminders: 16 426 [40.0%]; and 3 reminders: 16 714 [40.7%]; P < .001). Conclusions and Relevance: Generic patient portal reminders were effective in minimally increasing influenza vaccination rates, but more intensive or more targeted patient motivational strategies appear to be needed. Trial Registration: ClinicalTrials.gov Identifier: NCT03666026.
Authors: Allison Kempe; Matthew F Daley; Jennifer Barrow; Norma Allred; Nellie Hester; Brenda L Beaty; Lori A Crane; Kellyn Pearson; Stephen Berman Journal: Pediatrics Date: 2005-01 Impact factor: 7.124
Authors: Melissa S Stockwell; Elyse Olshen Kharbanda; Raquel Andres Martinez; Celibell Y Vargas; David K Vawdrey; Stewin Camargo Journal: JAMA Date: 2012-04-25 Impact factor: 56.272
Authors: Melissa S Stockwell; Carolyn Westhoff; Elyse Olshen Kharbanda; Celibell Y Vargas; Stewin Camargo; David K Vawdrey; Paula M Castaño Journal: Am J Public Health Date: 2013-12-19 Impact factor: 9.308
Authors: Sarah L Cutrona; Jessica G Golden; Sarah L Goff; Jessica Ogarek; Bruce Barton; Lloyd Fisher; Peggy Preusse; Devi Sundaresan; Lawrence Garber; Kathleen M Mazor Journal: J Gen Intern Med Date: 2018-01-30 Impact factor: 5.128
Authors: Nell J Marshall; Jennifer L Lee; Jessica Schroeder; Wei-Nchih Lee; Jermyn See; Mohammad Madjid; Mrudula R Munagala; John D Piette; Litjen Tan; Orly Vardeny; Michael Greenberg; Jan Liska; Monica Mercer; Sandrine Samson Journal: J Med Internet Res Date: 2022-10-07 Impact factor: 7.076
Authors: Douglas Halket; Jimmy Dang; Anuradha Phadke; Channa Jayasekera; W Ray Kim; Paul Kwo; Lance Downing; Aparna Goel Journal: J Gen Intern Med Date: 2022-03-01 Impact factor: 6.473
Authors: Carlos Lerner; Christina Albertin; Alejandra Casillas; O Kenrik Duru; Michael K Ong; Sitaram Vangala; Sharon Humiston; Sharon Evans; Michael Sloyan; Craig R Fox; Jonathan E Bogard; Sarah Friedman; Peter G Szilagyi Journal: Pediatrics Date: 2021-08 Impact factor: 7.124
Authors: Jessica G Wijesundara; Mayuko Ito Fukunaga; Jessica Ogarek; Bruce Barton; Lloyd Fisher; Peggy Preusse; Devi Sundaresan; Lawrence Garber; Kathleen M Mazor; Sarah L Cutrona Journal: J Med Internet Res Date: 2020-09-25 Impact factor: 5.428
Authors: Peter G Szilagyi; Christina S Albertin; Alejandra Casillas; Rebecca Valderrama; O Kenrik Duru; Michael K Ong; Sitaram Vangala; Chi-Hong Tseng; Sharon G Humiston; Sharon Evans; Michael Sloyan; Jonathan E Bogard; Craig R Fox; Carlos Lerner Journal: J Gen Intern Med Date: 2021-09-01 Impact factor: 5.128