Allison Kempe1, Alison W Saville2, L Miriam Dickinson3, Brenda Beaty4, Sheri Eisert5, Dennis Gurfinkel2, Sarah Brewer2, Heather Shull6, Diana Herrero6, Rachel Herlihy6. 1. Children's Outcomes Research Program, Children's Hospital Colorado, Aurora2Department of Pediatrics, University of Colorado, Denver. 2. Children's Outcomes Research Program, Children's Hospital Colorado, Aurora. 3. Children's Outcomes Research Program, Children's Hospital Colorado, Aurora3Colorado Health Outcomes Program, University of Colorado, Denver4Department of Family Medicine, University of Colorado, Denver. 4. Children's Outcomes Research Program, Children's Hospital Colorado, Aurora3Colorado Health Outcomes Program, University of Colorado, Denver. 5. Department of Health Policy and Management, University of South Florida, Tampa6Department of Pediatrics, University of South Florida, Tampa. 6. Colorado Immunization and Information System, Colorado Department of Public Health and Environment, Denver.
Abstract
IMPORTANCE: Reminder/recall notifications used by primary care practices increase the rates of childhood immunizations, but fewer than 20% of primary care practitioners nationally deliver such reminders. A reminder/recall notification conducted centrally by health departments in collaboration with primary care practices may reduce practice burden, reach children without a primary care practitioner, and decrease the cost of reminders/recalls. OBJECTIVE: To assess the effectiveness and cost-effectiveness of collaborative centralized (CC) vs practice-based (PB) reminder/recall approaches using the Colorado Immunization Information System (CIIS). DESIGN, SETTING, AND PARTICIPANTS: We performed a randomized pragmatic trial from September 7, 2012, through March 17, 2013, including 18,235 children aged 19 to 35 months in 15 Colorado counties. INTERVENTIONS: In CC counties, children who needed at least 1 immunization were sent as many as 4 reminders/recalls by mail or autodialed telephone calls by the CIIS. Primary care practices in these counties were given the option of endorsing the reminder/recall notification by adding the practice name to the message. In PB counties, primary care practices were invited to web-based reminder/recall training and offered financial support for sending notifications. MAIN OUTCOMES AND MEASURES: Documentation of any new immunization within 6 months constituted the primary outcome; achieving up-to-date (UTD) immunization status was secondary. We assessed the cost and cost-effectiveness of each approach and used a generalized linear mixed-effects model to assess the effect of the intervention on outcomes. RESULTS:In PB counties, 24 of 308 primary care practices (7.8%) attendedreminder/recall training and 2 primary care practices (0.6%) endorsed reminder/recall notifications. Within CC counties, 129 of 229 practices (56.3%) endorsed the reminder/recall letter. Documentation rates for at least 1 immunization were 26.9% for CC vs 21.7% for PB counties (P < .001); 12.8% vs 9.3% of patients, respectively, achieved UTD status (P < .001). The effect of CC counties on children's UTD status was greater when the reminder/recall notification was endorsed by the primary care practice (19.2% vs 9.8%; P < .001). The total cost of the CC reminder/recall was $28 620 or $11.75 per child for any new immunization and $24.72 per child achieving UTD status; the total cost to the 2 practices that conducted PB reminders/recalls was $74.00 per child for any immunization and $124.45 per child achieving UTD status. The modeling resulted in an adjusted odds ratio of 1.31 (95% CI, 1.16-1.48) for any new immunization in CC vs PB counties. CONCLUSIONS AND RELEVANCE: A CC reminder/recall notification was more effective and more cost-effective than a PB system, although the effect size was modest. Endorsement by practices may further increase the effectiveness of CC reminder/recall. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01557621.
RCT Entities:
IMPORTANCE: Reminder/recall notifications used by primary care practices increase the rates of childhood immunizations, but fewer than 20% of primary care practitioners nationally deliver such reminders. A reminder/recall notification conducted centrally by health departments in collaboration with primary care practices may reduce practice burden, reach children without a primary care practitioner, and decrease the cost of reminders/recalls. OBJECTIVE: To assess the effectiveness and cost-effectiveness of collaborative centralized (CC) vs practice-based (PB) reminder/recall approaches using the Colorado Immunization Information System (CIIS). DESIGN, SETTING, AND PARTICIPANTS: We performed a randomized pragmatic trial from September 7, 2012, through March 17, 2013, including 18,235 children aged 19 to 35 months in 15 Colorado counties. INTERVENTIONS: In CC counties, children who needed at least 1 immunization were sent as many as 4 reminders/recalls by mail or autodialed telephone calls by the CIIS. Primary care practices in these counties were given the option of endorsing the reminder/recall notification by adding the practice name to the message. In PB counties, primary care practices were invited to web-based reminder/recall training and offered financial support for sending notifications. MAIN OUTCOMES AND MEASURES: Documentation of any new immunization within 6 months constituted the primary outcome; achieving up-to-date (UTD) immunization status was secondary. We assessed the cost and cost-effectiveness of each approach and used a generalized linear mixed-effects model to assess the effect of the intervention on outcomes. RESULTS: In PB counties, 24 of 308 primary care practices (7.8%) attended reminder/recall training and 2 primary care practices (0.6%) endorsed reminder/recall notifications. Within CC counties, 129 of 229 practices (56.3%) endorsed the reminder/recall letter. Documentation rates for at least 1 immunization were 26.9% for CC vs 21.7% for PB counties (P < .001); 12.8% vs 9.3% of patients, respectively, achieved UTD status (P < .001). The effect of CC counties on children's UTD status was greater when the reminder/recall notification was endorsed by the primary care practice (19.2% vs 9.8%; P < .001). The total cost of the CC reminder/recall was $28 620 or $11.75 per child for any new immunization and $24.72 per child achieving UTD status; the total cost to the 2 practices that conducted PB reminders/recalls was $74.00 per child for any immunization and $124.45 per child achieving UTD status. The modeling resulted in an adjusted odds ratio of 1.31 (95% CI, 1.16-1.48) for any new immunization in CC vs PB counties. CONCLUSIONS AND RELEVANCE: A CC reminder/recall notification was more effective and more cost-effective than a PB system, although the effect size was modest. Endorsement by practices may further increase the effectiveness of CC reminder/recall. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01557621.
Authors: Allison Kempe; Laura P Hurley; Cristina V Cardemil; Mandy A Allison; Lori A Crane; Michaela Brtnikova; Brenda L Beaty; Laura J Pabst; Megan C Lindley Journal: Am J Prev Med Date: 2016-09-14 Impact factor: 5.043
Authors: Jennifer K Coury; Jennifer L Schneider; Beverly B Green; Laura-Mae Baldwin; Amanda F Petrik; Jennifer S Rivelli; Malaika R Schwartz; Gloria D Coronado Journal: Transl Behav Med Date: 2020-02-03 Impact factor: 3.046
Authors: Allison Kempe; Sean T O'Leary; Jo Ann Shoup; Shannon Stokley; Steven Lockhart; Anna Furniss; L Miriam Dickinson; Juliana Barnard; Matthew F Daley Journal: Pediatrics Date: 2016-02-26 Impact factor: 7.124
Authors: Allison Kempe; Alison W Saville; Christina Albertin; Laura Helmkamp; Xinkai Zhou; Sitaram Vangela; L Miriam Dickinson; Chi-Hong Tseng; Jonathan D Campbell; Melanie Whittington; Dennis Gurfinkel; Heather Roth; Dina Hoefer; Peter Szilagyi Journal: Acad Pediatr Date: 2019-11-05 Impact factor: 3.107
Authors: Peter G Szilagyi; Christina S Albertin; Alison W Saville; Rebecca Valderrama; Abigail Breck; Laura Helmkamp; Xinkai Zhou; Sitaram Vangala; L Miriam Dickinson; Chi-Hong Tseng; Jonathan D Campbell; Melanie D Whittington; Heather Roth; Cynthia M Rand; Sharon G Humiston; Dina Hoefer; Allison Kempe Journal: J Pediatr Date: 2020-06 Impact factor: 4.406
Authors: Peter Szilagyi; Christina Albertin; Dennis Gurfinkel; Brenda Beaty; Xinkai Zhou; Sitaram Vangala; John Rice; Jonathan D Campbell; Melanie D Whittington; Rebecca Valderrama; Abigail Breck; Heather Roth; Megan Meldrum; Chi-Hong Tseng; Cynthia Rand; Sharon G Humiston; Stanley Schaffer; Allison Kempe Journal: Pediatrics Date: 2020-04-06 Impact factor: 7.124
Authors: Jonathan D Lehnert; Alex Shevach; Sydney Walker; Rose Wang; Thomas J Fitzgerald; Samuel B Graitcer Journal: Hum Vaccin Immunother Date: 2018-04-09 Impact factor: 3.452