| Literature DB >> 28127527 |
Lea Seeber1, Tim Conrad2, Christian Hoppe3, Patrick Obermeier1, Xi Chen1, Katharina Karsch4, Susann Muehlhans1, Franziska Tief1, Sindy Boettcher5, Sabine Diedrich5, Brunhilde Schweiger6, Barbara Rath7.
Abstract
Parents are often uncertain about the vaccination status of their children. In times of vaccine hesitancy, vaccination programs could benefit from active patient participation. The Vaccination App (VAccApp) was developed by the Vienna Vaccine Safety Initiative, enabling parents to learn about the vaccination status of their children, including 25 different routine, special indication and travel vaccines listed in the WHO Immunization Certificate of Vaccination (WHO-ICV). Between 2012 and 2014, the VAccApp was validated in a hospital-based quality management program in Berlin, Germany, in collaboration with the Robert Koch Institute. Parents of 178 children were asked to transfer the immunization data of their children from the WHO-ICV into the VAccApp. The respective WHO-ICV was photocopied for independent, professional data entry (gold standard). Demonstrating the status quo in vaccine information reporting, a Recall Group of 278 parents underwent structured interviews for verbal immunization histories, without the respective WHO-ICV. Only 9% of the Recall Group were able to provide a complete vaccination status; on average 39% of the questions were answered correctly. Using the WHO-ICV with the help of the VAccApp resulted in 62% of parents providing a complete vaccination status; on average 95% of the questions were answered correctly. After using the VAccApp, parents were more likely to remember key aspects of the vaccination history. User-friendly mobile applications empower parents to take a closer look at the vaccination record, thereby taking an active role in providing accurate vaccination histories. Parents may become motivated to ask informed questions and to keep vaccinations up-to-date.Entities:
Keywords: ED, emergency department; Electronic health records; Immunization; Mobile health; Patient education; Patient empowerment; QM, quality management; RSV, respiratory syncytial virus; SOP, standard operating procedure; VAccApp, Vaccination App, a mobile application for vaccination histories; VPD, vaccine-preventable disease; Vaccination history; ViVI, Vienna Vaccine Safety Initiative; WHO, World Health Organization; WHO-ICV, International Certificate of Vaccination, issued by the World Health Organization
Year: 2017 PMID: 28127527 PMCID: PMC5257187 DOI: 10.1016/j.pmedr.2017.01.002
Source DB: PubMed Journal: Prev Med Rep ISSN: 2211-3355
Fig. 1Example of the VAccApp user interface.
Participant characteristics.
| Patient characteristics | VAccApp Group | Recall Group | ||
|---|---|---|---|---|
| Age of the child | 38.7 | 82.1 | ||
| (2180) | (2216) | |||
| Gender (% male) | 56.2 | 49.3 | 0.151 | |
| First or second generation international migrant (%) | 51.1 | 52.9 | 0.708 | |
| Race (%) | Caucasian or White | 83.1 | 75.2 | |
| Middle Eastern or North African | 10.1 | 13.7 | 0.254 | |
| African American or Black | 2.2 | 3.2 | 0.529 | |
| Asian | 2.2 | 2.5 | 0.838 | |
| Native Hawaiian or other Pacific Islander | 0.0 | 0.4 | 0.399 | |
| Other | 0.6 | 0.7 | 0.898 | |
| Unidentified | 1.7 | 4.3 | 0.129 | |
| Ethnicity (%) | Hispanic or Latino | 1.1 | 0.7 | 0.651 |
| Non-Hispanic or Latino | 96.6 | 92.1 | 0.051 | |
| Other | 1.1 | 2.2 | 0.385 | |
| Unidentified | 1.1 | 5.0 | 0.027 | |
| Number of individuals living in household (mean) | 3.7 | 3.9 | 0.140 | |
| Birth rank of the child among siblings (mean) | 1.6 | 1.7 | 0.501 | |
Baseline characteristics of patients in the VAccApp Group (n = 178) compared to the Recall Group (n = 278). p-Values were computed using the Whitney U test and the Chi-square test to assess whether the groups were significantly different from each other. Boldface indicates statistical significance (p < 0.05). The evaluation project was conducted between 2012 and 2014 in Berlin, Germany.
Vaccine-specific accuracy rates in the Recall Group.
| Vaccine type | Accurate responses in the Recall Group (%) | |
|---|---|---|
| Routine childhood vaccines | Tetanus | 41.01 |
| Diphtheria | 35.97 | |
| Polio | 35.25 | |
| Pertussis | 35.25 | |
| Haemophilus influenzae type b | 29.86 | |
| Hepatitis B | 31.29 | |
| Mumps | 39.21 | |
| Measles | 39.21 | |
| Rubella | 38.85 | |
| Pneumococcus | 24.10 | |
| Meningococcus | 23.74 | |
| Varicella | 30.94 | |
| Rotavirus | 38.13 | |
| Human papilloma virus | 43.53 | |
| Special indication vaccines or passive immunization | Influenza | 69.06 |
| Hepatitis A | 38.85 | |
| Tick-born encephalitis | 42.81 | |
| RSV (palivizumab) | 43.17 | |
| Tuberculosis | 41.01 | |
| Typhoid fever | 42.45 | |
| Yellow fever | 42.09 | |
| Rabies | 42.81 | |
| Cholera | 42.81 | |
| Japanese encephalitis | 42.81 | |
| Small pox | 42.09 |
Vaccine-specific accuracy rates describe the percentage of parents providing accurate vaccine-specific responses by recall only, i.e. without the vaccination record at hand (n = 278). Professional data entry from the original vaccination record served as gold standard. RSV = respiratory syncytial virus (passive immunization).
Vaccine-specific accuracy rates in the VAccApp Group.
| Vaccine type | Accurate responses in the | |
|---|---|---|
| Routine childhood vaccines | Tetanus | 96.07 |
| Diphtheria | 94.38 | |
| Polio | 93.82 | |
| Pertussis | 93.82 | |
| Haemophilus influenzae type b | 91.01 | |
| Hepatitis B | 93.82 | |
| Mumps | 89.89 | |
| Measles | 91.01 | |
| Rubella | 92.13 | |
| Pneumococcus | 90.45 | |
| Meningococcus | 85.39 | |
| Varicella | 91.57 | |
| Rotavirus | 97.75 | |
| Human papilloma virus | 99.44 | |
| Special indication vaccines or passive immunization | Influenza | 93.26 |
| Hepatitis A | 97.19 | |
| Tick-born encephalitis | 98.88 | |
| RSV (palivizumab) | 96.07 | |
| Tuberculosis | 98.31 | |
| Typhoid fever | 100.00 | |
| Yellow fever | 99.44 | |
| Rabies | 100.00 | |
| Cholera | 100.00 | |
| Japanese encephalitis | 100.00 | |
| Small pox | 99.44 |
Vaccine-specific accuracy rates describe the percentage of parents providing accurate vaccine-specific responses when entering data from the original vaccination record into the VAccApp (n = 178). Professional data entry from the original vaccination record served as gold standard. RSV = respiratory syncytial virus (passive immunization).
Fig. 2Pre/post testing illustrating short-term learning effects.
Short-term learning effects are illustrated before and immediately after use of the VAccApp: pre/post testing questions are displayed separately with regards to tetanus, Haemophilus influenzae type b, and hexavalent vaccine.
Results of the system usability assessment.
| System Usability Scale | Mean value on Likert scale (1-strongly disagree; 5-strongly agree) |
|---|---|
| #1: I think that I would like to use this app frequently. | 3.57 |
| #2: I found the app unnecessarily complex. | 2.29 |
| #3: I thought the app was easy to use. | 3.89 |
| #4: I think that I would need the support of a technical person to be able to use this app. | 1.87 |
| #5: I found the various functions in this app were well integrated. | 3.70 |
| #6: I thought there was too much inconsistency in this app. | 2.03 |
| #7: I would imagine that most people would learn to use this app very quickly. | 3.41 |
| #8: I found the app very cumbersome to use. | 2.48 |
| #9: I felt very confident using the app. | 3.74 |
| #10: I needed to learn a lot of things before I could get going with this app. | 1.81 |
After using the VAccApp for the first time, users were asked to assess the usability of the VAccApp, using the System Usability Scale (Brooke, 1996, Bangor et al., 2008). The assessment resulted in an overall System Usability Score of 69.5 out of possible 100 points, individual scores ranging between 35 and 100.
Fig. 3The WHO International Certificate of Vaccination or Prophylaxis (WHO-ICV).
Routine childhood vaccines (such as poliomyelitis vaccine) are presented in a matrix format (a). Other vaccinations (such as hepatitis A vaccine) are documented in a list format (b), which appears to be more difficult for parents to read.