The vaccinaTion & Hpv Knowledge (THinK) questionnaire: a reliability and validity study on a sample of women living in Sicily (southern-Italy).

OBJECTIVE: The aim of this study was to introduce the VaccinaTion & Hpv Knowledge (THinK) questionnaire to assess knowledge about human papillomavirus (HPV) and attitude to HPV-vaccination. Its reliability and validity was demonstrated in a sample of women living in Sicily (southern Italy).
METHODS: A cross-sectional survey was conducted on a sample of 220 women at the "Paolo Giaccone" University Hospital in Palermo (Sicily), aged 18-61. Data were analyzed through Cronbach's alpha and exploratory factor analysis, followed by a structural equation model with measurement component. The two-level data structure was explicitly considered.
RESULTS: Three dimensions were found: "knowledge of HPV infection (kHPV), "Attitude to be vaccinated against HPV (aHPV)" and "Knowledge about vaccines (KV)" (97% overall explained variance). Internal consistency was good for the whole questionnaire (0.82) and the first dimension (0.88) and acceptable for the second (0.78) and the third dimension (0.73). 23% of women showed no or little knowledge of HPV and 44.3% of women had no or little knowledge about HPV induced lesions. DISCUSSION: The use of a validated questionnaire may serve as a useful measure to assess general knowledge about HPV and attitude towards vaccination against HPV in the primary prevention setting.

Introduction

Human Papilloma Virus (HPV) infection is the most frequent among sexually transmitted diseases in the world. Cervical cancer is closely related to virus action, which is the main cause of cervical intraepithelial neoplasia and invasive lesions (Fang, Zhang & Jin, 2014).

Three HPV vaccines are at the moment available in many countries throughout the world. The bivalent (Cervarix, GSK biologicals) HPV vaccine prevents infections with the high-risk (HR) HPV 16 and 18. These genotypes are responsible for approximately 70% of cervical cancer cases globally and are considered responsible for a significant number of cervical low- and high- grade squamous intraepithelial lesions (LSIL and HSIL, respectively) (Clifford, Rana & Franceschi, 2003). The quadrivalent HPV vaccine (Gardasil, Sanofi Pasteur MSD), in addition to HR 16 and 18, also targets the LR HPV 6 and 11 that are associated with 90% of anogenital warts in men and women (Braaten & Laufer, 2008). Both bivalent and tetravalent vaccines have been shown to be effective and immunogenically valid in trials conducted in recent years with efficacy tests up to 55 years, especially in those who are virus-naïve (Harper & DeMars, 2017). Finally, the enavalent HPV vaccine (Merk, Sanofi Pasteur MSD, 9vHPV, trade name Gardasil9), in addition to the four genotypes of the quadrivalent vaccine, also targets five additional HR genotypes, namely HPV 31/33/45/52/58, which are the most frequently detected types in invasive cervical cancer worldwide, after HPV 16 and HPV 18 (Capra et al., 2017). Vaccination can be administered to people who did not have any contact with the genotypes that are covered; for this reason, it is preferable to get vaccinated in adolescence, before sexual activity begins and before any potential exposure to virus (Loke et al., 2017).

A cross-sectional study showed a prevalence of HR HPV infections of 24% in a group of young Sicilian women (18–24) (Ammatuna et al., 2008). According to the official statistics about the HPV vaccine coverage (year 2015), in Sicily the percentage of young women (fully) vaccinated against HPV is 44.10% compared to the national average rate of 62.15% (Ministero della Salute, 2015). In a female population living in Sicily, it has been shown that the switch to the enavalent vaccine would increase the prevention of cervical HSIL in up to 90% of cases (Capra et al., 2017).

Awareness of the risks associated to HPV infection is extremely important. In a large systematic review, Hendry et al. (2013) showed that misperception of risk could prevent from accepting vaccination; moreover, the correct knowledge of virus epidemiology can lead to adopt behaviors, as an example the use of condoms, to minimize the risk of infection. Most of the surveys conducted until now about HPV awareness and attitude to specific vaccination have involved young people  (Sopracordevole et al., 2012; Pelucchi et al., 2010). In 2008 an Italian Survey among women 14–24 showed the need to strengthen HPV knowledge, since only 23.3% of interviewed have heard about HPV and cervical cancer (Di Giuseppe et al., 2008). Knowledge about HPV infection has been shown to be poor among the public, students, patients and health professionals (Klug, Hukelmann & Blettner, 2008; Santangelo, Provenzano & Firenze, 2018) and, more recently, among European adolescents  (Patel et al., 2016). Furthermore, according to other studies, vaccination in women over 25 years, together with a screening program, offers the opportunity to reduce the incidence of cervical cancer in countries with limited resources and high disease burden. In 2017, results from a large survey in Italy showed that 73.8% of interviewed people were conscious about the availability of HPV vaccine, but had no trust in vaccines and believed that a PAP test is enough for prevention were expressed by 14.0% and 14.3% of women respectively (Censis, 2018).

The aim of this study was to assess knowledge of HPV and attitude to HPV-vaccination in a sample of Sicilian adult women and to demonstrate reliability and validity of the questionnaire used. The choice of an adult target population for this study relates to the importance of disseminating the culture of vaccination, just increasing parental awareness and attitude. The VaccinaTion & Hpv Knowledge (THinK) questionnaire was developed to be used in the first approach to the patient both in hospital and in outpatient service.

Materials & Methods

Participants

A cross-sectional survey was conducted at the “Paolo Giaccone” University Hospital in Palermo (Sicily) from April to December 2017. The study included 220 women, aged 18-61, consecutively enrolled from the Unit of Gynecology and Obstetrics (Ob/Gyn) (136 women) and from the University ambulatory clinic (UAC) (84 women). The Ob/Gyn is an outpatient service for women of all age groups while the UAC supplies free healthcare services to students and fresh graduates. Women apply to the Ob/Gyn either as they complain about some acute or chronic disorders or as they ask for a complete gynecological check-up. Alternatively, women apply to the UAC in order to receive information on contraception, sexually transmitted diseases (STD) and/or gynecological screening visits. Women already vaccinated against HPV were excluded from the study.

The vaccinaTion & Hpv Knowledge (THinK) questionnaire

Enrolled women were given advices about the aim of the study. This study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures were approved by the Research Ethics Committee at “Paolo Giaccone” University Hospital (Reference number 8/09/2018). Verbal informed consent was obtained from all participants. The THinK questionnaire included 16 items (Fig. 1), using a 5-level Likert scale (yes, much, somewhat, little, no). Questions concerned general knowledge about vaccination (acceptance, administration, effectiveness), HPV and related risks and acceptability of vaccine. The age, birthplace and education of each respondent were requested too. The draft of the THinK questionnaire was reviewed by five experts within “Paolo Giaccone” University Hospital to check its completeness and its suitability to be used in the first approach to the patient both in hospital and in outpatient service. Recommendations for improvement were also sought.

Figure 1

The 16-items THinK questionnaire.

Statistical methods

Descriptive statistics were calculated for participants’ general characteristics.

As a first step, an exploratory factor analysis (EFA) was carried out to describe the joint variability of the dimensions of the THinK questionnaire. Factors were rotated using the varimax approach to ease interpretation. Internal consistency was assessed for each dimension using the Cronbach’s alpha coefficient. Higher values indicate that scores on the considered dimension are internally consistent. Internal consistency is considered poor if the alpha value is below 0.60, questionable if between 0.60 and 0.70, acceptable between 0.70 and 0.80, good between 0.80 and 0.90 and excellent if not less than 0.90 (Bland & Altman, 1997). The sample size for this study was calculated according to the rule required in internal validity studies, which uses the ratio of the number of subjects (N) to the number of items (p) (Rouquette & Falissard, 2011).

As a second step, a structural equation model with measurement component was estimated to confirm the factor structure obtained through EFA. It was assumed a generalized linear model for ordinal response and link logit. As a final step, in order to take into account that participants are nested within two groups Ob/Gyn and UAC, a two-levels measurement model was considered. The LR test, AIC and BIC were used for comparison between the one-level and two-levels SEM models. The Student’s t-test was used to assess statistical significance of the difference between two women’s groups with respect to questionnaire’s items and dimensions. A p-value <0.05 was chosen for statistical significance. Statistical analysis was conducted using Stata SE/14.2.

Results

All five experts concurred that the measures should effectively capture any changes in the knowledge about HPV and attitude to vaccination and HPV vaccines, with concern to the first approach to the patient both in hospital and in outpatient service.

Women enrolled at UAC were on average younger (23.1 ± 2.45) and more educated (100% high school and more) than women enrolled at Ob/Gyn (35.5 ± 9.89 years old and 63% high school and more) (Table 1).

Table 1

Descriptive statistics of 220 Sicilian women by recruitment group.

Variables	Ob/Gyn Department (N = 136)	University outpatient service (N = 84)	p-valuea
Age (Mean ± SD)	35.50 ± 9.89	23.12 ± 2.45	<0.001
Education (n,%)			<0.001
No, primary	1 (0.8)	0 (0.0)
Low Middle School	49 (36.6)	0 (0.0)
High Middle School	49 (36.6)	70 (83.3)
Graduate	35 (26.0)	14 (16.7)
Citizenship (n,%)			<0.001
Italian	131 (96.3)	80 (95.2)	0.830
European	2 (1.5)	3 (3.6)
Extra-European	2 (1.5)	1 (1.2)
n.a.	1 (0.7)	–
Living place (n,%)
Italy	134 (98.6)	81 (96.4)	0.213
Europe	1 (0.7)	3 (3.6)
Extra-Europe	–	–
n.a.	1 (0.7)	–

Notes.

Student’s t-test for quantitative variables, Chi2 or Fisher’s exact test for categorical variables

Three dimensions were found trough EFA: “knowledge of HPV infection (kHPV)” (48% explained variance), correlated with items between Q9 and Q13, “Attitude to get vaccinated against HPV (aHPV)” (26%), correlated with items Q14-Q15-Q16, and “Knowledge about vaccines (KV)” (23%), correlated with items from Q1 to Q5. Three items (Q6-Q7, Q8) resulted with high uniqueness (≥0.80). Internal consistency was good for the whole questionnaire (0.82) and the first dimension (0.88) and acceptable for the second (0.78) and the third dimension (0.73) (Table 2).

Table 2

Internal consistency of the THinK questionnaire.

	Cronbach’s alpha
Whole questionnaire	0.816
kHPV	0.882
aHPV	0.784
KV	0.732

Results of the 1-level measurement SEM model confirmed the three factors structure of the THinK questionnaire (Fig. 2). By including the group’s level information (Fig. 3), the model fit was improved (p = 0.0223).

Figure 2

Construct validity of the THinK Questionnaire in a sample of Sicilian adult women: paths obtained from 1-level measurement SEM model.

kHPV, “knowledge of THinK infection”, KV, “Knowledge about vaccines”, aHPV, “Attitude to get vaccinated against HPV”, Q1-Q16, Questionnaire’s items.

Figure 3

Construct validity of the THinK Questionnaire in a sample of Sicilian adult women: paths obtained from two-levels measurement SEM model.

kHPV, “knowledge of HPV infection”, KV, “Knowledge about vaccines”, aHPV, “Attitude to get vaccinated against HPV”, Q1-Q16, Questionnaire’s items.

Notably, 23.1% of responders showed poor knowledge of HPV and 16.7% had never heard of it (Q12); For what concerns specific immunization, 21.8% of patients (Q14) responded that they are very little or not at all available to carry out vaccination. Poor knowledge of HPV induced lesions was expressed by almost half of the women interviewed (44.3% of women answered no or little at Q11), without any correlation with age or education. About the 19% of women expressed a clear refusal just to receive even simple information about HPV vaccination (Q16) (data not shown in tables).

On average, women enrolled at the UAC reported scores significantly higher compared to women enrolled at Ob/Gyn for Q3 (2.49 ± 1.41 vs 1.95 ± 1.12), Q14 (2.60 ± 1.70 vs 2.14 ± 1.20), Q15 (2.96 ± 1.79 vs 2.44 ± 1.28) and aHPV (0.17 ± 1.27 vs -0.28 ± 0.93). Conversely, their score was significantly lower for Q6 (2.96 ± 1.41 vs 3.57 ± 1.14) and Q7 (3.15 ± 1.15 vs 3.68 ± 1.14) (Table 3).

Table 3

Knowledge and attitude of 220 Italian women by group: Mean (SD) of responses to THinK questionnaire’s items and dimensions.

Questionnaire’s items	Ob/Gyn Department (N = 136)	University outpatient service (N = 84)	p-value
Q1	1.74 (1.01)	1.75 (0.99)	0.9310
Q2	1.55 (0.95)	1.83 (1.15)	0.0589
Q3	1.95 (1.12)	2.49 (1.41)	0.0019
Q4	2.92 (1.21)	2.91 (1.23)	0.9770
Q5	2.58 (1.25)	2.24 (1.37)	0.0662
Q6	3.57 (1.14)	2.96 (1.41)	0.0066
Q7	3.68 (1.14)	3.15 (1.15)	0.0029
Q8	3.58 (1.30)	3.93 (1.44)	0.0705
Q9	2.63 (1.32)	2.75 (1.47)	0.5195
Q10	2.30 (1.06)	2.50 (1.61)	0.2619
Q11	3.06 (1.43)	3.09 (1.59)	0.8929
Q12	2.58 (1.42)	2.99 (1.64)	0.0597
Q13	2.63 (1.07)	2.75 (1.51)	0.4966
Q14	2.14 (1.20)	2.60 (1.70)	0.0198
Q15	2.44 (1.28)	2.96 (1.79)	0.0138
Q16	2.14 (1.24)	2.38 (1.70)	0.2304
Dimensions
kHPV	−0.01 (0.98)	0.00 (1.16)	0.9412
KV	−0.06 (1.24)	0.04 (1.19)	0.5699
aHPV	−0.28 (0.93)	0.17 (1.27)	0.0026

Notes.

Bold values denote statistical significance at the p < 0.05 level.

Discussion

The aim of our study was to perform a reliability and validity study of the proposed THinK questionnaire as well as to assess knowledge of HPV and attitude towards HPV-vaccination in a sample of women living in Palermo.

The THinK questionnaire was found to measure three domains, which we named knowledge of HPV infection, attitude to be vaccinated against HPV and knowledge about vaccines, and it demonstrated adequate internal consistency as a whole and for each one of its three domains. We developed a short and succinct questionnaire with only 16 items in order to get it easier to be used in the first approach to the patient both in hospital and in outpatient service. There are many studies employing questionnaires about HPV issues, but just few use validated questionnaires, and their validity results are in line with those found for the THinK questionnaire. The HAVIQ questionnaire (Forster et al., 2017), which was designed to evaluate the efficacy of an intervention to affect HPV vaccination knowledge, obtained Cronbach’s alpha >0.6 for three of its four dimensions. The 25-item HPV general knowledge and 11-item HPV vaccination scale, validated on a national sample of Canadian parents of boys, showed internal consistency >0.70 (Perez et al., 2016). Two questionnaires to measure HPV knowledge on an international sample of adults showed Cronbach’s alpha >0.83 (Waller et al., 2013). Similar reliability was demonstrated for other instruments validated on undergraduates from Pakistan (Cronbach’s alpha (0.79)) (Khan et al., 2016) and on adolescents from Greece (Anagnostou, Aletras & Niakas, 2017).

The context proposed in our analysis concerns adult females living in Palermo. Rationale for choosing this target was to have indications about women that are yet (or not yet) mothers of girls and boys in vaccination age. Parents’ attitude about immunization is extremely important to vaccination of younger girl (La Torre et al., 2015); disagreement of parents has been the main reason for non-adherence to vaccination of girls aged 11–12 in an Italian Cross sectional study (Gualano et al., 2016).

When analyzing results of our paper, it is necessary to keep in mind that two groups involved in the survey are representative of two different populations. In fact, participants from Ob/Gyn are adult women referred for therapeutic purposes while those from the UAC are students or fresh graduates mostly referred for prevention and contraceptive prescription. Results from the 2-levels measurement SEM model showed that the group information explains a significant share of the total variability of the responses. This finding strengthens the importance of validating the questionnaire to measure HPV knowledge in specific populations.

One important finding of our study is that more than one in three of women were not conscious about HPV prevention and one in five would be only a little or not willing to be vaccinated against HPV. The roots of these disappointing results can be explained by a general poor knowledge of HPV (Hendry et al., 2013; Sopracordevole et al., 2012; Pelucchi et al., 2010; Di Giuseppe et al., 2008), lack of information on HPV vaccination given by health professionals to young women (La Torre et al., 2013) and widespread ignorance about HPV-specific lesions (Capogrosso et al., 2015), which has also been reported for the Italian general practitioners (GPs) (Signorelli et al., 2014). It has already been suggested that lack of information could represent an important barrier to vaccine acceptation (Loke et al., 2017); a cross-sectional pilot study showed higher vaccine-related knowledge in women vaccinated than in non-immunized  (Mathur, Mathur & Reichling, 2010).

Our results are consistent with Censis data, which show that judgment on available information on HPV and vaccinations is not positive, in terms of clarity and quantity (Censis, 2018).

By evaluating answers to the last question, it is possible to hypothesize a strong cultural resistance to vaccination and let us to reflect that a rooted resistance to immunization could play an important role in the HPV vaccine hesitancy (Guzzetta et al., 2014). Comparison between response to our questions Q3 and Q4 appears interesting, with 18.6% of respondents declaring that they were little or not at all favorable to vaccination in adulthood and only 8.6% being little or nothing convinced of vaccination in pediatric age. The found resistance to vaccination in adulthood, compared to the consolidated acceptance of vaccination in pediatric age, should help to explain the scarce attitude to be vaccinated against HPV in the Ob/Gyn group. Barriers to vaccination in adulthood have been long discussed by several authors and one of the most frequent reasons for failure to immunize is a lack of communication or bad information (Johnson, Nichol & Lipczynski, 2008).

Different authors showed the impact of socioeconomic variables on HPV awareness and vaccination: a few reported positive relationship between school education and mother’s school level, HPV knowledge and vaccination (Grandahl et al., 2017), between age and HPV awareness (Samkange-Zeeb, Mikolajczyk & Zeeb, 2013) and between education and the intention to be vaccinated against HPV (Alberts et al., 2017). Concerning the association with education, findings of our study do not allow to draw definitive conclusions, as it is not possible to distinguish if the major attitude of women enrolled at UAC depends on either the younger age or the higher education of this group compared to Ob/Gyn.

Through this study, we have provided initial evidence for validation of the THinK questionnaire. There are some margins for improvement of the instrument, as deleting those items resulted with high uniqueness or including additional items to get it more HPV-specific, e.g., concerning sexual behaviors (age at first sexual relationship, number of life partners, partner HPV status), knowledge about HPV induced lesions, smoking cigarettes, alcohol consumption, use of hormonal contraceptives or IUD, personal hygiene, prior infections of the cervico-vaginal tract, parity, HSV. Finally, more research is desirable to examine other aspects as concurrent validity and test-retest reliability with larger sample sizes.

Conclusions

The THinK questionnaire demonstrated adequate reliability and validity in a sample of Italian women living in Palermo. This instrument, short and easy to complete and to score, may serve as a useful measure in the primary healthcare setting in order to assess general knowledge about vaccination and HPV vaccines. Even if, in agreement with the guidelines of the Italian Ministry of Health, HPV vaccination is offered free of charge to girls in the twelfth year of life in all Italian regions since 2007/2008, efforts must be made to create a sound basis for understanding HPV issues and related risks, with a view to preventing and protecting patients.

Click here for additional data file.