3,819
Views
27
CrossRef citations to date
0
Altmetric
Research Paper

Determinants of vaccine hesitancy and effectiveness of vaccination counseling interventions among a sample of the general population in Palermo, Italy

ORCID Icon, , , , , , ORCID Icon, ORCID Icon, , , ORCID Icon, & ORCID Icon show all
Pages 2415-2421 | Received 06 Dec 2019, Accepted 03 Feb 2020, Published online: 18 Mar 2020

ABSTRACT

Counteract vaccine hesitancy is a public health priority. Main objectives of the cross-sectional study conducted were to evaluate knowledge, attitudes, and behaviors regarding vaccination issues, to estimate the prevalence of vaccine hesitancy and to estimate the effectiveness of vaccination counseling on community advocacy in a sample of general population. An anonymous validated questionnaire was administered in April 2017 at the main shopping center of Palermo and was followed by tailored vaccination counseling interventions. To estimate the effectiveness of the interventions four main connection parameters to the vaccinarsi.org website were evaluated, in the two months before and after the intervention and in the two months before the intervention compared with the same period of previous and following years. Among the 299 subject enrolled 12.7% were hesitant about vaccinations, and 4.7% declared being against vaccinations. General practitioners (GPs) and pediatricians were the most affordable source of information about vaccinations. A higher probability of vaccination hesitancy/refusal was reported among subjects who considered “alternative strategies” the best way for the prevention of infectious diseases (adj-OR = 7.01, IC95% 2.88–17.09, p-value < 0.001). A considerable increase of all the vaccinarsi.org website indicators analyzed was observed, from the area in which survey participants lived. Prevalence of vaccine hesitancy among population surveyed is consistent with the literature data. HCWs, such as GPs and pediatricians, should play a key role in modifying personal convictions and choices about vaccinations. A proper vaccination counseling could improve attitudes regarding vaccination issues, such as quality of web-based research.

Introduction

Vaccination counseling is widely recognized by health authorities and the medical community as a major tool for counteracting vaccination hesitancy and for increasing health advocacy among the general population.Citation1

Also a proper counseling programme is essential in changing people’s perceptions, knowledge and concerns about vaccination.Citation2

Recently, the increasingly widespread use of the Internet among the general population to collect information regarding health and medical treatment has led to the circulation of fake news and many anecdotal documents on the effectiveness and safety of vaccines.Citation3

As a consequence, the recent decline in vaccination coverage in Italy can be associated with the dissemination of incorrect information in the mass media and social media.Citation4,Citation5

Several studies showed that parents frequently acquire information on vaccination through the mass media and social media, focusing on potential collateral effects and adverse reactions.Citation6,Citation7

Around 15% of the general population of 13 Countries representative of all six World Health Organization (WHO) Regions was recently estimated as being hesitant about vaccinations, representing a priority target for tailored counseling intervention for the public health authorities.Citation8 Additionally, healthcare workers (HCWs) play an important role in motivating and empowering patients and the general population about vaccination themes.Citation9

Nevertheless, the HCWs themselves often exhibit a lack of confidence in vaccination strategies, such as influenza vaccination campaigns, and a lack of knowledge in providing proper counseling to the general population.Citation10-12

The main objectives of the study were to evaluate knowledge, attitudes, and behaviors regarding vaccination issues and to estimate the prevalence of vaccine hesitancy in a sample of the general population in the Province of Palermo. Moreover, to estimate the effectiveness of the vaccination counseling intervention, the number of visits to vaccinarsi.org, their duration, and the number of new website visitors are evaluated in the two months before and after the interventions.

Material and methods

A cross-sectional study was carried out in April 2017 at the Forum Palermo shopping center in Palermo by a team of nurses, public health medical residents, and public health doctoral students from the Hygiene and Preventive Medicine School of the University of Palermo, Italy.

All the team members were previously trained to limit the interviewer bias and the heterogeneity of data collection.

Palermo is the fifth most populous Italian province, with a population of 1,260,293 inhabitants.

Questionnaire

An anonymous and previously validated questionnaire was administered to subjects who were randomly sampled among the people at the Forum Palermo shopping center on two different Saturdays (from 9:00 a.m. to 2:00 p.m.).Citation6

Forum Palermo is the main shopping center in the city of Palermo and the most crowded, with approximately 20,000 daily visitors. The mall’s management estimates 6,000 people visit the shopping center on Saturday mornings.

To evaluate the representativeness of the sample, the basic numerousness of the sample to enlist (with a confidence interval of 95% and a desired precision of 5%) was previously calculated, corresponding to 196.

The participants were initially provided information that explained the goals of the study and the processing of personal data according to Italian privacy laws, as well as an informed consent form. If an individual agreed to participate and signed the informed consent form, the questionnaire was administered before the vaccination counseling intervention.

The questionnaire consists of 22 items, divided into four sections, as follows:Citation6

  • Demographic information and educational level, including gender, age, work activities, marital status, and parental status;

  • Attitudes toward vaccinations included in the Sicilian immunization schedule both for infant and adult, where a positive attitude involved total acceptance of the vaccination offered, a hesitant attitude involved partial acceptance of the vaccination offered or a delay in its administration on the immunization schedule, and a negative attitude involved refusal of the vaccination included in the schedule;

  • Knowledge and perceptions regarding vaccination and vaccine-preventable diseases;Citation6

  • Information sources on vaccination and the main vaccination-themed websites consulted and considered reliable.

Tailored counseling, in case of any doubt regarding the Sicilian vaccination schedule, vaccine-preventable diseases and related vaccines, and possible or suspected adverse reactions to vaccinations, was provided face to face by healthcare professionals and members of the study group. The mean duration spent for the individual counseling was around 15 minutes.

In addition, the participants all received informative flyers, shopper bags, balloons, and a copy of the Sicilian immunization schedule referring to VaccinarSì’s website, vaccinarsi.org.

The study was approved by the Palermo Ethical Committee 1 (session no. 12, December 2016).

Analysis of vaccinarsi.org visits

To estimate the effectiveness of the intervention strategy, visits to vaccinarsi.org were matched with a georeferenced analysis by Google Analytics.

The website was created by members of the Italian Society of Hygiene, Preventive Medicine and Public Health to inform and educate the general population and the healthcare community about vaccinations and to oppose the anti–vaccination movement’s spread on the Internet.Citation13

Social network accounts (e.g., on Facebook, Instagram, and Twitter), launched between 2013 and 2014, are also associated with VaccinarSì’s main web portal (vaccinarsi.org).

VaccinarSì’s website is organized into five main sections (vaccine-preventable diseases, registered vaccines, benefits and risks of vaccinations, the prevention of vaccine misinformation, travel immunization).

Its contents are validated by a scientific committee that includes more than 20 Italian and international experts on immunization from academia and Italian National Health Services.

Internet traffic from Palermo and Sicily (all the Sicilian cities in which survey participants lived were included in the analysis) to the VaccinarSì website was evaluated.

Four main indicators were taken into account:

  • The number of unique visits to vaccinarsi.org,

  • The number of new visitors,

  • The number of pages viewed in each visit,

  • The duration of each visit.

These parameters were all compared between the two months before the first counseling activity (from 8 February to the 7 April 2017) and the two months afterward (from 8 April to the 7 June 2017).

Moreover, average number of new unique visits to vaccinarsi.org in the two months after the interventions conducted (from 8th April 2017 to 7th June 2017) was compared with the same period of the two previous (2015, 2016) and following (2018, 2019) years.

Statistical analysis

Absolute and relative frequencies were calculated for the categorical (qualitative) variables, and quantitative variables were summarized by their means (standard deviations). The differences in the categorical variables for hesitancy or refusal and between before and after the intervention were analyzed using chi-squared tests (Mantel–Haenszel) and the Student test for the means.

All the variables found to have a statistically significant association with vaccination hesitancy/refusal in the univariate analysis were included in a multivariate backward stepwise logistic regression model.

All variables with a p-value ≤ 0.20 were selected in the multivariate model, to guarantee a more conservative approach.

The crude odds ratio (crude OR) and the adjusted OR (adj-OR) with 95% confidence intervals (CIs) were also calculated in the logistic regression model. The level of significance chosen for the multivariate logistic regression analysis was 0.05 (two tailed).

We entered all the information into a database created with EpiInfo 3.5.4 (Centers for Disease Control and Prevention, Atlanta, USA). All the data were analyzed using the statistical software package Stata/MP 12.1 (StataCorp LP, College Station, TX, USA).

Results

Questionnaire analysis

summarizes the sociodemographic and occupational characteristics of the surveyed population. A total of 299 adults (63.2% women) answered the questionnaire.

Table 1. Socio-demographic and occupational characteristics of the surveyed population (n = 299)

The mean age was 40 years (standard deviation ±14.2 years). In 77.6% of cases, the education level was a high school degree, and only 14.4% of the surveyed sample worked in the health sector.

The majority of the sample participants (n = 235) were parents (78.6%).

shows the attitudes of the surveyed population toward vaccinations. A total of 82.6% of participants in the sample (n = 247) had a positive attitude about vaccinations, denoting a willingness to receive vaccinations in the future, 12.7% (n = 38) were hesitant about vaccinations, and 4.7% (n = 14) declared being against vaccinations.

Table 2. Attitudes and sources of information about vaccination of the surveyed population and their confidence on the Public Health authorities recommendation (n = 299)

At the same time, 83.8% of the subjects stated they would vaccinate their own children in the future according to the regional immunization schedule.

On the other hand, 9.9% of the parents interviewed said they would vaccinate their own children only with mandatory vaccinations, and 6.3% stated they would refuse future vaccinations for their children. also presents the main sources of information on vaccinations and general perceptions about and trust in healthcare professionals.

General practitioners (GPs) and pediatricians were the main source of information in 81.3% of cases, followed by vaccination center workers (16.1%).

Official websites (15.1%), the mass media, and nongovernmental websites (24%) represented alternative sources of information about vaccinations. The questionnaire also asked which websites were consulted the most on vaccination issues and which were considered more reliable.

The most consulted websites on vaccination themes were institutional websites (50%), followed by focus.it (27.4%, a website with evidence based contents), and vaccinarsi.org (18.5%).

The most reliable websites were the institutional ones (55.8%), followed by vaccinarsi.org (21.9%) and focus.it (19.6%). Anti–vaccination websites seemed to have little visibility among the general population (4.1%) and were considered unreliable (2.7%).

Finally, 87.2% of the participants in the sample trusted the information provided by HCWs more than the information reported on the web (12.8%). However, 44.2% of the interviewees thought that the HCWs failed to mention some vaccine-related adverse effects during counseling.

shows the results of the univariate/multivariate analysis. A higher probability of vaccination hesitancy/refusal was reported among subjects who considered the mass media, the Internet, and friends or relatives the most reliable source of information (crude OR = 2.09, IC95% 1.01–4.41, p-value = 0.05), among subjects who had no confidence in HCWs regarding vaccination topics (crude OR = 2.18, IC95% 1.02–4.75, p-value = 0.05), and, finally, among subjects who considered hygiene, physical activity, or homeopathy, instead of vaccinations, the best strategies for the prevention of infectious diseases (crude OR = 7.39, IC95% 3.32–16.44, p-value < 0.001), a number that was also significant in the multivariate analysis (adj-OR = 7.01, IC95% 2.88–17.09, p-value < 0.001).

Table 3. Univariate (crude OR) and Multivariate (adj-OR)* analysis between vaccination hesitancy or refusal (vs vaccination confidence) with different categorical variables considered in the study. (* multivariate analysis was performed only for variables with p ≤ .0.20 at the univariate).

Analysis of connection data to vaccinarsi.org website

compares the number of visits to vaccinarsi.org between the two months before and the two months after the intervention. A 12% increase was noted in the number of new unique visits to vaccinarsi.org (+383, p-value < 0.01). A 10.5% increase (+274, p-value < 0.01) in the number of new website visitors was reported ().

Figure 1. Comparison of new unique visits, new website visitors (a), average webpages views in a single session and average duration of the website vaccinarsi.org visits in minutes (b), in the two months before (from 8th February 2017 to 7th April 2017) and after (from 8th April 2017 to 7th June 2017) vaccination counseling conducted at the principal shopping center of Palermo. (data limited to all the Sicilian cities in which survey participants lived)

Figure 1. Comparison of new unique visits, new website visitors (a), average webpages views in a single session and average duration of the website vaccinarsi.org visits in minutes (b), in the two months before (from 8th February 2017 to 7th April 2017) and after (from 8th April 2017 to 7th June 2017) vaccination counseling conducted at the principal shopping center of Palermo. (data limited to all the Sicilian cities in which survey participants lived)

Moreover, a significant increase in the average number of page views at vaccinarsi.org in a single session was reported (+0.56 pages per session, +28.6%, p-value < 0.05), and a concomitant increase (+21 seconds, +14.2%, p-value < 0.05) in the average duration of the website visits was observed ().

A comparison of the number of unique visits to vaccinarsi.org between the two months after the intervention and the same period of the two previous (2015, 2016) and following (2018, 2019) years was carried out. A constant increase of visits to vaccinarsi.org from April-June 2015 (n = 876) to the same period of 2019 (n = 2,568) is displayed in .

Figure 2. Average new unique visits to vaccinarsi.org in the two months after the interventions conducted (from 8th April 2017 to 7th June 2017), compared with the same period of the two previous (2015, 2016) and following (2018, 2019) years (data limited to all the Sicilian cities in which survey participants lived)

Figure 2. Average new unique visits to vaccinarsi.org in the two months after the interventions conducted (from 8th April 2017 to 7th June 2017), compared with the same period of the two previous (2015, 2016) and following (2018, 2019) years (data limited to all the Sicilian cities in which survey participants lived)

In particular, in the period April-June 2017 (after intervention counseling) a consistent and significant increase of the number of unique visits to vaccinarsi.org (n = 3,257) in comparison with two years before and after is reported, from all the Sicilian cities in which survey participants lived.

Discussion

Vaccine hesitancy refers to a delay in the acceptance of vaccines or their outright refusal, despite the availability of vaccination services. This phenomenon has recently become so vast and troubling that, in 2013, the World Health Organization (WHO) Strategic Advisory Group of Experts recommended an interview study with immunization managers in 13 countries to understand the main determinants of vaccine hesitancy worldwide.Citation8

Because of the dynamic and changing nature of vaccine hesitancy, the factors influencing the phenomenon, such as sociodemographic features, perceptions and personal experiences, attitudes, and knowledge, must be continuously monitored.Citation14-16

In our study, GPs and pediatricians were the most reliable and affordable sources of information about vaccination issues. Consequently, HCWs should improve knowledge about vaccine-preventable diseases and about vaccination counseling techniques with the general population and parents.Citation17,Citation18

Several studies conducted in Europe confirmed the key role of HCWs in modifying knowledge, personal convictions, and choices about vaccinations among the general population.Citation19-21

In the univariate analysis, a significant association with a positive attitude regarding vaccination was observed among subjects who trusted the vaccine information provided by the HCWs.

The general population’s perceptions about the risk of vaccinating themselves or their children are often conditioned more strongly by emotive, cognitive, and social factors than by scientific data, and personal experience usually plays a role in parents’ acceptance or refusal of vaccinations.Citation22 Moreover, widespread access to nongovernmental and unscientific websites and the mass media have created distrust among the population seeking information from alternative sources.

In the sample analyzed, 24% preferred consulting the mass media and the web about vaccination topics, as opposed to 15.1% of subjects who sought information from institutional websites. Generally, according to those surveyed, institutional websites were the most frequently consulted (50%) and were perceived as being the most reliable websites (55.8%).

Only 4.1% of the subjects consulted websites with a strong anti-scientific orientation (e.g. mednat.it or disinformazione.it), generating further disinformation and spreading false information such as the relation between measles, mumps and rubella (MMR) vaccines and autism or how alternative measures can be more effective than vaccinations in preventing infectious diseases.Citation23

Relatives and friends can also be a source of information about vaccinations that is often incorrect, leading to possible negative effects on vaccination knowledge and on the personal decision to properly vaccinate.Citation24 However, the survey results showed relatives and friends to be only a limited source of information (9.7%).

Subjects with a hesitant or reluctant attitude toward vaccination were those who considered the mass media, the Internet, and friends and relatives as their main sources of information on vaccination topics, as opposed to HCWs, or who considered hygiene, physical activity, or homeopathy, rather than vaccinations, the best strategies for infectious disease prevention.

Several studies previously showed that parents who are hesitant about vaccinations can differ in several sociodemographic characteristics related to education level and household income.

Parents who refuse vaccinations for their children frequently have low levels of trust in the government and healthcare professionals, and follow the recommendations of complementary or alternative medicine professionals, whom they consider to be reliable sources of vaccine information, similar to the observations in our population.Citation25,Citation26

The findings in this study can be useful in constructing a tailored strategy to manage vaccine-hesitant parents by establishing a positive dialogue, providing education targeting their concerns, maintaining a relationship with these families, and making every effort to follow the recommended immunization schedule.

According to WHO, a multipronged approach and dialogue-based intervention appear to be one of the most effective strategies to address vaccine hesitancy.Citation27

Major limitations, however, affect the present study. First, even though the sample reflects the same patterns of vaccination hesitancy/refusal as among the general population, a selection bias due to a lack a participation of those with negative attitudes toward vaccines should be taken into account.

Moreover, the shopping center, similarly to other Italian and European Cities, is far from the city center and near suburban neighborhoods of the town.

However, the possibility to reach the mall directly from city center with the tramway could limit the selection bias. Furthermore, the prevalence of vaccine hesitancy observed among our population is consistent with literature data, suggesting a good representativeness of the sample enrolled.Citation8

In addition, the time elapsed between the study and the results presentation could modify the estimation of the vaccination attitudes or acceptance (that was a self-reported item to ensure anonymity of participants), but this bias especially regards short-term preventive attitudes and acute diseases with rapid changes. Vaccine hesitancy is a relatively stable phenomenon, because it involves a long-lasting preventive concern that rarely changes over time and refers to vaccine-preventable diseases with both short and long clinical evolutions.Citation8

Finally, many other factors could contribute to the increase of the VaccinarSì’s website parameters analyzed in the study before and after the interventions conducted, such as the mass media/political level debate about the implementation of the Law 119/2017 that introduced ten mandatory vaccination for attending kindergarten.Citation28

However, the georeferenced increase in both unique visits and new visitors to vaccinarsi.org during the two months after the interventions, could equally suggest a positive impact of the vaccination counseling provided after the administration of the questionnaire.

Other experiences showed that it could be possible to change some convictions and attitudes toward vaccinations, properly interfacing with the general population through correct communication and web-based strategies.Citation6

A good starting point could be the proper channeling of requests for information about vaccinations on the Internet.Citation27,Citation29

The aim of counseling is not to suggest, persuade, or even direct but, overall, to encourage a better and more conscious vaccine awareness and greater acceptance. The necessity of accessing vaccine-hesitant subjects through a planned communicative strategy to eliminate their reluctance has already been underlined.Citation30

To promote a vaccination culture among the general population, also vaccination-related knowledge ant attitudes of HCWs must be improved.Citation31

As previously reported, HCWs usually play an important role in vaccination counseling, both for subjects with a positive attitude and for subjects with a hesitant/reluctant attitude toward vaccinations.Citation27

Only with tailored training in communicative vaccination strategies can the personal attitudes and counseling strategies of HCWs on vaccination topics be improved, making them public health opinion leaders who will provide the general population accurate information and lead to a community health advocacy about vaccination issues.

Disclosure of potential conflicts of interest

No potential conflicts of interest were disclosed.

References

  • Yaqub O, Castle-Clarke S, Sevdalis N, Chataway J. Attitudes to vaccination: a critical review. Soc Sci Med. 2014 Jul;112:1–11. doi:10.1016/j.socscimed.2014.04.018.
  • Esposito S, Principi N, Cornaglia G; ESCMID Vaccine Study Group (EVASG). Barriers to the vaccination of children and adolescents and possible solutions. Clin Microbiol Infec. 2014 May;20(Suppl 5):25–31. doi:10.1111/1469-0691.12447. PMID: 24354949.
  • Odone A, Signorelli C. When vaccine hesitancy makes headlines. Vaccine. 2017 Mar 1;35(9):1209–10. doi:10.1016/j.vaccine.2015.11.051. PMID: 26657186.
  • Hwang J, Shah DV. Health information sources, perceived vaccination benefits, and maintenance of childhood vaccination schedules. Health Commun. 2019 oct;34(11):1279–88. doi:10.1080/10410236.2018.1481707. PMID: 29869894.
  • Giambi C, Fabiani M, D’Ancona F, Ferrara L, Fiacchini D, Gallo T, Martinelli D, Pascucci MG, Prato R, Filia A, et al. Parental vaccine hesitancy in Italy - Results from a national survey. Vaccine. 2018 Feb 1;36(6):779–87. doi:10.1016/j.vaccine.2017.12.074. PMID: 29325822.
  • Tabacchi G, Costantino C, Cracchiolo M, Ferro A, Marchese V, Napoli G, Palmeri S, Raia D, Restivo V, Siddu A, et al. Information sources and knowledge on vaccination in a population from southern Italy: the ESCULAPIO project. Hum Vaccin Immunother. 2017 Feb;13(2):339–45. doi:10.1080/21645515.2017.1264733. PMID: 28032814.
  • Gowda C, Dempsey AF. The rise (and fall?) of parental vaccine hesitancy. Hum Vaccin Immunother. 2013 Aug;9(8):1755–62. doi:10.4161/hv.25085. PMID: 23744504.
  • Dubé E, Gagnon D, Nickels E, Jeram S, Schuster M. Mapping vaccine hesitancy–country-specific characteristics of a global phenomenon. Vaccine. 2014 Nov 20;32(49):6649–54. doi:10.1016/j.vaccine.2014.09.039. PMID: 25280436.
  • Kaufman J, Ryan R, Walsh L, Horey D, Leask J, Robinson P, Hill S. Face-to-face interventions for informing or educating parents about early childhood vaccination. Cochrane Database Syst Rev. 2018 May 8;5:CD010038. doi:10.1002/14651858.CD010038.pub3. PMID: 29736980.
  • Biasio LR, Corsello G, Costantino C, Fara GM, Giammanco G, Signorelli C, Vecchio D, Vitale F. Communication about vaccination: A shared responsibility. Hum Vaccin Immunother. 2016 Nov;12(11):2984–87. doi:10.1080/21645515.2016.1198456. PMID: 27458874.
  • McRee AL, Gilkey MB, Dempsey AF. HPV vaccine hesitancy: findings from a statewide survey of health care providers. J Pediatr Health Care. 2014 Nov-Dec;28(6):541–49. doi:10.1016/j.pedhc.2014.05.003. PMID: 25017939.
  • Di Gregori V, Franchino G, Marcantoni C, Simone B, Costantino C. Logistic regression of attitudes and coverage for influenza vaccination among Italian Public Health medical residents. J Prev Med Hyg. 2014 Dec;55(4):152–57. doi:10.15167/2421-4248/jpmh2014.55.4.456. PMID: 26137789.
  • Vaccinarsi.org website. [Accessed 2019 Dec 06]. https://www.vaccinarsi.org/
  • Domek GJ, O’Leary ST, Bull S, Bronsert M, Contreras-Roldan IL, Bolaños Ventura GA, Kempe A, Asturias EJ. Measuring vaccine hesitancy: field testing the WHO SAGE Working Group on Vaccine Hesitancy survey tool in Guatemala. Vaccine. 2018 Aug 23;36(35):5273–81. doi:10.1016/j.vaccine.2018.07.046. PMID: 30061026.
  • Palmeri S, Costantino C, D’Angelo C, Casuccio N, Ventura G, Vitale F, Pojero F, Casuccio A. HPV vaccine hesitancy among parents of female adolescents: a pre-post interventional study. Public Health. 2017 Sep;150:84–86. doi:10.1016/j.puhe.2017.05.009. PMID: 28646698.
  • Dubé E, Laberge C, Guay M, Bramadat P, Roy R, Bettinger J. Vaccine hesitancy: an overview. Hum Vaccin Immunother. 2013 Aug 9;8. 1763–73. DOI: 10.4161/hv.24657. PMID: 23584253.
  • Foss HS, Oldervoll A, Fretheim A, Glenton C, Lewin S. Communication around HPV vaccination for adolescents in low- and middle-income countries: a systematic scoping overview of systematic reviews. Syst Rev. 2019 Aug 1;8(1):190. doi:10.1186/s13643-019-1100-y. PMID: 31370886.
  • Marotta C, Raia DD, Ventura G, Casuccio N, Dieli F, D’Angelo C, Restivo V, Costantino C, Vitale F, Casuccio A. Improvement in vaccination knowledge among health students following an integrated extra curricular intervention, an explorative study in the University of Palermo. J Prev Med Hyg. 2017 Jun;58(2):E93–E98. doi:10.15167/2421-4248/jpmh2017.58.2.720. PMID: 28900348.
  • Badertscher N, Morell S, Rosemann T, Tandjung R. General practitioners’ experiences, attitudes, and opinions regarding the pneumococcal vaccination for adults: a qualitative study. Int J Gen Med. 2012;5:967–74. doi:10.2147/IJGM.S38472. PMID: 23204861.
  • Ames HM, Glenton C, Lewin S. Parents’ and informal caregivers’ views and experiences of communication about routine childhood vaccination: a synthesis of qualitative evidence. Cochrane Database Syst Rev. 2017 Feb 7;2:CD011787. doi:10.1002/14651858.CD011787.pub2. PMID: 28169420.
  • Prospero E, Galmozzi S, Paris V, Felici G, Barbadoro P, D’Alleva A, Zocco G, Ciavattini A. Factors influencing refusing of flu vaccination among pregnant women in Italy: healthcare workers’ role. Influenza Other Respir Viruses. 2019 Mar;13(2):201–07. doi:10.1111/irv.12600. PMID: 30099856.
  • Hobson-West P. ‘Trusting blindly can be the biggest risk of all’: organised resistance to childhood vaccination in the UK. Sociol Health Illn. 2007 Mar;29(2):198–215. doi:10.1111/j.1467-9566.2007.00544.x. PMID: 17381813.
  • DeStefano F, Shimabukuro TT. The MMR vaccine and autism. Annu Rev Virol. 2019 Apr 15. doi:10.1146/annurev-virology-092818-015515. PMID: 30986133.
  • Underwood NL, Gargano LM, Jacobs S, Seib K, Morfaw C, Murray D, Hughes JM, Sales JM. Influence of sources of information and parental attitudes on human papillomavirus vaccine uptake among adolescents. J Pediatr Adolesc Gynecol. 2016 Dec;29(6):617–22. doi:10.1016/j.jpag.2016.05.003. PMID: 27216710.
  • Smith PJ, Chu SY, Barker LE. Children who have received no vaccines: who are they and where do they live? Pediatrics. 2004 Jul;114(1):187–95. doi:10.1542/peds.114.1.187. PMID: 15231927.
  • Salmon DA, Moulton LH, Omer SB, DeHart MP, Stokley S, Halsey NA. Factors associated with refusal of childhood vaccines among parents of school-aged children: a case-control study. Arch Pediatr Adolesc Med. 2005 May;159(5):470–76. doi:10.1001/archpedi.159.5.470. PMID: 15867122.
  • Jarrett C, Wilson R, O’Leary M, Eckersberger E, Larson HJ, SAGE Working Group on Vaccine Hesitancy. Strategies for addressing vaccine hesitancy - A systematic review. Vaccine 2015 Aug 14;33(34):4180–90. doi:10.1016/j.vaccine.2015.04.040. PMID: 25896377.
  • Rezza G. Mandatory vaccination for infants and children: the Italian experience. Pathog Glob Health. 2019 Oct;113(7):291–96. doi:10.1080/20477724.2019.1705021. PMID: 31868571.
  • Arede M, Bravo-Araya M, Bouchard É, Singh Gill G, Plajer V, Shehraj A, Adam Shuaib Y. Combating vaccine hesitancy: teaching the next generation to navigate through the post truth era. Front Public Health. 2019 Jan 14;6:381. doi:10.3389/fpubh.2018.00381. PMID: 30693276.
  • MacDonald NE, Desai S, Gerstein B. Working with vaccine-hesitant parents: an update. Paediatr Child Health. 2018 Dec;23(8):561–62. doi:10.1093/pch/pxy144. PMID: 31043844. PMID: 31043844.
  • Costantino C, Restivo V, Gaglio V, Lanza GLM, Marotta C, Maida CM, Mazzucco W, Casuccio A, Torregrossa MV, Vitale F. Effectiveness of an educational intervention on seasonal influenza vaccination campaign adherence among healthcare workers of the Palermo University Hospital, Italy. Ann Ig. 2019 Jan–Feb;31(1):35–44. doi:10.7416/ai.2019.2256. PMID: 30554237.