12,202
Views
130
CrossRef citations to date
0
Altmetric
Research Paper

Effectiveness of interventions that apply new media to improve vaccine uptake and vaccine coverage

A systematic review

, , , , , & show all
Pages 72-82 | Received 05 Jun 2014, Accepted 11 Jun 2014, Published online: 01 Nov 2014

Abstract

Background

Vaccine-preventable diseases (VPD) are still a major cause of morbidity and mortality worldwide. In high and middle-income settings, immunization coverage is relatively high. However, in many countries coverage rates of routinely recommended vaccines are still below the targets established by international and national advisory committees. Progress in the field of communication technology might provide useful tools to enhance immunization strategies.

Objective

To systematically collect and summarize the available evidence on the effectiveness of interventions that apply new media to promote vaccination uptake and increase vaccination coverage.

Design

We conducted a systematic literature review. Studies published from January 1999 to September 2013 were identified by searching electronic resources (Pubmed, Embase), manual searches of references and expert consultation.

Study setting

We focused on interventions that targeted recommended vaccinations for children, adolescents and adults and: (1) aimed at increasing community demand for immunizations, or (2) were provider-based interventions. We limited the study setting to countries that are members of the Organisation for Economic Co-operation and Development (OECD).

Main outcome measures

The primary outcome was a measure of vaccination (vaccine uptake or vaccine coverage). Considered secondary outcomes included willingness to receive immunization, attitudes and perceptions toward vaccination, and perceived helpfulness of the intervention.

Results

Nineteen studies were included in the systematic review. The majority of the studies were conducted in the US (74%, n = 14); 68% (n = 13) of the studies were experimental, the rest having an observational study design. Eleven (58%) reported results on the primary outcome. Retrieved studies explored the role of: text messaging (n.7, 37%), smartphone applications (n.1, 5%), Youtube videos (n.1, 5%), Facebook (n.1, 5%), targeted websites and portals (n.4, 21%), software for physicians and health professionals (n.4, 21%), and email communication (n.1, 5%). There is some evidence that text messaging, accessing immunization campaign websites, using patient-held web-based portals and computerized reminders increase immunization coverage rates. Insufficient evidence is available on the use of social networks, email communication and smartphone applications.

Conclusion

Although there is great potential for improving vaccine uptake and vaccine coverage by implementing programs and interventions that apply new media, scant data are available and further rigorous research - including cost-effectiveness assessments - is needed.

Introduction

Vaccine-preventable diseases (VPD) still represent a major cause of morbidity and mortality worldwide. The World Health Organization (WHO) estimates that every year 1.5 million children die from VPD; this represents 17% of all deaths in children under five years of age.Citation1 As an example, pneumococcal disease accounts for nearly 15 million cases and 500 000 deaths per year in children, Hepatitis B accounts for 2 billion cases and 600 000 deaths,Citation2 this representing a large share of the global VPD burden. The burden of VPD impacts also on adolescents and adult populations with life-threatening diseases such as influenza, meningitis and infection-associated cancers.Citation3,Citation4

Immunization is one of the most successful and cost-effective primary prevention tools; it is estimated that, globally, immunizations prevent between 2 and 3 million deaths every year.Citation3 This holds true not only in low-income regionsCitation5 but also in high-income settings: in the United States, between 1888 and 2011, it is estimated that more than 100 million cases of infectious diseases have been prevented by vaccines.Citation6 In addition, recent data reported that vaccinating children results in substantial cost savings.Citation7

In high and middle-income settings vaccination coverage is relatively high.Citation8 However, in many countries coverage rates are still below the targets established by internationalCitation9 and national advisory committees,Citation7 particularly for specific vaccinations.Citation9 For example, in several countries including Austria, Indonesia, Denmark, the United Kingdom, and Italy measles vaccination coverage is far below the Organisation for Economic Co-operation and Development (OECD) countries’ average of 93.6%.Citation10 With regard to influenza vaccine in older populations, average coverage rate in OECD countries is less than 60%, this decreasing to 22% in Slovenia and the Czech Republic and to 1% in Estonia.Citation10

Suboptimum vaccination coverage in such settings results from a variety of challenges and obstacles acting on different subgroups of the population and including, among others, increasing migration flowsCitation5, the spread of the hesitancy in the general population of accepting vaccination for themselves and their children as well as among providers of vaccinating themselves and recommending vaccination for their patients.Citation11,Citation12

Increasing and maintaining vaccination coverage in children and adult populations is of fundamental importance to further decrease the burden of VPD and it has been identified as a public health priority.Citation9

In 1999 a comprehensive systematic review of the literature conducted by Briss et al. assessed the effectiveness of different interventions to improve vaccination coverage among children, adolescents, and adults.Citation13 The approach to the review was developed around a conceptual framework that stratified population-based interventions to improve vaccine coverage by the outcomes that they attempted to influence and divided them into four different categories: (1) interventions to increase community demand for immunizations; (2) interventions that enhance access to immunization services; (3) interventions that mandate immunizations; and (4) provider-based interventions.

Its findings have been used to formulate evidence-based recommendations provided by the US Department of Health and Human Services’ Guide to Community Preventive ServicesCitation23_ENREF_1 that have been recently updated_ENREF_2. Findings from the updated review can be found on the website: The Community Guide, http://www.thecommunityguide.org/vaccines/index.html.

Since then, in the last fifteen years, the field of information and communication technologies has flourished revolutionizing the processes of gathering, spreading and utilizing health information among healthcare providers, citizens and mass media.Citation14 As the number of subjects using the internet worldwide has increased by almost 570% in 2000–2012, reaching more than 2750 million users in 2013, new media have been proposed as effective tools to implement public health actions.Citation15 New media are means of mass communication, developed at the time of the web era and include, among others, smartphone and internet-based tools in opposition to “old” media such as television, radio, film, magazines, which are static representations of text and graphics without interactivity.Citation16 Patients can benefit from the use of new media through communication, education, information sharing, networking, receiving care and support, goal setting and tracking personal progress.Citation17 In line with that, , new media might offer potential to further improve immunization coverage, especially in middle and high-income countries. We are not aware of a systematic assessment that has yet been conducted or available in the literature on this topic. The aim of the current paper is to systematically collect, summarize and critically appraise the available evidence on the effectiveness of interventions that apply new media to promote vaccination uptake and increase vaccination coverage.

Methods

The review’s methods were defined in advance following the Prepared Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines.Citation18

Inclusion criteria

The term “new media” refers to on-demand access to content through digital devices, which provide the opportunity to participate and be actively involved, reply to other users and give feedback; new media are defined as manipulated, networkable and interactive.Citation16 Based on this definition, we included interventions that applied the following mobile phones and internet-based tools: text messaging, smartphone applications, email communications, social networks and portals such as Facebook and Twitter and Youtube, websites and blogs.

We considered vaccinations universally recommended for children, adolescents and adults in high-income settings as included in countries’ national immunization schedulesCitation19-Citation21: diphtheria, tetanus, pertussis, poliomyelitis, hepatitis B, measles, mumps, rubella, Haemophilus influenzae b (Hib), varicella, pneumococcal vaccine, meningococcal vaccine, papillomavirus (HPV), and seasonal influenza vaccine. This report does not address vaccines recommended for people with specific medical conditions (e.g., asthma), vaccines for international travellers or healthcare professionals.Citation22

Studies were included in the review if they met the following criteria: were conducted in countries that were members of the OECD; were original studies using an observational or experimental study design (guidelines, review, letters or editorials were excluded); were published in books or journals from January 1st 1999 to September 10th 2013; were written in English.

Outcome measures

The primary outcome of interest was a measure of vaccination: vaccine coverage or vaccine uptake.Citation13 Considered secondary outcomes included: willingness to get immunized/ to immunize children, immunizationtiming, access to healthcare for immunization-related issues, willingness to use/adopt the intervention/tool, perceived benefits and barriers of the intervention/tool, rate of utilization of the assessed intervention/tool, opinion on the helpfulness of the intervention, perceived risk associated with the vaccine, attitudes/knowledge towards immunizations and/or diseases. Secondary outcomes were retrieved if available and relevant.

Search strategy

We searched the electronic databases Medline and Embase for original studies. In addition, further studies were retrieved from reference listing of relevant articles and consultation with experts in the field.

The search strategy was built using a combination of keywords for the two main axes of the research question: (1) the selected interventions: the ones applying new media; and (2) the selected vaccinations: universally recommended vaccines for children, adolescents or adults. Within each axis we combined keywords with the “OR” operator and we then linked the search strategies for the two axes with the “AND” operator. The complete list of keywords used is presented in . The search was limited to the selected study setting: OECD countries. For the PubMed search, the use of free text terms was combined with Medical Subject Heading (MeSH) terms.

Table 1. Search strategy: keywords and limits

Study selection and data extraction

Identified studies were independently reviewed for eligibility by three authors (AF, FS, SV) in a two-step based process; a first screen was performed based on title and abstract while full texts were retrieved for the second screen. At both stages disagreements by reviewers were resolved by consensus.

Data were extracted by three authors (AF, FS, SV) supervised by a fourth author (AO) using a standardised data extraction spreadsheet. Data extraction was performed independently by two review authors. The data extraction spreadsheet was piloted on 10 randomly selected papers and modified accordingly. Data extraction included study characteristics such as: (1) authors’ name, year, country of publication, study design, study setting, study period and study population; (2) the vaccines considered; (3) information about the intervention being studied such as: type of intervention, type of new media applied, duration of the intervention; (4) information on follow-up time, analysis performed and outcomes of interest.

Analysis

We performed descriptive analysis to report the characteristics of the included studies.

Adhering to the same conceptual framework applied in the past by The Community Preventive Services Task Force, that stratified interventions by the outcomes that they attempt to influence,Citation23 we assessed whether new media were applied to enhance or make more efficient: (1) interventions to increase community demand for immunizations; and (2) provider-based interventions.

To summarize the findings on the effectiveness of an intervention across multiple studies, we displayed the results of individual studies in tables. For every intervention, when a control was available (either in a “before and after design” or where the outcomes were also assessed in a control group) we planned to apply random effects analyses to acquire pooled estimates of the average effect and to assess heterogeneity using the I2 statistic and visual inspection of forest plots.Citation24 Depending on data availability, we planned to conduct sub-group analyses (where relevant and possible) by vaccine, by study population and by age group. If unadjusted and adjusted outcomes were available, we recorded the adjusted estimates to reduce the risk of confounding.

Quality assessment

The same three authors who performed data extraction independently assessed the quality of selected studies using the methodological quality checklist developed by Downs and Black for both randomised and non-randomised studies of health care interventions.Citation25 Disagreements by reviewers were resolved by consensus. shows the quality assessment total score assigned to each study.

Table 2. Studies included in the systematic review

Results

Identified studies

We identified over 52 037 records by searching the selected databases and listing references of relevant articles. After removing duplicates, 37 634 abstracts were retrieved. Studies were screened and selected as illustrated in , resulting in 156 full text articles assessed for eligibility and 19 studies that were included in the systematic review.

Figure 1. Prisma flowchart.

Figure 1. Prisma flowchart.

Characteristics of included studies

The characteristics of the included studies are reported in . Included studies were published between 2004 and 2013; 84% (n = 16) were published after 2010. The majority of the studies were conducted in the United States (US) (74%, n = 14). Overall, 89% (n = 17) were conducted in English-speaking countries, including, apart from the US, Australia,Citation26 Canada,Citation27 and Ireland.Citation28 Two studies were conducted in Spain.Citation29,Citation30

Of the studies, 68% (n = 13) had an experimental study design, the rest were observational studies. In particular, we considered seven randomized controlled trials,Citation26,Citation31-Citation36 five non-randomized trials,Citation27,Citation30,Citation37-Citation39 three cross-sectional studies,Citation29,Citation40,Citation41 one case-control study,Citation42 and three studies that we considered to have an operational research approach.Citation37,Citation43,Citation44 Studies’ sample size ranged from 50 to 9213 subjects (median = 341). One paper described two different studies.Citation35

Five studies focused on childhood-recommended vaccines without listing specific vaccines.Citation31,Citation40-Citation42,Citation44 Nine studies considered influenza vaccine,Citation26,Citation27,Citation29,Citation30,Citation32,Citation33,Citation35,Citation36,Citation39 three considered HPV vaccine,Citation34,Citation35,Citation38 one considered Diphtheria-Tetanus-Pertussis (DTP) vaccine,Citation35 four pneumococcal vaccine,Citation32,Citation37,Citation39,Citation43 one Measles-Mumps-Rubella (MMR),Citation28 one meningococcal vaccine,Citation35 and one HibCitation35 in different combinations.

Target populations for immunization were children in seven (37%) studies,Citation31,Citation35,Citation36,Citation40-Citation42,Citation44 adolescents in two (10%),Citation35,Citation38 adults in seven (37%)Citation26-Citation30,Citation33,Citation34 and adults above 65 yeras of age in four (21%) papers.Citation32,Citation37,Citation39,Citation43 Studies on adult vaccinations included university students in the majority of cases (86%, n = 6)Citation26-Citation30,Citation34 and one study focused on pregnant women.Citation33

Eleven studies (58%) reported results on the primary outcome.Citation26,Citation31-Citation33,Citation35-Citation39,Citation42,Citation43 All randomized and non-randomized trials assessed the primary outcome. Twelve studies reported findings on secondary outcomes. Assessed secondary outcomes included: willingness to get immunized/ to immunize their children,Citation27,Citation30,Citation34 timeliness of immunization,Citation31,Citation33 access to healthcare,Citation26,Citation35 perceived risk associated with the vaccine,Citation34 attitudes/knowledge towards immunization and/or disease,Citation26,Citation27,Citation33,Citation34 willingness to use/adopt the intervention/tool,Citation29,Citation31,Citation33,Citation40 perceived benefits and barriers of the intervention/tool,Citation31,Citation40 rate of utilization of the assessed intervention/tool,Citation44 opinion on the helpfulness of the intervention.Citation28,Citation31,Citation33,Citation41,Citation44 Four papers reported qualitative data.Citation26,Citation28,Citation31,Citation40

Due to high degree of heterogeneity between studies no quantitative assessment could be performed.

New media applied to interventions to increase community demand for immunizations

Text messaging

Retrieved studies

Seven studies reported findings on the use of text messages to improve immunization rates.Citation31,Citation33,Citation35,Citation36,Citation38,Citation40,Citation41 Text messaging can be applied to the following interventions: patients remind/recallCitation31,Citation35,Citation36,Citation38,Citation40,Citation41 and multicomponent interventions including education.Citation33,Citation36

Retrieved studies were published between 2011 and 2013, all in the US. All studies were conducted in pediatric and community-based clinics in urban settings from 2009 to 2011.

Study populations

Study populations included parents of childrenCitation31,Citation35,Citation36,Citation40,Citation41 and adolescents,Citation35,Citation38 pregnant women,Citation33 providers and medical staff.Citation41 In two studies the predominant ethnicity was white,Citation31,Citation40 in others the percentage of latino ethnicity ranged from 42% to 85%.Citation35,Citation36,Citation41 In one study almost 70% of enrolled subjects were African American.Citation33 In studies where the data were reported the percentage of people with public insurance ranged from 58 to 90%.Citation31,Citation33,Citation35,Citation36,Citation38 Three studies targeted low socioeconomic status populations.Citation33,Citation35,Citation36

Data on health-related use

Sending or receiving health-related text messages is not yet common in routine public health practice.Citation40,Citation41 Few parents reported ever receiving text messages to schedule an appointment (5%) or as a reminder of an existing appointment (31%).Citation41

Interventions

In the included studies text messages were sent to parents and adolescents to remind pre-scheduled immunization visits,Citation31,Citation35,Citation38 to promote immunization in non-conformers adolescentsCitation35 and to promote influenza vaccine uptake prior and during the influenza season.Citation33,Citation36

Reminder text messages included one text message sent to parents of newborns one week before the immunizations due date (scheduled at 2, 4, and 6 month of age),Citation31 three weekly text messages sent to parents whose daughters were due to have the second or third dose of HPV vaccine,Citation38 12 weekly text messages encouraging pregnant women to get influenza vaccineCitation33 and up to three text messages sent two weeks before Hib immunization recall sessions.Citation35 Text messages targeting parents of immunization non-conformer adolescents were sent until vaccines were received up to 5 times.Citation35

In all described interventions text messages were computer generated; in some cases text messages were personalized and were written in patients’ preferred languageCitation35,Citation36,Citation38 and included patients’ name.Citation35 In one study they included educational messages targeted to patients’ age.Citation36

Outcomes

Five studies assessed the primary outcomeCitation31,Citation33,Citation35,Citation36,Citation38 and five assessed secondary outcomes.Citation31,Citation33,Citation35,Citation40,Citation41 Studies with data on the primary outcome included four randomized and one non-randomized trial; in all studies vaccination status was assessed through immunization registries at different time points.

By the age of seven months, a higher percentage of due immunizations were received by children whose parents got reminder text messages as compared to children whose parents did not; this holding true for every assessed time point (2, 4, and 6-month-of-age; per protocol analysis: 100%, 93% 79% vs. 90%, 85%, 78%, respectively).Citation31

On-time receipt of HPV vaccine was more frequent (51.6%) among girls whose parents signed up to receive the reminder text messages as compared with two control groups: an historical control group (38.1% p = 0.003) and parents who declined to receive the intervention (35%, p = 0.001). Similar results were reported when assessing receipt of HPV vaccine within 4 months of its due date.Citation38 Text messages sent to parents were proved to be effective to increase Hib and DTP vaccination intake in children at age 4 (P < 0.001), 12 (P = 0.005) and 24 weeks (p < 0.001) as well as to increase attendance to special immunization recall sessions as compared to standard mail reminder.Citation35

Compliance with meningococcal and/or DTP immunization requirements was higher in non-conformer adolescents whose parents were sent text messages at all time points from randomization (percentage-point difference: 11.2%, 12.8% and 18.3% at 4, 12, and 24 weeks, respectively), the difference being statistically significant. Similar findings were reported when assessing receipt of any vaccine.Citation35 Text messages sent with both educational and reminder purposes were associated with higher influenza vaccine uptake at the end and during the influenza season in a large study conducted on over 9000 children (RR = 1.09, 95% CI, 1.04–1.15 and RR = 1.19, 95% CI, 1.10–1.28)Citation36 but had no effect in a smaller study conducted on pregnant women during the same study period.Citation33

Studies assessing secondary outcomes reported that children whose parents received text message reminders were more likely to be immunized on time (although the difference was not statistically significant).Citation36

Most of interviewed study participants indicated strong support of using text messages to schedule or confirm a vaccine appointment, as a reminder of an existing appointment or return for missed vaccines and expressed willingness to sign up for a text messaging reminder system.Citation31,Citation40,Citation41 One study conducted in the US reported that English-speaking parents were more comfortable than Spanish-speaking ones with health-related text messaging (99% vs 91%, P = 0.05).Citation41

Perceived benefits of text messages reminder as emerged from qualitative data included: technology-related benefits such as interactivity,Citation41 ability to link to other systems/calendars and the speed with which information is available,Citation40 convenience-related benefits such as ease or timeliness of receiving reminders,Citation41 and easier communication.Citation41 Perceived barriers included technology-related issues such as lack of text capabilities, or not being technology-savvy; communication-related issues such as concerns regarding ability to understand text content, its limited characters, the use of abbreviations, or being provided inaccurate information. Some subjects worried about cell phone number accuracy and privacy, few worried about costs.Citation40,Citation41 With regard to suggestions to improve the interventions, parents expressed interest in incorporating many patient, provider, visit, and vaccine-related details in the text messages, stated that more than one message should be sent and that preferred time to receive text messages was the afternoon.Citation40 One study assessed providers’ opinion.Citation41

Internet-based interventions

Retrieved studies

Seven studies reported findings on the use of the internet-based interventions to improve immunization coverage.Citation26-Citation30,Citation34,Citation42 Internet is a potential useful tool to deliver interventions aimed at increasing community demand for immunizations, mainly through education and communication,Citation27,Citation29,Citation30,Citation34,Citation42 reminder/recall systemsCitation28 and client-held medical records.Citation26 Included studies focused on how and how frequently internet was used to retrieve information on immunizationCitation29,Citation42 and how such information would positively or negatively influence immunization decision making.Citation27,Citation30,Citation34,Citation42 In particular, some studies generally explored the rate of net surfing to seek immunization-related information,Citation29,Citation40-Citation42 while others focused on the role of specific immunization campaign websites and personalized portals,Citation26,Citation27,Citation29,Citation30,Citation34 blogsCitation34 and social media such as YoutubeCitation27 and Facebook.Citation29

Retrieved studies were published between 2010 and 2013, in Australia, Ireland, Spain and the US.

Study populations

Study populations were university students in the majority of the studiesCitation26-Citation30,Citation34 and parents of childrenCitation42; sample sizes ranging from 177 to 588 subjects. Two papers described the same study population but different outcomes.Citation29,Citation30

Data on health-related use

As emerged from the included studies, the share of people actively browsing the internet to get information about immunizations is around 10% in different settings.Citation29,Citation40 Frequency use of specific web portals including medical databases, government websites as well as Google, Youtube, and Wikipedia among university students was explored by one study conducted in Canada.Citation27

Outcomes

Two studies assessed the primary outcome.Citation26,Citation42

One study was retrieved that described how internet can be used to manage and maintain client-held medical records.Citation26 It was a randomized controlled trial conducted in Australia exploring the efficacy of a personalized web-based portal on influenza vaccination uptake.Citation26 The portal integrated personal health records with consumer care pathways called “journeys”, social forums and messaging tools that allowed consumers to interact with each other as well as with healthcare professionals. In particular, authors assessed the association between a specific influenza vaccine journey and vaccination rates during the study period. The influenza vaccine journey combined two elements: (1) an educational component that offered information on the influenza vaccine and how to get it; and (2) access to an online appointment booking system. Authors reported that subjects randomized to have access to the portal were 6.7% (95%CI: 1.46–12.30) more likely than people with no access to receive an influenza vaccine. In addition, they were also 11.6% (95%CI: 3.6–19.5) more likely to visit health service providers.

One descriptive study explored the use of electronic mail to improve vaccination uptake.Citation28 In particular, it reported on the usefulness of emails providing information on how and where to get vaccinated during a mumps outbreak in a university campus. More than 70% of interviewed students rated emails as the main sources of information about the vaccination and considered the use of emails as a very good/excellent source of information.Citation28

One study conducted on US-born parents assessed the influence of source networks, including internet, on vaccination decision-makingCitation42; authors reported that parents conforming to the nationally recommended vaccination schedule (who have their children vaccinated completely and on time) were more likely to rank internet as the most important source in their networks as compared with non-conformer parentsCitation42. However, the type of webpages surfed and their content was not reported.

A survey conducted in Spain among medical students assessed the willingness to use Facebook as an education channel to promote influenza immunization. Around 90% of students reported to be Facebook users in the study population; nearly 70% were willing to “follow” either an official website promoting influenza immunization or the associated informal Facebook page, with a higher percentage of students preferring the informal Facebook page.Citation29 A non-randomized trial was conducted on the same study population to assess the association between being specifically exposed to online promotional campaigns and the willingness to get vaccinated against influenza. Authors reported that students who surfed the website of the national 2010/11 influenza campaign, containing technical information, videos and games promoting the vaccine, were almost 2.5 times more willing to get immunized as compared with students who received no intervention (OR: 2.42 95% CI: 1.16–5.03).Citation30

In another experimental setting that compared the influence of blogs that both encouraged (positive) and discouraged (negative) HPV vaccination, it emerged how negative blogs have a negative impact on perceived vaccine efficacy, safety, and willingness to get vaccinated as compared with not being exposed to blogs’ content while positive blogs seem not to have impact on such outcomes. In fact, while students randomly assigned to access negative blog later perceived the vaccine as less safe, held more negative attitudes toward the vaccine, and had reduced intentions to get vaccinated, exposure to the positive blog did not positively modify any vaccine-related risk perceptions, attitudes, or intentions. On the contrary, a study assessing the impact of popular YouTube vaccine-critical videos on medical students’ attitudes towards influenza immunization reported no significant difference in pre to post video visualization attitudes towards influenza immunization, this holding true both for students exposed to ‘evidence-based’ presentation of vaccine-critical attitudes and videos focusing on anecdotal stories of harm.Citation27

Smartphones’ applications

Only one study was retrieved on smartphones’ application applied to preventive health action in the field of immunization.Citation44 The study, conducted in the US and published in 2012, assessed parental uptake of an Android smartphone application that served as a reminder system for vaccinations and provided users with detailed information about children immunizations. However, data are not sufficient to evaluate the effectiveness and usefulness of the application as out of a convenience sample of parents, 45 subjects downloaded the application and only six completed the survey.

New media applied to provider-based interventions

Computerized reminders for providers and computer-based standing orders

Retrieved studies

Four studies were retrieved on computerized reminders for providers and computer-based standing orders.Citation32,Citation37,Citation39,Citation43 They were published in 2004 and 2011, all in the US.

Study populations

All studies focused on influenza and/or pneumococcal vaccination in subjects over 65 y old in the emergency department,Citation43 impatient and primary care settings.Citation32,Citation37,Citation39 Sample size ranged from 266Citation37 to 4660Citation39 subjects.

Interventions

In the different studies patients eligible for influenza and pneumococcal vaccination were identified and standing orders and physician reminders were activated: semi-manually by querying the clinical information system and by patients’ interview,Citation37 automatically through hospitals’ computerized physician order entry systemsCitation32 and integrating 4 different information systems, including the electronic medical record, the computerized triage application, the computerized provider order entry system, and the order tracking application.Citation43

Outcomes

All studies reported data on the primary outcome. In inpatient and primary care settings, vaccination rates among eligible patients in the included studies ranged from 42% to 73% with standing ordersCitation32,Citation37 and from 15% to 59.7% with physician reminders,Citation32,Citation37,Citation39,Citation43 these percentages being much higher compared to rates in control groups who received no intervention, providing evidence that both standing orders protocols and computerized reminders to physicians are effective strategies to increase vaccination rates.Citation37,Citation39 In emergency department settings computerized reminder system increased vaccination rate from a baseline of 38.8% to 45.4%.Citation43

Discussion

This is the first systematic assessment of the available evidence on the use of new media to increase vaccine uptake and immunization coverage. There are few studies in the published literature that assessed the effectiveness of interventions applying new media to increase immunization coverage and vaccination uptake. There is some evidence that text messaging, accessing immunization campaign websites, using patient-held web-based portals and computerized reminders and standing orders increase immunization coverage rates. Insufficient evidence is available on the use of social networks, email communication and smartphone applications. Although research on the topic is still scant, we report an increasing trend in publications as most of the retrieved papers were published after 2010.

In particular, text messaging might be used for reminder/recall purposes as well as to deliver immunization-related health education to parents of children and adolescents also in deprived socioeconomic settings. Despite the wide use of text messaging—it is estimated that young adults in the 18–29 y age group send and receive on average 87.7 sms per dayCitation45—we report limited use of such tools for health-related purposes. Considering mobile phones’ ubiquity, portability and text messaging’s relative low cost, their use might be successfully adapted to prevention programmes in the field of immunizationCitation14. Last but not least, some qualitative data are available on patients’ preferences—including for example getting personalized messages with patients’ name and in patients’ mother tongue—that can be useful guides to successfully implement similar interventions in other settings.

While text messages are “one-way”-communication tools with limited potential for interaction and discussion, social media are internet-based “user-centered” applications that allow users’ active role in the creation and exchange of information. We report that such features could be effectively applied to improve vaccination uptake. In fact, as emerged from a randomized controlled trial, having access to a personalized web-based portal where patients could manage health records as well as interact with both providers and others members of the community through social forums and messaging tools increased influenza vaccination uptake. Citation26 Email communication is widely used in social and professional settings because of its efficiency, versatility, user-friendliness and low costCitation28 and it is likely that it will gradually replace traditional mail communication in prevention programs. However, there is insufficient evidence of its effectiveness to increase vaccine uptake.

Scant research is available on other forms of social media including smartphone applications and social networks. With regard to smartphone applications, the Centers for Disease Control and Prevention (CDC) and the WHO Regional Office for Europe have recently developed and launched two new smartphone applications. The CDC one is for clinicians and other immunization providers and aim to remind them the child, adolescent, and adult vaccines recommended by the Advisory Committee on Immunization PracticeCitation22; The WHO project targets parents and consists of a generic app code that countries can tailor into a smartphone application to remind parents when their children’s vaccinations are due based on the country-specific immunization schedule.Citation46 Hopefully new data on the impact of such initiatives will be available soon.

With regard to social networks, we report students’ willingness to use Facebook to seek health-related information. As the use of social networks is increasing—Eurostat data report that 86% of young people aged 16–24 y and 69% aged 16–24 are social networks subscribersCitation47—it would be worth to further explore how they can be used to promote immunization.

On the other hand, as internet plays an increasingly central role in connecting people to information, the negative impact associated with the dissemination of negative or wrong messages regarding immunization has also alarmingly increased.Citation48 As emerged from the literature review anecdotally, “against-vaccination” blogs and websites are effective in discouraging people to get vaccinated or not to conform to recommended immunization schedules underlining how the potential harm of bad communication in the new media era is a public health concern.

The use of new media is differentially distributed worldwide and in different age groups and these patterns are reflected in the study settings and study populations of the included papers that cluster around, respectively, the US and young populations. This might hinder the generalizability of the results to the population level; however the impact of interventions applying new media is likely to be higher where the prevalence of new media use is high. Interventions that apply internet-based tools seem to be more suitable for young adults, in particular university students and, consequently, for vaccines targeting such age groups.Citation46 Of note, there is some evidence that such target populations might be more sensitive to immunization promotion messages informally delivered through social media as compared to highly technical messages.Citation29

The role of new media in other fields of public health has been explored.Citation49-Citation51 A recent systematic review assessed the effectiveness of new media-based interventions to promote healthy sexual behaviours among young adults and reported promising findings.Citation49 Similar research has been conducted in the field of health education for cancer patients.Citation50,Citation51 There is some evidence that internet or interactive computer-based health education programmes in breast cancer patients increase health knowledge but not other outcomes.Citation50 Another systematic review retrieved poor evidence on the effectiveness of using new media in prevention programmes targeting underserved subgroups of the population.Citation51

Our review has limitations. These are mainly linked to limitations of the original studies. There was a high degree of heterogeneity between studies in terms of study setting, study populations, data collected, methods applied and exposure and outcomes assessed which limited the potential of quantitatively pooling estimates and findings and to conduct subgroups analysis. In addition, many studies had limited sample sizes, reported only descriptive analysis, had no control groups and did not assess the primary outcome not allowing to assess the impact of the interventions of interest. More than half of included studies had observational study designs which are at higher risk of reporting partly biased results. Data on some new media were not available and no data were available about costs and cost effectiveness.

Unmet immunization coverage targets in some settings signal the need for innovative strategies. The field of information and communication technologies has grown exponentially in the last years and will continue to. New media are increasingly accessible to the general population. In this context, we report that they offer great potential to increase vaccine uptake and immunization coverage in high and middle-income settings. However, more research is needed to assess the effectiveness and cost-effectiveness of interventions applying new media and on how to successfully market constructive public health messages in the new communication era.

Disclosure of Potential Conflicts of Interest

The authors alone are responsible for the views expressed in this article and they do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated.

References

  • WHO. Immunization http://www.who.int/gho/immunization/en/.
  • WHO. Estimates of disease burden and cost-effectiveness http://www.who.int/immunization/monitoring_surveillance/burden/estimates/en/.
  • WHO. World Immunization Week http://www.who.int/campaigns/immunization-week/2014/event/en/.
  • CrosignaniP, De StefaniA, FaraGM, IsidoriAM, LenziA, LiveraniCA, LombardiA, MenniniFS, Palu’G, PecorelliS, et al. Towards the eradication of HPV infection through universal specific vaccination. BMC Public Health2013; 13:642; http://dx.doi.org/10.1186/1471-2458-13-642; PMID: 23845195
  • PangT.. Vaccination in developing countries: problems, challenges and opportunities. Global Perspectives in Health Vol II
  • van PanhuisWG, GrefenstetteJ, JungSY, ChokNS, CrossA, EngH, LeeBY, ZadorozhnyV, BrownS, CummingsD, et al. Contagious diseases in the United States from 1888 to the present. N Engl J Med2013; 369:2152 - 8; http://dx.doi.org/10.1056/NEJMms1215400; PMID: 24283231
  • ZhouF, SheferA, WengerJ, MessonnierM, WangLY, LopezA, MooreM, MurphyTV, CorteseM, RodewaldL. Economic evaluation of the routine childhood immunization program in the United States, 2009. Pediatrics2014; 133:577 - 85; http://dx.doi.org/10.1542/peds.2013-0698; PMID: 24590750
  • WHO. Global health risks: mortality and burden of disease attributable to selected major risks. http://www.who.int/healthinfo/global_burden_disease/GlobalHealthRisks_report_full.pdf 2009
  • WHO. Global vaccine action plan 2011-2020 http://www.who.int/immunization/global_vaccine_action_plan/GVAP_doc_2011_2020/en/, 2013.
  • OECD. Health at a Glance 2011- OECD Indicators www.oecd-ilibrary.org2014. (accessed 03 07).
  • ECDC. Review of the scientific literature on drivers and barriers of seasonal influenza coverage in the EU/EEA 2013
  • SchlipköterU, FlahaultA. Communicable Diseases: Achievements and Challanges for Public Health. Public Health Rev2010; 32:90 - 119
  • BrissPA, RodewaldLE, HinmanAR, SheferAM, StrikasRA, BernierRR, Carande-KulisVG, YusufHR, NdiayeSM, WilliamsSM, The Task Force on Community Preventive Services. Reviews of evidence regarding interventions to improve vaccination coverage in children, adolescents, and adults. Am J Prev Med2000; 18:Suppl97 - 140; http://dx.doi.org/10.1016/S0749-3797(99)00118-X; PMID: 10806982
  • AmiciziaD, DomnichA, GaspariniR, BragazziNL, LaiPL, PanattoD. An overview of current and potential use of information and communication technologies for immunization promotion among adolescents. Hum Vaccin Immunother2013; 9:2634 - 42; http://dx.doi.org/10.4161/hv.26010; PMID: 23954845
  • InternetWorldStats. Internet usage statistics www.internetworldstats.com/stats.htm.
  • PostLA, VacaFE, DoranKM, LucoC, NaftilanM, DziuraJ, BrandtC, BernsteinS, JagminasL, D’OnofrioG. New media use by patients who are homeless: the potential of mHealth to build connectivity. J Med Internet Res2013; 15:e195; http://dx.doi.org/10.2196/jmir.2724; PMID: 24001876
  • HousehM. The use of social media in healthcare: organizational, clinical, and patient perspectives. Stud Health Technol Inform2013; 183:244 - 8; PMID: 23388291
  • LiberatiA, AltmanDG, TetzlaffJ, MulrowC, GøtzschePC, IoannidisJP, ClarkeM, DevereauxPJ, KleijnenJ, MoherD. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ2009; 339:b2700; http://dx.doi.org/10.1136/bmj.b2700; PMID: 19622552
  • It S. I. Calendario Vaccinale per la Vita. http://www.societaitalianaigiene.org/site/new/images/docs/calendariovaccinale/2012/cvplv.pdf
  • CDC. Recommended Immunization Schedule for Persons Age 0 Through 18 Years www.cdc.gov/vaccines/schedules/hcp/imz/child-adolescent.html
  • NHS. The NHS vaccination schedule. http://www.nhs.uk/Conditions/vaccinations/Pages/vaccination-schedule-age-checklist.aspx (accessed 24/04/2014)
  • Center for Disease Control and Prevention. . http://www.cdc.gov/vaccines/schedules/hcp/schedule-app.html
  • BrissPA, RodewaldLE, HinmanAR, SheferAM, StrikasRA, BernierRR, Carande-KulisVG, YusufHR, NdiayeSM, WilliamsSM, The Task Force on Community Preventive Services. Reviews of evidence regarding interventions to improve vaccination coverage in children, adolescents, and adults. Am J Prev Med2000; 18:Suppl97 - 140; http://dx.doi.org/10.1016/S0749-3797(99)00118-X; PMID: 10806982
  • Higgins JPGS. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. In. 5.1.0 ed: The Cochrane Collaboration; 2011.
  • DownsSH, BlackN. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health1998; 52:377 - 84; http://dx.doi.org/10.1136/jech.52.6.377; PMID: 9764259
  • LauAY, SintchenkoV, CrimminsJ, MagrabiF, GallegoB, CoieraE. Impact of a web-based personally controlled health management system on influenza vaccination and health services utilization rates: a randomized controlled trial. J Am Med Inform Assoc2012; 19:719 - 27; http://dx.doi.org/10.1136/amiajnl-2011-000433; PMID: 22582203
  • RobichaudP, HawkenS, BeardL, MorraD, TomlinsonG, WilsonK, KeelanJ. Vaccine-critical videos on YouTube and their impact on medical students’ attitudes about seasonal influenza immunization: a pre and post study. Vaccine2012; 30:3763 - 70; http://dx.doi.org/10.1016/j.vaccine.2012.03.074; PMID: 22484293
  • CooneyF, RyanA, SchinaiaN, BreslinA. Using electronic mail to improve MMR uptake amongst third level students. Ir Med J2010; 103:72 - 4; PMID: 20666068
  • MenaG, LlupiàA, García-BasteiroAL, AldeaM, SequeraVG, TrillaA. The willingness of medical students to use Facebook as a training channel for professional habits: the case of influenza vaccination. Cyberpsychol Behav Soc Netw2012; 15:328 - 31; http://dx.doi.org/10.1089/cyber.2011.0457; PMID: 22703040
  • MenaG, LlupiàA, García-BasteiroAL, SequeraVG, AldeaM, BayasJM, TrillaA. Educating on professional habits: attitudes of medical students towards diverse strategies for promoting influenza vaccination and factors associated with the intention to get vaccinated. BMC Med Educ2013; 13:99; http://dx.doi.org/10.1186/1472-6920-13-99; PMID: 23866902
  • Ahlers-SchmidtCR, ChesserAK, NguyenT, BrannonJ, HartTA, WilliamsKS, WittlerRR. Feasibility of a randomized controlled trial to evaluate Text Reminders for Immunization Compliance in Kids (TRICKs). Vaccine2012; 30:5305 - 9; http://dx.doi.org/10.1016/j.vaccine.2012.06.058; PMID: 22750044
  • DexterPR, PerkinsSM, MaharryKS, JonesK, McDonaldCJ. Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: a randomized trial. JAMA2004; 292:2366 - 71; http://dx.doi.org/10.1001/jama.292.19.2366; PMID: 15547164
  • MonizMH, HasleyS, MeynLA, BeigiRH. Improving influenza vaccination rates in pregnancy through text messaging: a randomized controlled trial. Obstet Gynecol2013; 121:734 - 40; http://dx.doi.org/10.1097/AOG.0b013e31828642b1; PMID: 23635672
  • NanX, MaddenK. HPV vaccine information in the blogosphere: how positive and negative blogs influence vaccine-related risk perceptions, attitudes, and behavioral intentions. Health Commun2012; 27:829 - 36; http://dx.doi.org/10.1080/10410236.2012.661348; PMID: 22452582
  • StockwellMS, KharbandaEO, MartinezRA, LaraM, VawdreyD, NatarajanK, RickertVI. Text4Health: impact of text message reminder-recalls for pediatric and adolescent immunizations. Am J Public Health2012; 102:e15 - 21; http://dx.doi.org/10.2105/AJPH.2011.300331; PMID: 22390457
  • StockwellMS, KharbandaEO, MartinezRA, VargasCY, VawdreyDK, CamargoS. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial. JAMA2012; 307:1702 - 8; http://dx.doi.org/10.1001/jama.2012.502; PMID: 22535855
  • CoyleCM, CurrieBP. Improving the rates of inpatient pneumococcal vaccination: impact of standing orders versus computerized reminders to physicians. Infect Control Hosp Epidemiol2004; 25:904 - 7; http://dx.doi.org/10.1086/502317; PMID: 15566021
  • KharbandaEO, StockwellMS, FoxHW, AndresR, LaraM, RickertVI. Text message reminders to promote human papillomavirus vaccination. Vaccine2011; 29:2537 - 41; http://dx.doi.org/10.1016/j.vaccine.2011.01.065; PMID: 21300094
  • LooTS, DavisRB, LipsitzLA, IrishJ, BatesCK, AgarwalK, MarksonL, HamelMB. Electronic medical record reminders and panel management to improve primary care of elderly patients. Arch Intern Med2011; 171:1552 - 8; http://dx.doi.org/10.1001/archinternmed.2011.394; PMID: 21949163
  • Ahlers-SchmidtCR, ChesserAK, PaschalAM, HartTA, WilliamsKS, YaghmaiB, Shah-HaqueS. Parent opinions about use of text messaging for immunization reminders. J Med Internet Res2012; 14:e83; http://dx.doi.org/10.2196/jmir.1976; PMID: 22683920
  • HofstetterAM, VargasCY, KennedyA, KitayamaK, StockwellMS. Parental and provider preferences and concerns regarding text message reminder/recall for early childhood vaccinations. Prev Med2013; 57:75 - 80; http://dx.doi.org/10.1016/j.ypmed.2013.04.007; PMID: 23624252
  • BrunsonEK. The impact of social networks on parents’ vaccination decisions. Pediatrics2013; 131:e1397 - 404; http://dx.doi.org/10.1542/peds.2012-2452; PMID: 23589813
  • DexheimerJW, TalbotTR3rd, YeF, ShyrY, JonesI, GreggWM, AronskyD. A computerized pneumococcal vaccination reminder system in the adult emergency department. Vaccine2011; 29:7035 - 41; http://dx.doi.org/10.1016/j.vaccine.2011.07.032; PMID: 21784117
  • PeckJL, StantonM, ReynoldsGE. Smartphone preventive health care: parental use of an immunization reminder system. J Pediatr Health Care2014; 28:35 - 42; http://dx.doi.org/10.1016/j.pedhc.2012.09.005; PMID: 23195652
  • Pew Reserach Center. . http://www.pewinternet.org/files/old-media//Files/Reports/2011/Americans%20and%20Text%20Messaging.pdf?src=prc-number.
  • WHO Regional Office for Europe. . http://www.euro.who.int/en/health-topics/Life-stages/child-and-adolescent-health/news/news/2013/04/new-app-will-help-parents-keep-track-of-their-childrens-vaccinations.
  • Eurostat. Digital agenda Scoreboard 2012
  • ZimmermanRK, WolfeRM, FoxDE, FoxJR, NowalkMP, TroyJA, SharpLK. Vaccine criticism on the World Wide Web. J Med Internet Res2005; 7:e17; http://dx.doi.org/10.2196/jmir.7.2.e17; PMID: 15998608
  • RyhänenAM, SiekkinenM, RankinenS, KorvenrantaH, Leino-KilpiH. The effects of Internet or interactive computer-based patient education in the field of breast cancer: a systematic literature review. Patient Educ Couns2010; 79:5 - 13; http://dx.doi.org/10.1016/j.pec.2009.08.005; PMID: 19744817
  • ThompsonHS, SheltonRC, MitchellJ, EatonT, ValeraP, KatzA. Inclusion of underserved racial and ethnic groups in cancer intervention research using new media: a systematic literature review. J Natl Cancer Inst Monogr2013; 2013:216 - 23; http://dx.doi.org/10.1093/jncimonographs/lgt031; PMID: 24395995
  • KaplanAM, MichaelH. Users of the world, unite! The challenges and opportunities of social media. Bus Horiz2010; 53:61; http://dx.doi.org/10.1016/j.bushor.2009.09.003
  • Ahlers-SchmidtCR, ChesserAK, NguyenT, BrannonJ, HartTA, WilliamsKS, WittlerRR. Feasibility of a randomized controlled trial to evaluate Text Reminders for Immunization Compliance in Kids (TRICKs). Vaccine2012; 30:5305 - 9; http://dx.doi.org/10.1016/j.vaccine.2012.06.058; PMID: 22750044
  • Ahlers-SchmidtCR, ChesserAK, PaschalAM, HartTA, WilliamsKS, YaghmaiB, Shah-HaqueS. Parent opinions about use of text messaging for immunization reminders. J Med Internet Res2012; 14:e83; http://dx.doi.org/10.2196/jmir.1976; PMID: 22683920
  • BrunsonEK. The impact of social networks on parents’ vaccination decisions. Pediatrics2013; 131:e1397 - 404; http://dx.doi.org/10.1542/peds.2012-2452; PMID: 23589813
  • CooneyF, RyanA, SchinaiaN, BreslinA. Using electronic mail to improve MMR uptake amongst third level students. Ir Med J2010; 103:72 - 4; PMID: 20666068
  • CoyleCM, CurrieBP. Improving the rates of inpatient pneumococcal vaccination: impact of standing orders versus computerized reminders to physicians. Infect Control Hosp Epidemiol2004; 25:904 - 7; http://dx.doi.org/10.1086/502317; PMID: 15566021
  • DexheimerJW, TalbotTR3rd, YeF, ShyrY, JonesI, GreggWM, AronskyD. A computerized pneumococcal vaccination reminder system in the adult emergency department. Vaccine2011; 29:7035 - 41; http://dx.doi.org/10.1016/j.vaccine.2011.07.032; PMID: 21784117
  • DexterPR, PerkinsSM, MaharryKS, JonesK, McDonaldCJ. Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: a randomized trial. JAMA2004; 292:2366 - 71; http://dx.doi.org/10.1001/jama.292.19.2366; PMID: 15547164
  • HofstetterAM, VargasCY, KennedyA, KitayamaK, StockwellMS. Parental and provider preferences and concerns regarding text message reminder/recall for early childhood vaccinations. Prev Med2013; 57:75 - 80; http://dx.doi.org/10.1016/j.ypmed.2013.04.007; PMID: 23624252
  • KharbandaEO, StockwellMS, FoxHW, AndresR, LaraM, RickertVI. Text message reminders to promote human papillomavirus vaccination. Vaccine2011; 29:2537 - 41; http://dx.doi.org/10.1016/j.vaccine.2011.01.065; PMID: 21300094
  • LauAY, SintchenkoV, CrimminsJ, MagrabiF, GallegoB, CoieraE. Impact of a web-based personally controlled health management system on influenza vaccination and health services utilization rates: a randomized controlled trial. J Am Med Inform Assoc2012; 19:719 - 27; http://dx.doi.org/10.1136/amiajnl-2011-000433; PMID: 22582203
  • LooTS, DavisRB, LipsitzLA, IrishJ, BatesCK, AgarwalK, MarksonL, HamelMB. Electronic medical record reminders and panel management to improve primary care of elderly patients. Arch Intern Med2011; 171:1552 - 8; http://dx.doi.org/10.1001/archinternmed.2011.394; PMID: 21949163
  • MenaG, LlupiàA, García-BasteiroAL, AldeaM, SequeraVG, TrillaA. The willingness of medical students to use Facebook as a training channel for professional habits: the case of influenza vaccination. Cyberpsychol Behav Soc Netw2012; 15:328 - 31; http://dx.doi.org/10.1089/cyber.2011.0457; PMID: 22703040
  • MenaG, LlupiàA, García-BasteiroAL, SequeraVG, AldeaM, BayasJM, TrillaA. Educating on professional habits: attitudes of medical students towards diverse strategies for promoting influenza vaccination and factors associated with the intention to get vaccinated. BMC Med Educ2013; 13:99; http://dx.doi.org/10.1186/1472-6920-13-99; PMID: 23866902
  • MonizMH, HasleyS, MeynLA, BeigiRH. Improving influenza vaccination rates in pregnancy through text messaging: a randomized controlled trial. Obstet Gynecol2013; 121:734 - 40; http://dx.doi.org/10.1097/AOG.0b013e31828642b1; PMID: 23635672
  • NanX, MaddenK. HPV vaccine information in the blogosphere: how positive and negative blogs influence vaccine-related risk perceptions, attitudes, and behavioral intentions. Health Commun2012; 27:829 - 36; http://dx.doi.org/10.1080/10410236.2012.661348; PMID: 22452582
  • PeckJL, StantonM, ReynoldsGE. Smartphone preventive health care: parental use of an immunization reminder system. J Pediatr Health Care2014; 28:35 - 42; http://dx.doi.org/10.1016/j.pedhc.2012.09.005; PMID: 23195652
  • RobichaudP, HawkenS, BeardL, MorraD, TomlinsonG, WilsonK, KeelanJ. Vaccine-critical videos on YouTube and their impact on medical students’ attitudes about seasonal influenza immunization: a pre and post study. Vaccine2012; 30:3763 - 70; http://dx.doi.org/10.1016/j.vaccine.2012.03.074; PMID: 22484293
  • StockwellMS, KharbandaEO, MartinezRA, LaraM, VawdreyD, NatarajanK, RickertVI. Text4Health: impact of text message reminder-recalls for pediatric and adolescent immunizations. Am J Public Health2012; 102:e15 - 21; http://dx.doi.org/10.2105/AJPH.2011.300331; PMID: 22390457
  • StockwellMS, KharbandaEO, MartinezRA, VargasCY, VawdreyDK, CamargoS. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial. JAMA2012; 307:1702 - 8; http://dx.doi.org/10.1001/jama.2012.502; PMID: 22535855

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.