293
Views
56
CrossRef citations to date
0
Altmetric
Review

Acceptance of a pandemic influenza vaccine: a systematic review of surveys of the general public

, , , &
Pages 197-207 | Published online: 20 Oct 2011

Abstract

Introduction

The effectiveness of pandemic vaccine campaigns such as the H1N1 vaccine rollout is dependent on both the vaccines’ effectiveness and the general public’s willingness to be vaccinated. It is therefore critical to understand the factors that influence the decision of members of the public whether to get vaccinated with new, emergently released vaccines.

Methods

A systematic review of English language quantitative surveys was conducted to identify consistent predictors of the decision to accept or decline any (pre)pandemic vaccine, including the H1N1 influenza A vaccine. A total of ten studies were included in this review and all pertained to the 2009 H1N1 influenza A pandemic. Respondents’ willingness to receive a pandemic vaccine ranged from 8%–67% across the ten studies. The factors reported to be consistent predictors of the intention to vaccinate were: risk of infection, proximity or severity of the public health event, severity of personal consequences resulting from the illness, harm or adverse events from the vaccine, acceptance of previous vaccination, and ethnicity. Age and sex were the demographic variables examined most frequently across the ten studies and there was no consistent association between these variables and the intention to accept or reject a pandemic vaccine.

Conclusion

Some predictors of the intention to accept or decline a (pre)pandemic vaccine or the H1N1 influenza A vaccine are consistently identified by surveys. Understanding the important factors influencing the acceptance of a pandemic vaccine by individual members of the public may help inform strategies to improve vaccine uptake during future pandemics.

Introduction

The release of a pandemic vaccine to protect individuals from H1N1 was an unprecedented undertaking for many nations across the world. The development-to-implementation process of a new, emergency-released vaccine like the H1N1 vaccine differs in many ways from that of established vaccines, such as the seasonal influenza vaccine. Given the urgent need for a vaccine during the H1N1 pandemic or similar emergency situations, a vaccine must be developed and distributed in an efficient and timely manner to reduce the overall public health burden of the disease. Furthermore, a large portion of the population must be vaccinated within a short period to maximize the benefits of the vaccine. Vaccination campaigns that are successful in encouraging the general public to get vaccinated can help reduce the morbidity and mortality related to the emerging disease. Understanding the factors that influence decisions made by individual members of the public to accept or decline an emergency-released vaccine such as the H1N1 vaccine can help public health officials in preparedness planning and management activities for future infectious disease outbreaks.

Several surveys have examined the factors that influenced the uptake of the H1N1 vaccine. A systematic review of the published survey literature was conducted to synthesize the data from these studies and identify barriers and facilitators to vaccination that were consistently identified across studies.

Methods

Search strategy

A systematic search of the literature for all articles was conducted on July 26, 2010 using the MEDLINE (Ovid interface: January 1950 to July 26, 2010), EMBASE (Ovid interface: 1947 to July 26, 2010), and PsycINFO (Ovid interface: 1806 to July 26, 2010) databases. The search strategy for the MEDLINE database was based on medical subject headings and keywords. The research librarian ensured that the coding was as inclusive and exhaustive as possible and provided guidance in transporting the search strategy into other databases. The search strategy combined terms that represented attitudes, perceptions, and barriers and facilitators with “H1N1 influenza” and “pandemic vaccine.” The searches were supplemented by a review of the references of key articles on the topic. The full search strategies are presented in the Appendix.

Study selection

All abstracts generated by the searches were added to a database and duplicates were removed prior to screening. Two reviewers independently screened the abstracts for eligibility. Agreement between reviewers on the selection of studies was compared using a Kappa score. All English articles that met the following criteria were included in the final meta-synthesis: sampled the general public and not a specific population; examined H1N1 pandemic, or swine flu, or other prepandemic vaccines and vaccination/immunization; examined personal intention or willingness to get vaccinated, or actual vaccination rate, or barriers and/or predictors of intention to personally receive or having received the vaccination; obtained data through a quantitative survey.

Any disagreement between the reviewers was discussed and resolved by consensus. In cases where consensus was not achieved, a third reviewer addressed any discrepancies that arose.

Data abstraction

Two reviewers independently extracted data from the eligible studies and a third addressed any discrepancies that arose. From a preliminary review of the articles, the two reviewers developed a coding template, using the constant comparative method.Citation1 The factors influencing vaccine use identified in the studies were categorized using this coding template, which consisted of broad headings termed “themes,” and subheadings termed “categories.”Citation2 The reviewers conducted a second review of the articles to extract quantitative survey data pertaining to the themes in the coding template. The quantitative data extracted from the studies had to meet one of the following criteria of significance; either: odds ratio (OR) values with a P-value of <0.05, or when a P-value is not provided the 95% confidence interval must not include the value of 1, or the factors were indicated by the author(s) of the study to be statistically significant. If both univariate and multivariate analyses were available, data from the multivariate analyses were preferentially extracted. When the data were presented as percentage values, the top three responses for a given question were reported. The authors of all the studies included in the analysis were emailed and requested to review the information that was extracted to help ensure that the data extracted represented the data and results presented in the authors’ respective publications.

Statistical analysis

Kappa scores were calculated to determine chance-adjusted interobserver agreement in the abstract and study selection processes. Due to the heterogeneity of the populations and survey methods covered by the studies included in the review, as well as a lack of guidelines on combining survey data, a meta-analysis was not conducted.

Results

Study selection and characteristics

The search strategy yielded 720 abstracts and titles (). Of these, 51studies met selection criteria and the full articles were pulled for further analysis. A total of ten studies met the final inclusion criteria and were included in the systematic review. There was excellent agreement between the two reviewers for the initial screening of the abstracts (κ = 0.97) and the final articles (κ = 1.00).

Figure 1 Flow diagram of selection of studies for the systematic review.

Figure 1 Flow diagram of selection of studies for the systematic review.

The characteristics of the studies included in the review are summarized in . The studies included in the analysis surveyed the general population of adults aged ≥18 years, except for one study that surveyed participants aged ≥16 years.Citation3 The methods of survey administration included telephone surveys (n = 4), online surveys (n = 3), paper-based surveys (n = 2), and one survey was conducted in person. Five of the surveys were self-administered.Citation4Citation8 The sample size of the ten studies ranged from 207Citation9 to 5175Citation3 respondents. The response rate for the surveys ranged from 8%Citation3 to 80%.Citation9 Three studies were conducted in the USA,Citation4,Citation5,Citation9 four were conducted in Europe,Citation3,Citation6,Citation8,Citation10 two studies took place in Australia,Citation7,Citation11 and one in Hong Kong.Citation12 All of the studies took place during the H1N1 influenza A pandemic. Five of these surveys were administered before the availability of the H1N1 vaccine in the respective countries.Citation3,Citation5,Citation7,Citation9,Citation12

Table 1 Summary of the characteristics of the studies included in the review

Intention to vaccinate

The reported willingness of the respondents to receive the pandemic vaccine was evaluated in nine studies and this ranged from 8%Citation5 to 67%.Citation11 A study conducted by Maurer and colleagues was conducted after the vaccination campaign and reported an actual vaccination rate of 20% for H1N1 influenza A vaccine in their study population.Citation4

Factors influencing intention to receive vaccination

reports the factors identified in the studies that influenced intention or willingness to receive a pandemic vaccine. The factors were categorized under the following themes: personal risk perception, vaccination attitude, communications and information sources, access, demographic variables, and others. The major themes summarized factors that share similarities and these themes are further divided into categories within each theme.

Table 2 Themes identified as predictors of vaccination with a pandemic vaccine by the general public

Personal risk perception

Nine studies were identified to report data under the theme personal risk perception.Citation3,Citation5Citation12 Of these, data on the perception of harm or adverse events from the vaccine were reported in seven studies.Citation5Citation7,Citation9Citation12 Two of the seven studiesCitation5,Citation12 reported ORs of 0.11, 0.33, and 0.36, demonstrating that these concerns were associated with a lower intention to be vaccinated. Among the factors with the largest effect size for the intention to vaccinate was the perception of harm or adverse events from vaccine; in one study, participants who were more worried about the vaccine were 90% less likely to accept the vaccine (OR = 0.11).Citation5 Five studies reported the perception of harm or adverse events from the vaccine as one of the top three factors influencing the decision to accept or decline the new vaccine.Citation6,Citation7,Citation9Citation11 Four studies presented data on factors relating to the perception of the proximity or severity of the public health issues and reported ORs ranging from 1.2 to 2.5, suggesting that this factor increased the intention to vaccinate.Citation3,Citation6,Citation7,Citation11 Four studies presented data on the perception of the severity of personal consequences from the illness and reported ORs ranging from 1.64 to 3.61.Citation5,Citation6,Citation8,Citation9 Five studies reported data pertaining to perceptions of the risk of infection with ORs ranging from 1.55 to 4.7.Citation3,Citation7Citation10 In one study, participants who had higher levels of worry about personally catching the pandemic flu were almost five times more likely to accept the vaccine (OR = 4.7).Citation3

Vaccination attitude

Seven studies were identified to report data under the theme of vaccination attitude.Citation5Citation9,Citation11,Citation12 Two studies reported this theme as one of the top three factors influencing the decision to accept or decline the new vaccine.Citation7,Citation11 Data relating to people’s acceptance of previous vaccination on their intention to vaccinate was reported by seven studiesCitation5Citation9,Citation11,Citation12 and six of these studies reported ORs ranging from 1.27 to 5.03, suggesting that this factor increased the intention to vaccinate.Citation5Citation7,Citation9,Citation11,Citation12 Acceptance of previous vaccination was the factor with the largest effect on the intention to vaccinate, with those who accepted previous influenza vaccination shown to be five times more likely to accept a pandemic vaccine (OR = 5.03) in one study.Citation11 Information on people’s belief of vaccine effectiveness or necessity and antivaccination attitude were less consistently reported and only four studies reported data on these two categories.Citation7,Citation8,Citation11,Citation12

Communications and information sources

Seven studies were identified to report data under the theme of communications and information sources.Citation3,Citation4,Citation6,Citation8Citation10,Citation12 Within this larger theme the following categories were identified: recommendations from healthcare professionals, public health messages, knowledge of the disease or vaccine, and influence of family and friends. These categories were less consistently reported, with less than three studies reporting on each of the categories. Three of the seven studies reported nonsignificant association between this theme and the intention to vaccinate.Citation8Citation10 In one study, recommendations from health care professionals had a large effect on the intention to vaccinate based on the different levels of advice given by health care professionals. Respondents who received positive advice from a primary care physician for vaccination were more likely to accept the pandemic vaccine (OR = 4.57), and those who did not receive positive advice were more likely to decline the vaccine (OR = 0.57).Citation6

Access

Four studies were identified to report data under the theme of access.Citation5,Citation6,Citation8,Citation9 Within this broad theme the following categories were identified: priority group, convenience, financial costs/insurance, and vaccine delivery. Three of the four studies reported nonsignificant association between access and the intention to accept a pandemic vaccine.Citation5,Citation8,Citation9 One study reported an odds ratio of 5.09 for acceptance of a pandemic vaccine for those in a priority group compared to those who were not.Citation6

Demographic variables

The association between demographic variables and intention to accept or decline a pandemic vaccine are summarized in . Seven of ten studies reported data on the association between age and the intention to accept a pandemic vaccine.Citation3,Citation6,Citation7,Citation9Citation12 The association was not significant in three of the seven studies.Citation7,Citation9,Citation12 Furthermore, there was inconsistency about which age group is more likely to accept a pandemic vaccine for studies reporting significant associations. Eight studies reported on the association between sex and the intention to accept a pandemic vaccine, which was shown to be not significant in fiveCitation3,Citation7Citation9,Citation12 of the eight studies.Citation3,Citation6Citation12 Four studies reported on the association between ethnicity and the intention to accept a pandemic vaccine.Citation3,Citation5,Citation7,Citation9 The reported ORs ranged from 1.6 to 3.27 for a higher intention to accept a pandemic vaccine in people who were not of Caucasian background, in countries composed of a heterogeneous mix of ethnic groups.Citation3,Citation5,Citation7 Other demographic variables included education, community/household-related factors, personal health, occupation/social grade/work status, and marital status. For all of these, there was no clear trend toward statistical significance.

Table 3 Demographic variables identified as predictors of vaccination with a pandemic vaccine by the general public

Discussion

In a public health emergency, promoting the uptake of an emergency-released vaccine by the target population can be a difficult challenge for public health authorities. If such a challenge is not properly addressed, it may impede efforts to manage the infectious disease. Determining the factors influencing the intention to accept or decline a pandemic vaccine may inform strategies to promote vaccination uptake in case of future public health emergencies. Specific strategies to address factors influencing the public’s reluctance to be vaccinated with a pandemic vaccine may increase the rate of overall vaccine uptake and help public health authorities better manage the emerging public health concern.

This study systematically reviewed the existing survey literature on factors influencing the intention to accept or decline a pandemic vaccine. The findings of a survey are generally limited to the population from which they were obtained. However, if multiple surveys in several different geographical regions sampling different populations consistently identify similar findings, then the generalizability of the findings is increased.

Based on the findings of this review, issues relating to personal risk perceptions, including severity of the public health issue, risk of being infected by the virus, risk of severe illness from being infected, and risk of harm from a pandemic vaccine, are important factors that should be considered for future emergency vaccination campaigns. Developing strategies to modify people’s perception of their own risk may help encourage members of the general public to obtain vaccinations during public health emergencies. The findings also suggest that targeted messaging should perhaps be used for individuals of different ethnic groups in countries with a heterogeneous mix of ethnic groups, such as Canada and the USA, to reach groups that are more reluctant to accept a pandemic vaccine during a public health emergency.

Studies that did not meet the inclusion criteria but examined similar constructs, identified similar findings. A study conducted in 1976 by Cummings and colleaguesCitation13 reported factors that played a significant role in explaining variance in the behavioral intention to vaccinate; these were: perceived susceptibility and perceived severity of the disease, perceived efficacy of vaccination, and physician’s recommendation. Together, these factors accounted for 37.8% of the variance in the behavioral intention to vaccinate. Levine and colleaguesCitation14 also reported perceived risk as an independent facilitator of the likelihood to vaccinate. While addressing a previous influenza pandemic threat, these findings are consistent with the observations of this review. The findings from this review are also consistent with studies using other research methodologies. Focus groups conducted by Henrich and colleaguesCitation15 reported perception of risk of infection, severity of morbidity from infection, proximity and ease of spread of the disease, and concerns about the safety of the new vaccine, as being among the factors influencing the decision to vaccinate with a novel vaccine during a pandemic. A meta-analysis of the relationship between risk perception and vaccination behavior found strong evidence that perceived risk of getting the disease, perceived self-susceptibility to the disease, and perceived severity of consequences significantly predicted vaccination.Citation16 In their review, Bish and colleguesCitation17 also reported perceived susceptibility to the disease and perceived severity of the disease as important predictors of protective behaviors, such as vaccination, during a pandemic.

The present review has important limitations. The review is specific but not sensitive for identifying generalizable themes. If a theme is not reported to be a consistent predictor of vaccination intention it may be a consequence of surveys not asking a specific question related to the theme, or not reporting data related to the theme. It is also limited by the biases inherent in the original studies, including response bias and social desirability bias. The responses the individuals gave of their intention to get vaccinated may not be a true indication of how they would behave in an actual pandemic, as intention does not consistently translate to behavior. Further research exploring the factors that influenced the vaccination behavior during the H1N1 pandemic is necessary for a complete understanding of the behavior pre- and postpandemic. Further, the results presented are also not generalizable to non-English-speaking populations. Non-English-language papers were specifically excluded because translation could result in distortion of meaning of themes and subsequent misclassification. Another limitation resulting from the exclusion of non-English-language papers is the possibility of reporting biases that may occur as statistically significant (positive) studies are more likely to be submitted and accepted for publication and are more likely to be published in English.Citation18

Conclusion

This review suggests that across different populations, the factors consistently associated with intention to accept or decline a pandemic vaccine include personal risk perception, vaccination attitude, and ethnicity. In future, emergency vaccination campaigns’ public health officials should be cognizant of these issues in hope of increasing acceptance of a pandemic vaccine by the general public. In particular, the components of personal risk perception and vaccination attitude represent potentially modifiable factors that officials could develop strategies to influence, prior to and during the release of an emergent vaccine. By addressing these factors proactively public health officials may increase the uptake of an emergently released vaccine and reduce the overall impact of the emerging disease.

Disclosure and acknowledgments

The authors would like to thank Alexandra Davis for her guidance in developing the search strategies. Kumanan Wilson is supported by the Canadian Institutes of Health Research (CIHR) through the CIHR operating grant Health Systems, Ethics, and Knowledge Translation Research on Implications of H1N1 (grant number H1N – 104059). Trang Nguyen received funding from the Frederick Banting and Charles Best Canada Graduate Scholarship from CIHR in 2010. The funders had no role in study design, data collection and analysis, decisions to publish, or preparation of the manuscript. No other conflicts of interest are reported by the authors.

References

  • JuppVThe Sage Dictionary of Social Research MethodsLondonSage Publications2006
  • MillsEJadadARRossCWilsonKSystematic review of qualitative studies exploring parental beliefs and attitudes toward childhood vaccination identifies common barriers to vaccinationJ Clin Epidemiol200558111081108816223649
  • RubinGJPottsHWMichieSThe impact of communications about swine flu (influenza A H1N1v) on public responses to the outbreak: results from 36 national telephone surveys in the UKHealth Technol Assess (Winchester, England)20101434183266
  • MaurerJUscher-PinesLHarrisKMPerceived seriousness of seasonal and A (H1N1) influenzas, attitudes toward vaccination, and vaccine uptake among US adults: does the source of information matter?Prev Med201051218518720510270
  • QuinnSCKumarSFreimuthVSKidwellKMusaDPublic willingness to take a vaccine or drug under Emergency Use Authorization during the 2009 H1N1 pandemicBiosecur Bioterror20097327529019775200
  • SchwarzingerMFlicoteauxRCortarenodaSObadiaYMoattiJPLow acceptability of A/H1N1 pandemic vaccination in French adult population: did public health policy fuel public dissonance?PLoS One201054e1019920421908
  • SealeHHeywoodAEMcLawsMLWhy do I need it? I am not at risk! Public perceptions towards the pandemic (H1N1) 2009 vaccineBMC Infect Dis2010109920403201
  • ZijtregtopEAWilschutJKoelmaNWhich factors are important in adults’ uptake of a (pre)pandemic influenza vaccine?Vaccine20092820722719800997
  • HorneyJAMooreZDavisMMacDonaldPDIntent to receive pandemic influenza A (H1N1) vaccine, compliance with social distancing and sources of information in NC, 2009PLoS One201056e1122620585462
  • SypsaVLivaniosTPsichogiouMPublic perceptions in relation to intention to receive pandemic influenza vaccination in a random population sample: evidence from a cross-sectional telephone surveyEuro Surveill20091449pii 19437.
  • EastwoodKDurrheimDNJonesAButlerMAcceptance of pandemic (H1N1) 2009 influenza vaccination by the Australian publicMed J Aust2010192333620047546
  • LauJTYeungNCChoiKCChengMYTsuiHYGriffithsSFactors in association with acceptability of A/H1N1 vaccination during the influenza A/H1N1 pandemic phase in the Hong Kong general populationVaccine201028294632463720457289
  • CummingsKMJetteAMBrockBMHaefnerDPPsychosocial determinants of immunization behaviour in a swine influenza campaignMed Care1979176639649221759
  • LevineAJTrentRBThe swine flu immunization program: a comparison of inoculation recipients and nonrecipientsEval Health Prof1978119521510315848
  • HenrichNHolmesBThe public’s acceptance of novel vaccines during a pandemic: A focus group study and its application to influenza H1N1Emerg Health Threats J20092e8
  • BrewerNTChapmanGBGibbonsFXGerrardMMcCaulKDWeinsteinNDMeta-analysis of the relationship between risk perception and health behavior: the example of vaccinationHealth Psychol20072613614517385964
  • BishAMichieSDemographic and attitudinal determinants of protective behaviours during a pandemic: a reviewBr J Health Psychol20101579782420109274
  • PaiMMcCullochMGormanJDSystematic reviews and meta-analyses: an illustrated, step-by-step guideNatl Med J India2004172869515141602

Appendix

Search strategies

Database: Ovid MEDLINE® in-process and other nonindexed citations and Ovid MEDLINE® 1950 to present

Search strategy

  1. Vaccination/or Mass Vaccination/or vaccin$.tw. (181200)

  2. Anthrax Vaccines/or Smallpox Vaccine/or Influenza Vaccines/or (H1N1 or swine flu or H5N1 or avian flu or bird flu).tw. (21236)

  3. 1 or 2 (189137)

  4. Disease Outbreaks/or (pandemic$ or epidemic$ or out-break$).tw. (113889)

  5. Bioterrorism/or emergencies/or (bioterror$ or emergency or emergent).tw. (146705)

  6. 4 or 5 (257604)

  7. 3 and 6 (17661)

  8. Attitude/or attitude$.tw. (98801)

  9. Perception/or (perception$ or perceive$).tw. (174307)

  10. communication barriers/or barrier$.tw. (114683)

  11. “Patient Acceptance of Health Care”/or (accept$ or rejection or willingness).tw. (301968)

  12. Motivation/or Intention/or (intention$ or motivat$).tw. (110507)

  13. Health Knowledge, Attitudes, Practice/or “Attitude of Health Personnel”/(118620)

  14. exp decision making/or (decision$ adj1 making).tw. (122071)

  15. or/8–14 (890811)

  16. 7 and 15 (1182)

  17. animals/not humans/(3425576)

  18. 16 not 17 (1100)

  19. qualitative research/or qualitative.tw. (87357)

  20. interview/or health surveys/or interviews as topic/or narration/or questionnaires/or Focus Groups/(299201)

  21. (interview$ or survey$ or focus group$ or questionnaire$ or narrat$ or experience$).tw. (1039040)

  22. Observation/or observation$.tw. (469567)

  23. or/19–22 (1613210)

  24. 18 and 23 (392)

  25. from 24 keep 1–392 (392)

Database: EMBASE Classic plus EMBASE 1947 to 2010 July 22

Search strategy

  1. vaccination/or mass immunization/or vaccin$.tw. (168265)

  2. anthrax vaccine/or smallpox vaccine/or influenza vaccine/ or avian influenza vaccine/(19211)

  3. (H1N1 or swine flu or H5N1 or avian flu or bird flu). tw. (6132)

  4. or/1–3 (176731)

  5. epidemic/or (pandemic$ or epidemic$ or outbreak$). tw. (89724)

  6. biological warfare/or (bioterror$ or emergency or emergent).tw. (116221)

  7. 5 or 6 (203711)

  8. 4 and 7 (15798)

  9. health personnel attitude/or nurse attitude/or physician attitude/or patient attitude/(48932)

  10. attitude/or attitude$.tw. (73587)

  11. perception/or (perception$ or perceive$).tw. (142016)

  12. barrier$.tw. (97777)

  13. (accept$ or rejection or willingness).tw. (278073)

  14. behavior/or motivation/(105523)

  15. (intention$ or motivat$).tw. (71526)

  16. decision making/or (decision$ adj1 making).tw. (78039)

  17. or/9–16 (782106)

  18. qualitative research/or qualitative.tw. (73896)

  19. exp interview/(60764)

  20. health survey/(75971)

  21. exp questionnaire/(164048)

  22. information processing/(66875)

  23. (interview$ or survey$ or focus group$ or questionnaires$ or narrat$ or experience$).tw. (850724)

  24. observational study/or observation$.tw. (489505)

  25. or/18–24 (1509918)

  26. 8 and 17 and 25 (294)

  27. from 26 keep 1–294 (294)

Database: PsycINFO® 1806 to July week 3 2010

Search strategy

  1. immunization/or vaccin$.tw. (2506)

  2. (h1n1 or swine flu or h5n1 or avian flu or bird flu).tw. (99)

  3. 1 or 2 (2583)

  4. epidemics/or (pandemic$ or epidemic$ or outbreak$). tw. (7129)

  5. Bioterrorism/or (bioterror$ or emergency or emergent). tw. (18614)

  6. 4 or 5 (25567)

  7. 3 and 6 (291)

  8. Health Personnel Attitudes/or Health Attitudes/or Attitudes/or attitude$.tw. (166439)

  9. Communication Barriers/or barrier$.tw. (25197)

  10. Risk Perception/or Perception/or (perception$ or perceive$).tw. (265390)

  11. (accept$ or rejection or willingness).tw. (90606)

  12. Consumer Behavior/or Client Attitudes/(23532)

  13. Intention/or Motivation/or (intention$ or motivat$).tw. (123477)

  14. decision making/or choice behavior/(41198)

  15. (decision$ adj1 making).tw. (44649)

  16. or/8–14 (610471)

  17. Qualitative Research/or qualitative.tw. (56552)

  18. interviews/(5241)

  19. Mail Surveys/or Consumer Surveys/or Telephone Surveys/or Surveys/(5346)

  20. questionnaires/(11041)

  21. (interview$ or survey$ or focus group$ or questionnaire$ or narrat$ or experience$).tw. (647996)

  22. observation methods/or observation$.tw. (90753)

  23. or/17–22 (731033)

  24. 7 and 16 and 23 (34)

  25. from 24 keep 1–34 (34)