2,754
Views
6
CrossRef citations to date
0
Altmetric
HPV

Implementing interventions to start HPV vaccination at age 9: Using the evidence we have

, , , &
Article: 2180250 | Received 28 Nov 2022, Accepted 10 Feb 2023, Published online: 20 Feb 2023

ABSTRACT

Human papillomavirus (HPV) vaccination is routinely recommended for adolescents aged 11 or 12 years but can begin at age 9. On-time HPV vaccination by the thirteenth birthday has proven to be effective in preventing HPV cancer and pre-cancer. However, HPV coverage rates continue to lag behind other routinely recommended vaccinations for adolescents. A promising approach to improving coverage is to start HPV vaccination at age 9. This approach has been endorsed by the American Academy of Pediatrics and the American Cancer Society. Benefits of this approach include increased time to complete vaccination series by the thirteenth birthday, additional spacing of recommended vaccines, and a more concentrated focus on cancer prevention messaging. While promising, little is known about how and if existing evidence-based interventions and approaches can be used to promote starting HPV vaccination at age 9. Implementation science frameworks offer scientific direction in how to adapt current and develop new interventions to promote starting HPV vaccination at age 9 and accelerate dissemination and prevent HPV cancers.

This article is part of the following collections:
HPV Vaccination Starting at Age 9

Human papillomavirus (HPV) vaccination prevents diseases caused by HPV, including six types of cancer (oral, cervical, anal, vaginal, vulvar, and penile), cervical precancer, genital warts, and recurrent respiratory papillomatosis. HPV vaccination is routinely recommended at age 11 or 12 years and can begin at age 9 up through age 26 in the United States (US). Recently, vaccinations have been recommended for some adults aged 27 to 45 years who were not vaccinated when they were younger, following a discussion with their health-care provider.Citation1–3 In the US, HPV vaccination coverage has reached nearly 77% of 13- to-17-year-old adolescents with one or more doses and nearly 62% completing the vaccination series.Citation4 However, when compared to other routinely recommended vaccinations for adolescents, HPV vaccination continues to lag behind. Coverage for two other routinely recommended adolescent vaccines are more than 30% higher. Coverage rates for the quadrivalent meningococcal conjugate (MenACWY) vaccine is 89% and 90% for tetanus, diphtheria, and acellular pertussis (Tdap) vaccinenationally.Citation4

Disparities in HPV vaccination coverage based on geographic region, rurality, and poverty persist.Citation4,Citation5 Since the vaccine was first introduced in the US in 2006, HPV infections and cervical precancers have dropped significantly despite relatively slow uptake.Citation5 However, the vaccine’s cancer prevention potential has not been realized due to a range of factors, including limited awareness and knowledge, lack of a strong health-care provider recommendation, and concerns related to safety and effectiveness. Recent studiesCitation6–13 continue to validate the effectiveness of HPV vaccination for disease prevention, particularly on-time HPV vaccination by the thirteenth birthday.Citation14,Citation15 Effective, scalable approaches that are widely implemented are urgently needed to improve on-time HPV vaccination to prevent related cancers and other HPV diseases.

A promising approach to improving coverage is starting HPV vaccination at age 9 as discussed in several published studies,Citation16–21 including those published in this special issue, which demonstrate the feasibility, value, and effectiveness of implementing HPV vaccination at age 9. The American Academy of PediatricsCitation22 and the American Cancer SocietyCitation23 have also strongly endorsed beginning the HPV vaccination series at age 9. In 2022, the Advisory Committee on Immunization Practices changed its statement to emphasize a recommendation to receive the vaccine at age 11 or 12, with the option to start at 9 years.Citation24 To ensure population benefits, it is important to reiterate that recommending and then administering HPV vaccination starting at age 9 may result in higher levels of initiation and on-time completion by the thirteenth birthday.

Beginning HPV vaccination at age 9 offers myriad benefits, such as increased time to complete the vaccination series by the thirteenth birthday, opportunities for additional spacing of recommending adolescent vaccinations, concerted focus on cancer prevention prior to first HPV exposure, lessened focus on sexual activity, and decreased emphasis on “required” vaccinations for school since HPV vaccination has school-entry requirements in only three US states at this time. However, evidence-based interventions to increase HPV vaccination have been largely based on bundled approaches with other routinely recommended adolescent vaccinations or for older populations, such as adults. Additionally, the evidence base for applying these approaches starting at age 9 is limited, leading to pressing questions: Can existing evidence-based approaches to support HPV vaccination be adapted to promote starting the series at age 9? How will we know if this is the case? To prompt attention to these questions, we offer an overview of the current evidence base related to promoting HPV vaccination, including gaps, and discuss the role of implementation science in guiding thoughtful adaptations to existing evidence.

Implementation science offers us a path forward to ensure high rigor with adaptation of existing evidence-based interventions and can also inform conceptualization, development, and testing of newly developed interventions to improve HPV vaccination coverage. Implementation science is defined as “the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and, hence, to improve the quality and effectiveness of health services”Citation25 and as “the study of methods to promote the adoption and integration of evidence-based practices, interventions, and policies into routine health care and public health settings to improve the impact on population health”.Citation26

The first step in assessing adaptation opportunities is to examine the available research evidence. The National Cancer Institute Evidence-based Cancer Control Programs (EBCCP) is an important repository of evidence-based interventions (or programs) for various cancer prevention and control topic areas.Citation27,Citation28 The repository includes interventions tested in a research study with published results in a peer-reviewed journal. The EBCCP website is searchable and includes HPV vaccination interventions. As of November 2022, there were six HPV vaccination interventions included in the EBCCP ().Citation29–34 The interventions largely focused on education and training. The time period for publication of the primary outcome (HPV vaccination initiation and/or completion) ranged from 2011 to 2016, which precedes the availability of Gardasil9 in the US and also prior to the latest ACIP guidelines published in 2019.Citation1,Citation2 Only two of the interventions included address HPV vaccination among both females and males;Citation30,Citation33 four interventions are female-only.Citation29,Citation31,Citation32,Citation34 The majority of these evidence-based interventions – five out of six – did not include 9–10-year-olds.Citation29–33 There are efforts underway to update the EBCCP repository for HPV vaccination programs and also many interventional research studies underway to determine effectiveness.

Table 1. Overview of evidence-based cancer control programs for HPV vaccination.

Another commonly used source of evidence-based interventions is The Guide to Community Preventive Services (The Community Guide), which is a collection of the evidence-based findings of the Community Preventive Services Task Force.Citation35 The Community Guide provides information on community preventive services, programs, and policies that have been shown to work and how they may fit the needs of a community. The Community Guide does not include specific interventions for HPV vaccination but does include recommended approaches for vaccinations overall. Unlike EBCCP, The Community Guide recommends interventions that are less packaged programs and more approaches or strategies. For vaccinations, interventions that are recommended based on strong evidence include interventions to enhance access to vaccination services, increase community demand for vaccinations, and increase provider- or system-based interventions. However, it is unclear which of these interventions, recommended based on strong evidence, are relevant for HPV vaccination and which may be appropriate for starting at age 9.

In addition to these two evidence-based repositories, there are numerous other published interventions that have been shown to successfully improve HPV vaccination initiation and/or completion.Citation36,Citation37 We have highlighted a few examples here. There is growing evidence about the value of designing multilevel interventions to target different levels (e.g., individual, interpersonal, clinical, and community).Citation38,Citation39 Quality improvementCitation40–43 and learning collaborativesCitation44–47 have shown promise by aligning activities with usual clinical workflows and also by including approaches recommended in The Community Guide. School-based interventions have not been as commonplace in the US as in other countries but have shown promise in certain geographic regions.Citation48 To date, these interventions have not yet been indexed in EBCCP or clearly outlined in The Community Guide. Nonetheless, with few exceptions, most of these have focused on the routine recommendation age of 11–12 years. Additionally, the existing evidence base does not reflect the diversity of populations who may benefit from HPV vaccination at age 9 and the range of public health and clinical settings that serve them.

Across the research literature, the absence of empirically tested interventions to improve HPV vaccination initiation and completion among 9–10-year-olds is noticeable and presents an ideal opportunity to explore how existing evidence-based interventions can be adapted and tested to ensure the key components of these interventions remain effective at earlier ages. Previous studies have estimated that translation of research evidence into practice takes 17 years.Citation49–51 Drivers of these lags are quite diverse, ranging from attributes of the intervention (e.g., complexity and appropriateness for the setting) to attributes of organizational and social context (e.g., resource availability and characteristics of service recipients).Citation52,Citation53 There are other depictions as well, such as bridging the discovery-delivery disconnectCitation54 that accounts for gaps that emerge during the traditional research process, notably the final gap in dissemination that characterizes the pitfalls of “if you build it, they will come” and emphasizes the importance of engagement throughout the research enterprise. A recent publication by Khan, Chambers, and NetaCitation53 showed that the landmark publication of HPV vaccination was in 2002 with US Food and Drug Administration (FDA) approval in 2006. The 50% threshold in HPV vaccination was achieved in 2016. This resulted in a 4-year gap between landmark publication and FDA approval and an additional 10-year gap to achieving the tipping point indicator. To prevent HPV cancers in the future, a more accelerated approach to ensuring good fit with existing evidence-based interventions and starting at age 9 for HPV vaccination is needed. With already slow uptake of HPV vaccination, especially among certain populations, acting now to improve vaccination rates is essential.

Implementation science offers systematic approaches to adapting and testing evidence-based interventions and approaches developed for older adolescents and even for adults to determine if they still yield meaningful impacts on vaccination rates for programs encouraging vaccination starting at age 9. In addition to developmental differences, the context change related to starting at age 9 may require altered implementation strategies to attend to relevant determinants. Adaptation has been defined as a process of thoughtful and deliberate alteration to the design or delivery of an evidence-based intervention to improve its fit or effectiveness in a given context or for a specific population.Citation55

Adaptations to evidence-based interventions must support a balance between making changes to maximize desired outcomes while retaining fidelity to fundamental elements of the evidence-based intervention.Citation56 This is often easier said than done, given that it is not always clear which elements of an intervention are critical versus exchangeable. One useful way to consider the balance is to focus on preserving the “function” rather than the”form” of the intervention.Citation55 This allows for utilization of the core principles of an intervention, without being tied to every detail of delivery. For example, some of the HPV interventions in the repositories emphasize use of digital video discs, commonly called DVDs, and were developed too soon to include social media or mobile phone applications. Appropriate adaptations can preserve this type of engagement and messaging strategy while using dramatically different delivery channels.

When making and testing adaptations, it is critical to capture and report these changes using systematic procedures, to support the development of a rich evidence base around adaptation. A few of the frameworks and approaches to guide the adaptation process are summarized here. These frameworks and approaches offer a rigorous manner to track inputs, processes, and outputs due to planned and unplanned adaptations to focus on starting HPV vaccination at age 9. Future research is needed in studying the type and nature of adaptations so as not to reduce intervention effectiveness.

Early publications on adaptations identified potential sources of intervention adaptations, such as to the setting, target audience, mode of delivery, cultural, and core components, and have informed evolving frameworks to guide adaptations.Citation57 The Framework for Modification and Adaptations was developed to document modifications to evidence-based interventions.Citation58 This framework assesses and documents by whom modifications are made, what is modified, at what level of delivery (for whom or what modifications made), which context modifications are made, and what is the nature of the content modifications. The Framework for Reporting Adaptations and Modifications-Expanded (FRAME) built on the original model to include when and how changes happened, whether changes were planned or unplanned, relationship to fidelity, and reasons and goals for the changes.Citation59,Citation60 An additional model, FRAME-Implementation Strategies (FRAME-IS), offers a more intentional focus on the strategies used to support integration of evidence-based interventions into practice settings.Citation61

Other frameworks and approaches for adaptation also exist. Intervention mappingCitation62 is a commonly used intervention development framework, which also has relevance for adaptation. Intervention Mapping-Adapt (IM-Adapt) has emerged as an essential guide to apply principles of intervention mapping to adapting evidence-based interventions.Citation63,Citation64 IM-Adapt focuses on understanding needs and capacity and planning and evaluating adaptations based on these assessments.Citation63,Citation64 ADAPT was developed to guide specific adaptations to evidence-based interventions to account for new contexts.Citation64–66 The multi-step development process of ADAPT resulted in a series of questions for adaptation that can ensure the process includes the right people (adaptation team), clear rationale for adaptations, planning for and undertaking adaptations, and ensuring that interventions can be implemented and maintained at an appropriate scale.Citation66 Finally, assessing the impact of adaptations may require additional guidance to ensure complexities are considered. For example, Iterative Decision-making for Evaluation of Adaptations (IDEA) offers a series of decisions to balance adaptations to evidence-based intervention.Citation67 Those making adaptations are prompted to consider core elements of the intervention, opportunities for piloting, and whether or not potential costs of adaptations are acceptable.

A search of the peer-reviewed published literature revealed no published studies explicitly using one of the aforementioned frameworks and approaches to adapt HPV vaccination interventions for age 9. However, there were articles describing various approaches to adapt interventions – or components of interventions – for different populations and different channels.Citation68–72 This included reference to commonly used implementations of science theories, models, and frameworks, as well as needed cultural adaptation. Gilkey and colleagues,Citation73 examined the challenge with bringing evidence-based HPV vaccination interventions to scale in real-world settings. Of note, the authors acknowledge the importance of future implementation research in examining the role of contextual factors in supporting scale-up and leveraging assets to enhance sustainability.Citation73 These challenges noted by Gilkey are addressable using adaptation frameworks to track and monitor necessary modifications and to assess the impact of such modifications on overall process and outcome measures.Citation73

There are other considerations when exploring adaptations of existing evidence-based interventions for starting HPV vaccination at age 9. As noted, there are differences in HPV vaccination coverage depending on geographic location, rurality, and population characteristics that have persisted. Therefore, equity is a critical consideration when determining the necessary adaptations to evidence-based interventions for success with starting at age 9.Citation74,Citation75 There may be instances where an evidence-based intervention requires adaptations to meet the needs of a new target population in which the context may differ so drastically from the original source of the evidence base that enough adaptations would be needed that one could not consider the program evidence-based any longer. In this case, starting at age 9 may elucidate altered determinants or implementation strategies due to the modified context. Partnerships with those most affected (e.g., young people and their caregivers), those delivering care (e.g., pediatricians and school clinic nurses), and those who can impact the process (e.g., policymakers) can offer insight into the types of adaptations required for success. This will inform decisions around adapting to existing interventions or beginning anew.Citation76 Similar considerations are also highlighted in calls to use methods of transcreationCitation77,Citation78 to co-create and co-produce interventions (while drawing on the evidence base) in pursuit of addressing health inequities. In addition to noted major considerations regarding adaptations, the economics of adaptation is an important element to track, monitor, and consider.Citation79 The planned and unplanned adaptations made to an intervention may alter the required resources necessary for effective implementation of core components. Increasing recognition of research-to-practice gaps has called for rapid research informed by rigorous models, which predated the pandemics, such as the Framework to Assess Speed of Translation (FAST),Citation80 Designed for Accelerated Translation (DART),Citation81 and designing for dissemination.Citation82,Citation83 Additionally, such efforts must consider a focus on sustainability, if we are to continue achieving population benefit.Citation84 provides potential adaptations of The Community Guide recommended interventions and approaches guided by FRAME and FRAME-IS to illustrate possible application in practice.

Table 2. Potential adaptations to the community guide interventions and approaches.

We do not have 17 years to wait for newly developed evidence-based interventions to promote the start of HPV vaccination at age 9.Citation85 With growing evidence around the success of HPV vaccinations globally, it is imperative that we leverage implementation science to reduce the research-to-practice gap for evidence-based interventions and use tools today to see if what we know works now can be adapted for additional populations and contexts. Current approaches to HPV vaccination have worked for many – but not for all. We fall short of the Healthy People 2030 goal of 80% of 13–15-year-olds vaccinated in the US, especially in some regions of the country and among some populations. Starting vaccinations at age 9 has the potential to increase HPV vaccination rates. However, many evidence-based interventions and strategies have not been specifically tested and/or incorporated with a focus on vaccine initiation for 9-year-olds. Implementation science and specifically the study of adaptations, can help to ensure that we can modify existing interventions and strategies to be applicable to 9-year-olds while simultaneously documenting the key determinants and drivers for implementing interventions to be maximally effective. We require additional information on intervention implementation in a constantly changing healthcare environment to understand how to adapt appropriately. In addition to using what we have now that has been shown to work for 11–12-year-old children, we must also consider novel approaches that may be needed with populations that have had consistently lower coverage, such as rural and/or more conservative communities in the US. What we have available now is not working for all and adaptation of existing evidence-based interventions may or may not bring the needed results. The longer we wait to meet the Healthy People 2030 goal, which was the same as our Healthy People 2020 goal, hundreds of thousands of children will miss out on this safe, effective cancer prevention vaccine.

Disclosure statement

The authors declare the following: Dr. Brandt: Nothing to disclose. Dr. Footman: Nothing to disclose. Dr. Adsul: Nothing to disclose. Dr. Ramanadhan: Nothing to disclose. Dr. Kepka: Dr. Kepka is a co-investigator on an HPV vaccination study at the University of Utah. In this study, a small portion of her salary was supported by the American Cancer Society, who received funding from Merck, for the purpose of the “Mission: HPV Cancer Free Quality Improvement Initiative.” This project will end on December 31, 2022. Dr. Kepka has also assisted Merck as an expert consultant.

Additional information

Funding

This publication was supported by the American Lebanese and Syrian Associated Charities (ALSAC) of St. Jude Children’s Research Hospital. Additional funding sources include the National Cancer Institute [U54CA156732]. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Cancer Institute or the National Institutes of Health. No commercial support was obtained.]

References

  • Meites E, Kempe A, Markowitz LE. Use of a 2-dose schedule for human papillomavirus vaccination - updated recommendations of the advisory committee on immunization practices. Morb Mortal Wkly Rep. 2016 Dec 16;65(49):1405–8. doi:10.15585/mmwr.mm6549a5. PMID: 27977643.
  • Meites E, Szilagyi PG, Chesson HW, Unger ER, Romero JR, Markowitz LE. Human papillomavirus vaccination for adults: updated recommendations of the advisory committee on immunization practices. Morb Mortal Wkly Rep. 2019 Aug 16;68(32):698–702. doi:10.15585/mmwr.mm6832a3. PMID: 31415491; PMCID: PMC6818701.
  • Petrosky E, Bocchini JA Jr, Hariri S, Chesson H, Curtis CR, Saraiya M, Unger ER, Markowitz LE. Centers for disease control and prevention (CDC). Use of 9-valent human papillomavirus (HPV) vaccine: updated HPV vaccination recommendations of the advisory committee on immunization practices. Morb Mortal Wkly Rep. 2015 Mar 27;64(11):300–04. PMID: 25811679; PMCID: PMC4584883.
  • Pingali C, Yankey D, Elam-Evans LD, Markowitz LE, Valier MR, Fredua B, Crowe SJ, Stokley S, Singleton JA. National vaccination coverage among adolescents aged 13-17 years - national immunization survey-teen, United States, 2021. Morb Mortal Wkly Rep. 2022 Sep 2;71(35):1101–08. doi:10.15585/mmwr.mm7135a1. PMID: 36048724; PMCID: PMC9472778.
  • Centers for Disease Control and Prevention, United States Department of Health and Human Services. Reasons to Get Vaccinated; 2021 Nov 21 [accessed 2022 Nov 1]. https://www.cdc.gov/hpv/parents/vaccine/six-reasons.html?CDC_AA_refVal=https%3A%2F%2Fwww.cdc.gov%2Fhpv%2Finfographics%2Fvacc-six-reasons.html.
  • Arbyn M, Xu L, Simoens C, Martin-Hirsch PP Prophylactic vaccination against human papillomaviruses to prevent cervical cancer and its precursors. Cochrane Database Syst Rev. 2018 May 9;5(5):CD009069. doi: 10.1002/14651858.CD009069.pub3. PMID: 29740819; PMCID: PMC6494566.
  • Falcaro M, Castañon A, Ndlela B, Checchi M, Soldan K, Lopez-Bernal J, Elliss-Brookes L, Sasieni P. The effects of the national HPV vaccination programme in England, UK, on cervical cancer and grade 3 cervical intraepithelial neoplasia incidence: a register-based observational study. Lancet. 2021 Dec 4;398(10316):2084–92. doi:10.1016/S0140-6736(21)02178-4. Epub 2021 Nov 3. PMID: 34741816.
  • Herweijer E, Sundström K, Ploner A, Uhnoo I, Sparén P, Arnheim-Dahlström L. Quadrivalent HPV vaccine effectiveness against high-grade cervical lesions by age at vaccination: a population-based study. Int J Cancer. 2016 Jun 15;138(12):2867–74. doi:10.1002/ijc.30035. Epub 2016 Mar 9. Erratum in: Int J Cancer. 2017 Jul 1;141(1):E1-E4. PMID: 26856527; PMCID: PMC5069657.
  • Kjaer SK, Dehlendorff C, Belmonte F, Baandrup L. Real-world effectiveness of human papillomavirus vaccination against cervical cancer. J Natl Cancer Inst. 2021 Oct 1;113(10):1329–35. doi:10.1093/jnci/djab080. PMID: 33876216; PMCID: PMC8486335.
  • Lehtinen M, Lagheden C, Luostarinen T, Eriksson T, Apter D, Harjula K, Kuortti M, Natunen K, Palmroth J, Petäjä T, et al. Ten-year follow-up of human papillomavirus vaccine efficacy against the most stringent cervical neoplasia end-point-registry-based follow-up of three cohorts from randomized trials. BMJ Open. 2017 Aug 18;7(8):e015867. doi:10.1136/bmjopen-2017-015867. PMID: 28821519; PMCID: PMC5629648.
  • Lei J, Ploner A, Elfström KM, Wang J, Roth A, Fang F, Sundström K, Dillner J, Sparén P. HPV vaccination and the risk of invasive cervical cancer. N Engl J Med. 2020 Oct 1;383(14):1340–48. doi:10.1056/NEJMoa1917338. PMID: 32997908.
  • Palmer T, Wallace L, Pollock KG, Cuschieri K, Robertson C, Kavanagh K, Cruickshank M. Prevalence of cervical disease at age 20 after immunisation with bivalent HPV vaccine at age 12-13 in Scotland: retrospective population study. BMJ. 2019 Apr 3;365:l1161. doi:10.1136/bmj.l1161. PMID: 30944092; PMCID: PMC6446188.
  • Perkins RB, Lin M, Wallington SF, Hanchate A Impact of number of human papillomavirus vaccine doses on genital warts diagnoses among a national cohort of U.S. adolescents. Sex Transm Dis. 2017 Jun;44(6):365–70. doi:10.1097/OLQ.0000000000000615. PMID: 28499288; PMCID: PMC5502820.
  • National Committee for Quality Assurance. Immunizations for adolescents (IMA); 2021 [accessed 2022 Nov 1]. https://www.ncqa.org/hedis/%20measures/immunizations-for-adolescents/.
  • Bednarczyk RA, Ellingson MK, Omer SB. Human papillomavirus vaccination before 13 and 15 years of age: analysis of national immunization survey teen data. J Infect Dis. 2019 Jul 31;220(5):730–34. doi:10.1093/infdis/jiy682. PMID: 30657920; PMCID: PMC6667791.
  • Biancarelli DL, Drainoni ML, Perkins RB. Provider experience recommending HPV vaccination before age 11 years. J Pediatr. 2020 Feb;217:92–97. doi:10.1016/j.jpeds.2019.10.025. Epub 2019 Nov 19. PMID: 31757474.
  • Goleman MJ, Dolce M, Morack J Quality improvement initiative to improve human papillomavirus vaccine initiation at 9 years of age. Acad Pediatr. 2018 Sep-Oct;18(7):769–75. doi:10.1016/j.acap.2018.05.005. Epub 2018 May 26. PMID: 29842924.
  • Perkins RB, Legler A, Jansen E, Bernstein J, Pierre-Joseph N, Eun TJ, Biancarelli DL, Schuch TJ, Leschly K, Athr F, et al. Improving HPV vaccination rates: a stepped-wedge randomized trial. Pediatrics. 2020 Jul;146(1):e20192737. doi:10.1542/peds.2019-2737. Epub 2020 Jun 15. PMID: 32540986.
  • National HPV Vaccination Roundtable. Evidence summary: HPV vaccination at 9-12 years of age; 2022 April [accessed 2022 Nov 1]. https://hpvroundtable.org/wp-content/uploads/2022/04/Evidence-Summary-HPV-Vaccination-Age-9-12-Final.pdf.
  • St Sauver JL, Rutten LJF, Ebbert JO, Jacobson DJ, McGree ME, Jacobson RM. Younger age at initiation of the human papillomavirus (HPV) vaccination series is associated with higher rates of on-time completion. Prev Med. 2016 Aug;89:327–33. doi:10.1016/j.ypmed.2016.02.039. Epub 2016 Feb 28. PMID: 26930513; PMCID: PMC4969174.
  • Kong WY, Huang Q, Thompson P, Grabert BK, Brewer NT, Gilkey MB Recommending human papillomavirus vaccination at age 9: a national survey of primary care professionals. Acad Pediatr. 2022 May-Jun;22(4):573–80. doi:10.1016/j.acap.2022.01.008. Epub 2022 Jan 23. PMID: 35081470; PMCID: PMC9081141.
  • O’leary ST, Nyquist AC Why AAP recommends initiating HPV vaccination as early as age 9; 2019 Oct 4 [accessed 2022 Nov 1]. https://www.aappublications.org/news/2019/10/04/hpv100419.
  • Saslow D, Andrews KS, Manassaram-Baptiste D, Smith RA, Fontham ETH, American Cancer Society Guideline Development Group. Human papillomavirus vaccination 2020 guideline update: American cancer society guideline adaptation. CA Cancer J Clin. 2020 Jul;70(4):274–80. doi:10.3322/caac.21616. Epub 2020 Jul 8. PMID: 32639044.
  • Centers for Disease Control and Prevention, United States Department of Health and Human Services; 2021 Nov 21 [accessed 2022 Nov 1]. https://www.cdc.gov/vaccines/vpd/hpv/hcp/recommendations.html.
  • Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. 2015 Sep 16;3(1):32. doi:10.1186/s40359-015-0089-9. PMID: 26376626; PMCID: PMC4573926.
  • National Cancer Institute. What is implementation science?; n.d. [accessed 2022 Nov 1]. https://cancercontrol.cancer.gov/is.
  • National Cancer Institute. Evidence-based cancer control programs; 2020 Oct 2 [accessed 2022 Nov 1]. https://ebccp.cancercontrol.cancer.gov/index.do.
  • Percy-Laurry A, Adsul P, Uy A, Vinson C Improving evidence-based program repositories: introducing the evidence-based cancer control programs (EBCCP) web repository. Am J Health Promot. 2021 Sep;35(7):897–99. doi:10.1177/08901171211006589. Epub 2021 Apr 8. PMID: 33827272.
  • Vanderpool RC, Cohen E, Crosby RA, Jones MG, Bates W, Casey BR, Collins T “1-2-3 pap” intervention improves HPV vaccine series completion among Appalachian women. J Commun. 2013 Feb;63(1):95–115. doi:10.1111/jcom.12001. Epub 2013 Jan 10. PMID: 26560123; PMCID: PMC4639462.
  • Perkins RB, Zisblatt L, Legler A, Trucks E, Hanchate A, Gorin SS. Effectiveness of a provider-focused intervention to improve HPV vaccination rates in boys and girls. Vaccine. 2015 Feb 25;33(9):1223–29. doi:10.1016/j.vaccine.2014.11.021. Epub 2014 Nov 24. PMID: 25448095.
  • Fiks AG, Grundmeier RW, Mayne S, Song L, Feemster K, Karavite D, Hughes CC, Massey J, Keren R, Bell LM, et al. Effectiveness of decision support for families, clinicians, or both on HPV vaccine receipt. Pediatrics. 2013 Jun;131(6):1114–24. doi:10.1542/peds.2012-3122. Epub 2013 May 6. PMID: 23650297; PMCID: PMC3666111.
  • Hopfer S, Clippard JR College women’s HPV vaccine decision narratives. Qual Health Res. 2011 Feb;21(2):262–77. doi:10.1177/1049732310383868. Epub 2010 Sep 14. PMID: 20841433.
  • Brewer NT, Hall ME, Malo TL, Gilkey MB, Quinn B, Lathren C. Announcements versus conversations to improve HPV vaccination coverage: a randomized trial. Pediatrics. 2017 Jan;139(1):e20161764. doi:10.1542/peds.2016-1764. Epub 2016 Dec 5. PMID: 27940512; PMCID: PMC5192091.
  • Winer RL, Gonzales AA, Noonan CJ, Buchwald DS A cluster-randomized trial to evaluate a mother-daughter dyadic educational intervention for increasing HPV vaccination coverage in American Indian girls. J Community Health. 2016 Apr;41(2):274–81. doi:10.1007/s10900-015-0093-2. PMID: 26399648; PMCID: PMC4779421.
  • Guide to Community Preventive Services, Community Preventive Services Task Force; n.d. [accessed 2022 Nov 1]. https://www.thecommunityguide.org/.
  • Bennett C, Edwards D, Sherman SM, Baker P, Waheed DE, Vorsters A, Çevik H S, Karafillakis E, Prue G, Kelly D Which interventions improve HPV vaccination uptake and intention in children, adolescents and young adults? An umbrella review. Sex Transm Infect. 2022 Dec;98(8):599–607. doi:10.1136/sextrans-2022-055504. Epub 2022 Sep 5. PMID: 36396162.
  • Lott BE, Okusanya BO, Anderson EJ, Kram NA, Rodriguez M, Thomson CA, Rosales C, Ehiri JE. Interventions to increase uptake of human papillomavirus (HPV) vaccination in minority populations: a systematic review. Prev Med Rep. 2020 Jul 11;19:101163. doi:10.1016/j.pmedr.2020.101163. PMID: 32714778; PMCID: PMC7372149.
  • Fisher-Borne M, Preiss AJ, Black M, Roberts K, Saslow D Early outcomes of a multilevel human papillomavirus vaccination pilot intervention in federally qualified health centers. Acad Pediatr. 2018 Mar;18(2S):S79–84. doi:10.1016/j.acap.2017.11.001. PMID: 29502642.
  • Paskett E, Thompson B, Ammerman AS, Ortega AN, Marsteller J, Richardson D. Multilevel interventions to address health disparities show promise in improving population health. Health Aff (Millwood). 2016 Aug 1;35(8):1429–34. doi:10.1377/hlthaff.2015.1360. PMID: 27503968; PMCID: PMC5553289.
  • Calo WA, Gilkey MB, Leeman J, Heisler-MacKinnon J, Averette C, Sanchez S, Kornides ML, Brewer NT. Coaching primary care clinics for HPV vaccination quality improvement: comparing in-person and webinar implementation. Transl Behav Med. 2019 Jan 1;9(1):23–31. doi:10.1093/tbm/iby008. PMID: 29471460; PMCID: PMC6305561.
  • Cassidy B, Braxter B, Charron-Prochownik D, Schlenk EA A quality improvement initiative to increase HPV vaccine rates using an educational and reminder strategy with parents of preteen girls. J Pediatr Health Care. 2014 Mar-Apr;28(2):155–64. doi:10.1016/j.pedhc.2013.01.002. Epub 2013 Mar 20. PMID: 23522561.
  • Grabert BK, Heisler-MacKinnon J, Liu A, Margolis MA, Cox ED, Gilkey MB. Prioritizing and implementing HPV vaccination quality improvement programs in healthcare systems: the perspective of quality improvement leaders. Hum Vaccin Immunother. 2021 Oct 3;17(10):3577–86. doi:10.1080/21645515.2021.1913965. Epub 2021 Jun 21. PMID: 34152924; PMCID: PMC8437543.
  • Perkins RB, Foley S, Hassan A, Jansen E, Preiss S, Isher-Witt J, Fisher-Borne M Impact of a multilevel quality improvement intervention using national partnerships on human papillomavirus vaccination rates. Acad Pediatr. 2021 Sep-Oct;21(7):1134–41. doi:10.1016/j.acap.2021.05.018. Epub 2021 May 20. PMID: 34023489.
  • Fu L, Smith A, Ciotoli C, Dannenbaum M, Jacobs M. An immunization quality improvement learning collaborative in the college health setting. J Am Coll Health. 2021 Oct;20:1–10. doi:10.1080/07448481.2021.1979560. Epub ahead of print. PMID: 34670105.
  • Oliver K, Beskin K, Noonan L, Shah A, Perkins R, Humiston S. A quality improvement learning collaborative for human papillomavirus vaccination. Pediatr Qual Saf. 2020 Dec 28;6(1):e377. doi:10.1097/pq9.0000000000000377. PMID: 33409429; PMCID: PMC7781351.
  • Rand CM, Schaffer SJ, Dhepyasuwan N, Blumkin A, Albertin C, Serwint JR, Darden PM, Humiston SG, Mann KJ, Stratbucker W, et al. Provider communication, prompts, and feedback to improve HPV vaccination rates in resident clinics. Pediatrics. 2018 Apr;141(4):e20170498. doi:10.1542/peds.2017-0498. Epub 2018 Mar 14. PMID: 29540572; PMCID: PMC9473325.
  • Rand CM, Tyrrell H, Wallace-Brodeur R, Goldstein NPN, Darden PM, Humiston SG, Albertin CS, Stratbucker W, Schaffer SJ, Davis W, et al. A learning collaborative model to improve human papillomavirus vaccination rates in primary care. Acad Pediatr. 2018 Mar;18(2S):S46–52. doi:10.1016/j.acap.2018.01.003. PMID: 29502638.
  • Flood T, Wilson IM, Prue G, McLaughlin M, Hughes CM. Impact of school-based educational interventions in middle adolescent populations (15-17yrs) on human papillomavirus (HPV) vaccination uptake and perceptions/knowledge of HPV and its associated cancers: a systematic review. Prev Med. 2020 Oct;139:106168. doi:10.1016/j.ypmed.2020.106168. Epub 2020 Jun 27. PMID: 32603795.
  • Balas EA, Boren SA. Managing clinical knowledge for health care improvement. Yearb Med Inform. 2000;09(01):65–70. doi: 10.1055/s-0038-1637943. PMID: 27699347.
  • Grant J, Green L, Mason B. Basic research and health: a reassessment of the scientific basis for the support of biomedical science. Res Eval. 2003;12(3):217–24. doi:10.3152/147154403781776618.
  • Morris ZS, Wooding S, Grant J The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011 Dec;104(12):510–20. doi:10.1258/jrsm.2011.110180. PMID: 22179294; PMCID: PMC3241518.
  • Berwick DM. Disseminating innovations in health care. JAMA. 2003 Apr 16;289(15):1969–75. doi:10.1001/jama.289.15.1969. PMID: 12697800.
  • Khan S, Chambers D, Neta G Revisiting time to translation: implementation of evidence-based practices (EBPs) in cancer control. Cancer Causes Control. 2021 Mar;32(3):221–30. doi:10.1007/s10552-020-01376-z. Epub 2021 Jan 4. PMID: 33392908.
  • Freeman HP. Commentary on the meaning of race in science and society. Cancer Epidemiol Biomarkers Prev. 2003 Mar;12(3):232s–6s. PMID: 12646516.
  • Stirman SW, Gamarra J, Bartlett B, Calloway A, Gutner C. Empirical examinations of modifications and adaptations to evidence-based psychotherapies: methodologies, impact, and future directions. Clin Psychol (New York). 2017;24(4):396–420. doi:10.1111/cpsp.12218.
  • Escoffery C, Lebow-Skelley E, Udelson H, Boing EA, Wood R, Fernandez ME, Mullen PD. A scoping study of frameworks for adapting public health evidence-based interventions. Transl Behav Med. 2019 Jan 1;9(1):1–10. doi:10.1093/tbm/ibx067. PMID: 29346635; PMCID: PMC6305563.
  • Chambers DA, Norton WE The adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016 Oct;51(4 Suppl 2):S124–31. doi:10.1016/j.amepre.2016.05.011. Epub 2016 Jun 28. PMID: 27371105; PMCID: PMC5030159.
  • Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013 Jun 10;8(1):65. doi:10.1186/1748-5908-8-65. PMID: 23758995; PMCID: PMC3686699.
  • Kirk MA, Moore JE, Wiltsey Stirman S, Birken SA. Towards a comprehensive model for understanding adaptations’ impact: the model for adaptation design and impact (MADI). Implement Sci. 2020 Jul 20;15(1):56. doi:10.1186/s13012-020-01021-y. PMID: 32690104; PMCID: PMC7370455.
  • Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019 Jun 6;14(1):58. doi:10.1186/s13012-019-0898-y. PMID: 31171014; PMCID: PMC6554895.
  • Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci. 2021 Apr 7;16(1):36. doi:10.1186/s13012-021-01105-3. PMID: 33827716; PMCID: PMC8024675.
  • Bartholomew LK, Parcel GS, Kok G Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ Behav. 1998 Oct;25(5):545–63. doi:10.1177/109019819802500502. PMID: 9768376.
  • Highfield L, Hartman MA, Mullen PD, Rodriguez SA, Fernandez ME, Bartholomew LK. Intervention mapping to adapt evidence-based interventions for use in practice: increasing mammography among African American women. Biomed Res Int. 2015;2015:160103. doi:10.1155/2015/160103. Epub 2015 Oct 26. PMID: 26587531; PMCID: PMC4637430.
  • Walker TJ, Foster M, Szeszulski J, Craig DW, Mullen PD, Fernández ME. Evidence-based intervention (EBI) mapping: a systematic approach to understanding the components and logic of EBIs. BMC Public Health. 2022 Jul 7;22(1):1300. doi:10.1186/s12889-022-13692-x. PMID: 35794615; PMCID: PMC9261043.
  • Evans RE, Craig P, Hoddinott P, Littlecott H, Moore L, Murphy S, O’cathain A, Pfadenhauer L, Rehfuess E, Segrott J, et al. When and how do ‘effective’ interventions need to be adapted and/or re-evaluated in new contexts? The need for guidance. J Epidemiol Community Health. 2019 Jun;73(6):481–82. doi:10.1136/jech-2018-210840. Epub 2019 Feb 20. PMID: 30787038; PMCID: PMC6581090.
  • Moore G, Campbell M, Copeland L, Craig P, Movsisyan A, Hoddinott P, Littlecott H, O’cathain A, Pfadenhauer L, Rehfuess E, et al. Adapting interventions to new contexts-the ADAPT guidance. BMJ. 2021 Aug 3;374:n1679. doi: 10.1136/bmj.n1679. PMID: 34344699; PMCID: PMC8329746.
  • Miller CJ, Wiltsey-Stirman S, Baumann AA Iterative Decision-making for Evaluation of Adaptations (IDEA): a decision tree for balancing adaptation, fidelity, and intervention impact. J Community Psychol. 2020 May;48(4):1163–77. doi:10.1002/jcop.22279. Epub 2020 Jan 23. PMID: 31970812; PMCID: PMC7261620.
  • Colon-Lopez V, Soto-Abreu R, Medina-Laabes DT, Diaz-Miranda OL, Ortiz AP, Suarez EL, Hull PC. Implementation of the human papillomavirus school-entry requirement in Puerto Rico: barriers and facilitators using the consolidated framework for implementation research. Hum Vaccin Immunother. 2021 Nov 2;17(11):4423–32. doi:10.1080/21645515.2021.1955609. Epub 2021 Aug 9. PMID: 34369857; PMCID: PMC8828084.
  • Hopfer S, Duong HT, Garcia S, Tanjasiri SP Health information source characteristics matter: adapting the dissemination of an HPV vaccine intervention to reach latina and Vietnamese women. J Prim Prev. 2021 Oct;42(5):511–29. doi:10.1007/s10935-021-00643-2. Epub 2021 Jul 20. PMID: 34283351; PMCID: PMC8290389.
  • Hopfer S, Phillips KK, Weinzierl M, Vasquez HE, Alkhatib S, Harabagiu SM. Adaptation and dissemination of a national cancer institute HPV vaccine evidence-based cancer control program to the social media messaging environment. Front Digit Health. 2022 Jul 27;4:819228. doi:10.3389/fdgth.2022.819228. PMID: 35966142; PMCID: PMC9363572.
  • Rodriguez SA, Roncancio AM, Savas LS, Lopez DM, Vernon SW, Fernandez ME. Using intervention mapping to develop and adapt two educational interventions for parents to increase HPV vaccination among Hispanic adolescents. Front Public Health. 2018 Jun 15;6:164. doi:10.3389/fpubh.2018.00164. PMID: 29963542; PMCID: PMC6013574.
  • Zhang X, Tang L. Cultural adaptation in HPV vaccine intervention among racial and ethical minority population: a systematic literature review. Health Educ Res. 2022 Jan 27;36(5):479–93. doi:10.1093/her/cyab034. PMID: 34542147.
  • Gilkey MB, Parks MJ, Margolis MA, McRee AL, Terk JV Implementing evidence-based strategies to improve HPV vaccine delivery. Pediatrics. 2019 Jul;144(1):e20182500. doi:10.1542/peds.2018-2500. Epub 2019 Jun 17. PMID: 31209158; PMCID: PMC6615521.
  • Adsul P, Chambers D, Brandt HM, Fernandez ME, Ramanadhan S, Torres E, Leeman J, Baquero B, Fleischer L, Escoffery C, et al. Grounding implementation science in health equity for cancer prevention and control. Implement Sci Commun. 2022 Jun 3;3(1):56. doi:10.1186/s43058-022-00311-4. PMID: 35659151; PMCID: PMC9164317.
  • Aschbrenner KA, Mueller NM, Banerjee S, Bartels SJ. Applying an equity lens to characterizing the process and reasons for an adaptation to an evidenced-based practice. Implement Res Pract. 2021 Jan-Dec;2. doi: 10.1177/26334895211017252. Epub 2021 May 26. PMID: 34514417; PMCID: PMC8428660.
  • Ramanadhan S, Davis MM, Armstrong R, Baquero B, Ko LK, Leng JC, Salloum RG, Vaughn NA, Brownson RC. Participatory implementation science to increase the impact of evidence-based cancer prevention and control. Cancer Causes Control. 2018 Mar;29(3):363–69. doi:10.1007/s10552-018-1008-1. Epub 2018 Feb 7. PMID: 29417296; PMCID: PMC5858707.
  • Nápoles AM, Santoyo-Olsson J, Stewart AL. Methods for translating evidence-based behavioral interventions for health-disparity communities. Prev Chronic Dis. 2013 Nov 21;10:E193. doi:10.5888/pcd10.130133. PMID: 24262025; PMCID: PMC3839588.
  • Nápoles AM, Stewart AL. Transcreation: an implementation science framework for community-engaged behavioral interventions to reduce health disparities. BMC Health Serv Res. 2018 Sep 12;18(1):710. doi:10.1186/s12913-018-3521-z. PMID: 30208873; PMCID: PMC6134771.
  • Salloum RG, Wagner TH, Midboe AM, Daniels SI, Quanbeck A, Chambers DA. The economics of adaptations to evidence-based practices. Implement Sci Commun. 2022 Sep 24;3(1):100. doi:10.1186/s43058-022-00345-8. PMID: 36153575; PMCID: PMC9509646.
  • Proctor E, Ramsey AT, Saldana L, Maddox TM, Chambers DA, Rc B. FAST: a framework to assess speed of translation of health innovations to practice and policy. Glob Implement Res Appl. 2022;2(2):107–19. doi:10.1007/s43477-022-00045-4. Epub 2022 Jun 2. PMID: 35669171; PMCID: PMC9161655.
  • Ramsey AT, Proctor EK, Chambers DA, Garbutt JM, Malone S, Powderly WG, Bierut LJ Designing for accelerated translation (DART) of emerging innovations in health. J Clin Transl Sci. 2019 Jun;3(2–3):53–58. doi:10.1017/cts.2019.386. Epub 2019 Jul 30. PMID: 31528365; PMCID: PMC6746422.
  • Brownson RC, Jacobs JA, Tabak RG, Hoehner CM, Stamatakis KA Designing for dissemination among public health researchers: findings from a national survey in the United States. Am J Public Health. 2013 Sep;103(9):1693–99. doi:10.2105/AJPH.2012.301165. Epub 2013 Jul 18. PMID: 23865659; PMCID: PMC3966680.
  • Kwan BM, Brownson RC, Glasgow RE, Morrato EH, Luke DA. Designing for dissemination and sustainability to promote equitable impacts on health. Annu Rev Public Health. 2022 Apr 5;43(1):331–53. doi:10.1146/annurev-publhealth-052220-112457. Epub 2022 Jan 4. PMID: 34982585; PMCID: PMC9260852.
  • Shelton RC, Chambers DA, Glasgow RE. An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time. Front Public Health. 2020 May 12;8:134. doi:10.3389/fpubh.2020.00134. PMID: 32478025; PMCID: PMC7235159.
  • Eisman AB, Kim B, Salloum RG, Shuman CJ, Glasgow RE. Advancing rapid adaptation for urgent public health crises: using implementation science to facilitate effective and efficient responses. Front Public Health. 2022 Aug 24;10:959567. doi:10.3389/fpubh.2022.959567. PMID: 36091566; PMCID: PMC9448975.