An introduction to implementation evaluation of school-based interventions

References

• Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Roesch, S. C. (2016). Validation of the Implementation Leadership Scale (ILS) in substance use disorder treatment organizations. Journal of Substance Abuse Treatment, 68, 31–35. https://doi.org/10.1016/j.jsat.2016.05.004
   PubMed Web of Science ®Google Scholar
• Abry, T., Hulleman, C. S., & Rimm-Kaufman, S. E. (2015). Using indices of fidelity to intervention core components to identify program active ingredients. American Journal of Evaluation, 36(3), 320–338. https://doi.org/10.1177/1098214014557009
   Web of Science ®Google Scholar
• Blase, K. A., & Fixsen, D. L. (2013). Core intervention components: Identifying and operationalizing what makes programs work. US Department of Health and Human Services.
   Google Scholar
• Bywater, T. (2012). Developing rigorous programme evaluation. In B. Kelly & D. F. Perkins (Eds.), Handbook of implementation science for psychology in education (pp. 37–53). Cambridge University Press. https://doi.org/10.1017/CBO9781139013949.006
   Google Scholar
• Cassar, S., Salmon, J., Timperio, A., Naylor, P.-J., Van Nassau, F., Contardo Ayala, A. M., & Koorts, H. (2019). Adoption, implementation and sustainability of school-based physical activity and sedentary behaviour interventions in real-world settings: A systematic review. International Journal of Behavioral Nutrition and Physical Activity, 16(120), 1–13. https://doi.org/10.1186/s12966-019-0876-4
   PubMedGoogle Scholar
• Clinton-McHarg, T., Yoong, S. L., Tzelepis, F., Regan, T., Fielding, A., Skelton, E., Kingsland, M., Ooi, J. Y., & Wolfenden, L. (2016). Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the consolidated framework for implementation research: A systematic review. Implementation Science, 11(148), 1–22. https://doi.org/10.1186/s13012-016-0512-5
   PubMedGoogle Scholar
• Cook, C. R., Lyon, A. R., Locke, J., Waltz, T., & Powell, B. J. (2019). Adapting a compilation of implementation strategies to advance school-based implementation research and practice. Prevention Science, 20(6), 914–935. https://doi.org/10.1007/s11121-019-01017-1
   PubMed Web of Science ®Google Scholar
• Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(50), 1–15. https://doi.org/10.1186/1748-5908-4-50
   PubMed Web of Science ®Google Scholar
• Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. https://doi.org/10.1007/s10464-008-9165-0
   PubMed Web of Science ®Google Scholar
• Dusenbury, L. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256. https://doi.org/10.1093/her/18.2.237
   PubMed Web of Science ®Google Scholar
• Ehrhart, M. G., Torres, E. M., Wright, L. A., Martinez, S. Y., & Aarons, G. A. (2016). Validating the Implementation Climate Scale (ICS) in child welfare organizations. Child Abuse & Neglect, 53, 17–26. https://doi.org/10.1016/j.chiabu.2015.10.017
   PubMed Web of Science ®Google Scholar
• Kien, C., Griebler, U., Schultes, M.-T., Thaler, K., & Stamm, T. (2021). Psychometric testing of the German versions of three implementation outcome measures. Global Implementation Research and Applications. Advance online publication. https://doi.org/10.1007/s43477-021-00019-y
   Google Scholar
• Kien, C., Schultes, M.-T., Szelag, M., Schoberberger, R., & Gartlehner, G. (2018). German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: A systematic review. Implementation Science, 13(150), 1–16. https://doi.org/10.1186/s13012-018-0837-3
   PubMedGoogle Scholar
• Kittelman, A., Bromley, K. W., Mercer, S. H., & McIntosh, K. (2019). Validation of a measure of sustainability of school-wide behavior interventions and supports. Remedial and Special Education, 40(2), 67–73. https://doi.org/10.1177/0741932517753821
   Web of Science ®Google Scholar
• Klug, J., Schultes, M.-T., & Spiel, C. (2018). Assessment at school – Teachers’ diary-supported implementation of a training program. Teaching and Teacher Education, 76, 298–308. https://doi.org/10.1016/j.tate.2017.10.014
   Web of Science ®Google Scholar
• Koh, S., Lee, M., Brotzman, L. E., & Shelton, R. C. (2020). An orientation for new researchers to key domains, processes, and resources in implementation science. Translational Behavioral Medicine, 10(1), 179–185. https://doi.org/10.1093/tbm/iby095
   Web of Science ®Google Scholar
• Kollmayer, M., Schultes, M.-T., Lüftenegger, M., Finsterwald, M., Spiel, C., & Schober, B. (2020). REFLECT – A teacher training program to promote gender equality in schools. Frontiers in Education, 5(136), 1–8. https://doi.org/10.3389/feduc.2020.00136
   Google Scholar
• Landes, S. J., McBain, S. A., & Curran, G. M. (2019). An introduction to effectiveness-implementation hybrid designs. Psychiatry Research, 280(1–6), 112513. https://doi.org/10.1016/j.psychres.2019.112513
   PubMedGoogle Scholar
• Lendrum, A., & Humphrey, N. (2012). The importance of studying the implementation of interventions in school settings. Oxford Review of Education, 38(5), 635–652. https://doi.org/10.1080/03054985.2012.734800
   Web of Science ®Google Scholar
• Lewis, C. C., & Dorsey, C. (2020). Advancing implementation science measurement. In B. Albers, A. Shlonsky, & R. Mildon (Eds.), Implementation science 3.0 (pp. 227–251). Springer International Publishing. https://doi.org/10.1007/978-3-030-03874-8_9
   Google Scholar
• Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015). Outcomes for implementation science: An enhanced systematic review of instruments using evidence-based rating criteria. Implementation Science, 10(155), 1–17. https://doi.org/10.1186/s13012-015-0342-x
   PubMedGoogle Scholar
• Martinez, R., Lewis, C., & Weiner, B. (2014). Instrumentation issues in implementation science. Implementation Science, 9(118), 1–9. https://doi.org/10.1186/s13012-014-0118-8
   Google Scholar
• McIntosh, K., Massar, M. M., Algozzine, R. F., George, H. P., Horner, R. H., Lewis, T. J., & Swain-Bradway, J. (2017). Technical adequacy of the SWPBIS tiered fidelity inventory. Journal of Positive Behavior Interventions, 19(1), 3–13. https://doi.org/10.1177/1098300716637193
   Web of Science ®Google Scholar
• Moullin, J. C., Sabater-Hernández, D., Fernandez-Llimos, F., & Benrimoj, S. I. (2015). A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Research Policy and Systems, 13(16), 1–11. https://doi.org/10.1186/s12961-015-0005-z
   PubMedGoogle Scholar
• Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24(3), 315–340. https://doi.org/10.1177/109821400302400303
   Web of Science ®Google Scholar
• Nilsen, P. (2015). Making sense of implementation theories, models and frameworks. Implementation Science, 10(53), 1–13. https://doi.org/10.1186/s13012-015-0242
   PubMedGoogle Scholar
• Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53. https://doi.org/10.1007/s10488-010-0314-z
   PubMed Web of Science ®Google Scholar
• Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
   PubMed Web of Science ®Google Scholar
• Rojas-Andrade, R., & Bahamondes, L. L. (2019). Is implementation fidelity important? A systematic review on school-based mental health programs. Contemporary School Psychology, 23(4), 339–350. https://doi.org/10.1007/s40688-018-0175-0
   Google Scholar
• Schultes, M.-T., Bergsmann, E., Brandt, L., Finsterwald, M., Kien, C., & Klug, J. (2019). How connecting psychology and implementation science supports pursuing the sustainable development goals. Zeitschrift Für Psychologie, 227(2), 129–133. https://doi.org/10.1027/2151-2604/a000364
   Web of Science ®Google Scholar
• Schultes, M.-T., Jöstl, G., Finsterwald, M., Schober, B., & Spiel, C. (2015). Measuring intervention fidelity from different perspectives with multiple methods: The reflect program as an example. Studies in Educational Evaluation, 47, 102–112. https://doi.org/10.1016/j.stueduc.2015.10.001
   Web of Science ®Google Scholar
• Schultes, M.-T., Stefanek, E., van de Schoot, R., Strohmeier, D., & Spiel, C. (2014). Measuring implementation of a school-based violence prevention program: Fidelity and teachers’ responsiveness as predictors of proximal outcomes. Zeitschrift Für Psychologie, 222(1), 49–57. https://doi.org/10.1027/2151-2604/a000165
   Web of Science ®Google Scholar
• Shah, S., Allison, K. R., Schoueri-Mychasiw, N., Pach, B., Manson, H., & Vu-Nguyen, K. (2017). A review of implementation outcome measures of school-based physical activity interventions. Journal of School Health, 87(6), 474–486. https://doi.org/10.1111/josh.12514
   PubMed Web of Science ®Google Scholar
• Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implementation Science, 12(108), 1–12. https://doi.org/10.1186/s13012-017-0635-3
   PubMed Web of Science ®Google Scholar