References
- Aarons, G. A., Green, A. E., Willging, C. E., Ehrhart, M. G., Roesch, S. C., Hecht, D. B., & Chaffin, M. J. (2014). Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implementation Science, 9(1), 183. https://doi.org/10.1186/s13012-014-0183-z
- Barnett, M. L., Bernal, N. A., & Sanchez, B. E. L. (2020). Direct-to-consumer marketing for parent-child interaction therapy: Impact of language and messenger. Journal of Child and Family Studies, 29(1), 71–81. https://doi.org/10.1007/s10826-019-01575-6
- Barnett, M. L., Lau, A. S., Lind, T., Wright, B., Stadnick, N. A., Innes-Gomberg, D., Pesanti, K., & Brookman-Frazee, L. (2020). Caregiver attendance as a quality indicator in the implementation of multiple evidence-based practices for children. Journal of Clinical Child & Adolescent Psychology, 49(6), 868–882. https://doi.org/10.1080/15374416.2019.1683851
- Becan, J. E., Bartkowski, J. P., Knight, D. K., Wiley, T. R. A., DiClemente, R., Ducharme, L., Welsh, W. N., Bowser, D., McCollister, K., Hiller, M., Spaulding, A. C., Flynn, P. M., Swartzendruber, A., Dickson, M. F., Fisher, J. H., & Aarons, G. A. (2018). A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study. Health and Justice, 6(1), 9. https://doi.org/10.1186/s40352-018-0068-3
- Beidas, R. S., Marcus, S., Wolk, C. B., Powell, B., Aarons, G. A., Evans, A. C., Hurford, M. O., Hadley, T., Adams, D. R., Walsh, L. M., Babbar, S., Barg, F., & Mandell, D. S. (2016). A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 43(5), 640–649. https://doi.org/10.1007/s10488-015-0673-6
- Beveridge, R. M., Fowles, T. R., Masse, J. J., McGoron, L., Smith, M. A., Parrish, B. P., Circo, G., & Widdoes, N. (2015). State-wide dissemination and implementation of parent–child interaction therapy (PCIT): Application of theory. Children and Youth Services Review, 48, 38–48. https://doi.org/10.1016/j.childyouth.2014.11.013
- Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014). Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 228–236. https://doi.org/10.1007/s10488-012-0461-5
- Brookman-Frazee, L., Stadnick, N., Roesch, S., Regan, J., Barnett, M. L., Bando, L., Innes-Gomberg, D., & Lau, A. S. (2016). Measuring sustainment of multiple practices fiscally mandated in children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 1009–1022. https://doi.org/10.1007/s10488-016-0731-8
- Brookman-Frazee, L., Zhan, C., Stadnick, N., Sommerfeld, D., Roesch, S., Innes-Gomberg, D., Bando, L., & Lau, A. S. (2018). Using survival analysis to understand patterns of sustainment within a system-driven implementation of multiple evidence- based practices for children’s mental health services. Frontiers in Public Health, 6, 54. https://doi.org/10.3389/fpubh.2018.00054
- Bruns, E. J., Hoagwood, K. E., & Hamilton, J. D. (2008). State implementation of evidence-based practice for youths, part I: Responses to the state of the evidence. Journal of the American Academy of Child and Adolescent Psychiatry, 47(4), 369–373. https://doi.org/10.1097/CHI.0b013e31816485f4
- Chaffin, M., Funderburk, B., Bard, D., Valle, L. A., & Gurwitch, R. (2011). A combined motivation and parent–child interaction therapy package reduces child welfare recidivism in a randomized dismantling field trial. Journal of Consulting and Clinical Psychology, 79(1), 84–95. https://doi.org/10.1037/a0021227
- Chambers, D. A., & Rupp, A. (2015). Sharing state mental health data for research: Building toward ongoing learning in mental health care systems. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 586–587. https://doi.org/10.1007/s10488-015-0624-2
- Charest, É., & Gagné, M. (2019). Measuring and predicting service providers’ use of an evidence-based parenting program. Administration and Policy in Mental Health and Mental Health Services, 46(4), 542–554. https://doi.org/10.1007/s10488-019-00934-1
- Fixsen, D., Blase, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79(2), 213–230. https://doi.org/10.1177/001440291307900206
- Fowles, T. R., Masse, J. J., McGoron, L., Beveridge, R. M., Williamson, A. A., Smith, M. A., & Parrish, B. P. (2018). Home-based vs. clinic-based parent–child interaction therapy: Comparative effectiveness in the context of dissemination and implementation. Journal of Child and Family Studies, 27(4), 1115–1129. https://doi.org/10.1007/s10826-017-0958-3
- Hailemariam, M., Bustos, T., Montgomery, B., Barajas, R., Evans, L. B., & Drahota, A. (2019). Evidence-based intervention sustainability strategies: A systematic review. Implementation Science, 14(1), 57. https://doi.org/10.1186/s13012-019-0910-6
- Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. https://doi.org/10.1016/j.cpr.2010.02.005
- Herschell, A. D., Kolko, D. J., Scudder, A. T., Taber-Thomas, S., Schaffner, K. F., Hiegel, S. A., & Mrozowski, S. (2015). Protocol for a statewide randomized controlled trial to compare three training models for implementing an evidence-based treatment. Implementation Science, 10, 133. https://doi.org/10.1186/s13012-015-0324-z
- Hoagwood, K. E., Essock, S., Morrissey, J., Libby, A., Donahue, S., Druss, B., Finnerty, M., Frisman, L., Narasimhan, M., Stein, B. D., Wisdom, J., & Zerzan, J. (2016). Use of pooled state administrative data for mental health services research. Administration and Policy in Mental Health and Mental Health Services Research, 43(1), 67–78. https://doi.org/10.1007/s10488-014-0620-y
- Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2015). Associations between implementation characteristics and evidence-based practice sustainment: A study of the Adolescent Community Reinforcement Approach. Implementation Science, 10(1), 173. https://doi.org/10.1186/s13012-015-0364-4
- Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2017). Predicting evidence-based treatment sustainment: Results from a longitudinal study of the Adolescent-Community Reinforcement Approach. Implementation Science, 12(1), 75. https://doi.org/10.1186/s13012-017-0606-8
- Jackson, C. B., Herschell, A. D., Schaffner, K. F., Turiano, N. A., & McNeil, C. B. (2017). Training community-based clinicians in parent-child interaction therapy: The interaction between expert consultation and caseload. Professional Psychology: Research and Practice, 48(6), 481–489. https://doi.org/10.1037/pro0000149
- Johnson, J. E., Wiltsey-Stirman, S., Sikorskii, A., Miller, T., King, A., Blume, J. L., Pham, X., Moore Simas, T. A., Poleshuck, E., Weinberg, R., & Zlotnick, C. (2018). Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women. Implementation Science, 13(1), 115. https://doi.org/10.1186/s13012-018-0807-9
- Lang, J. M., & Connell, C. M. (2017). Measuring costs to community-based agencies for implementation of an evidence-based practice. Journal of Behavioral Health Services Research, 44(1), 122–134. https://doi.org/10.1007/s11414-016-9541-8
- Lanier, P., Kohl, P. L., Benz, J., Swinger, D., & Drake, B. (2014). Preventing maltreatment with a community-based implementation of parent-child interaction therapy. Journal of Child and Family Studies, 23(2), 449–460. https://doi.org/10.1007/s10826-012-9708-8
- Lau, A. S., & Brookman-Frazee, L. (2016). The 4KEEPS study: Identifying predictors of sustainment of multiple practices fiscally mandated in children’s mental health services. Implementation Science, 11(1), 31. https://doi.org/10.1186/s13012-016-0388-4
- Lau, A. S., Lind, T., Crawley, M., Rodriguez, A., Smith, A., & Brookman-Frazee, L. (2020). When do therapists stop using evidence-based practices? Findings from a mixed method study on system-driven implementation of multiple EBPs for children. Administration and Policy in Mental Health and Mental Health Services Research, 47(2), 323–337. https://doi.org/10.1007/s10488-019-00987-2
- Lewis, C. C., Klasnja, P., Powell, B., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 136. https://doi.org/10.3389/fpubh.2018.00136
- Lieneman, C. C., Quetsch, L. B., Theodorou, L. L., Newton, K. A., & McNeil, C. B. (2019). Reconceptualizing attrition in Parent-Child Interaction Therapy: “dropouts” demonstrate impressive improvements. Psychology Research and Behavior Management, 12, 543–555. https://doi.org/10.2147/PRBM.S207370
- Lyon, A. R., & Budd, K. S. (2010). A community mental health implementation of Parent-Child Interaction Therapy (PCIT). Journal of Child and Family Studies, 19(5), 654–668. https://doi.org/10.1007/s10826-010-9353-z
- Moullin, J. C., Dickson, J. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019). Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implementation Science, 14(1), 1. https://doi.org/10.1186/s13012-018-0842-6
- Nelson, M. M., Shanley, J. R., Funderburk, B. W., & Bard, E. (2012). Therapists’ attitudes toward evidence-based practices and implementation of parent–child interaction therapy. Child Maltreatment, 17(1), 47–55. https://doi.org/10.1177/1077559512436674
- Palinkas, L. A., Spear, S. E., Mendon, S. J., Villamar, J., Valente, T., Chou, C., Landsverk, J., Kellam, S. G., & Brown, C. H. (2016). Measuring sustainment of prevention programs and initiatives: A study protocol. Implementation Science, 11(1), 95. https://doi.org/10.1186/s13012-016-0467-6
- Pearl, E., Thieken, L., Olafson, E., Boat, B., Connelly, L., Barnes, J., & Putnam, F. (2012). Effectiveness of community dissemination of parent–child interaction therapy. Psychological Trauma: Theory, Research, Practice, and Policy, 4(2), 204–213. https://doi.org/10.1037/a0022948
- Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019). Enhancing the impact of implementation strategies in healthcare: A research agenda. Frontiers in Public Health, 7, 3. https://doi.org/10.3389/fpubh.2019.00003
- Proctor, E., Luke, D., Calhoun, A., McMillen, C., Brownson, R., McCrary, S., & Padek, M. (2015). Sustainability of evidence-based healthcare: Research agenda, methodological advances, and infrastructure support. Implementation Science, 10(1), 88. https://doi.org/10.1186/s13012-015-0274-5
- Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G. A., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
- Purtle, J., Peters, R., & Browns, R. C. (2016). A review of policy dissemination and implementation research funded by the National Institutes of Health, 2007–2014. Implementation Science, 11(1), 1. https://doi.org/10.1186/s13012-015-0367-1
- Regan, J., Lau, A. S., Barnett, M. L., Stadnick, N., Hamilton, A., Pesanti, K., Bando, L., & Brookman-Frazee, L. (2017). Agency responses to a system-driven implementation of multiple evidence-based practices in children’s mental health services. BMC Health Services Research, 17(1), 671. https://doi.org/10.1186/s12913-017-2613-5
- Rodriguez, A., Lau, A. S., Wright, B., Regan, J., & Brookman-Frazee, L. (2018). Mixed method analysis of program leader perspectives on the sustainment of multiple child evidence-based practices in a system-driven implementation. Implementation Science, 13(1), 44. https://doi.org/10.1186/s13012-018-0737-6
- Roseborough, D. J., McLeod, J. T., & Wright, F. I. (2016). Attrition in psychotherapy: A survival analysis. Research on Social Work Practice, 26(7), 803–815. https://doi.org/10.1177/1049731515569073
- Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014). The Cost of Implementing New Strategies (COINS): A method for mapping implementation resources using the stages of implementation completion. Children and Youth Services Review, 39, 117–182. https://doi.org/10.1016/j.childyouth.2013.10.006
- Sanders, M. R., Prinz, R. J., & Shapiro, C. J. (2009). Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Administration and Policy in Mental Health and Mental Health Services Research, 36(2), 133–143. https://doi.org/10.1007/s10488–009–0205–3
- Scudder, A. T., Taber-Thomas, S. M., Schaffner, K., Pemberton, J. R., Hunter, L., & Herschell, A. D. (2017). A mixed-methods study of system-level sustainability of evidence-based practices in 12 large-scale implementation initiatives. Health Research Policy and Systems, 15(1), 102. https://doi.org/10.1186/s12961-017-0230–8
- Self-Brown, S., Valene, J. R., Wild, R. C., Whitaker, D. J., Galanter, R., Dorsey, S., & Stanley, J. (2012). Utilizing benchmarking to study the effectiveness of Parent–Child Interaction Therapy implemented in a community setting. Journal of Child and Family Studies, 21(6), 1041–1049. https://doi.org/10.1007/s10826-012-9566-4
- Sheldon, R. C., Cooper, B. R., & Wiltsey Stirman, S. (2018). The sustainability of evidence-based interventions and practices in public health and health care. Annual Review of Public Health, 39(1), 55–76. https://doi.org/10.1146/annurev-publhealth-040617-014731
- Stahmer, A. C., Suhrheinrich, J., Schetter, P. L., & Hassrick, E. M. (2018). Exploring multi-level system factors facilitating educator training and implementation of evidence-based practices (EBP): A study protocol. Implementation Science, 13(1), 3. https://doi.org/10.1186/s13012-017-0698-1
- StataCorp. (2017). Stata Statistical Software: Release 15.
- Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 17. https://doi.org/10.1186/1748-5908-7-17
- Stokes, J. O., Wallace, N. M., & McNeil, C. B. (2018). Effectiveness of community-delivered parent-child interaction therapy compared to usual care. Child & Family Behavior Therapy, 40(4), 279–305. https://doi.org/10.1080/07317107.2018.1522232
- Timmer, S. G., Urquiza, A. J., Boys, D. K., Forte, L. A., Quick-Abdullah, D., Chan, S., & Gould, W. (2016). Filling potholes on the implementation highway: Evaluating the implementation of Parent–Child Interaction Therapy in Los Angeles County. Child Abuse & Neglect, 53, 40–50. https://doi.org/10.1016/j.chiabu.2015.11.011
- Triplett, N. S., Sedlar, G., Berliner, L., Jungbluth, N., Boyd, M., & Dorsey, S. (2020). Evaluating a train-the-trainer approach for increasing EBP training capacity in community mental health. The Journal of Behavioral Health Services & Research, 47(2), 189–200. https://doi.org/10.1007/s11414-019-09676-2
- Wallace, N. M., Questsch, L. B., Robinson, C., McCoy, K., & McNeil, C. B. (2018). Infusing parent-child interaction therapy principles into community-based wraparound services: An evaluation of feasibility, child behavior problems, and staff sense of competence. Children and Youth Services Review, 88, 567–581. https://doi.org/10.1016/j.childyouth.2018.04.007
- Westman, J. G., Daleiden, E. L., & Chorpita, B. F. (2019). The agency supervisor model: Developing supervisors who facilitate therapist transfer of training in community behavioral health service organizations. The Clinical Supervisor, 39(1), 45–65. https://doi.org/10.1080/07325223.2019.1695159