ABSTRACT
Implementation science is at the nexus of research and practice, and studies ways to promote the use of research findings in service settings. Clinical supervision has a rich theoretical literature for workplace support, and has also been used to ensure internal validity for “evidence based” interventions during efficacy trials. Calls to leverage supervision as an implementation strategy have prompted a focus on clinical supervision in implementation science. Articles included in this special issue address how supervision “typically” operates and how it might “optimally” promote implementation. A range of methodologies, client populations, settings, and mental health problem foci are included.
Clinical supervision (hereafter, supervision) is a central part of training for behavioral health service providers across disciplines, degrees, and accreditation standards (Borders et al., Citation2014). Supervision “manages, supports, develops and evaluates the work of colleagues” (Milne, Citation2007, p. 439), and is required during graduate training and, for psychologists, counselors, and social workers in the United States, post-degree to be license-eligible. In studies characterizing the use of supervision in mental health service settings, researchers have reported that clinical supervision is a typical part of the professional supports available to mental health providers (Choy-Brown & Stanhope, Citation2018; Laschober et al., Citation2012; Schoenwald et al., Citation2008), although the quantity, quality, and content of supervision has been found to vary widely (Bailin et al., Citation2018; Choy-Brown & Stanhope, Citation2018; Dorsey et al., Citation2017; Fukui et al., Citation2014). There is a robust theoretical literature on the purpose of supervision in the mental health workplace, variously described as administrative, educational, and supportive (Kadushin & Harkness, Citation2014) or – similarly – as “normative” (administrative and ethical oversight), “formative” (education and skill development), and “restorative” (Proctor, Citation1986). Numerous models for the practice of supervision have been developed, and many accrediting bodies list guidelines for best practices (Borders et al., Citation2014).
Quite separate from the theory and practice of professional, workplace-based supervision, supervision has been an essential ingredient in research, specifically as a part of mental health efficacy and effectiveness trials (Beidas & Kendall, Citation2010). Interventions tested in randomized clinical trials – often called “evidence-based treatments” or EBTs – typically made use of expert supervision during the trials in order to ensure high-fidelity, and therefore internal validity, to the intervention being tested (see Roth et al., Citation2010). In this context, supervision has been used as a means of quality assurance within the trial and, as others have noted (Falender, Citation2018), is often not well-described in the studies touting the benefits of these interventions. As Roth et al. (Citation2010) noted, “What has actually been demonstrated is the impact of the therapeutic intervention in the context of dedicated training and supervision for trial therapists” (p. 296). Despite this, the interventions alone are evaluated in terms of the evidence of their benefit; these same interventions are labeled “effective,” and then often published, made available for purchase, and implemented in mental health service settings that differ in substantial ways from research trials (Weisz et al., Citation2014). Mental health service settings and the academic settings of clinical efficacy trials differ in terms of client characteristics, provider characteristics, the resources available, and the nature of the supervision that is provided (Accurso et al., Citation2011; Bailin et al., Citation2018; Dorsey et al., Citation2018; Schriger et al., Citation2020).
It is hardly a surprise, then, that results of efficacy trials so often fail to replicate in mental health services settings (Weisz et al., Citation2014). Implementation science, “or the systematic study of methods to promote the use of research findings in real-world practice settings” (Williams & Beidas, Citation2019, p. 430), has wisely honed in on the use of supervision as a means of increasing EBT adoption, implementation, and sustainment as interventions move from research to practice (Schoenwald et al., Citation2013). Since 2000, there has been increased attention to the potential relationship between supervision and implementation outcomes (see Carlson et al., Citation2012, for an overview). Although still an emerging area of empirical inquiry, there is growing consensus that supervision in mental health service settings is an asset that can be leveraged to support EBT implementation.
Positioned at the intersection of research and practice, implementation scientists who study supervision need to understand, and ultimately balance, both what is typical and what is optimal when it comes to supervision that supports providers and benefits clients. “Evidence based interventions” are of little use if they cannot feasibly be implemented in mental health service settings; this is also true for supervision models or practices that don’t fit into the contexts of practice. This special issue sought reflect this balance, and to add to the still small but growing research on the use of supervision in the implementation of EBTs. The special issue includes a range of practice contexts, client populations, and target problems, as well as diverse research methodologies.
The issue begins, arguably, where the very notion of supervision to support evidence-based practice began: with Derek Milne, whose seminal work to characterize and measure the micro-skills of supervision has been used to support large-scale EBT implementation in his home country of the UK . As his frequent coauthor Reiser (Citation2021) reflects in his profile, Milne was dissatisfied with vague conceptualizations of supervision and was determined to clearly and precisely describe what supervisors do, and then to test the effect of those components. Reiser describes the rigorous process by which Evidence-Based Clinical Supervision was developed, tested, and refined – a process that continues! It is fitting that the issue begins with a profile of Milne, as his influential work is cited by nearly all of the other contributors.
Next, Bailin and Bearman (Citation2021) provide an overview of supervision “as usual.” Using self-report from supervisory dyads as well as audio recordings, the authors describe the coverage of evidence-based practice content discussed in supervision meetings in community-based mental health settings serving children and adolescents. They found coverage of evidence-based practice content was typically brief, with some practices missing altogether – suggesting areas for targeted quality improvement if workplace-based supervision is to support EBTs. At the same time, coverage of content outside of the evidence base suggested that supervision “as usual” may include other important aspects that do not receive attention in research-supported protocols, but may be of value to mental health service settings.
This theme of “typical” supervision is continued in a study by Boyd et al. (Citation2021) in which they examined how training asymmetry between supervisors and supervisees impact the supervisory working alliance. Supervisory working alliance was compromised when supervisors had less EBT training than their supervisees. The results make a compelling case that EBT implementation efforts must train not only frontline providers, but also their supervisors.
In the article that follows, Tugendrajch et al. (Citation2021) review the evidence that supports “best practices” in supervision. The authors identified common supervision practice elements (e.g., supervisor provides feedback to supervisee) recommended by three sets of professional guidelines: The American Psychological Association’s (APA, Citation2015) Guidelines for Clinical Supervision in Health Service Psychology, the Association for Counselor Education and Supervision’s (ACES, Citation2011, Borders et al., Citation2014) Best Practices in Clinical Supervision, and the National Association of Social Workers (NASW, Citation2013) Best Practice Standards in Social Work Supervision. Then, they reviewed the empirical support for 17 common supervision elements. Although some best practices had been studied in a majority of the reviewed studies, others appeared in few or no studies. These results point to the work that remains in order to realize the goal of a strong evidence-base for supervision.
In a complementary review by Bradley and Becker (Citation2021) that follows, the authors used a systematic distillation approach to review the evidence for supervision practice elements that fall into the formative (e.g., skill development) and restorative (e.g., well-being) functions of supervision proposed by Proctor (Citation1986). It is striking that the most common practices for promoting formative outcomes were corrective feedback, discussing interventions, and role play – all concrete supervisor behaviors described in Milne’s (Citation2009) EBCS model.
In the remaining articles, authors explore consultation and supervision used in the implementation of three EBTs. Although not synonymous with supervision, consultation is an analogous process often utilized in implementation wherein the person providing education and support is not employed by the same agency as the provider. First, Caron et al. (Citation2021) explore the strategies used by consultants to engage therapists in active learning during implementation of Attachment and Biobehavioral Catch-up (ABC), a home-based preventive intervention for infants who have experienced adversity. Results indicate that key consultant strategies were associated with greater likelihood of therapist active learning; these results could be easily applied to the supervisor-supervisee process. Next, Sewell (Citation2021) describes a feasibility study of a clinical supervision model to support Stop Now and Plan (SNAP), an evidence-based intervention for disruptive behavior in children in Canada. Provider report suggested that the supervision model was acceptable and that there was demand for specified supervision. Lastly, Giannopoulos et al. (Citation2021) describes a pre-post study of supervision for addictions counselors using the Pathways to Comorbidity Care Program (PCC), an intervention to address comorbidity in state-funded drug health services across urban and regional Australia. Clinical note audits indicated that, following supervision, there were significant increases in rates of prescribed screening and treatment strategies. Counselor self-efficacy also improved.
Although the articles in this special issue were selected because of the salient topics they address, their methodological diversity, and the range of provider disciplines, client populations, and practice settings they reflect, there are some important limitations. We received no submissions that directly addressed issues of racial and ethnic diversity and multiculturalism, despite cultural humility being a critical competency for both clinical work and supervision (Falender & Shafranske, Citation2017). EBT implementation efforts are often in publicly funded mental health settings that serve diverse client populations and seek to address inequities in mental health access and effectiveness, yet most EBTs were developed and tested with primarily White participants (Pina et al., Citation2019). Whereas organizational culture is a key part of conceptual models of implementation (Williams & Beidas, Citation2019), individual and community culture is largely absent. This point underscores the need for studies on supervision in implementation of EBTs – and in implementation science more broadly– that center cultural diversity.
Additionally, the articles included in the special issue are largely observational or systematic reviews, with no studies that explicitly test causal theories of supervision for EBT implementation using experimental designs. This point again reflects the bulk of implementation research (Williams & Beidas, 2019). Studies that directly test causal theories of supervision will help to inform practice and increase the rigor of the evidence-base for supervision. As well, whereas studies that examine provider behaviors following guidance from expert consultants and supervisors are instructive with regards to potential mechanisms of change, the use of workplace based supervisors as interventionists would increase the ecological validity of this research.
I would be remiss if I did not also acknowledge the unusual backdrop for this special issue, which largely took place during the COVID-19 pandemic. As a result of many challenges this posed, several promising submissions were withdrawn and some notable contributors were unable to participate. I am especially grateful to all the authors whose work is reflected here despite very difficult working conditions, and to the journal’s editor, DiAnne Borders, for her patience and encouragement throughout the process.
Disclosure statement
No potential conflict of interest was reported by the author.
Additional information
Notes on contributors
Sarah Kate Bearman
Sarah Kate Bearman, Ph.D. is an Assistant Professor in the School Psychology program of the Department of Educational Psychology in the College of Education at The University of Texas at Austin. A clinical child psychologist, her interests focus on advancing effective and scientifically supported treatments for youth and families in low-resource settings. In particular, she is interested in the supportive infrastructures, such as clinical supervision, that can promote successful adoption and implementation of evidence-based therapies.
References
- Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5(2), 88–96. https://doi.org/10.1037/a0023537
- American Psychological Association (APA). (2015). SoA: Standards of accreditation for health service psychology. Retrieved October 23, 2019, from http://www.apa.org/ed/accreditation/about/policies/ standards-of-accreditation.pdf.
- Association for Counselor Education and Supervision Taskforce on Best Practices in Clinical Supervision. (2011). Best practices in clinical supervision. Retrieved May 9, 2020 from http://www.acesonline.net/wpcontent/uploads/2011/10/ACES-Best-Practices-in-clinical-supervisiondocument- FINAL.pdf.
- Bailin, A., & Bearman, S. K. (2021). Coverage of EBT practices in routine clinical supervision for youth: How much overlap with the evidence base? The Clinical Supervisor, 1–20. https://doi.org/10.1080/07325223.2020.1844107
- Bailin, A., Bearman, S. K., & Sale, R. (2018). Clinical supervision of mental health professionals serving youth: Format and microskills. Administration and Policy in Mental Health and Mental Health Services Research, 45(5), 800–812. https://doi.org/10.1007/s10488-018-0865-y
- Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. https://doi-org.ezproxy.lib.utexas.edu/10.1111/j.1468-2850.2009.01187.x
- Borders, L. D., Glosoff, H. L., Welfare, L. E., Hays, D. G., DeKruyf, L., Fernando, D. M., & Page, B. (2014). Best practices in clinical supervision: Evolution of a counseling specialty. The Clinical Supervisor, 33(1), 26–44. https://doi.org/10.1080/07325223.2014.905225
- Boyd, M., Park, A. L., Becker, K. D., & Chorpita, B. F. (2021). The relation between training asymmetry and supervisory working alliance: Implications for the role of supervisors in implementation. The Clinical Supervisor, 1–19. https://doi.org/10.1080/07325223.2020.1871460
- Bradley, W. J., & Becker, K. D. (2021). Clinical supervision of mental health services: A systematic review of supervision characteristics and practices associated with formative and restorative outcomes. The Clinical Supervisor.
- Carlson, L., Rapp, C. A., & Eichler, M. S. (2012). The experts rate: Supervisory behaviors that impact the implementation of evidence-based practices. Community Mental Health Journal, 48(2), 179–186. https://doi.org/10.1007/s10597-010-9367-4
- Caron, E. B., Lind, T. A., & Dozier, M. (2021). Strategies that promote therapist engagement in active and experiential learning: Micro-level sequential analysis. The Clinical Supervisor, 1–22. https://doi.org/10.1080/07325223.2020.1870023
- Choy-Brown, M., & Stanhope, V. (2018). The availability of supervision in routine mental health care. Clinical Social Work Journal, 46(4), 271–280. https://doi.org/10.1007/s10615-018-0687-0
- Dorsey, S., Kerns, S. E., Lucid, L., Pullmann, M. D., Harrison, J. P., Berliner, L., Thompson, K., & Deblinger, E. (2018). Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health. Implementation Science, 13(1), 1–12. https://doi.org/10.1186/s13012-017-0708-3
- Dorsey, S., Pullmann, M. D., Kerns, S. E., Jungbluth, N., Meza, R., Thompson, K., & Berliner, L. (2017). The juggling act of supervision in community mental health: Implications for supporting evidence-based treatment. Administration and Policy in Mental Health and Mental Health Services Research, 44(6), 838–852. https://doi.org/10.1007/s10488-017-0796-z
- Falender, C. A. (2018). Clinical supervision—the missing ingredient. American Psychologist, 73(9), 1240–1250. https://doi-org.ezproxy.lib.utexas.edu/10.1037/amp0000385
- Falender, C. A., & Shafranske, E. P. (2017). Competency‐based clinical supervision: Status, opportunities, tensions, and the future. Australian Psychologist, 52(2), 86–93. https://doi.org/10.1111/ap.12265
- Fukui, S., Rapp, C. A., Goscha, R., Marty, D., & Ezell, M. (2014). The perceptions of supervisory support scale. Administration and Policy in Mental Health and Mental Health Services Research, 41(3), 353–359. https://doi.org/10.1007/s10488-013-0470-z
- Giannopoulos, V., Morley, K. C., Uribe, G. M., Louie, E., Wood, K., Teesson, M., Baillie, A., & Haber, P. S. (2021). The role of clinical supervision in implementing evidence-based practice for managing comorbidity. The Clinical Supervisor.
- Kadushin, A., & Harkness, D. (2014). Supervision in social work. Columbia University Press.
- Laschober, T. C., De Tormes Eby, L. T., & Sauer, J. B. (2012). Clinical supervisor and counselor perceptions of clinical supervision in addiction treatment. Journal of Addictive Diseases, 31(4), 382–388. https://doi.org/10.1080/10550887.2012.735599
- Milne, D. (2007). An empirical definition of clinical supervision. British Journal of Clinical Psychology, 46(4), 437–447. https://doi.org/10.1348/014466507X197415
- Milne, D. (2009). Evidence-based clinical supervision:Principles and practice. Blackwell Publishing.
- National Association of Social Workers (NASW). (2013). Best practice standards in social work supervision. Retrieved October 23, 2019, from http://www.socialworkers.org/Practice/Practice-Standards-Guidelines.
- Pina, A. A., Polo, A. J., & Huey, S. J. (2019). Evidence-based psychosocial interventions for ethnic minority youth: The 10-year update. Journal of Clinical Child & Adolescent Psychology, 48(2), 179–202. https://doi.org/10.1080/15374416.2019.1567350
- Proctor, B. (1986). Supervision: A co‐operative exercise in accountability. In M. Marken & M. Payne (Eds.), Enabling and ensuring: Supervision in practice (pp. 21–34). National Youth Bureau and Council for Education and Training in Youth and Community Work.
- Reiser, R. (2021). Derek Milne: An evidence-based approach to clinical supervision. The Clinical Supervisor.
- Roth, A. D., Pilling, S., & Turner, J. (2010). Therapist training and supervision in clinical trials: Implications for clinical practice. Behavioural and Cognitive Psychotherapy, 38(3), 291–302. https://doi.org/10.1017/S1352465810000068
- Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Glisson, C., & Rolls-Reutz, J., & Research Network on Youth Mental Health. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 84–97. https://doi.org/10.1007/s10488-007-0147-6
- Schoenwald, S. K., Mehta, T. G., Frazier, S. L., & Shernoff, E. S. (2013). Clinical supervision in effectiveness and implementation research. Clinical Psychology: Science and Practice, 20(1), 44–59. https://doi-org.ezproxy.lib.utexas.edu/10.1111/cpsp.12022
- Schriger, S. H., Becker-Haimes, E. M., Skriner, L., & Beidas, R. S. (2020). Clinical supervision in community mental health: Characterizing supervision as usual and exploring predictors of supervision content and process. Community Mental Health Journal. https://doi-org.ezproxy.lib.utexas.edu/10.1007/s10597-020-00681-w
- Sewell, K. (2021). Supporting children’s mental health evidence-based interventions: Feasibility study of a workplace-based supervision model. The Clinical Supervisor.
- Tugendrajch, S. K., Sheerin, K. M., Andrews, J. H., Reimers, R., Cho, E., Marriott, B. R., & Hawley, K. M. (2021). What is the evidence for supervision best practices? The Clinical Supervisor. https://doi.org/10.1080/07325223.2021.1887785
- Weisz, J. R., Ng, M. Y., & Bearman, S. K. (2014). Odd couple? Reenvisioning the relation between science and practice in the dissemination-implementation era. Clinical Psychological Science, 2(1), 58–74. https://doi.org/10.1177/2167702613501307
- Williams, N. J., & Beidas, R. S. (2019). Annual research review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry, 60(4), 430–450. https://doi-org.ezproxy.lib.utexas.edu/10.1111/jcpp.12960