0
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Exploring influences of supervision on psychotherapists’ professional development: correlates across career-level cohorts

, &
Received 26 Feb 2024, Accepted 02 Jul 2024, Published online: 24 Jul 2024

ABSTRACT

This exploratory study aims to extend and strengthen the empirical case for supervision as a facilitator of professional growth, as outlined in an established conceptual model, by exploring its correlates among psychotherapists across their entire professional career. Ratings of the impact of supervision by 6267 psychotherapists of different professions, theoretical orientations, and career levels in many countries who were currently in supervision were correlated, separately for each of five career cohorts, with aspects of their treatment experience, work situation, and personal characteristics. Large percentages of psychotherapists at all career levels, including senior psychotherapists, engaged in supervision and rated its impact on their development positively. Growth-facilitating supervision was associated broadly but moderately in all career cohorts mainly with interpersonal aspects of therapists’ treatment experience, with supportive work settings, and with caring and expressive personal characteristics. Some differential findings among cohorts also reflected potential developmentally based functions of supervision. The implications of results were considered both for supervisory practice, training and for future supervision research.

Introduction

This study explores empirically the relationship between effective clinical supervision and supervised therapists` experiences of professional development at successive phases in the full span of psychotherapists` careers. To do so, we initially clarify what the complex concepts of supervision and development mean and how they will be studied.

Clinical supervision

Supervision is an integral part of psychotherapy training and practice. Drawing on Shulman’s (Citation2005) concept of signature pedagogy of professions, several authors (e.g. Bernard & Goodyear, Citation2019; Watkins, Citation2020) have described supervision as a signature pedagogy of mental health disciplines. Supervision has also been described as the “sine qua non” for the optimal learning of psychotherapy (Watkins, Citation2020). An often quoted definition of supervision holds it to be:

… an intervention provided by a more senior member of a profession to a more junior colleague or colleagues who typically (but not always) are members of that same profession. This relationship is evaluative and hierarchical, extends over time, and has the simultaneous purposes of enhancing the professional functioning of the more junior person(s), monitoring the quality of professional services offered to the clients that she, he, or they see, and serving as a gatekeeper for the particular profession the supervisee seeks to enter (Bernard & Goodyear Citation2019, p. 9).

In a research-based modification of this, Milne and Watkins (Citation2014, p. 4) defined supervision as “The formal provision, by approved supervisors, of a relationship-based education and training that is work-focused [sic] and which manages, supports, develops and evaluates the work of colleagues.”

In addition to ensuring client welfare and serve a gate keeping function into the profession, a central objective is to facilitate professional development of supervisees at all levels of experience (Bernard & Goodyear, Citation2009; Knox & Hill, Citation2021). Indeed, the fact that professional development is a long-term aim of supervision differentiates supervision from other professional roles such as consultation. Some forms of consultation, such as “Client-centered case consultation” and “Consultee-centered case consultation” (Caplan, Citation1995) may resemble supervision in some ways (e.g. quality of the learning processes). However, one major way in which consultation and supervision is in the distribution of responsibility among participants. Responsibility for the client in supervision of students and pre-licensed practitioners resides with the supervisor, while according to Caplan “An essential aspect of consultation, as defined here, is that the professional responsibility for the client remains with the consultee” (p. 8).

For more than 40 years, several developmental supervision models have been articulated (e.g. Loganbill, Hardy, & Delworth, Citation1982; Stoltenberg, McNeill, & Delworth, Citation2010; for a full review see; Bernard & Goodyear, Citation2019). These developmental models, as well as others, such as reflective conceptions of supervision (e.g. Neufeldt, Citation1999; Neufeldt, Karno, & Nelson, Citation1996), have contributed substantially to supervision practice. However, like the definitions of supervision cited above, they typically address the first years of clinical training (e.g. Knox & Hill, Citation2021), which restricts their applicability to later career phases, although in many places supervision for psychotherapists is a (sometimes mandatory) element throughout their professional careers. At later career phases, engaging in supervision is often voluntary not mandatory, more collegial than hierarchical, and less focused on evaluation than on problem-solving. Moreover, these models are limited by typically not having empirically studied supervision during the post-training, post-licensing, post-credentialing years, despite the fact that substantial proportions of “mature” and “senior” adult therapist, defined by age, reported they were in supervision (Orlinsky & Rønnestad, Citation2015).

Initial steps to conceptualize supervision based on empirical studies of life-long psychotherapist development have already been made (e.g. Rønnestad & Orlinsky, Citation2005; Rønnestad & Skovholt, Citation2013; Skovholt & Rønnestad, Citation1992). In previous reports of their long-term qualitative study of psychotherapist development, Rønnestad and colleagues delineated five phases in the career of mental health workers based on years of practice, and proposed that supervision for clinicians – in addition to attending to core principles such as “contract” and “alliance” – should be sensitive to the growth challenges that may be met in successive career phases (Rønnestad, Orlinsky, Schröder, Skovholt, & Willutzki, Citation2018; Rønnestad & Skovholt, Citation2013).

Professional development

Previously, in a large-scale empirical study of psychotherapists` development (Orlinsky & Rønnestad, Citation2005), we distinguished between conceptually and methodologically distinct approaches to assessing development. To do this, we cross-combined two basic observational viewpoints (reflexive or self-observed vs. external or other-observed and two temporal contexts (synchronic or current-time vs. diachronic or extended-time). These defined four developmentally relevant approaches to data collection: Currently, Experienced Development (reflexive/synchronic); Cumulative Career Development (reflexive/diachronic); Comparative Cohort Development (external/synchronic); and Individual Longitudinal development (external/diachronic). The first three empirical perspectives were studied broadly in our book (Orlinsky & Rønnestad, Citation2005).Footnote1 The current paper focuses specifically on psychotherapists` Currently Experienced Development (CED) in relation to clinical supervision.

In our previous research (Orlinsky & Rønnestad, Citation2005) we found the leading, and by far strongest predictor of psychotherapists` Currently Experienced Development (CED) was experiencing therapeutic work with their patients as a Healing Involvement (22%) variance).Footnote2 In the current study, this empirical dimension of Healing Involvement and its empirical process-facet components, will form a main focus in exploring the relevance of supervision for therapists at successive career levels.

There is still limited empirically based knowledge of the professional and personal characteristics that may contribute to supervision facilitating therapists` professional development throughout the career. This is surprising as after training and licensure ”it is not atypical for therapists to see clients until they retire 40 to 70 years later” (Aafjes-van Doorn & Barber, Citation2023, p. 55). These authors have provided an overview of empirical research on the effect of professional training that includes few studies on experienced therapists and also recommendation for future research. Given the predominant research focus on unlicensed trainees, they write: “This means that little is known about how practicing psychologists use supervision or if they learn from it” (p. 64). By contributing to fill this gap in knowledge, the current explorative study aims to provide a knowledge base to better differentiate between core principles of supervision and phase-specific supervision.

Main goal and research questions

This study aims to explore, for therapists at successive career levels, perceived supervision quality, currently experienced development, the relationship between them, and some of their correlates – with the aim of noting both differences and continuities across career levels. The specific research questions are as follows:

  1. What percentage of therapists at different career levels are currently in clinical supervision?

  2. How much do therapists at different career levels experience supervision as a positive influence on development (Developmentally Positive Supervision, or DPS)?

  3. How much do DPS ratings by therapists at each level reflect their being currently in supervision?

  4. How much are therapists’ DPS ratings related to their experiences of current development across career levels?

  5. How much are therapists’ DPS ratings at each level associated with their typical experiences of doing therapy?

  6. How much are therapists’ DPS ratings at each level related to experiences in their main work setting?

  7. How much do therapists’ DPS ratings at each level reflect their personal characteristics?

Method

Research measures

This exploratory study is possible through use of a very large archival database on collected by the Society for Psychotherapy Research Collaborative Research Network (SPR/CRN) between 1991 and 2020 (e.g. Orlinsky, Citation2022; Orlinsky & Rønnestad, Citation2005; Orlinsky, Rønnestad, & Willutzki, Citation2011). Therapists of varied professions, theoretical orientations, and career levels from many countries had taken the Development of Psychotherapists Common Core Questionnaire (DPCCQ) – a multifaceted survey of therapists’ demographic, professional, cultural, and personal backgrounds; their experiences in clinical practice and professional development; and their individual psychological characteristics. Parallel back-translated versions of the DPCCQ exist in Chinese, Danish, English, French and German Hebrew, Italian, Korean, Norwegian, Portuguese, Russian, Spanish, and Swedish. Its face validity for therapists is attested by the large number (N ≥12,000) who gave their time to voluntarily and anonymously completing the wide-ranging questionnaire. Later versions of the DPCCQ included a modified version of the Experiences in Close Relationships short questionnaire (Wei, Russell, Mallinckrodt, & Vogel, Citation2007).

Study variables

Principal variables

Current supervision

The DPCCQ asked therapists: ”Are you currently receiving regular supervision for any of your therapy cases?” (yes or no).

Developmentally positive supervision (DPS)

Therapists were also asked: ”How much influence (positive and/or negative) do you feel [that supervision] has had on your current development as a therapist?” with responses given on a 7-point scale from −3 (very negative), through 0 (neutral) to +3 (very positive). As only 2.5% reported any degree of negative influence, as compared to 85% reporting some positive influence, a 4-point scale of Developmentally positive supervision (DPS) was constructed from the positive half of the ratings (0 = none, 1= slight, 2 = moderate, 3 = very), which will be the focus of this study.

Career Cohorts

The career course was divided into five broad career-level cohorts inspired by the concepts proposed by Rønnestad and colleagues (e.g. Rønnestad & Skovholt, Citation2013):

Novice students started to treat clients but for less than 1.5 years (M = 0.75 years, SD = 0.4; n = 635). Apprentices or advanced students treated clients for 1.5 to 3 years (M = 2.4 years, SD = 0.5, n = 1,005). Graduates or beginning professionals were in their first 3–8 years of practice post initial training, (M = 5.6 years, SD = 1.5, n = 2,803). Established therapists had been in practice from 8 to 23 years (M = 14.3, SD = 4.0, n = 4684). Senior therapists were those in practice from 23 to 54 years (M = 29.5, SD = 6.1, n = 1,392).

Currently experienced development

Two complementary dimensions of currently experienced development were identified by Orlinsky and Rønnestad (Citation2005), using factor analysis, as Currently Experienced Growth (CEG) and Currently Experienced Depletion (CED). A reliable 6-item measure for CEG (α = .86) includes items like: ”In your recent psychotherapeutic work, how much do you feelYou are deepening your understanding of psychotherapy? You are overcoming past limitations as a therapist?‘—rated on a 0 to 5 scale (0 = Not at all, 5 = Very much); M = 3.49, SD = 0.9, N = 10,400. A 4-item measure of CED (α = .70) included items like: ’In your recent psychotherapeutic work, how much do you feelYou are losing your capacity to respond empathically? Your performance is becoming mainly routine?” (M = 0.80, SD = 0.8, N = 986).

Therapy practice variables

The DPCCQ provided a detailed description of therapists’ experiences in therapy with clients. Scaled items were included for the following facets: (a) therapeutic skills used to implement treatment goals; (b) difficulties encountered in practice while employing those skills; (c) coping strategies engaged when difficulties arise; (d) manner and agency in relating with clients; and (e) therapists’ own feelings during therapy sessions. Data reduction was achieved by factor-analysis of the item-scales within each facet. This reduced set of multi-item facet scales was subjected to a second-level cross-facet factor analysis, resulting in the identification of two complementary dimensions of therapeutic work involvement: Healing Involvement and Stressful Involvement (Orlinsky & Rønnestad, Citation2005; confirmed by; Orlinsky, Hartmann, Rønnestad, & Willutzki, Citation2022).

Healing Involvement (HI, α = .71) is composed of facet scales for: Basic Clinical Skills (e.g. engage in a working alliance, be empathic with clients); Technical Expertise (e.g. mastery of techniques and strategies); Advanced Relational Skills (e.g. making constructive use of self); employment of Constructive Coping Strategies if difficulties arise (e.g. try to see problem from a different perspective, consult with a senior colleague); relating to clients in an Affirming (e.g. warm, involved, accepting) and Effective (e.g. committed, intuitive, effective) manner; and having In-session feelings of “Flow” (Csikszentmihalyi, Citation1990) (inspired, stimulated, creative).

Stressful Involvement (SI, α = .82) is composed of multi-item facet scales for: Difficulties in Practice, including Frustrating Treatment Case (e.g. frustrated with a patient for wasting time), Negative Personal Reaction to Clients (e.g. unable to withstand a patient’s neediness), and Professional Self-Doubt (e.g. unsure how best to deal effectively with a client); a negative dimension of Coping called Avoidant/Critical Response to Difficulties (e.g. avoid dealing with the problem for the present); relating to clients in a Directive (e.g. authoritative, directive, demanding) or a Reserved (e.g. detached, guarded, reserved) manner; and feeling Bored (e.g. bored, drowsy, inattentive) and/or Anxious (e.g. pressured, anxious, tense) during recent sessions. Both HI and SI and their component first-level dimensions will be assessed in relation to therapists’ ratings of how positively supervision influenced their current development.

Work setting and personal variables

Therapeutic Work Setting. Aspects of the therapist’s primary work setting in this study were the degrees of support and satisfaction experienced both with the work environment and therapeutic work conducted there. Relevant items in the DPCCQ included 6-point (0=Not at all to 5=Very much) scales for questions such as: “How satisfied do you feel with your main work setting?‘ ’How well supported do you feel in your work?‘ These were combined into a reliable multi-item scale of Work/Setting Support and Satisfaction (α = .73; M = 3.47, SD = 0.9). ’How well does your work environment allow you to function as a therapist?” was also assessed using the same 6-point scale.

Personal identity

Therapists’ personal identity, defined as their self-experience in close personal relationships, was assessed in the DPCCQ using 35 4-point self-descriptive adjectival items (anchored at 0=not at all, 1 = some, 2 = much, 3 = very much), presented following the question: “How would you describe yourself as you really are in your close personal relationships?” Interpersonal aspects of self were assessed with items based on Leary’s (Citation1957) circumplex model of interpersonal behavior. Temperament aspects of self were assessed with items reflecting amplitude vs. restraint in individual’s cognitive-instrumental and emotional-expressive functioning. Exploratory factor analysis of these items yielded four dimensions that essentially replicated prior similar factor analyses (Orlinsky, Rønnestad, Hartmann, Heinonen, & Willutzki, Citation2019, Citation2022): (1) Genial/Caring (warm, friendly, tolerant, nurturant, optimistic, accepting; α = .72); (2) Forceful/Exacting items (directive, demanding, authoritative, challenging, critical; α = .75); (3) Reclusive/Remote (reserved, guarded, skeptical; α = .70); (4) Practical/Determined (effective, organized, pragmatic, determined, energetic, α = .74).

Adult attachment

Adult attachment was assessed with the Experiences in Close Relationships questionnaire short form (ECR-S; Wei, Russell, Mallinckrodt, & Vogel, Citation2007), yielding scores on two dimensions of insecure (vs. secure) attachment: Avoidant Attachment (e.g. “I prefer not to show a partner how I feel deep down”) α = .84, and Anxious Attachment (e.g. “I worry about being abandoned”) α = .78.

Sample

In order to recruit participants in the SPR/CRN study, different strategies were used for data collection: solicitation of participants at professional workshops and conferences; cooperation with professional societies to survey their members; collaboration with training programs to ensure the participation of less experienced therapists; recruitment through individual collegial networks; for further general information concerning the DPCCQ, see Orlinsky (Citation2022) and Orlinsky and Rønnestad (Citation2005). The sample for this study comprises 10,869 psychotherapists who received supervision currently or had in the past (with some exceptions as noted). The demographic and professional characteristics are summarized in . Approximately 70% came from eight geographically dispersed, culturally diverse countries. About 63% were female. The average age was 45 years and the range was broad. Psychology was the largest professional discipline but many were trained in Psychiatry or Medical Psychotherapy and Counseling, with smaller groups from Social Work and practitioners describing themselves as “psychotherapists” or “psychoanalysts”. Most therapy orientations were represented. The average experience level was 12 years in practice with a very wide range. The average number of years in supervision was 6.

Table 1. Psychotherapist sample Characteristics1.

Statistical analysis

Chi-square (χ2) tests were used to determine the association between categorical variables, including Cramer’s V to assess the effect size. One-way ANOVA with Scheffe post hoc test was used to assess differences between cohort mean values. Non-parametric Spearman correlations (p) were calculated to determine the association between the continuous measures; point-biserial correlations were used for continuous measures and two-value categorical variables. As an exploratory study, relationships with multiple independent variables were assessed without an alpha-level adjustment since detecting potential factors related to supervision is the principal task, rather than hypothesis testing. However, as the very large samples in some cohorts will lead to the detection of many very small effects, a criterion of p ≥ .10 (1% of shared variance) will be used to indicate effects worth noting, the importance of which was affirmed by Götz, Gosling, and Rentfrow (Citation2022) who argue that without accepting small effects as a norm, reliable and reproducible cumulative psychological science cannot be built. Analyses used SPSS for Mac version 28.0.0.

Ethical review

The International Study of the Development of Psychotherapists (ISDP) was approved by the Research Ethics Review Committee of the University of Chicago Division of Social Sciences. Therapists responding to the DPCCQ did so anonymously and voluntarily without payment. The agreement of psychotherapists to respond to the DPCCQ was understood as their informed consent.

Results

How many therapists at each career level are currently in clinical supervision?

shows the incidence of current supervision was very high among Novice and Apprentice therapists (77% and 72% respectively), as might be expected. However, it was also high among Graduate therapists (71%) and even Established therapists (61%). A smaller but still large proportion (41%) of Senior therapists was also having supervision. The differences across cohorts were statistically significant.

Table 2. Supervision and development across career cohorts incidence and Influence1.

Table 3. Currently Experienced Development by Supervision vs. Developmentally Positive Supervision

How much do therapists at each level experience supervision as a positive influence on development; i.e. experiencing ‘developmentally positive supervision’ (DPS)?

shows that cohort means for the positive influence of supervision on current professional development (DPS) were statistically equal, excepting for Senior therapists. For most, the mean was between 2 (moderate) and 3 (very much); the mean for Seniors was around 2.

How much do DPS ratings by therapists at each level reflect their being currently in supervision?

shows that just being in supervision doesn’t guarantee it is rated as positively influencing development. The relation of DPS to being in supervision at all career levels was positive, significant and notable, but modest for students (especially Novices, at 3% of shared variance), and stronger at later career levels (9% to 16% of shared variance for Graduate, Established and Senior therapists). The association of supervision per se and DPS appeared progressively stronger across cohorts.

How much are therapists’ DPS ratings related to their positive and negative experiences of current development?

indicates significant, positive and notable correlations of DPS with ratings of Currently Experienced Growth (CEG) at all career levels, but in this case with correlations highest for Novice and Apprentice therapists.

shows lower, significant negative correlations of DPS with Currently Experienced Depletion (CED) at all career levels.

How much are therapists’ DPS ratings associated with their typical experiences of doing therapy?

shows a consistent significant, positive and notable association of Developmentally Positive Supervision (DPS) with therapists’ experience of therapeutic work as a Healing Involvement (HI) at all career levels: when DPS was strong, HI tended to be elevated. There was a much smaller and less consistent negative association between DPS and therapists’ experience of therapeutic work as a Stressful Involvement (SI). For a more differentiated picture of how therapists’ experiences related to DPS, the next following rows in show correlations with the specific facets of Work Involvement.

Table 4. Therapeutic work correlates of positively influential Supervision1.

shows that DPS had a modest but notable association with Basic Relational Skills among Novices, and among Graduate and Established therapists. By contrast, DPS was linked to Advanced Relational Skills only for Senior therapists. Technical Skills was linked modestly to DPS most notably for Graduate therapists. Total Clinical Skills was positively and significantly correlated with DPS in all except the Senior cohort.

shows the association of DPS with therapists’ difficulties in practice. Professional Self-Doubt was largely unrelated except notably and negatively for Apprentices. Experiencing a Frustrating Treatment Case was negatively and notably related with DPS for Apprentices and Novices, but also among Seniors. The same applied to Apprentices, Novices and Seniors when experiencing a Negative Personal Reaction toward a client. In the foregoing, more Developmentally Positive Supervision (DPS) tended to be linked with less frequent difficulties. Reflecting this, DPS negatively correlated with Total Difficulties overall, and notably and significantly among Apprentices and Seniors.

shows consistently significant, positive and relatively strong associations of DPS with the dimensions of Constructive Coping, and smaller but consistently negative and mostly significant links to Avoidant/Critical Coping: when DPS was strong, therapists tended to cope well more often and cope poorly less often.

shows that Developmentally Positive Supervision (DPS) tended to be consistently, positively and most often significantly and notably associated with therapists’ experiencing their relating to clients as Effective and Affirming. By contrast, DPS tended to be consistently negatively associated with being Reserved when with clients, although significantly and notably so mainly for Novices and Apprentices. DPS also tended to be negatively associated with therapists’ experiencing themselves as Directive in manner, at least notably for Apprentices.

shows that DPS was consistently, notably, and significantly positively correlated with therapists’ experiencing “Flow” during sessions. Also when DPS was high, Novice and Apprentice therapists in particular less often tended to feel Bored during sessions. Interestingly, therapists’ feeling Anxiety during sessions was unrelated to DPS.

How much are therapists’ DPS ratings related to experiences in their main work setting?

shows that Work/Setting Support and Satisfaction was significantly, positively and notably correlated with DPS at all career levels, but especially among Novices and Apprentices. Therapists’ feeling that their Work Setting Supported Good Therapeutic Functioning ran parallel to this, showing a similar aspect of relation between Developmentally Positive Supervision (DPS) and the therapists’ work context.

Table 5. Contextual correlates of developmentally positive Supervision1.

How much do therapists’ DPS ratings reflect their personal characteristics?

  1. The therapist’s personality (e.g. self-concept and attachment style) represents an internal context of the work experience. shows that therapists experiencing higher levels of being Genial/Caring and Ardent/Expressive in close relationships tended to also experience more DPS. Alternatively, DPS was unrelated to therapists being either Forceful/Exacting or Reclusive/Remote with intimates, except for among Apprentices.

  2. suggests that therapists whose attachment style was Avoidant tended to be negatively although not significantly linked with DPS at most career levels (possibly due fo small Ns), but Anxious Attachment was unrelated to DPS at all career levels.

Discussion

Summary of findings

This first explorative study of supervision across the entire career of psychotherapists has established that supervision is a common practice not only among Novices and Apprentices still in training but at all subsequent career levels – for a majority of Graduate and Established therapists, and nearly as many among Seniors. The study also showed that therapists at all career levels reported supervision has a positive influence on their development, and that positively influential supervision is favorably associated with a sense of growth, and inversely associated with a sense of professional depletion. The study then investigated potential correlates of developmentally positive supervision (DPS) in the therapists’ experiences in therapeutic work, in the work environment, and in therapists’ personalities, noting similarities and differences across career levels.

We found that, while the incidence of current supervision declined steadily across career levels from 77% among Novices to 41% among Seniors, experiencing it as developmentally positive (DPS) increased steadily across levels, from p=.18 among Novices to p=.40 for Established and Senior therapists. Practicing therapists in advanced cohorts who were in supervision were more likely to find it a positive influence on development, whereas therapists getting supervision while still in training experienced it as a less positive influence on development. A possible explanation for this difference is that trainees are typically assigned to supervisors who may or may not feel compatible, whereas Established and Senior therapists typically choose the supervisors they want to work with and are more likely to find the work profitable. However, insofar as Novices and Apprentices do experience supervision as a positive influence on their development, the association of DPS with current growth (CEG) was stronger than for Seniors. A possible explanation for this difference is that trainees likely have a greater need and capacity for current growth than do Senior therapists.

The following discussion of correlates of developmentally positive supervision (DPS) with therapists’ experiences of therapeutic work, the work environment, and in therapists’ personalities, focus first on results that were common across career cohorts, and then on differences between career cohorts. Implications for supervisory practice are included with each.

Career-long aspects of positively influential supervision

Positively influential supervision (DPS) was positively associated with therapists’ overall experience of working with clients as a Healing Involvement (HI) at all levels. This was reflected specifically in the consistent association of DPS with reliance on Constructive Coping strategies when facing difficulties; having an Effective manner when relating to clients; and feeling Flow in sessions when working with clients. In their main work settings, the more that therapists found their main work setting satisfying and supportive, and conducive to good therapeutic practice, the more they tended to report supervision to be developmentally positive. Among therapists’ individual characteristics, experiencing oneself as Genial/Caring and Ardent/Expressive in close personal relationships was positively associated with DPS.

What do these consistent associations across career cohorts imply about essential features of effective supervision? Given the ambiguity about the direction of causal influence, it is possible to view therapists who feel successful at work as also tending to feel successful in supervision; i.e. successful at all they do. However, it is possible and perhaps more plausible to view positively experienced supervision as facilitating of therapeutic work; as promoting the experience of therapy as a Healing Involvement (HI) by supporting reliance on Constructive Coping with difficulties, relating to clients Effectively, and feeling an enriching sense of Flow during sessions. Logically, both are possible as reciprocal influences.

While contextual influences may be viewed as predominantly unidirectional, supervision may also have an effect on them. A satisfying and supportive work milieu would normally include and promote positively experienced supervision (DPS), although good supervision is also part of what makes the work setting satisfying and supportive. Similarly, a warm and expressive self-concept could be viewed as promoting an effective supervisory alliance and openness to supervisory input, but developmentally positive supervision might also have a positive personal influence on the therapist.

Recommendations for supervision of psychotherapists often focus on enhancing therapists’ strengths, but supervisory attention is also warranted at all career levels by indications that therapists are showing signs of Currently Experienced Depletion (e.g. losing empathic responsiveness, becoming habitual or routinized in practice, deflated work morale).

Developmental aspects of positively influential supervision

Novice and apprentice cohorts

Most therapists-in-training were currently in supervision, as no doubt they were often required to be, although merely being in supervision correlated least with DPS among Novices and Apprentices. As mentioned above, the obligatory nature of most early supervision and the fact that supervisors are often assigned to the trainees may account for this. Importantly, inadequate supervision (Duff & Shahin, Citation2010), the surprisingly high prevalence of harmful supervision (Ellis et al., Citation2014), and the evaluative nature of student supervision (Bernard & Goodyear, Citation2019), may lead to supervisees concealing information. Prior research (mostly with trainee samples) has documented that effective supervision may be compromised by supervisee non-disclosure in individual cases (e.g. Ladany, Hill, Corbett, & Nutt, Citation1996) as well as in group supervision (Reichelt et al., Citation2009; Skjerve et al., Citation2009).

However, compared to more experienced therapists, DPS was more strongly linked to growth (CEG) among Novices and Apprentices. For Novices, DPS was positively associated with Basic Relational Skills (also Total Clinical Skills), and tended to lessen coping with difficulties by avoiding dealing with them or by criticizing the client. For Apprentices, DPS was negatively associated with being Directive in relating to patients. Among Novices and Apprentices, DPS tended to counter having a Frustrating Treatment Case or a Negative Personal Reaction to a Client; being Reserved when relating to clients; and feeling Bored during therapy sessions – illustrating the importance of effective supervision for trainees.

For Novices, DPS was most strongly associated with a supportive work environment, although this was felt to some degree by all cohorts. In terms of personal characteristics, Apprentices who tended to be Forceful/Exacting or Reclusive/Remote in close personal relationships stood out for a significant negative association between DPS; i.e. were less likely to experience supervision as developmentally positive, whereas those lower in Forceful/Exacting or Reclusive/Remote were more likely to do so.

For both Novices and Apprentices, positively influential supervision (DPS) was negatively associated with dysfunctional aspects of relating to clients, and positively associated with being Affirming towards clients, highlighting a focus of DPS on the therapeutic relationship.

Supervisors of Novice and Apprentice therapists should be particularly sensitive to the difficulties supervisees may experience in their work, specifically with frustrating treatment cases as well as negative personal reactions to certain clients. These usually need to be discussed as they occur, due to their potentially negative impact on the supervisees’ alliance with clients, and on the supervisees themselves. Supervisors of Novice and Apprentice therapists should be aware of the possibility that trainees may find themselves struggling with boredom during therapy sessions, and experiencing this as a personal failure that they may not want to reveal in supervision – given the evaluative aspect of supervision for beginning psychotherapists of which they are typically acutely aware (e.g. Ladany, Hill, Corbett, & Nutt, Citation1996; Rønnestad & Orlinsky, Citation2005). Boredom may ensue from a variety of reasons, among them therapists’ failure to engage sufficiently in the client`s experiential world (i.e. an empathic lapse); or else, through inexperience, allowing clients to avoid talking about what currently concerns them, which affectively de-energizes the therapeutic dialogue. One of the important areas of learning for beginning therapists is understanding what the feelings they experience during sessions may indicate about the therapeutic process.

Graduate and established therapists

Developmentally positive supervision (DPS) was associated with Technical Skills only among Graduate therapists, but was also still positively related to Basic Relational Skills (and Total Clinical Skills). These results underscore the importance of mastering helping skills even beyond the training years. Moreover, although DPS was unrelated to difficulties for Graduates, the negative correlation of DPS with Avoidant Coping implies that supervision may help to limit reliance on non-therapeutic responses, concurrent with the positive support of DPS for Constructive Coping as among other cohorts.

Perhaps the most distinctive thing about Established therapists is that so many (61%) were currently in supervision. The therapist’s quite likely voluntary engagement in supervision may be the basis for the comparatively strong association among Established therapists of being in supervision with its being rated as positively influential for their current development. Surprisingly for Established therapists, DPS was still positively related to a focus on Basic Relational Skills and the perennially relevant issues of empathy and understanding – attributes of a positive therapeutic alliance that consistently predict clinical outcome (e.g. Norcross & Lambert, Citation2019) regardless of therapeutic modality or client characteristics such as age, gender, or diagnosis.

Senior therapists

A surprising finding was the large minority (41%) of Senior therapists who were still or again in supervision. Like Established therapists, being in supervision and with whom was likely a matter of choice, and there was a similarly strong association of being in supervision and its being positively influential for current development. Given the seniority of these therapists, most of the supervision they sought may have been co-supervision with more or less equally senior colleagues, which would make the supervisory process less hierarchical and much less evaluative than among trainees – a description that fits supervision described by highly experienced therapists (Rønnestad & Skovholt, Citation2013).

Equally surprising were the significant inverse correlations among Seniors of DPS with having a Frustrating Treatment Case, a Negative Personal Reaction to a Client, and Total Practice Difficulties – resembling the supervision experience of Apprentice therapists. Clearly, having a productive supervisory focus on difficulties in practice is not the same as experiencing frequent difficulties in practice, and a check of the data showed that Senior (and Established) therapists had indeed reported the lowest levels for all difficulties dimensions. Yet the evidence implies that Senior therapists who engaged in supervision fruitfully were concerned about their experiences of difficulty. Rønnestad and Skovholt’s (Citation2013) model of development suggests that Seniors who opted for supervision might have been finding new challenges that led them to seek this supervision as a developmental resource. The fact that supervisory concern about difficulties arose among them further suggests that they might have been experiencing limitations in their habitual mode of practice, or may have been attempting to learn a new and as yet unmastered mode of practice.

The negative correlations of DPS that focused on limiting Avoidant Coping reinforces the impression that Seniors in supervision were experiencing a degree of stress in their accustomed mode of practice. The fact that Advanced Relational Skills (i.e. transference/counter-transference issues) was another focus of positively influential supervision (uniquely for Seniors) further suggests that Seniors who chose supervision may also have done so to grow beyond some personal limitations.

Another challenge faced by many Seniors for which supervision might be sought stems from the collegial isolation experienced in individual private practice (Skovholt and Rønnestad (Citation1992). Fully 76% of Senior therapists in our sample were in solo private practice (compared to 66% of Established and 49% of Graduate therapists), and those who worked in solo practice did so for an average of 22 hours/week (M = 21.9, SD = 13.2). A relatively isolated and lonely work situation would tend to deprive therapists of collegial stimulation and support, and those who felt it more keenly might seek supervision as a relevant resource.

Taken together, these findings suggest a pronounced sense of vulnerability and need for support among many Seniors. As supervisors of Seniors are likely to be Seniors themselves, or at least highly experienced Established therapists, they may tend not to recognize and address the limitations or vulnerabilities their Senior supervisees may experience (and may be shy of revealing to their peers). Nevertheless, we observed that Senior therapists who engaged in supervision found it profitable to focus on the difficulties they encounter. The supervisory relationship and supervision outcome are likely enhanced if the supervisor does not take for granted that Senior supervisees feel competent and assured, but recognizes the potential struggles and vulnerability supervisees may be feeling. Finding that Support in the Main Work Setting was valued by Senior therapists as it was by others helps to correct the typical view of Seniors as capable of dispensing support and guidance to others but not needing those themselves.

Learning preferences seem to change during therapists` career. “With increasing experience, there occurs a marked shift toward a self-directed preference for what to learn and how to learn” (Rønnestad & Skovholt, Citation2013, p. 39). More experienced supervisees are thus more likely than novices to know what they want to learn from supervision and where to focus, the consequence of which is that participants will spend less time discussing supervision procedures and supervision goals. An inherent aspect of “elective supervision” is that the supervisee chooses the supervisor, which is different from the assigned supervisor procedure typically applied in student settings. More experienced supervisees likely know the professional community sufficiently to be able to make a qualified choice of supervisor to meet their developmental needs which may add to the effectiveness and satisfaction of elective supervision.

Methodological considerations

Some methodological limitations may be noted. First, as in other studies, supervision has been treated as unitary while its forms quite likely varied for therapists in our sample (e.g. individual vs. group supervision, expert-led vs. peer supervision; frequency and duration of supervision; use of video vs. case reports). Second, the sampling procedures producing our cumulative database have varied in different countries and can best be described as convenience sampling (Jager, Putnick, & Bornstein, Citation2017), so that traditional generalizability of findings is limited. Third, the sample is richly heterogeneous, which may be a further source of random variation. Fourth, the many low to moderate correlations reflect small effect sizes which limit the impact attributable to many findings, but which can be explained as due in part to the heterogeneity of the study sample, as well as by the fact that supervision is just one of the growth-facilitating influences on therapists (e.g. Orlinsky & Rønnestad, Citation2005). Fifth, our main variable (DPS) was assessed by a single-item scale, which although not ideal has yielded numerous statistically significant findings indicating a reasonable degree of reliability, and which in a related field of study such as life satisfaction research has been shown to be reliably and validly assessed, as well as more practical for use in large sample studies (Diener, Oishi, & Tay, Citation2018). Sixth, the study focused on reports of positive supervisory experiences, as reports of negative supervision were too infrequent. Seventh, the study has a cross-sectional design, which suggests caution in interpreting differences across cohorts as developmental. Eighth, the study is correlational in design, which precludes firm causal inferences. Ninth, the length of the questionnaire may for some have led to carelessness or fatigue while filling out the questionnaire, which would limit response validity.

Nevertheless, the study has some major strengths. First, the database is substantially larger than other supervision studies and includes data from a broad range of nations and health and social service professions. Second, two major publications are available (Orlinsky & Rønnestad, Citation2005; Orlinsky, Rønnestad, Hartmann, Heinonen, & Willutzki, Citation2022) in which characteristics of the therapists in the database have been analyzed in detail. Third, this study is notable in including therapists over the entire professional career, in contrast to previous studies focused on trainees and novice professionals. Fourth, the study was guided by an established conceptual model of therapist development (Rønnestad & Skovholt, Citation2013), including the contribution of supervision as one important developmental resource. Fifth, a broad range of treatment-, situation- and person-related variables were examined, and almost all were assessed by reliable multiple-item scales.

Our study’s findings reflect the degree to which therapists’ ratings of supervision as growth-enhancing (DPS) were related to specific aspects of their therapeutic work, their work situation, and some of their personal characteristics. If positive supervision focused on these specific topics, it might imply that supervisees found them to be problematic. However, these were also the topics where therapists said supervision positively facilitated their current development. The study’s results thus suggest that, for therapists in supervision, the supervisory experience was more profitable when it touched on those topics; and further, that these results might be of benefit if known to those who provide supervision.

Given the varied strengths and limitations of the study, the safest conclusion is that our exploration of Currently Experienced Growth and its correlates should be viewed as provisional considerations for supervision practice and future research.

Clinical implications

This study has shown that a substantial proportion of psychotherapists have supervision, not just early in their careers, but even as very experienced Established and Senior practitioners. Further, at all career levels, being currently in supervision was significantly associated with therapists’ describing supervision as a positive influence on their development (DPS), with the strongest association among Established and Senior psychotherapists. This has two implications: Firstly, it suggests that psychotherapists tend to use supervision as a relevant adjunct to practice through their whole career, rather than only in the years of initial professional training. Secondly, it should encourage professional organizations, training bodies and service providers to offer supervision resources for all career levels in order to promote professional development.

Importantly, the results also showed that, for all career levels, positively influential supervision (DPS) was significantly associated with Healing Involvement, both globally and in relation to specific facet dimensions. The latter include Coping Constructively with Difficulties, Relating in an Effective manner, and Feeling “Flow” (rapt interest and involvement) during sessions with clients. Positively influential supervision (DPS) may help therapists to experience work as a Healing Involvement and, conversely, the benefit derived from supervision may be optimal when therapists’ work experiences are predominantly positive and provide a sense of mastery. By contrast, a more harmful combination of learning experiences for supervisees is the experience called “double traumatization” (Rønnestad & Orlinsky, Citation2005), in which the supervisee experiences a conflict with the supervisor while simultaneously experiencing Stressful Involvement with a client – a circumstance that supervisors should always try to mitigate.

For all experience cohorts, Work Setting Support and Satisfaction was significantly associated with positively influential supervision (DPS). Not surprisingly, the strongest association was found for the earliest career cohorts, which implies that supervisors should be attentive to (and if needed, discuss with the supervisees) how they experience their work environment. Equally important is that Work Setting Support and Satisfaction was also significantly associated with positively influential supervision for Established and Senior therapists. Even in the supervision of highly experienced supervisees, who are often assumed to be self-reliant and autonomous, supervisors should still be attentive to the supervisee’s perceptions of their work environment.

It is worth noting that a small but statistically significant inverse association was found, at all career levels, between positively influential supervision (PDS) and Negative Personal Reaction to Clients. Having a Negative Personal Reaction to a Client may well draw supervisory attention, and positively influential supervision (PDS) may help to resolve it. This type of difficulty may stem at least partially from the therapists’ personal characteristics. Combined with the finding that DPS was positively associated with supervisees’ having a Genial and Expressive personal self, this suggests both that supervisees’ personalities can have an effect on how they experience supervision, and that positively influential supervision may also favorably affect the supervisee’s personal development. These negative and positive findings about supervision align with the general understanding that therapists can and should enhance their psychotherapeutic work by having personal therapy themselves (Geller, Norcross, & Orlinsky, Citation2022; Orlinsky, Schofield, Schröder, & Kazantzis, Citation2011; Rønnestad, Orlinsky, & Wiseman, Citation2016) or by engaging in analogous forms of personal practice (Bennett-Levy, Citation2019).

Post-graduate training implications

Our findings indicate that Graduate, Established and Senior therapists who are currently having supervision are more likely than Novices or Apprentices to report that they experience it as Developmentally Positive Supervision (DPS) (). Moreover, DPS for Graduate, Established and Senior therapists continued to reinforce their experience of Currently Experienced Growth and, to a lesser extent, suppressed their sense of Currently Experienced Depletion (). Finally, DPS also supported their experience of therapeutic work as a Healing Involvement, especially in regard to coping with difficulties (). These findings clearly support the inclusion of regular supervision as an important element of post-graduate training.

However, the effect of different kinds and formats of continuing education has not been clearly established. Studies on the effect of conference and work-shop participation (in person and online) and supervision (Aafjes-van Doorn & Barber, Citation2023) show varying and inconclusive results and raise many questions, including how to define and measure outcome. Nevertheless, supervision is a well-established learning arena, not only for basic training and pre-licensing, but also for post-graduate education of psychotherapist. In a large-scale study of sources of influence for current professional development that included assessment at different career levels (Orlinsky, Botermans, & Rønnestad, Citation2001) clinical supervision was highly ranked as a source of influence across experience levels as well as across nations, professions, supervisees` theoretical orientation and gender. All in all, there is every reason to recommend supervision as a central component in the continuing education of psychotherapists.

Research recommendation

Our first, most general recommendation is that basic research on supervision should be carried out for supervisees at different career levels. All of the other recommendations below should be carried out with this in mind.

Our second recommendation is that future supervision research should focus on studying the functions and processes of `elective` supervision, voluntarily undertaken throughout the entire professional career, as compared to `required` supervision. This clearly agrees with a research question suggested by Aafjes-van Doorn and Barber (Citation2023) who asked: “Is supervision different when supervisors are assigned versus selected … ” (p.72).

Third, we recommend that future research should differentiate among different forms of supervision (e.g. individual vs. group, expert-led vs. peer supervision, etc.).

Fourth, future research should include data on supervisees and supervisors` background, including, but not limited to, types and frequency and duration of current and past supervision experiences, certification/licensure. A study of trainees currently underway has already been gathering data relevant to the third and fourth points (Orlinsky et al., Citation2015).

Fifth, future research on supervision should focus on the study of therapeutic skills, experiences of difficulties, coping strategies, feelings in session, and manner of relating.

Sixth, future research should study how characteristics of the work setting (e.g. organizational culture) and supervisees` personal characteristics (e.g. personal self) may interact with supervisor characteristics and supervisory methods (including participants` theoretical orientation), in general and differentially across experience cohorts.

Finally, future research can consider alternative ways of conceptualizing and operationalizing professional development as a function of data collected (a) from multiple observational perspectives (e.g. supervisee, supervisor, clients, external observers, biographical informants), (b) at different time-points (pre-training, during training, post training), and (c) by using different technologies.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Notes

1. The latter, Individual Longitudinal Development, is the focus of study in Orlinsky, Hartmann, Willutzki, Rønnestad, and Schröder (Citation2024).

2. The second strongest predictor of CED was therapists` motivation to develop further (8% variance), which may lead those beyond their initial training to voluntarily seek supervision, and which in turn may support those therapists` motivation for professional development.

References

  • Aafjes-van Doorn, K., & Barber, J. P. (2023). Professional training and supervision after graduation. In L. G. Castonguay & C. E. Hill (Eds.), Becoming better psychotherapists: Advancing training and supervision. Washington, DC: American Psychological Association.
  • Bennett-Levy, J. (2019). Why therapists should walk the talk: The theoretical and empirical case for personal practice in therapist training and professional development. Journal of Behavior Therapy and Experimental Psychiatry, 62, 133–145. doi:10.1016/j.jbtep.2018.08.004
  • Bernard, J. M., & Goodyear, R. K. (2009). Fundamentals of clinical supervision (4th ed.). New York: Merrill.
  • Bernard, J. M., & Goodyear, R. K. (2019). Fundamentals of clinical supervision (6th ed.). New York: Pearson.
  • Caplan, G. (1995). Types of mental health consultation. Journal of Educational & Psychological Consultation, 6(1), 7–21. doi:10.1207/s1532768xjepc0601_1
  • Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. New York: Harper & Row.
  • Diener, E., Oishi, S., & Tay, L. (2018). Advances in subjective well-being research. Nature Human Behaviour, 2(4), 253–260. doi:10.1038/s41562-018-0307-6
  • Duff, C. T., & Shahin, J. (2010). Conflict in supervision: Antecedents, impact, amelioration and prevention. The Alberta Counsellor, 31(1), 1–8.
  • Ellis, M. V., Berger, L., Hanus, A. E., Ayala, E. E., Swords, B. A., & Siembor, M. (2014). Inadequate and harmful clinical supervision: Testing a revised framework and assessing occurrence. The Counseling Psychologist, 42(4), 434–472. doi:10.1177/0011000013508656
  • Geller, J. D., Norcross, J. C., & Orlinsky, D. E. (Eds.). (2022). The psychotherapist`s own psychotherapy: Patient and clinician perspectives. Oxford. UK: Oxford University Press.
  • Götz, F. M., Gosling, S. D., & Rentfrow, P. J. (2022). Small effects: The indispensable foundation for a cumulative psychological science. Perspectives on Psychological Science, 17(1), 205–215. doi:10.1177/1745691620984483
  • Jager, J., Putnick, D. L., & Bornstein, M. H. (2017). More than just convenient: The scientific merits of homogeneous convenience sampling. Monographs of the Society for Research in Child Development, 82(2), 13–30. doi:10.1111/mono.12296
  • Knox, S., & Hill, C. E. (2021). Training and supervision in psychotherapy: What we know and where we need to go. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change (pp. 775–811). Hoboken, NJ: Wiley.
  • Ladany, N., Hill, C. E., Corbett, M. M., & Nutt, E. A. (1996). Nature, extent, and importance of what psychotherapy trainees do not disclose to their supervisors. Journal of Counseling Psychology, 43(1), 10–24. doi:10.1037/0022-0167.43.1.10
  • Leary, T. (1957). Interpersonal diagnosis of personality. New York: Ronald Press.
  • Loganbill, C., Hardy, E., & Delworth, U. (1982). Supervision: A conceptual model. The Counseling Psychologist, 10(1), 3–42. doi:10.1177/0011000082101002
  • Milne, D., & Watkins, C. E., Jr. (2014). Defining and understanding clinical supervision: A functional approach. In C. R. E. Watkins Jr & D. L. Milner (Eds.), The Wiley international handbook of clinical supervision (1st ed.). Chichester, UK: Wiley.
  • Neufeldt, S. A. (1999). Training in reflective processes in supervision. In M. Carroll & E. I. Holloway (Eds.), Education of clinical supervisors (pp. 92–105). London: Sage Publications. doi:10.4135/9781446218044.n5
  • Neufeldt, S. A., Karno, M. P., & Nelson, M. L. (1996). A qualitative study of experts’ conceptualizations of supervisee reflectivity. Journal of Counseling Psychology, 43(1), 3–9. doi:10.1037/0022-0167.43.1.3
  • Norcross, J. C., & Lambert, M. J. (Eds.). (2019). Psychotherapy relationships that work (3rd ed., Vol. I). New York: Oxford University Press.
  • Orlinsky, D. E. (2022). How psychotherapists live: The personal self and private life of professional healers. New York: Routledge.
  • Orlinsky, D. E., Botermans, J.-F., & Rønnestad, M. H. (2001). Towards an empirically-grounded model of psychotherapy training: Five thousand therapists rate influences on their development. Australian Psychologist, 36(2), 139–148. doi:10.1080/00050060108259646
  • Orlinsky, D. E., Hartmann, A., Rønnestad, M. H., & Willutzki, U. (2022). Psychotherapists as persons: Doing psychotherapy. In D. E. Orlinsky (Eds.), How psychotherapists live: The personal self and private life of professional healers (pp. 168–200). New York: Routledge.
  • Orlinsky, D. E., Hartmann, A., Willutzki, U., Rønnestad, M. H., & Schröder, T. A. (2024). Trainees’ developing experiences of healing involvement and stressful involvement: A longitudinal analysis. Paper Presented at the Society of Psychotherapy Research 55th Annual International Meeting. Ottawa, Canada.
  • Orlinsky, D. E., & Rønnestad, M. H. (2005). How psychotherapists develop: A study of therapeutic work and professional growth. New York: American Psychological Association.
  • Orlinsky, D. E., & Rønnestad, M. H. (2015). Psychotherapists growing older: A study of senior practitioners. Journal of Clinical Psychology, 71(11), 1128–1138. doi:10.1002/jclp.22223
  • Orlinsky, D. E., Rønnestad, M. H., Hartmann, A., Heinonen, E., & Willutzki, U. (2019). The personal self of psychotherapists: Dimensions, correlates, and relations with clients. Journal of Clinical Psychology, 76(3), 461–475. doi:10.1002/jclp.22876
  • Orlinsky, D. E., Rønnestad, M. H., Hartmann, A., Heinonen, E., & Willutzki, U. (2022). Personal self. In D. E. Orlinsky, (Eds.), How psychotherapists live: The personal self and private life of professional healers (pp. 33–54). New York: Routledge.
  • Orlinsky, D. E., Rønnestad, M. H., & Willutzki, U. (2011). SPR collaborative research program on the development of psychotherapists. In J. C. Norcross, G. R. VandenBos, & D. K. Freedheim (Eds.), History of psychotherapy (2nd ed., pp. 223–235). Washington, DC: American Psychological Association.
  • Orlinsky, D. E., Schofield, M., Schröder, T. A., & Kazantzis, N. (2011). Utilization of personal therapy by psychotherapists in six English-speaking countries. Journal of Counseling Psychology/In Session, 67(8), 828–842. doi:10.1002/jclp.20821
  • Orlinsky, D. E., Strauss, B., Rønnestad, M. H., Hill, C., Castonguay, L., Willutzki, U., & Carlsson, J. (2015). A collaborative study of development in psychotherapy trainees. Psychotherapy Bulletin, 50(4), 21–25.
  • Reichelt, S., Gullestad, S. E., Hansen, B. R., Rønnestad, M. H., Torgersen, A. M., Jacobsen, C. H., & Nielsen, G. H. (2009). Nondisclosure in psychotherapy group supervision: The supervisee perspective. Nordic Psychology, 61(4), 5–27. doi:10.1027/1901-2276.61.4.5
  • Rønnestad, M. H., & Orlinsky, D. E. (2005). Clinical implications: Training, supervision and practice. In How psychotherapists develop: A study of therapeutic work and professional growth (pp. 181–201). Washington, DC: American Psychological Association.
  • Rønnestad, M. H., Orlinsky, D. E., Schröder, T. A., Skovholt, T. M., & Willutzki, U. (2018). The professional development of counselors and psychotherapists: Implications of empirical studies for supervision, training and practice. Counselling and Psychotherapy Research, 19(3), 214–230. doi:10.1002/capr.12198
  • Rønnestad, M. H., Orlinsky, D. E., & Wiseman, H. (2016). Professional development and personal therapy. In J. C. Norcross, D. K. Freedheim, & G. R. VandenBos (Eds.), APA handbook of clinical psychology, Vol. V, Education and Profession (pp. 223–235). Washington, DC: American Psychological Association. ISBN 978-1-4338-2129-5.
  • Rønnestad, M. H., & Skovholt, T. M. (2013). The developing practitioner: Growth and stagnation of therapists and counsellors. New York: Routledge.
  • Shulman, I. S. (2005). Signature pedagogies in the professions. Proceedings of the American Academy of Arts and Sciences, 134(3), 52–59. doi:10.1162/0011526054622015
  • Skjerve, J., Nielsen, G. H., Jacobsen, C. H., Gullestad, S. E., Hansen, B. R. … Torgersen, A. M. (2009). Nondisclosure in psychotherapy group supervision: The supervisor perspective. Nordic Psychology, 61(4), 28–48. doi:10.1027/1901-2276.61.4.28
  • Skovholt, T. M., & Rønnestad, M. H. (1992). The evolving professional self: Stages and themes in therapist ad counselor development. Chichester, UK: Wiley.
  • Stoltenberg, C. D., McNeill, B. W., & Delworth, U. (2010). IDM: An integrated developmental model for supervising counselors and therapists (3rd ed.). New York: Routledge.
  • Watkins Jr, C. E. (2020). Psychotherapy supervision: An ever evolving signature pedagogy. World Psychiatry, 19(2), 244–245. doi:10.1002/wps.20747
  • Wei, M., Russell, D. W., Mallinckrodt, B., & Vogel, D. I. (2007). The experiences in close relationships scale (ECR)—short form: Reliability, validity, and factor structure. Journal of Personality Assessment, 88(2), 187–204. doi:10.1080/00223890701268041