4,750
Views
5
CrossRef citations to date
0
Altmetric
Articles

Does Formulation of Service Users’ Difficulties Improve Empathy in Forensic Mental Health Services?

, DClinPsy, , PhD, , DClinPsy & , PhD

ABSTRACT

The culture and values of the National Health Service and the staff that work within it have received much attention over recent years. The erosion of empathy and compassionate care toward service users has been highlighted. Psychological formulation may be one way that clinicians can understand their service users more fully, which could lead to an improvement in the empathy they express toward them. The current study investigates the effect of presenting client information in a psychological formulation on self-reported empathy in staff in medium and low secure forensic mental health services. One hundred and fifty-four staff were recruited via convenience sampling to complete self-report questionnaires measuring burnout (Maslach Burnout Inventory), state (Adapted Interpersonal Reactivity Index), and trait (Empathy Quotient) empathy. No significant difference in state empathy scores was observed among the staff in the formulated group when compared with the unformulated group. Linear multiple stepwise regressions demonstrated that trait empathy and burnout significantly predicted variance in state empathy, but the information format was not significant. It was concluded that mode of presentation in this instance did not influence the degree of empathic concern staff expressed toward a hypothetical client in a vignette. General levels of empathy and degree of burnout superseded this effect. Further research is needed on how adjusting client information formats might enhance empathy among professionals.

Empathy in forensic mental health services

The culture within the UK National Health Service (NHS) has come under increasing scrutiny following the exposure of failings within a series of hospital trusts (e.g., Mid Staffordshire and Southern Health). Subsequent reports investigating these incidents, such as the Francis report (Francis, Citation2013), highlight the need for a change within NHS culture, with a renewed focus on patient-led and compassionate care. In response, there has been a greater emphasis on values-based staff recruitment, whereby prospective employees holding values congruent with the NHS constitution (e.g., dignity, respect, and compassion) are sought (Health Education England, Citation2014). Within this context, empathy is often referred to as a skill that NHS trusts seek in individuals (Nash, Citation2013).

Empathy is cited in the literature as being central to the role of health care professionals (Walker & Alligood, Citation2001). It is an important component of the relationship between staff and service users, and is crucial to ensuring the delivery of quality care (Yu & Kirk, Citation2009). Research indicates that empathy is vulnerable to erosion by factors including cultural and environmental influences (Alligood & May, Citation2000). In a longitudinal study with first-year nursing students, Ward, Cody, Schaal, and Hojat (Citation2012) found a significant decline in empathy for participants who had a greater exposure to client interaction. These findings were mirrored in studies conducted with third-year medical students (Bellini & Shea, Citation2005; Hojat et al., Citation2009). These studies indicate empathy is a dynamic construct and therefore attention to empathy levels within staff should not only focus on recruitment, but maintain prominence throughout their employment.

In mental health services, staff can regularly be exposed to, and be expected to manage, behaviors such as self-harm and aggression. Working within a forensic setting has been highlighted as particularly challenging for staff. The perceived threat of violence felt by staff within these settings has been hypothesized to lead to increased stress (Joseph, Citation1993), thereby affecting the ability of staff to empathize with service users. Sandhu, Rose, Rosthill-Brookes, and Thrift (2012) discussed the specific challenges staff face when working with service users who had committed sexual or sexually related offenses. Within this context, their qualitative study found that staff reported difficulties in empathizing with this population.

Despite the challenges staff face, Polson and McCullom (Citation1995) highlight the importance of empathy within a forensic mental health setting. They discuss the positive effects of therapists’ empathy toward a service user on the service users’ subsequent ability to empathize with themselves and their victims. This highlights the clinical relevance of investigating mechanisms for increasing and facilitating empathy within staff.

Empathy: State and trait

Carl Rogers’ (1957) definition of empathy was developed from a humanistic approach within the field of psychology. He referred to empathy as the ability to accurately perceive the internal emotions and meaning of another as if one were the person. Despite decades of research, reviews of the literature on empathy in nursing have highlighted continuing inconsistencies in the definition and components of the construct (Duan & Hill, Citation1996; Kunyk & Olson, Citation2001).

In a concept analysis of nursing literature on empathy between 1992 and 2000, Kunyk and Olson (Citation2001) summarized varying definitions of empathy into five key conceptualizations (trait, state, caring, communication process, and special relationship). As with previous research (Evans, Wilt, Alligood, & O’Neil, Citation1998), this paper will focus on two of these conceptualizations: trait and state.

Trait empathy is considered in the literature to be a natural, innate ability that cannot be taught (Kunyk & Olson, Citation2001); for example, toddlers appear to be able to relate to the happiness or sadness of others. Definitions in this category focus on empathy being a human capacity, with an ability to share another person’s experiences (Dracup & Bryan-Brown, Citation1999). Alligood (Citation1992) discusses how trait empathy is an involuntary sharing of another person’s emotions. Therefore trait empathy is a raw, basic human reaction of one person to another. Although this conceptualization posits that empathy cannot be taught, Kunyk and Olson (Citation2001) highlight that it can be identified and reinforced in individuals.

In addition to trait empathy, Alligood (Citation1992) distinguishes state empathy, which is also included in the five conceptualizations by Kunyk and Olson (Citation2001). State empathy is defined as being a learned skill, which is primarily comprised of cognitive and behavioral components. This has been the focus of the nursing literature, and has also been referred to as clinical empathy (Hojat et al., Citation2009). State empathy encompasses concepts of trait empathy in that the clinician is able to accurately perceive the emotions of the service user. However, it moves beyond this, focusing on the clinicians’ ability to maintain objectivity, and focus on the service user. Rogers’ (1957) definition would fit within this conceptualization with his reference to the importance of maintaining the “as-if” quality.

The inference that state empathy can be taught or learned in relation to professional practice (Alligood, Citation1992) is supported empirically by evidence for empathy-enhancing programs with nursing and medical students (Batt-Rawden, Chisolm, Anton, Flickinger, Citation2013; Brunero, Lamont, & Coates, Citation2010). In a review of empathy education in nursing, Brunero et al. (Citation2010) found 11 out of 18 studies reported statistically significant increases in empathy as a result of empathy education. The most successful interventions were shown to be experiential role-plays, where students were given opportunities to reflect upon and understand service users’ emotional states in a controlled environment. The majority of this research has focused on students within health care professions; however, the Francis report (Francis, Citation2013) has highlighted the potential loss of empathy within qualified staff already working within the NHS. Research investigating interventions that support or increase empathy in qualified clinicians would be beneficial, given the association with clinical outcomes and quality of care.

One potentially promising approach that has been highlighted in the literature is psychological formulation. A greater, more meaningful understanding of service users’ difficulties, which can be facilitated by psychological formulation (Boyle & Johnstone, Citation2014), has been highlighted in the literature as essential to empathic interaction (Mercer & Reynolds, Citation2002). Staff reports within forensic mental health settings have supported this, stating that an awareness of service users’ early life experiences helped their empathic response toward those with a sexual offending history (Sandhu et al., Citation2012).

Formulation: Possible effects on empathy

Johnston and Dallos (Citation2013) define psychological formulation as a summary of the service users’ difficulties, based on psychological theory, which informs intervention. One outcome of developing a formulation with service users is to aid their understanding of their difficulties; which can serve to enhance staff understanding. This was supported by Berry, Barrowclough, and Wearden (Citation2009) who found that staff reported a greater understanding of service users’ difficulties following formulation with service users with psychosis.

The Division of Clinical Psychology (DCP, Citation2011) highlights the strengths of formulation to promote collaborative working, and improve relationships between clinicians and service users.

Formulation is also cited in the literature as a powerful systemic intervention (Kennedy, Smalley, & Harris, Citation2003). This may be particularly relevant in Cognitive Analytic Therapy approaches where evidence has shown that formulations with team members can enable staff to understand their own interactions, adaptive and maladaptive, with service users (Carradice, Citation2004; Kerr, Citation1999). In this approach, staff roles and relationships with service users can be encompassed within the service user’s formulation to help staff identify the role they play in the relationship. Further research has reported the positive effects of formulation on staff understanding of service users, and subsequent relationships (Hewitt, Citation2008; Lake, Citation2008; Summers, Citation2006).

Although formulation has been shown to have a positive effect based on self-report from staff perspectives (Hewitt, Citation2008; Lake, Citation2008; Summers, Citation2006), the evidence from service user perspectives is inconclusive. Some research denotes the clients’ experience of formulation as being helpful, encouraging, and reassuring (Evans & Parry, Citation1996). However, qualitative interviews provide evidence that service users can experience formulation as overwhelming and worrying (Chadwick, Williams, & Mackenzie, Citation2003). Completing a comprehensive assessment and formulation can be a daunting process for service users who may not have discussed or fully comprehended the adversity they have experienced.

The British Psychological Society’s Division of Clinical Psychology (BPS, DCP) Good Practice Guidelines on the Use of Formulation (2011) summarize how there is emerging evidence for the value of formulation within multidisciplinary working, but that further research is required to assess the impact of formulation on quality of care and team functioning. The role of formulation in potentially enhancing or maintaining levels of state empathy in staff is therefore worth exploring.

Burnout: The potential influence on empathy

In addition to the mode by which staff are presented with information when working with service users, there are a number of additional factors that might influence their capacity to empathize. Some examples include gender, interpersonal style, culture, environment, and personality (Alligood & May, Citation2000). In particular, burnout has been associated in the nursing and medical literature with empathy (Ferri, Guerra, Marcheselli, Cunico, & Di-Lorenzo, Citation2015) and will be examined in the current study.

Maslach (Citation2003) defines the experience of burnout as involving physical depletion, feelings of helplessness, negative self-concept, and negative attitudes toward work, life, and others. The Maslach Burnout Inventory (MBI; Maslach & Jackson, Citation1981) measures burnout across three dimensions: emotional exhaustion, depersonalization, and personal accomplishment. Burnout is linked with increased rates of job turnover and stress-related absences, and health care workers are documented to be at increased risk of suffering burnout (Bender & Farvolden, Citation2008; Morse, Salyers, Rollins, Monroe-DeVita, & Pfahler, Citation2012). It is not surprising, therefore, that burnout has been widely researched in health care settings with an increasing focus on mental health care workers.

In some of the literature, empathy has been negatively correlated to level of perceived burnout in health care staff (Lamothe, Boujut, Zenasni, & Sultan, Citation2014; Lee, Song, Cho, Lee, & Daly, Citation2003; Torres, Areste, Mora, & Soler-Gonzalez, Citation2015; Walocha, Tomaszewski, Wilczek-Rużyczka1, & Walocha, Citation2013). Zenasni, Boujut, Woerner, and Sultan (Citation2012) have proposed (given the evidence for a negative association between burnout and empathy), that interventions to increase clinicians’ level of empathy with service users may serve to prevent or protect against burnout. This suggestion provides supplementary support for investigating mechanisms that can increase clinician empathy levels.

This study aims to address the identified gap in the literature by exploring the effect of formulation on the state empathy of clinical staff toward a hypothetical service user in a forensic service. Furthermore, the study will look at the impact of other independent variables on empathy (e.g., age of participants, years of experience, and level of burnout).

Hypotheses

Formulated client information will be associated with an enhanced empathic response to a hypothetical service user case compared to nonformulated information. Where participants have a greater psychological understanding of the client via formulation, they will endorse a more empathic response toward the service user.

Method

Participant characteristics

Ninety-nine (64%) of the total sample were female, with males representing (35.7%) of participants (see ). There was an even spread of participants across the first four age categories spanning 18–55 years. Eleven participants (7.1%) were in the 56 years and above category. The most frequent category was 26–35 years. One hundred and thirty-five participants (88%) described themselves as White; other ethnic groups represented 12% of the sample, including participants who identified themselves as being mixed ethnicity, Black, Indian, Asian, Mauritian, and Iranian.

Table 1. Frequencies and percentages of participants in the unformulated and formulated groups according to demographic variable categories.

The majority of participants worked on medium secure forensic wards (n = 110, 71%) in full-time roles (n = 145, 94%). The majority of participants (n = 119, 77%) reported that they had more than five hours’ face-to-face contact with patients per shift. Eleven percent of participants reported having 1–3 hours or 3–5 hours of face-to-ace contact with patients per shift. The largest proportion of participants (n = 58, 78%) reported having up to 3 years of experience; however, the second highest reported level of experience was 15 years or more (n = 27, 18%).

Sampling procedures and ethics

Ethical and sponsorship approval (UoL001107, 12/01/Citation2015) was granted by the University of Liverpool. Research and Development Committee. Approval was also granted from the local services where recruitment took place (ref: 867, 09/04/2015; ref: 15/06, 08/04/2015; ref: 2015/11, 10/06/2015). Prior to commencing recruitment, the researcher liaised with the relevant ward and service managers to agree on the best time to access potential participants that would have minimal impact on service users.

One hundred and fifty-four clinical staff were recruited face-to-face, from three low and medium secure forensic services in the North West of England, via convenience sampling. All of the hospitals included in the study provided care for male and female patients presenting with a variety of difficulties including self-harm, psychosis, interpersonal difficulties, and emotional regulation difficulties. “Clinical staff” were defined as those who had face-to-face contact with service users. Staff that did not have face-to-face contact with service users (e.g., administrative staff) were excluded from the study. Due to their extensive training in formulation, psychologists were also excluded from taking part in the study. One hundred and ninety participants agreed to take a questionnaire pack; however, 154 participants (81% response rate) gave written consent and returned fully completed questionnaires (recruitment process shown in ). Demographic categories were dichotomized to ease data interpretation and reporting (see ).

Figure 1. Flow chart indicating process of recruiting participants into the current study.

Figure 1. Flow chart indicating process of recruiting participants into the current study.

Participants were recruited on site by the researcher or a link researcher based within the respective services. Staff were told verbally about the project, and if they showed interest they were given an information leaflet further outlining the procedure, aims, and confidentiality arrangements of the study. The participants’ right to withdraw was explained and written consent gained. Participants were given a questionnaire pack that included the measures described below (see Measures and Covariates section) and either a formulated or unformulated vignette, which were alternately allocated. The content of the pack was arranged in a specific sequence. Participants completed the MBI (Maslach & Jackson, Citation1981) and EQ-SF (Wakabayashi et al., Citation2006) first and then were asked to read through the vignette and complete the IRI-A (Davis, Citation1983) in relation to the client presented in the vignette.

Following completion of these questionnaires, the participants were invited to ask any questions relating to the study and to request relevant support. However, none of the participants requested any further support. Additionally, they were given the opportunity to enter the prize draw as remuneration for their time by providing their contact details that were stored separately to their data.

Sample size and power

A minimum sample size target was calculated for multiple linear stepwise regression utilizing G*Power 3 software (Faul, Erdfelder, Lang, & Buchner, Citation2007). Alpha was set at .05 and power at 80%, based on Cohen’s guidelines for behavioral sciences (Cohen, Citation1992) with a medium effect size anticipated; this yielded a target sample size of 92 with 5 predictors.

Measures and covariatesFootnote1

Demographic information was collected via a self-report questionnaire designed by the researcher. Information collected included participant age, gender, ethnicity, years of experience, role, hours of face-to-face contact with service users, and whether they were full-time or bank members of staff.

Interpersonal reactivity index–adapted

State empathy and empathic responses to the formulated–nonformulated case presentation was assessed using an adapted version of the Interpersonal Reactivity Index (IRI-A; Davis, Citation1983). The original IRI is based on a multidimensional model of the process of empathy, with four distinct subscales: (a) perspective taking (PT), in line with traditional definitions of cognitive empathy; (b) fantasy (FS), which measures a tendency to identify with fictional characters; (c) empathic concern (EC), capturing the respondent’s ability to have warm feelings towards other; and (d) personal distress (PD), which measures the occurrence of the respondent’s experience of others’ negative experiences.

Each of these subscales are represented by seven items (subscale score range = 0–28) with a total of 28 items (total score range = 0–112). Respondents are asked to indicate along a 5-point Likert scale the extent to which statements describe them (0 = does not describe me well, 4 = describes me well). Internal consistency is reported at (α = 0.70–0.78) and test–retest reliability is reported over a 60–75-day period (= 0.61–0.81; Yu & Kirk, Citation2009).

Although it was not designed specifically for use in a health care context, studies within a health care setting have reported good structural integrity and convergent validity. This suggests that the measure has the potential for use specifically with health care professionals (Evans, Stanley, & Burrows, Citation1993; Yarnold, Bryant, Nightingale, & Martin, Citation1996). Konrath (Citation2013) highlighted how the subscale scores should not be totaled, advising that researchers utilize the individual subscales pertinent to their study. Additionally, Baron-Cohen and Wheelwright (Citation2004) highlighted the lack of clarity surrounding the FS subscale in relation to its measurement of empathy; therefore, the FS subscale was omitted. Items from the other three subscales (PT, EC, and PD) were modified to relate specifically to the service user presented in the case vignette (total score range = 0–84). This adaptation enabled the measure to capture a participant’s state empathy toward the service user in the vignette. Each of the adapted subscales (EC, PT, PD) in this study were found to have Cronhach’s alphas of (α = .61; α = .65; α = .73) respectively.

The empathy quotient–short form

Trait empathy was assessed using the Empathy Quotient–Short Form (EQ-SF; Wakabayashi et al., Citation2006). This is a self-report questionnaire designed to measure empathy in adults. It is based on the original 60-item questionnaire developed by Lawrence, Shaw, Baker, Baron-Cohen, and David (Citation2004). Respondents are asked to indicate along a 4-point scale the degree to which they agree with a series of 40 statements (e.g., “I find it hard to know what to do in a social situation”). Response options are four statements: strongly agree, slightly agree, strongly disagree, or slightly disagree. Responses are either reverse or normally scored, with two points for a strong empathy response, one point for a slightly empathic response, and zero if the response is nonempathic. A total score is calculated (range = 0–80) and then interpreted as falling within one of four categories: (a) lower than average (0–32); (b) average (33–52); (c) above average (53–63); and (d) very high (64–80). These categories indicate the respondents’ self-reported ability to understand the feelings of others and respond appropriately.

Although originally designed for clinical applications, the measure has been utilized in general populations, with studies reporting higher scores in females than males (Baron-Cohen & Wheelwright, Citation2004), a finding which has been replicated cross-culturally (Berthoz, Wessa, Kedia, Wicker, & Grezes, Citation2008; Preti et al., Citation2011; Wakabayashi et al., Citation2007).The short form of this questionnaire was utilized to reduce the burden for participants. This was deemed important, as clinical staff would be completing the study within working hours and ethically it was important to reduce the possible impact on service users. Principal component analysis and factor analysis has suggested that the short form version is highly correlated with the full-scale versions (Wakabayashi et al., Citation2006). The current study reported good internal consistency in this measure (α = .83).

Maslach Burnout Inventory

The Maslach Burnout Inventory (MBI; Maslach & Jackson, Citation1981)is a 22-item self-report questionnaire measuring three identified dimensions of burnout: emotional exhaustion (EE), depersonalization (DP), and lack of personal accomplishment (PA) along a 7-point response scale. Respondents are asked to indicate the frequency with which they experience the feeling specified in each item. The frequency scale ranges from “never experienced” (0) to “experience such feelings every day” (6). A separate score is calculated for each of the subscales. These are categorized as low, medium, or high according to predetermined cutoff scores for each subscale (EE, low = 0–16, medium = 17–26, high = 27–54; DP, low = 0–6, medium = 7–12, high = 13–30; PA, low = 0–31, medium = 32–38, high = 33–48). High scores on the EE and DP subscales and a low score on the PA subscale is deemed to be suggestive of high levels of perceived burnout. This measure is considered to be the gold standard for measuring burnout (Dorez, Novara, Sica, & Sanavio, Citation2003; Schutte, Toppinen, Kalimo, & Schaufeli, Citation2000). The subscales demonstrate high internal consistency (EE, α = .90; DP, α = .79; PA, α = .71) as reported by Maslach and Jackson (Citation1981). In this study the subscales of EE and PA demonstrated good internal consistency (EE, α = .88; PA, α = .71); however, alpha was shown to be lower (α = .60) for the DP subscale.

Design

A between-groups design was adopted. Exposure to formulated client information (yes/no) was the main independent variable, with state empathy as the dependent variable.

Experimental manipulations

Case vignette

A case vignette was designed and two versions were developed to reflect a formulated and an unformulated presentation. The case was developed during a focus group with qualified clinical psychologists based in a forensic setting. Details about the client in the vignette were based on an amalgamation of clients with whom the clinical psychologists had worked, and considered representative of a typical service user within a secure forensic setting. Both versions described the same hypothetical service user. The “unformulated” version detailed basic information including age, index offense, current medications, diagnosis, presenting difficulties, gender, and reason for referral. The “formulated” version provided additional information about the hypothetical service user’s background and history from a psychological stance.

Data analysis procedure

Variable distributions were first examined for parametric assumptions testing. Results of the Shapiro-Wilk test for normality (Field, Citation2013) indicated that the scores on the EQ-SF (Wakabayashi et al., Citation2006) and the EC subscale of the adapted IRI (Davis, Citation1983), were normally distributed (W = .991, p = .416; = .985, p = .048). Tests of normality on the EE, DP, and PA subscales of the MBI (Maslach & Jackson, Citation1981; W = .962, p = .000; = .899, p = .000; W = .968, p = .001) and the PD and PT subscales of the IRI (W = .970, p = .002; W = .967, p = .001) indicated that the data were significantly different from that of a normal distribution. Where assumptions were not violated, parametric tests were conducted. Basic descriptive analysis was then conducted on all variables, and bivariate associations between individual independent variables and the dependent variable (state empathy) were examined. The main hypothesis was tested by examining whether the independent variables (formulation yes/no, burnout—MBI Scores, trait empathy—EQ-SF scores) predicted the variance in the dependent variable (state empathy, IRI-A scores) using multiple regressions (SPSS version 21; International Business Machines [IBM], 2012). Assumptions for regressions were met.

Results

Descriptive statistics: Exploring formulated and unformulated groups

The profiles of the two groups (formulated and unformulated) were examined to ensure that they were comparable. Categories for the demographic variables were dichotomized in order to aid comparison between the two groups (see ). There was an equal split of participants across both age categories, and the majority of participants were female. No significant differences in age or gender for the two groups were observed (see ).

The highest number of participants were support workers, followed by qualified nurses. The rest of the sample consisted of other health care professionals including social workers, occupational therapists, and medical doctors (see ). No significant differences were observed between the groups for participant role. Participants allocated to the unformulated and formulated groups were almost equally split in each of the respective services, level of security, and hours of contact. Chi-squared analysis demonstrated no significant differences between the groups; therefore, these variables were not entered as predictors in the regressions (see ).

Participant’s years of experience in the unformulated group were spread equally across the subcategories. However participants in the formulated group were not equally spread (see ). A chi-square test of independence was calculated comparing the formulated and unformulated groups across the demographic variables in . No significant association was found between the unformulated and formulated groups on any of the demographic variables, and therefore they were assumed not to be predictive of the dependent variable (trait empathy, IRI-A), so were not inputted into the regression model.

Independent variables: Burnout (MBI) and trait empathy (EQ-SF)

There were no significant differences between the groups on the MBI (Maslach & Jackson, Citation1981) subscales. Scores on the EE subscale fell within the Medium range, and scores on the PA and DP subscales fell into the high and low ranges respectively (further information in ).

Table 2. Mean scores, standard deviations, and t-tests on the Maslach Burnout Inventory (MBI) subscales, and Empathy Quotient (EQ-SF) in the formulated and unformulated groups.

Means and standard deviations were comparable between the groups on the EQ-SF (Wakabayashi et al., Citation2007), with no significant difference found (see ). These scores score fell within the high end of the “average” empathy category.

Dependent variable: State empathy (IRI-A)

Means and standard deviations were comparable between the groups on the IRI-A subscales (see ). An independent samples t-test revealed no significant differences between groups on state empathy (as measured by the IRI-A), indicating that exposure to the formulated client information did not significantly affect participants’ scores. The formulation group were examined separately and dichotomized as having high (N = 45) or low empathy (N = 33) based on the median EQ-SF score. Those with high trait empathy demonstrated significantly higher empathic concern on the IRI-A (high trait empathy M = 21.93, SD = 3.67; low trait empathy M = 18.42, SD = 4.03; t(76) = 4.01, < .001) but there was no statistically significant difference in perspective-taking or personal distress.

Table 3. Mean scores, standard deviations, and t-tests on the Adapted Interpersonal Reactivity Index (IRI-A) subscales in the formulated and unformulated groups.

Regressions

Two separate stepwise multiple regressions were performed (see ) with IRI-A subscales (EC and PT) as the dependent variable in each case. In each of the two analyses the predictor variables were MBI subscales, trait empathy (EQ-SF), vignette formulated–unformulated (see ). A third analysis with PD subscale as the dependent variable did not meet the assumptions of the regression due to the weak correlations with the independent variables.

Table 4. Linear model of predictors of IRI-A subscales: Empathic concern and perspective taking.

As shown in , for empathic concern, only trait empathy (EQ-SF; Wakabayashi et al., Citation2007) and the personal accomplishment subscale of the MBI (Maslach & Jackson, Citation1981) predicted a significant amount of the variance (F[1,151] = 27.323, < .01, R2 adjusted = .256). Type of vignette (formulated or unformulated) was not a significant predictor of empathic concern. For perspective taking, trait empathy (EQ-SF) was again significant, alongside the depersonalization subscale of the MBI. There was no evidence of an effect for personal accomplishment. Type of vignette (formulated–unformulated) was not a significant predictor of this subscale of state empathy (F[1,151] = 6.105, < .01, R2 = .075, R2 adjusted = .063). The emotional exhaustion subscale of the MBI was not predictive of scores on either dependent variable. Correlations were performed on IRI-A subscale scores and EQ-SF score for participants in the unformulated (control) group, to further explore the relationship between trait and state empathy. Significant positive correlations were found between EQ-SF and two of the IRI-A subscales PT (rs = .256, < 0.05) and EC (= .382, < 0.05). This demonstrated a small but significant association between trait empathy and two subscales of state empathy. The PD subscale of the IRI-A was negatively correlated with EQ-SF; however, this was not significant (rs = –.094, > 0.05).

Discussion

This research addressed a gap in the empirical literature by investigating whether the mode of presentation (formulated–unformulated) of client information affected the level of state empathic response from staff in a forensic service, toward a hypothetical service user presented in a vignette.

Exploring the hypothesis

It was hypothesized that formulated client information would be associated with an enhanced state empathic response from staff when compared to responses from staff that read nonformulated information. Theoretical evidence suggested that, where participants had a greater psychological understanding of the client via formulation, they would endorse a more empathic response toward the service user.

In order to test the hypothesis, a comparison was made between participants’ scores on the adapted Interpersonal Reactivity Index (IRI-A) in the formulated and unformulated groups. Mean scores and standard deviations were comparable across both groups on all of the IRI-A subscales, with no significant difference in scores between groups. This suggested that exposure to the formulated client information did not significantly affect clinicians’ expressed state empathy. Therefore no statistical evidence was found to support the alternative hypothesis, and the null hypothesis has been accepted. It is interesting that staff who were generally empathic, as demonstrated by scoring high on trait empathy, also demonstrated greater empathic concern in response to the vignette but had no greater capacity for perspective taking, nor did they report more personal distress than staff who were generally less empathic. This may suggest a healthy resilience among this group where they can feel therapeutically concerned for a client without being overwhelmed by the client’s distress.

There have been no previous studies investigating the effect of psychological formulation on staff state empathy toward service users. As discussed in the introduction, previous empirical research (Berry et al., Citation2009) suggested that psychological formulation, through the mechanism of increasing staff understanding, could increase staff empathy toward service users. The current research did not find evidence to support these findings. Unlike Berry et al. (Citation2009), the current research did not evaluate the level of understanding staff had of a service user pre- and postformulation. In addition, the method of providing the formulation to staff differed in the two studies. In the current research, participants were presented with already formulated service user information; conversely, in the study conducted by Berry et al. (Citation2009), participants attended hour-long formulation meetings. The brevity of the formulation provided in the current research was important practically to reduce participant burden; however, this may have reduced the potential impact of the formulation. It is likely that there are many additional factors that will moderate the relationship between trait empathy and responses to the vignette and one of these might be a capacity for reflexivity in therapeutic practice when working with distressed clients (Procter, Citation2009). The relatively unstructured vignette involving a formulation may inherently appeal to staff who are open to reflecting on their practice and this could potentially account for more of the variance in the relationship than those included in the model here. This factor was not examined in the study here, but future studies could include it as a variable and test whether it adds to the model developed here.

As outlined in the introduction, qualitative research with staff from a forensic learning disability service has reported that an awareness of service users’ early life experiences helped to increase their empathic response (Sandhu et al., Citation2012). It may be that the findings of the current study are not comparable with this research due to the use of different methodologies. Qualitative research gleans rich, descriptive data (Patton, Citation2005), which may have been lost through the numeric, categorical, self-report measures utilized in the current study. Additionally, this study did not cite formulation as the method by which staff learnt about the service users’ early life experiences. Instead this information was shared as part of a therapeutic group. Therefore the written format of the information about early life experiences in the current study may be considered to be detached from the hypothetical service users’ emotions, or personal delivery of this information, which may explain the difference in findings.

The regression analysis was performed in the current study to investigate whether the way information was presented to participants (e.g., formulated–unformulated) would significantly predict participant scores on the subscales of the IRI-A. Preliminary descriptive statistics revealed that the groups did not significantly differ across the range of demographic variables. Therefore, no additional independent variables were added into the regression analysis. Despite previous research (Bellini & Shea, Citation2005; Hojat et al., Citation2009) indicating a negative association between years of experience and empathy, this finding was not replicated in this study. These previous studies had a longitudinal design and were conducted with medical students. The current study adopted a single time point sampling method and different population, which may explain the difference in findings.

While formulation mode was not a significant predictor of state empathy, two other factors were associated with a more empathic response to the vignette. Trait empathy was shown to be predictive of both subscales of the IRI-A, and there was a particular pattern of relationships between elements of burnout and elements of state empathy.

When considering the empathic concern (EC) subscale of the IRI-A, the variance in scores was significantly predicted by the total trait empathy score (EQ-SF; Wakabayashi et al., Citation2007) and the personal accomplishment (PA) subscale of burnout. Empathic concern is discussed by Davis (Citation1983) as an emotional state, where respondents have the ability to feel warm toward others. It could be perceived as similar to Alligood’s (Citation1992) conceptualization of trait empathy, which encompasses an involuntary sharing of others’ emotions. The similarities demonstrated in the definitions of these constructs could account for the variance in empathic concern (EC) being predicted by trait empathy. The link between low personal accomplishment and EC in the current study is also supported by the literature: Maslach (Citation2003) conceptualizes low PA as indicative of burnout, which in turn has been linked to lower levels of empathy (Ferri et al., Citation2015).

The Davis (Citation1983) conceptualization of state empathy includes perspective taking in addition to empathic concern. The regression analysis indicated that EQ-SF (trait empathy) was also predictive of this IRI-A subscale. However the depersonalization (DP) subscale of the Maslach Burnout Inventory ([MBI], Maslach & Jackson, Citation1981) was predictive in this instance. Paris and Hoge (Citation2009) define depersonalization as an unfeeling and impersonal response toward service users, while perspective taking could be seen as the opposite: the clinicians’ ability to take on the view of another person (Davis, Citation1983). It could be hypothesized that a clinician’s ability to take the perspective of a service user (PT) may be explained or predicted by the degree to which they hold negative attitudes toward them (DP), thus explaining the predictive relationship observed in the current study.

This does not support the work of Paro et al. (Citation2014), who found that personal accomplishment, rather than depersonalization, was predictive of the variance in perspective taking. Despite obvious differences between the studies in terms of location (Brazil) and target population (medical students), it is not clear why their findings would have differed from the current study.

Although Alligood (Citation1992) proposed that trait and state empathy were two distinct and unique concepts, Kunyk and Olson (Citation2001) highlighted little difference between definitions, with overlap between the two conceptualizations. These included the ability to accurately perceive the clients’ situation, thoughts, and feelings. The weak yet significant correlations observed in the current study between the PT and EC subscales of the IRI-A and trait empathy measure may indicate that there is an association between the constructs, but they are not the same. This provided evidence to support the theoretical argument of Kunyk and Olson (Citation2001).

Clinical implications

Methodological issues in the current study (e.g., the brevity of the formulation provided and the written format of the formulation) may explain the lack of effect observed between the groups (formulated–unformulated). Previous studies reporting the positive effects of formulation for staff have utilized interactive experiential methods such as formulation meetings. The findings of the current study could support the clinical importance of clinical psychologists actively involving the staff team in generating and discussing the formulation rather than relying on a written version within service users’ notes. This demonstrates the importance and value of clinical psychologists being situated within multidisciplinary teams, where they are able to promote and support staff understanding of service users through the active process of formulation and reformulation.

Although the current research did not find support for the experimental hypothesis, evidence was found to support the partial association between trait and state empathy. This finding holds clinical significance in that NHS trusts could screen prospective employees for trait empathy with a view to providing training for state empathy as part of their induction program. The aim here would be to keep naturally empathic people able to remain empathic in a clinical context throughout their working life.

Strengths and limitations

This study was conducted following a predetermined protocol, with approval from the relevant research and ethical committees. The use of well-validated tools enabled comprehensive exploration of a complex construct, with strong clinical relevance. This, in addition to the real-world setting with busy practitioners on the ground, aids the ecological validity and reliability of the findings. In addition, the study exceeded the minimum number of participants required for adequate power to detect a medium effect size. However, there are limitations that should be considered when interpreting the findings.

The key limitation of this study was the brevity and format of the formulation. The decisions regarding the format of the formulated vignette and study design were made to ensure that participant burden was minimized. It was important to reduce the possible impact of completing the study on staff work load, so as to prevent any subsequent impact on service user care.

This study adopted a quantitative research design. Whilst this numerical approach affords the opportunity to complete statistical analysis to derive potentially generalizable findings, empathy and formulation are complex nuanced constructs that are difficult to fully capture using predefined structured instruments. Indeed, Yu and Kirk (Citation2009) comment on the lack of satisfactory measures of empathy within nursing literature. Therefore, a mixed-methods design utilizing qualitative interviews may have enriched the numerical data. Qualitative exploration could have enhanced understanding of the nature of the significant relationships, and further explored staff’s perception of the utility of formulation. Alongside this, Paro et al. (Citation2014) highlighted the problem of social desirability bias in self-report measures of empathy, such as those used in the current study. Qualitative interviews may have given the researcher the opportunity to explore these issues; however, a mixed-method approach was beyond the resources of this project.

Areas of future research

It was not within the remit of the current study to validate the adapted version of the IRI. The authors acknowledge the potential limitations this may have on the findings of the study, and therefore future research validating this version of the measure or developing a bespoke measure would be beneficial. This would also address a previously identified gap in the literature highlighted by Yu and Kirk (Citation2009), who stated that improvements needed to be made in the measurement of empathy, as there was currently no gold-standard tool. A larger study could include development of a more detailed case vignette and support more focused involvement of staff when responding to it, and thus be in a better position to bring about a difference among those exposed. In relation to clinical implications, the lack of effect observed from the implementation of the formulation may be due to the two-dimensional written formulation utilized in the study. Future studies could compare the effect of live-interactive formulation with staff members versus the written-formulation format that was utilized in the current study.

Notes

1 The publication manual of the American Psychological Association, 6th edition (APA, 2012) was adhered to in relation to acronyms when referring to measures and subscales; for ease of interpretation, full titles have been used at times within the results and discussion sections.

References

  • Alligood, M. R. (1992). Empathy: The importance of recognizing two types. Journal of Psychosocial Nursing and Mental Health Services, 30(3), 14–17. doi:10.3928/0279-3695-19920301-06
  • Alligood, M. R., & May, B. A. (2000). A nursing theory of personal system empathy: Interpreting a conceptualization of empathy in King’s interacting systems. Nursing Science Quarterly, 13(3), 243–247. doi:10.1177/08943180022107645
  • American Psychological Association. (2012). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
  • Baron-Cohen, S., & Wheelwright, S. (2004). The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. Journal of Autism and Developmental Disorders, 34(2), 163–175. doi:10.1023/B:JADD.0000022607.19833.00
  • Batt-Rawden, S. A., Chisolm, M. S., Anton, B., & Flickinger, T. E. (2013). Teaching empathy to medical students: An updated, systematic review. Academic Medicine, 88(8), 1171–1177. doi:10.1097/ACM.0b013e318299f3e3
  • Bellini, L. ., & Shea, J. A. (2005). Mood change and empathy decline persist during three years of internal medicine training. Academic Medicine, 80(2), 164–167. doi:10.1097/00001888-200502000-00013
  • Bender, A., & Farvolden, P. (2008). Depression and the workplace: A progress report. Current Psychiatry Reports, 10(1), 73–79. doi:10.1007/s11920-008-0013-6
  • Berry, K., Barrowclough, C., & Wearden, A. (2009). A pilot study investigating the use of psychological formulations to modify psychiatric staff perceptions of service users with psychosis. Behavioral and Cognitive Psychotherapy, 37(01), 39–48. doi:10.1017/S1352465808005018
  • Berthoz, S., Wessa, M., Kedia, G., Wicker, B., & Grezes, J. (2008). Cross-cultural validation of the empathy quotient in a French-speaking sample. Canadian Journal of Psychiatry, 53(7), 469–477. doi:10.1177/070674370805300712
  • Boyle, M., & Johnstone, L. (2014). Alternatives to psychiatric diagnosis. The Lancet Psychiatry, 1(6), 409–411. doi:10.1016/S2215-0366(14)70359-1
  • Brunero, S., Lamont, S., & Coates, M. (2010). A review of empathy education in nursing. Nursing Inquiry, 17(1), 65–74. doi:10.1111/j.1440-1800.2009.00482.x
  • Carradice, A. (2004). Applying CAT to guide indirect working. Reformulation, 23, 16–23. Retrieved from http://www.acat.me.uk/reformulation.php?issue_id=14&article_id=131
  • Chadwick, P., Williams, C., & Mackenzie, J. (2003). Impact of case formulation in cognitive behavior therapy for psychosis. Behavior Research and Therapy, 14(6), 671–680. doi:10.1016/S0005-7967(02)00033-5
  • Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155. doi:10.1037/0033-2909.112.1.155
  • Davis, M. H. (1983). Measuring individual differences in empathy: Evidence for a multidimensional approach. Journal of Personality and Social Psychology, 44(1), 113–126. doi:10.1037/0022-3514.44.1.113
  • Division of Clinical Psychology. (2011). Good practice guidelines on the use of psychological formulation. Leicester, England: British Psychological Society. Retrieved from https://www.canterbury.ac.uk/social-and-applied-sciences/salomons-centre-for-applied-psychology/docs/resources/DCP-Guidelines-for-Formulation.pdf
  • Dorez, S., Novara, C., Sica, C., & Sanavio, E. (2003). Predicting burnout among HIV/AIDS and oncology health care workers. Psychology and Health, 18(5), 677–684. doi:10.1080/0887044031000141180
  • Dracup, K., & Bryan-Brown, C. W. (1999). Empathy: A challenge for critical care. American Journal of Critical Care, 8(4), 204–206. Retrieved from http://search.proquest.com.liverpool.idm.oclc.org/docview/227826307/fulltextPDF/6AC65661F94B493APQ/4?accountid=12117
  • Duan, C., & Hill, C. E. (1996). The current state of empathy research. Journal of Counselling Psychology, 43(3), 261–274. doi:10.1037/00220167
  • Evans, B. J., Stanley, R. O., & Burrows, G. D. (1993). Measuring medical students’ empathy skills. British Journal of Medical Psychology, 66(2), 121–133. doi:10.1111/j.2044-8341.1993.tb01735.x
  • Evans, G., & Parry, J. (1996). The impact of reformulation in cognitive-analytic therapy with difficult-to-help clients. Clinical Psychology and Psychotherapy, 3(2), 109–117. doi:10.1002/(SICI)1099-0879(199606)
  • Evans, G. W., Wilt, D. L., Alligood, M. R., & O’Neil, M. (1998). Empathy: A study of two types. Issues in Mental Health Nursing, 19(5), 453–461. doi:10.1080/016128498248890
  • Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavioral Research Methods, 39(2), 175–191. Retrieved from http://link.springer.com/article/10.3758/BF03193146#
  • Ferri, P., Guerra, E., Marcheselli, L., Cunico, L., & Di Lorenzo, R. (2015). Empathy and burnout: An analytic cross-sectional study among nurses and nursing students. Acta Biomed for Health Professions, 86, 104–115. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/26629665
  • Field, A. (2013). Discovering statistics using IBM SPSS statistics. London, England: Sage.
  • Francis, R. (2013). Report of Mid Staffordshire Foundation Trust public inquiry. London, England: Her Majesty’s Stationery Office. Retrieved from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/279124/0947.pdf
  • Health Education England. (2014). Values based recruitment framework. Leeds, England: Author. Retrieved from https://www.hee.nhs.uk/our-work/attracting-recruiting/values-based-recruitment
  • Hewitt, O. M. (2008). Using psychological formulation as a means of intervention in a psychiatric rehabilitation setting. International Journal of Psychosocial Rehabilitation, 25, 6–9. Retrieved from http://eds.b.ebscohost.com/eds/detail/detail?sid=9ce45b54-ba3f-43a1-8b0d-84ec762d4842%40sessionmgr104&vid=1&hid=111&bdata=JnNpdGU9ZWRzLWxpdmUmc2NvcGU9c2l0ZQ%3d%3d#AN=33122494&db=a9h
  • Hojat, M., Vergare, M. J., Maxwell, K., Brainard, G., Herrine, S. K., Isenberg, G. A., . . . Gonnella, J. S. (2009). The devil is in the third year: A longitudinal study of erosion of empathy in medical school. Academic Medicine, 84(9), 1182–1191. doi:10.1097/ACM.0b013e3181b17e55
  • International Business Machines. (2012). IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY: IBM Corp.
  • Johnstone, L., & Dallos, R. (2013). Introduction to formulation. In L. Johnstone & R. Dallos (Eds.), Formulation in psychology and psychotherapy: Making sense of people’s problems (2nd ed., pp. 1–16). London, England: Routledge.
  • Joseph, P. (1993). Occupational stress in psychiatric nursing. Journal of Advanced Nursing, 18(4), 591–601. doi:10.1046/j.1365-2648.1993.18040591.x
  • Kennedy, F., Smalley, M., & Harris, T. (2003). Clinical psychology for inpatient settings: Principles for development and practice. Clinical Psychology Forum, 30, 21–24.
  • Kerr, I. B. (1999). Cognitive Analytic Therapy for borderline personality disorder in the context of a community mental health team: Individual and organizational psychodynamic implications. British Journal of Psychotherapy, 15(4), 425–438. doi:10.1111/j.1752-0118.1999.tb00473.x
  • Konrath, S. (2013). A critical analysis of the Interpersonal Reactivity Index. Mededportal Publications, 9. doi:10.15766/mep_2374-8265.9596
  • Kunyk, D., & Olson, J. K. (2001). Clarifications of the conceptualizations of empathy. Journal of Advanced Nursing, 35(3), 317–325. doi:10.1046/j.1365-2648.2001.01848.x
  • Lake, N. (2008). Developing skills in consultation 2: A team formulation approach. Clinical Psychology Forum, 186, 18–24.
  • Lamothe, M., Boujut, E., Zenasni, F., & Sultan, S. (2014). To be or not to be empathic: The combined role of empathic concern and perspective taking in understanding burnout in general practice. Biomed Central Family Practice, 15(15), 1–7. doi:10.1186/1471-2296-15-15
  • Lawrence, E. J., Shaw, P., Baker, D., Baron-Cohen, S., & David, A. S. (2004). Measuring empathy: Reliability and validity of the Empathy Quotient. Psychological Medicine, 34, 911–924. doi:10.1017/S0033291703001624
  • Lee, H., Song, R., Cho, Y. S., Lee, G. Z., & Daly, B. (2003). A comprehensive model for predicting burnout in Korean nurses. Journal of Advanced Nursing, 44(5), 534–545. doi:10.1046/j.0309-2402.2003.02837.x
  • Maslach, C. (2003). Burnout: The cost of caring (2nd ed.). Cambridge, MA: Malor Books.
  • Maslach, C., & Jackson, S. (1981). The measurement of experienced burnout. Journal of Occupational Behavior, 2, 90–113. doi:10.1002/job.4030020205
  • Mercer, S. W., & Reynolds, W. J. (2002). Empathy and quality of care. British Journal of General Practice, 52, 9–13. Retrieved from http://bjgp.org/content/bjgp/52/supplement/S9.full.pdf
  • Morse, G., Salyers, M. P., Rollins, A. L., Monroe-DeVita, M., & Pfahler, C. (2012). Burnout in mental health services: A review of the problem and its remediation. Administration and Policy in Mental Health, 39(5), 341–352. doi:10.1007/s10488-011-0352-1
  • Nash, S. (2013). Working with people with dementia and their carers: Values based recruitment, a toolkit. Newcastle, England: North of England Mental Health Development Unit. Retrieved from http://www.ncl.ac.uk/media/wwwnclacuk/instituteforageing/files/values-based-recruitment.pdf
  • Paris, M., & Hoge, M. A. (2009). Burnout in the mental health workforce: A review. Journal of Behavioral Health Sciences & Research, 37(4), 519–528. doi:10.1007/s11414-009-9202-2
  • Paro, H. B., Silveira, P. S., Perotta, B., Gannam, S., Enns, S. C., Giaxa, R. R., . . . Tempski, P. Z. (2014). Empathy among medical students: Is there a relation with quality of life and burnout? Plos One, 9(4), e94133. doi:10.1371/journal.pone.0094133
  • Patton, M. Q. (2005). Qualitative research. London, England: Wiley.
  • Polson, M., & McCullom, E. (1995). Therapist caring in the treatment of sexual abuse offenders: Perspectives from a qualitative case study of one sexual abuse treatment program. Journal of Child Sexual Abuse, 4(1), 21–44. doi:10.1300/J070v04n01_02
  • Preti, A., Vellante, M., Baron-Cohen, S., Zucca, G., Petretto, D. R., & Masala, C. (2011). The empathy quotient: A cross-cultural comparison of the Italian version. Cognitive Neuropsychiatry, 16(1), 50–70. doi:10.1080/13546801003790982
  • Procter, H. (2009). Reflexivity and reflective practice in personal and relational construct psychology. In J. Stedmon & R. Dallos (Eds.), Reflective practice in psychotherapy and counselling (pp. 93–114). Maidenhead, Berkshire: Open University Press.
  • Rogers, C. R. (1957). The necessary and sufficient conditions of therapeutic personality change. Journal of Consulting Psychology, 21(2), 95. doi:10.1037/h0045357
  • Sandhu, D. K., Rose, J., Rostill-Brookes, H. J., & Thrift, S. (2012). “It’s Intense, to an Extent”: A qualitative study of the emotional challenges faced by staff working on a treatment program for intellectually disabled sex offenders. Journal of Applied Research in Intellectual Disabilities, 25(4), 308–318. doi:10.1111/j.1468-3148.2011.00667.x
  • Schutte, N., Toppin, S., Kalimo, R., & Schaufeli, W. (2000). The factorial validity of the Maslach Burnout Inventory–General Survey (MBI-GS) across occupational groups and nations. Journal of Occupational and Organizational Psychology, 73, 53–66. doi:10.1348/096317900166877
  • Summers, A. (2006). Psychological formulations in psychiatric care: Staff views on their impact. Psychiatric Bulletin, 30(9), 341–343. doi:10.1192/pb.30.9.341
  • Torres, O. Y., Areste, M. E., Mora, J. R. M., & Soler-Gonzalez, J. (2015). Association between sick leave prescribing practices and physician burnout and empathy. Plos One, 10(7), 1–9. doi:10.1371/journal.pone.0133379
  • Wakabayashi, A., Baron-Cohen, S., Uchiyama, T., Yoshida, Y., Kuroda, M., & Wheelwright, S. (2007). Empathizing and systemizing in adults with and without autism spectrum conditions: Cross-cultural stability. Journal of Autism and Developmental Disorders, 37(10), 1823–1832. doi:10.1007/s10803-006-0316-6
  • Wakabayashi, A., Baron-Cohen, S., Wheelwright, S., Goldenfeld, N., Delaney, J., Fine, D., . . . Weil, L. (2006). Development of short forms of the Empathy Quotient (EQ-Short) and the Systemizing Quotient (SQ-Short). Personality and Individual Differences, 41(5), 929–940. doi:10.1016/j.paid.2006.03.017
  • Walker, K. M., & Alligood, M. R. (2001). Empathy from a nursing perspective: Moving beyond borrowed theory. Archives of Psychiatric Nursing, 15(3), 140–147. doi:10.1053/apnu.2001.23754
  • Walocha, E., Tomaszewski, K. A., Wilczek-Rużyczka1, E., & Walocha, J. (2013). Empathy and burnout among physicians of different specialties. Folia Medica Cracoviensia, 53(2), 35–42. Retrieved from https://www.researchgate.net/profile/Jerzy_Walocha/publication/262610020_Empathy_and_burnout_among_physicians_of_different_specialities/links/5524f3d40cf22e181e73b3fb.pdf
  • Ward, J., Cody, J., Schaal, M., & Hojat, M. (2012). The empathy enigma: An empirical study of decline in empathy among undergraduate nursing students. Journal of Professional Nursing, 28(1), 34–40. doi:10.1016/j.profnurs.2011.10.007
  • Yarnold, P. R., Bryant, F. B., Nightingale, S. D., & Martin, G. J. (1996). Assessing physician empathy using the Interpersonal Reactivity Index: A measurement model and cross-sectional analysis. Psychology, Health, and Medicine, 1, 207–221. doi:10.1080/13548509608400019
  • Yu, J., & Kirk, M. (2009). Evaluation of empathy measurement tools in nursing: Systematic review. Journal of Advanced Nursing, 65(9), 1790–1806. doi:10.1111/j.1365-2648.2009.05071
  • Zenasni, F., Boujut, E., Woerner, A., & Sultan, S. (2012). Burnout and empathy in primary care: Three hypotheses. British Journal of General Practice, 62(600), 346–347. doi:10.3399/bjgp12X652193