21,366
Views
107
CrossRef citations to date
0
Altmetric
Review Article

“Diagnosing” burnout among healthcare professionals: Can we find consensus?

, & | (Reviewing Editor)
Article: 1 | Received 05 Feb 2016, Accepted 09 Sep 2016, Published online: 17 Oct 2016

Abstract

Burnout is an established phenomenon across cultures and occupations. The Maslach Burnout Inventory (MBI) is the most commonly used measure of burnout. The MBI delineates burnout according to three components (emotional exhaustion, depersonalization and reduced personal accomplishment) and provides the opportunity to assign a classification of burnout. However, the criteria of what constitutes burnout and/or low, medium or high burnout varies considerably. In the following paper, we have systematically reviewed studies of healthcare professionals that specifically “diagnose” burnout. Results indicate multiple approaches to assigning different levels of burnout. The need for a consensus on how to classify different degrees of burnout is discussed.

Public Interest Statement

Burnout is a psychological syndrome that involves a prolonged response to chronic emotional and interpersonal stressors on the job. It is a common problem among healthcare professionals, especially those at the frontline of care. Our study reviews papers that classified individuals in terms of their burnout level using the Maslach Burnout Inventory (MBI) that discerns three dimensions of burnout; emotional exhaustion, depersonalization and reduced sense of accomplishment. We reviewed the ways in which researchers defined burnout, whether burnout was conceptualized as a multidimensional or unidimensional construct, and whether cut-off scores were used in its assessment. Our results showed a significant variation in the ways burnout levels are identified that can lead to problems in comparative studies, as well as in the interpretation of burnout at the individual level by practitioners. Our paper argues for better guidance and agreement concerning the use of the MBI as a research/diagnosis tool.

Competing Interests

The authors declare no competing interest.

1. Introduction

Burnout is a well-studied syndrome in healthcare associated with various professional and personal consequences. Numerous studies have attempted to estimate the rates of burnout in healthcare professionals reporting prevalence rates ranging from 25 to 75% (e.g. Fahrenkopf et al., Citation2008; Linzer et al., Citation2001; Shanafelt, Bradley, Wipf, & Back, Citation2002). Burnout is defined as a syndrome that consists of emotional exhaustion (EE), depersonalization (DP), and reduced personal accomplishment (PA) (Maslach, Jackson, & Leiter, Citation1996). Symptoms of burnout vary across individuals but they also vary according to the stage of burnout.

The Maslach Burnout Inventory (MBI) is the most widely used measure of job burnout. The MBI has dominated the field as a research tool; by the end of the 1990s it had been used in 93% of the journal articles (Schaufeli & Enzmann, Citation1998). The factorial reliability and validity of the MBI has been established across cultures and occupations. The three dimensions of the MBI generate three scores for every individual respondent. The challenge for the researcher or practitioner is how to combine these three different scores. The original MBI Manual presents the distribution of scores for its normative samples and divides them into thirds; the scoring range in each third is used to indicate “low,” “average,” and “high” scores on burnout (Maslach et al., Citation1996).

However, the developers of the MBI argue that is was developed as a research tool, not as a diagnostic one (Maslach, Leiter, & Schaufeli, Citation2008). However, this cautionary guidance has not stopped researchers from treating the MBI as a clinical tool. Burnout (correctly) does not appear in the most commonly used classification systems (International Classification of Diseases 10th revision, ICD-10, and Diagnostic and Statistical Manual of Mental Disorders 4th revision, DSM-IV). However, in practice a diagnosis is being made and used as a basis for further treatment (Kaschka, Korczak, & Broich, Citation2011).

The Netherlands represents a special case with regard to the use of the MBI as a diagnostic tool. The MBI has been clinically validated in the Netherlands (Brenninkmeijer & Van Yperen, Citation2003; Roelofs, Verbraak, Keijsers, de Bruin, & Schmidt, Citation2005; Schaufeli, Bakker, Hoogduin, Schaap, & Kladler, Citation2001). This work provided the basis for a decision rule whereby an individual can be diagnosed as clinically burnout when s/he scores high on EE and high on one of the other two MBI dimensions. The classification of high burnout is based on clinically validated cut-off scores. In the Netherlands, this diagnostic tool is included in the practice guidelines for managing stress-related disorders in occupational and primary healthcare, as issued by the Royal Dutch Medical Association in 2000. According to these guidelines, burnout is defined as work-related neurasthenia that includes long-term loss of the occupational role, and the diagnostic tool enables physicians to discriminate between those who suffer from severe burnout and those who do not. The use of the MBI as a tool for medical diagnosis has also been adopted in Sweden. The problem of using burnout as a medical diagnosis is that it treats burnout as a unidimensional concept and forces all the attention towards emotional exhaustion. However, the use of the MBI as a clinical tool to diagnose burnout is problematic. For example, Kleijweg, Verbraak, and Van Dijk (Citation2013) recommend that the MBI should not be used by itself as a diagnostic tool in a patient population, because of a resultant high probability of overdiagnosing burnout.

The issue as to whether burnout is a continuous or dichotomous variable is an important topic in the medical community. For example, the exchange between Shanafelt and Dyrbye (Citation2012) and Blanchard, Rodrigues, and Colombat (Citation2012) concerning the prevalence of burnout among oncologists in the Journal of Clinical Oncology highlights the need for clarity on guidelines for the screening for burnout. Indeed, the fact that healthcare professionals are concerned with screening for burnout reveals their desire to be able to diagnose it appropriately.

In the following paper, we systematically review the use of the MBI as a tool to “diagnosis” burnout in studies concerning healthcare professionals. We intentionally denote the word diagnosis in inverted commas to acknowledge that while only some authors may refer to burnout as a clinical syndrome, all authors attribute caseness (i.e. burnout/no burnout) without the appropriate caveats. Studies using the MBI have been prodigious; therefore we limited our review to frontline healthcare professionals (physicians, nurses, and medical residents) and a specific recent time period (2011–2012).

The aim of the review is to identify studies which used the MBI–Human Services Survey (MBI–HSS) or the MBI–General Survey (MBI–GS) to “diagnose” burnout in healthcare professionals and explore how researchers defined burnout and whether they treated it as a unidimensional or multidimensional construct.

2. Methods

2.1. Identification of the studies

Relevant studies were found by means of a systematic search in the academic database SCOPUS from 2011 to 2012. Combinations of the following keywords were used: “burnout”, “physicians”, “nurses”, “doctors”.

For inclusion, the articles had to fulfill the following criteria: (i) include health professionals in the study population, (ii) measure burnout with the use of MBI–HSS or the MBI–GS, (iii) provide a classification of burnout either with the use of cut-off scores, or a dichotomy, (iv) be published in English and (v) be peer-reviewed.

The process of the systematic review is shown in . The combination of keywords yielded 927 potentially relevant articles. From these, 181 articles were excluded due to duplication, 96 articles were excluded after reading their abstract and 11 articles because of limited access to the full paper. In total, 639 full text articles were reviewed and 589 of them were excluded for not meeting one or more of the inclusion criteria. More specifically, 119 articles were excluded because they were not written in English, 385 because they did not measure burnout and 85 articles were not included because they did not provide any classification of burnout or they did not explain it in detail. Finally, 50 articles were included in the review. Those articles, studied burnout in healthcare professionals with the use of MBI–HSS or MBI–GS and they provided a classification of burnout, using either cut-off scores, percentiles, tertiles or a dichotomy of burnout.

Figure 1. Review selection process and results.

Figure 1. Review selection process and results.

Two independent reviewers conducted the literature review and they evaluated separately the methodological quality of the articles. Each article retrieved for this study was assessed independently, by two reviewers for inclusion in or exclusion from the review on the basis of reading the full text. The views of the two reviewers were compared and where there were differences, the article was reconsidered.

3. Results

In total, 50 studies were included in this systematic review. Those studies assessed burnout in health professionals (doctors, nurses and medical residents) using either the MBI–HSS (46 studies) or MBI–GS (4 studies). presents the sample of the studies. As shows the sample sizes of the studies varied considerably.

Table 1. Sample characteristics

3.1. Burnout definition

There is a considerable variability in how researchers define burnout when they study it with regard to health care professionals. This can be problematic because depending on how conservative or liberal the definition is, it can result in either underestimation or overestimation of burnout. Several ways to define clinical burnout have been suggested. According to Maslach, a high degree of burnout is reflected in high scores in EE and DP subscales and low scores in PA subscale. Alternatively, according to Schaufeli and other researchers, high scores on emotional exhaustion and/or depersonalization, but not a low score in personal accomplishment scale can distinguish the clinically burned-out from the non burned-out (Dyrbye, West, & Shanafelt, Citation2009; Schaufeli et al., Citation2001; Thomas, Citation2004).

The studies of the review presented a great variation with regard to how they defined burnout. Forty-three of the studies explained in detail how they identified burnout in their research, while the rest do not provide an explicit rationale as to their criteria for assigning different levels of burnout. Five predominant approaches in the definition of burnout were identified from the review of the papers:

  1. The combination of high EE, high DP and low PA (14 studies)

  2. High EE and/or high DP (12 studies)

  3. High levels of EE and/or DP combined with low PA (3 studies)

  4. A high score in any of the three subscales (4 studies)

  5. High levels in EE subscale only (10 studies)

More conservative definitions required the existence of both high scores in EE and DP and low scores in PA in order to classify burnout, according to Maslach guidelines. However, these studies face the risk of underestimating the burnout rate of individuals who score either high EE or high DP scores. Other studies defined burnout as high scores in only EE and DP. Other studies defined burnout as high scores in either EE and/or DP and low scores in PA. Four studies considered symptoms of burnout high when it was reported in at least one of the three subscales. Finally, ten studies measured only EE and considered it as the core dimension of burnout.

3.2. Burnout: A multidimensional or a unidimesional construct?

A great variation existed also in the way the studies treated burnout in relation to the other examined variables. Burnout was treated mainly in three ways: (i) the continuous data of each domain of burnout were analyzed separately, (ii) each domain was classified as low, average and high according to the cut-off scores, (iii) as a unidimesional construct with a dichotomy of burnout/no burnout. summarizes the different ways, studies treated burnout either as a multidimensional or unidimesnional construct. Some studies adopted both approaches which is why the total numbers of studies exceeds the studies included in the review. As shows, the majority of the studies evaluated the relationship between burnout dimensions and other variables using the individual domain scores as continuous data. The second more frequent choice was the dichotomy between burnout and no burnout symptoms. This dichotomy while it may seem practical can be quite problematic as there is no standard definition of burnout, and thus studies which use this dichotomy may have measured and defined burnout in very different ways.

Table 2. Categories of burnout (MBI–HSS)

3.3. Classification of burnout using cut-off scores

Forty-one studies used the MBI–HSS to assess burnout and provided cut-off scores. However, the cut-off scores varied among studies. Among the studies which used MBI–HSS, 31 studies administered all three subscales of burnout, whereas 10 studies administered only the EE exhaustion subscale to assess burnout. Twenty-five studies classified burnout as low, average and high whereas 16 studies only provided the cut-off scores for high burnout. A detailed description of the different cut-off scores is provided in .

Table 3. MBI–HSS cut-off scores (for a total of 41 studies)

Cut-off scores differed from the cut-off scores provided by Maslach, Schaufeli, and Leiter (Citation2001) with regard to low, average and high burnout. 79.49% of the studies defined high EE as ≥27 according to Maslach guidelines. However, the high cut-off score for EE ranged between 24 and 31. Regarding the DP subscale the cut-off scores for high DP varied between 9 and 30, despite Maslach’s recommendation which set the cut-off score of DP at 10.

Five studies used the MBI–HSS to assess burnout but they did not report any specific cut-off scores. Two studies used percentiles to identify high burnout, one study compared the MBI scores of its participants with the norms, one study used tertiles to classify burnout and one study identified burnout when symptoms were present at least once per week or high score was obtained with higher score on either EE or DP or both.

Four studies used the MBI–GS to assess burnout. Wu et al. (Citation2012) reported the following cut-off scores for EE: low: <9, average: 9–13, high: >13, depersonalization: <3, average: 3–9, High: >9 and personal accomplishment: low:>30, average: 3–9, high: >9. Spence Laschinger, Grau, Finegan, and Wilk (Citation2012) also defined severe burnout as a mean > 3.0 for EE. Koivu et al. (Citation2012a, Citation2012b) in two studies categorized burnout as severe if symptoms were experienced daily or weekly, mild when they occurred monthly and no burnout if symptoms were experienced few times per year.

4. Discussion

This systematic review indicates significant variation as to what constitutes cut-off scores for burnout among healthcare professionals. This is a significant problem with regard to how researchers and practitioners should classify burnout. From the research perspective, it means that meta-analysis or aggregation studies that aim to review the prevalence of burnout could be problematic. At the practitioner level, it contributes to confusion as to how burnout can be diagnosed/classified.

The confusion in the field is probably contributed to by the different guidelines that exist with regard to classifying burnout. On the one hand, Maslach et al. (Citation2001) stress that the MBI is a research tool, but they also provide cut-off scores. Additionally, Dutch researchers have developed clinically validated cut-off scores. Thus, without clear guidance on the issue, researchers can and do treat the MBI as a diagnosis tool. Intelligent and nuanced guidance on how to grapple with the MBI does exist (e.g. Maslach et al., Citation2008), but practical considerations expedite the need for researchers (and the respondents of the MBI) to assess who is and who is not burned out. Thus, there is a tension between the MBI as a research tool and a practitioner tool for “diagnosing” burnout.

None of the studies reviewed used proxy measures to validate classifications of burnout. For example, Schaufeli and colleagues have recommended using work-related neurasthenia, as defined in the ICD-10 (1992), as the equivalent of clinical burnout (Schaufeli et al., Citation2001). According to the ICD-10, a neurasthenic diagnosis (code F43.8) requires: (1) persistent and increased fatigue or weakness after minimal (mental) effort; (2) at least two out of seven distress symptoms such as irritability and inability to relax; (3) the absence of other disorders such as mood disorder or anxiety disorder. According to Schaufeli et al. (Citation2001), in order to be diagnosed with clinical burnout, the neurasthenic symptoms should additionally be work related, and the individual should receive professional treatment.

4.1. Why has consensus not been reached?

The trend towards categorizing burnout as a medical diagnosis implies one dimensionality, and it is clear that exhaustion has emerged as that single dimension (Maslach & Leiter, Citation2016). On the one hand, the push to medicalise burnout reflects a desire to enable it to have weight within the medical community, to access disability support and to establish common standards in the field. While this is laudatory, it runs the risk of ignoring the fact that a multidimensional approach reflects that fact burnout represents a crisis in values. Thus, burnout is a social phenomenon that captures that relationship between an individual work environment. Moreover, recent research suggests that cynicism (disengaged profile) comes closest to the negative endpoint of burnout (Leiter & Maslach, Citation2015; Maslach & Leiter, Citation2008). Thus, the barriers to reaching consensus relate to a lack of shared understanding about the conceptual, theoretical and methodological background regarding the measurement of burnout.

4.2. Limitations

This review presents some limitations. First of all, our systematic search of studies was conducted only in one scientific database, which entails the danger that relevant studies were not found (i.e. file drawer problem). Finally, the period of time (2 years) was limited but it was indicative of the variation that exists in measuring, defining and analyzing burnout.

5. Conclusions

Cordes and Dougherty noted in a (Citation1993) review on burnout that a systematic assessment of the convergent and discriminant validity using the Multitrait-Multimethod Matrix approach had not appeared in the literature. In 2016, this objective has still not been realized.

Deciding on how to utilize the data from the MBI is complicated by the fact that some researchers favor a two-component model, whereas others have argued for a three-component model. The problem is further complicated by unidimensional vs. multidimensional approaches to the burnout. Maslach has consistently argued against viewing burnout as a unitary concept, but the problem of consensus still remains.

The purpose of the present review is to raise awareness concerning the heterogeneity that exists in classifying burnout. In order for the field to reach consensus, researchers need to first establish a shared understanding as to advantages and disadvantages associated with classifying individuals as being either burnout/not burnout.

Job burnout is a symptom of organizational functioning. There is a need to shift the focus from the individual to the organizational level, bringing forward the need for interventions to address the chronic organizational conditions that are systematically and incrementally contributing to feelings of burnout among staff in a healthcare organization. In terms of benchmarking organizational issues prior to an intervention, the six areas of work life of Leiter and Maslach (Citation2004) is a good place to start. According to this approach, organizations can benchmark six key domains; workload, control, reward, community, fairness and values. These domains, which are evidence based, can direct organizational interventions towards the key factors influencing individual well-being.

Additional information

Funding

Funding. The authors received no direct funding for this research.

Notes on contributors

Karolina Doulougeri

This study was conducted by Karolina Doulougeri, Katerina Georganta, and Anthony Montgomery, who are all work and organizational psychologists working at the University of Macedonia, Thessaloniki, Greece. The three authors are members of the WELLMED network. WELLMED is an international network of researchers and practitioners focused on identifying the factors that help to link healthcare professional wellbeing and performance in clinical practice [www.wellmed.gr]. WELLMED meets biannually to bring together experts from diverse disciplinary backgrounds in order to present and discuss innovative ways of linking well-being to patient safety and quality of care. The WELLMED network conducts research aimed at exploring how burnout and wellbeing are related to different aspects of quality of care and patient safety, in terms of clinical decision making, communication in clinical practice, medical errors, civility at workplace, and patient neglect.

References

  • *Aiken, L. H., Sloane, D. M., Clarke, S., Poghosyan, L., Cho, E., You, L., … Aungsuroch, Y. (2011). Importance of work environments on hospital outcomes in nine countries. International Journal for Quality in Health Care, 23, 357–364. doi:10.1093/intqhc/mzr022
  • *Balch, C. M., Shanafelt, T. D., Sloan, J. A., Satele, D. V., & Freischlag, J. A. (2011). Distress and career satisfaction among 14 surgical specialties, comparing academic and private practice settings. Annals of Surgery, 254, 558–568. doi:10.1097/SLA.0b013e318230097e
  • *Balch, C. M., Shanafelt, T. D., Sloan, J., Satele, D. V., & Kuerer, H. M. (2011). Burnout and career satisfaction among surgical oncologists compared with other surgical specialties. Annals of Surgical Oncology, 18, 16–25. doi:10.1245/s10434-010-1369-5
  • *Barbosa, F. T., Leão, B. A., Tavares, G. M. S., & Santos, J. G. R. P. (2012). Burnout syndrome and weekly workload of on-call physicians: Cross-sectional study. Sao Paulo Medical Journal, 130, 282–288.10.1590/S1516-31802012000500003
  • *Beckman, T. J., Reed, D. A., Shanafelt, T. D., & West, C. P. (2012). Resident physician well-being and assessments of their knowledge and clinical performance. Journal of General Internal Medicine, 27, 325–330. doi:10.1007/s11606-011-1891-6
  • Blanchard, P., Rodrigues, M., & Colombat, P. (2012). On the prevalence and causes of oncologist burnout. Journal of Clinical Oncology, 30, 3029–3030. doi:10.1200/JCO.2012.43.8705
  • *Bragard, I., Dupuis, G., Razavi, D., Reynaert, C., & Etienne, A.-M. (2012). Quality of work life in doctors working with cancer patients. Occupational Medicine, 62, 34–40. doi:10.1093/occmed/kqr149
  • Brenninkmeijer, V., & Van Yperen, N. (2003). How to conduct research on burnout: Advantages and disadvantages of a unidimensional approach in burnout research. Occupational and Environmental Medicine, 60, 16i–20.10.1136/oem.60.suppl_1.i16
  • *Chivato Pérez, T., Campos Andreu, A., Negro Alvarez, J. M., & Caballero Martínez, F. (2011). Professional burnout and work satisfaction in Spanish allergists: Analysis of working conditions in the specialty. Journal of Investigational Allergology & Clinical Immunology, 21, 13–21.
  • *Cimiotti, J. P., Aiken, L. H., Sloane, D. M., & Wu, E. S. (2012). Nurse staffing, burnout, and health care-associated infection. American Journal of Infection Control, 40, 486–490. doi:10.1016/j.ajic.2012.02.029
  • Cordes, C. L., & Dougherty, T. W. (1993). A review and an integration of research on job burnout. The Academy of Management Review, 18, 621–656. doi:10.2307/258593
  • *Czaja, A. S., Moss, M., & Mealer, M. (2012). Symptoms of posttraumatic stress disorder among pediatric acute care nurses. Journal of Pediatric Nursing, 27, 357–365. doi:10.1016/j.pedn.2011.04.024
  • *Dolan, G., Strodl, E., & Hamernik, E. (2012). Why renal nurses cope so well with their workplace stressors. Journal of Renal Care, 38, 222–232. doi:10.1111/j.1755-6686.2012.00319.x
  • *Dyrbye, L. N., Shanafelt, T. D., Balch, C. M., Satele, D., Sloan, J., & Freischlag, J. (2011). Relationship between work-home conflicts and burnout among American surgeons. Archives of Surgery, 146, 211–217. doi:10.1001/archsurg.2010.310
  • Dyrbye, L. N., West, C. P., & Shanafelt, T. D. (2009). Defining burnout as a dichotomous variable. Journal of General Internal Medicine, 24, 440. doi:10.1007/s11606-008-0876-6
  • Fahrenkopf, A. M., Sectish, T. C., Barger, L. K., Sharek, P. J., Lewin, D., Chiang, V. W., … Edwards, S. (2008). Rates of medication errors among depressed and burnt out residents: Prospective cohort study. BMJ, 336, 488–491. doi:10.1136/bmj.39469.763218
  • *Guest, R. S., Baser, R., Li, Y., Scardino, P. T., Brown, A. E., & Kissane, D. W. (2011). Cancer surgeons’ distress and well-being, I: The tension between a culture of productivity and the need for self-care. Annals of Surgical Oncology, 18, 1229–1235. doi:10.1245/s10434-011-1622-6
  • *Hagau, N., & Pop, R. S. (2012). Prevalence of burnout in Romanian anaesthesia and intensive care physicians and associated factors. Jurnalul Român de Anestezie Terapie intensivă, 19, 117–124.
  • *Hayashino, Y., Utsugi-Ozaki, M., Feldman, M. D., & Fukuhara, S. (2012). Hope modified the association between distress and incidence of self-perceived medical errors among practicing physicians: Prospective cohort study. PLoS ONE, 7, e35585. doi:10.1371/journal.pone.0035585
  • *Hernández, T. J., Sánchez, G., Hernández, J. F., & Avendaño, V. (2012). Prevalence of burnout syndrome in employees of institutions of the health sector. In A. M. Gil-Lafuente, J. Gil-Lafuente, & J. M. Merigó-Lindahl (Eds.), Soft computing in management and business economics (pp. 207–225). Heidelberg: Springer. Retrieved from http://link.springer.com/chapter/10.1007/978-3-642-30457-6_14
  • *Ho, S. M. Y., & Lo, R. S. Y. (2011). Dispositional hope as a protective factor among medical emergency professionals: A preliminary investigation. Traumatology, 17, 3–9. doi:10.1177/1534765611426786
  • *Karanikola, M. N. K., Papathanassoglou, E. D. E., Mpouzika, M., & Lemonidou, C. (2012). Burnout syndrome indices in Greek intensive care nursing personnel. Dimensions of Critical Care Nursing, 31, 94–101. doi:10.1097/DCC.0b013e3182445fd2
  • Kaschka, W. P., Korczak, D., & Broich, K. (2011). Burnout: A fashionable diagnosis. Deutsches Ärzteblatt International, 108, 781–787. doi:10.3238/arztebl.2011.0781
  • *Kelly, L. A., McHugh, M. D., & Aiken, L. H. (2011). Nurse outcomes in magnet® and non-magnet hospitals. JONA: The Journal of Nursing Administration, 41, 428–433. doi:10.1097/NNA.0b013e31822eddbc
  • *Kholdebarin, R., Helewa, R. M., & Hochman, D. J. (2011). Evaluation of a regional acute care surgery service by residents in general surgery. Journal of Surgical Education, 68, 290–293. doi:10.1016/j.jsurg.2011.03.001
  • Kleijweg, J. H. M., Verbraak, M. J. P. M., & Van Dijk, M. K. (2013). The clinical utility of the Maslach Burnout Inventory in a clinical population. Psychological Assessment, 25, 435–441. doi:10.1037/a0031334
  • *Klopper, H. C., Coetzee, S. K., Pretorius, R., & Bester, P. (2012). Practice environment, job satisfaction and burnout of critical care nurses in South Africa. Journal of Nursing Management, 20, 685–695. doi:10.1111/j.1365-2834.2011.01350.x
  • *Koivu, A., Saarinen, P. I., & Hyrkas, K. (2012a). Does clinical supervision promote medical-surgical nurses’ well-being at work? A quasi-experimental 4-year follow-up study. Journal of Nursing Management, 20, 401–413. doi:10.1111/j.1365-2834.2012.01388.x
  • *Koivu, A., Saarinen, P. I., & Hyrkas, K. (2012b). Who benefits from clinical supervision and how? The association between clinical supervision and the work-related well-being of female hospital nurses. Journal of Clinical Nursing, 21, 2567–2578. doi:10.1111/j.1365-2702.2011.04041.x
  • *Lang, G. M., Patrician, P., & Steele, N. (2012). Comparison of nurse burnout across army hospital practice environments. Journal of Nursing Scholarship, 44, 274–283. doi:10.1111/j.1547-5069.2012.01462.x
  • Leiter, M. P., & Maslach, C. (2004). Areas of worklife: A structured approach to organizational predictors of job burnout. In P. L. Perrewe & D. C. Ganster (Eds.), Research in occupational stress and well –being, (Vol. 3, pp. 91–134). Oxford: Elsevier.
  • Leiter, M. P., & Maslach, C. (2015). Burnout profiles: A new approach to understanding the burnout experience (Unpublished manuscript).
  • Linzer, M., Visser, M. R., Oort, F. J., Smets, E. M., McMurray, J. E., de Haes, H. C., & Society of General Internal Medicine (SGIM) Career Satisfaction Study Group (CSSG). (2001). Predicting and preventing physician burnout: Results from the United States and the Netherlands. The American Journal of Medicine, 111, 170–175.10.1016/S0002-9343(01)00814-2
  • *Liu, K., You, L.-M., Chen, S.-X., Hao, Y.-T., Zhu, X.-W., Zhang, L.-F., & Aiken, L. H. (2012). The relationship between hospital work environment and nurse outcomes in Guangdong, China: A nurse questionnaire survey. Journal of Clinical Nursing, 21, 1476–1485. doi:10.1111/j.1365-2702.2011.03991.x
  • *Lucas, B. P., Trick, W. E., Evans, A. T., Mba, B., Smith, J., Das, K., … Weinstein, R. A. (2012). Effects of 2- vs. 4-week attending physician inpatient rotations on unplanned patient revisits, evaluations by trainees, and attending physician burnout. JAMA, 308, 2199–2207. doi:10.1001/jama.2012.36522
  • *Marcelino, G., Cerveira, J. M., Carvalho, I., Costa, J. A., Lopes, M., Calado, N. E., & Marques-Vidal, P. (2012). Burnout levels among Portuguese family doctors: A nationwide survey. BMJ Open, 2, e001050. doi:10.1136/bmjopen-2012-001050
  • *Margaryan, A. G. (2011). Health and well-being of Armenian physicians. New Armenian Medical Journal, 5, 37–40.
  • Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). Maslach Burnout Inventory Manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press.
  • Maslach, C., & Leiter, M. P. (2008). Early predictors of job burnout and engagement. Journal of Applied Psychology, 93, 498–512.10.1037/0021-9010.93.3.498
  • Maslach, C., & Leiter, M. P. (2016). Understanding the burnout experience: Recent research and its implications for psychiatry. World Psychiatry, 15, 103–111.10.1002/wps.20311
  • Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001). Job burnout. Annual Review of Psychology, 52, 397–422. doi:10.1146/annurev.psych.52.1.397
  • Maslach, C., Leiter, M. P., & Schaufeli, W. B. (2008). Measuring burnout. In C. L. Cooper & S. Cartwright (Eds.), The Oxford handbook of organizational well-being (pp. 86–108). Oxford: Oxford University Press.
  • *McInerney, S., Rowan, M., & Lawlor, B. (2012). Burnout and its effect on neurocognitive performance. Irish Journal of Psychological Medicine, 29, 176–179. doi:10.1017/S0790966700017213
  • *Mealer, M., Jones, J., Newman, J., McFann, K. K., Rothbaum, B., & Moss, M. (2012). The presence of resilience is associated with a healthier psychological profile in intensive care unit (ICU) nurses: Results of a national survey. International Journal of Nursing Studies, 49, 292–299. doi:10.1016/j.ijnurstu.2011.09.015
  • *Mikalauskas, A., Širvinskas, E., Marchertienė, I., Macas, A., Samalavičius, R., Kinduris, Š., & Benetis, R. (2012). Burnout among Lithuanian cardiac surgeons and cardiac anesthesiologists. Medicina (Kaunas, Lithuania), 48, 478–484.
  • *Mortada, E. M., & El Seifi, O. S. (2012). Clinicians’ burnout and career satisfaction across the major specialties in Zagazig University Hospitals. Journal of Applied Sciences Research, 8, 3961–3969.
  • *Nantsupawat, A., Srisuphan, W., Kunaviktikul, W., Wichaikhum, O.-A., Aungsuroch, Y., & Aiken, L. H. (2011). Impact of nurse work environment and staffing on hospital nurse and quality of care in Thailand. Journal of Nursing Scholarship, 43, 426–432. doi:10.1111/j.1547-5069.2011.01419.x
  • *Neff, D. F., Cimiotti, J. P., Heusinger, A. S., & Aiken, L. H. (2011). Nurse reports from the frontlines: Analysis of a statewide nurse survey. Nursing Forum, 46, 4–10. doi:10.1111/j.1744-6198.2010.00201.x
  • *Orton, P., Orton, C., & Pereira Gray, D. P. (2012). Depersonalised doctors: A cross-sectional study of 564 doctors, 760 consultations and 1876 patient reports in UK general practice. BMJ Open, 2, e000274. doi:10.1136/bmjopen-2011-000274
  • *Pieroni, P., Allin, J., Lowenstein, D., Perez, G., Guardiani, F., Mettini, S., … Eleit, G. (2011). Current status of cardiology residencies. 2009–2010 residents national survey. Revista Argentina De Cardiología, 79, 167–177.
  • *Probst, H., Griffiths, S., Adams, R., & Hill, C. (2012). Burnout in therapy radiographers in the UK. The British Journal of Radiology, 85, e760–e765. doi:10.1259/bjr/16840236
  • *Quenot, J. P., Rigaud, J. P., Prin, S., Barbar, S., Pavon, A., Hamet, M., … Jacquiot, N. (2012). Suffering among carers working in critical care can be reduced by an intensive communication strategy on end-of-life practices. Intensive Care Medicine, 38, 55–61. doi:10.1007/s00134-011-2413-z
  • *Raftopoulos, V., Charalambous, A., & Talias, M. (2012). The factors associated with the burnout syndrome and fatigue in Cypriot nurses: A census report. BMC Public Health, 12, 173. doi:10.1186/1471-2458-12-457
  • Roelofs, J., Verbraak, M., Keijsers, G. P. J., de Bruin, M. B. N., & Schmidt, A. J. M. (2005). Psychometric properties of a Dutch version of the Maslach Burnout Inventory General Survey (MBI-DV) in individuals with and without clinical burnout. Stress and Health, 21, 17–25. doi:10.1002/smi.1032
  • *Roth, M., Morrone, K., Moody, K., Kim, M., Wang, D., Moadel, A., & Levy, A. (2011). Career burnout among pediatric oncologists. Pediatric Blood & Cancer, 57, 1168–1173. doi:10.1002/pbc.23121
  • *Ruitenburg, M. M., Frings-Dresen, M. H., & Sluiter, J. K. (2012). The prevalence of common mental disorders among hospital physicians and their association with self-reported work ability: A cross-sectional study. BMC Health Services Research, 12, 1285. doi:10.1186/1472-6963-12-292
  • Sargent, M. C., Sotile, W., Sotile, M. O., Rubash, H., & Barrack, R. L. (2009). Quality of life during orthopaedic training and academic practice: Part 1: Orthopaedic surgery residents and faculty. The Journal of Bone & Joint Surgery, 91, 2395–2405. doi:10.2106/JBJS.H.00665
  • Schaufeli, W. B., & Enzmann, D. (1998). The burnout companion to study and practice: A critical analysis. London: Taylor & Francis.
  • Schaufeli, W. B., Bakker, A. B., Hoogduin, K., Schaap, C., & Kladler, A. (2001). On the clinical validity of the maslach burnout inventory and the burnout measure. Psychology and Health, 16, 565–582.10.1080/08870440108405527
  • Shanafelt, T. D., & Dyrbye, L. N. (2012). Reply to P. Blanchard et al. Journal of Clinical Oncology, 30, 3030. doi:10.1200/JCO.2012.44.4703
  • Shanafelt, T. D., Bradley, K. A., Wipf, J. E., & Back, A. L. (2002). Burnout and self-reported patient care in an internal medicine residency program. Annals of Internal Medicine, 136, 358–367.10.7326/0003-4819-136-5-200203050-00008
  • *Shanafelt, T. D., Balch, C. M., Dyrbye, L., Bechamps, G., Russell, T., Satele, D., … Oreskovich, M. R. (2011). Special report. Archives of Surgery, 146, 54–62. doi:10.1001/archsurg.2010.292
  • *Shanafelt, T. D., Boone, S., Tan, L., Dyrbye, L. N., Sotile, W., Satele, D., … Oreskovich, M. R. (2012). Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Archives of Internal Medicine, 172, 1377–1385. doi:10.1001/archinternmed.2012.3199
  • *Siu, C. F. Y., Yuen, S. K., & Cheung, A. (2012). Burnout among public doctors in Hong Kong: Cross-sectional survey. Hong Kong Medical Journal = Xianggang Yi Xue Za Zhi / Hong Kong Academy of Medicine, 18, 186–192.
  • *Spence Laschinger, H. K., Grau, A. L., Finegan, J., & Wilk, P. (2012). Predictors of new graduate nurses’ workplace well-being. Health Care Management Review, 37, 175–186. doi:10.1097/HMR.0b013e31822aa456
  • *Stimpfel, A. W., Sloane, D. M., & Aiken, L. H. (2012). The longer the shifts for hospital nurses, the higher the levels of burnout and patient dissatisfaction. Health Affairs, 31, 2501–2509. doi:10.1377/hlthaff.2011.1377
  • *Tekindal, B., Tekindal, M. A., Pinar, G., Ozturk, F., & Alan, S. (2012). Nurses’ burnout and unmet nursing care needs of patients’ relatives in a Turkish state hospital. International Journal of Nursing Practice, 18, 68–76. doi:10.1111/j.1440-172X.2011.01989.x
  • Thomas, N. K. (2004). Resident burnout. JAMA, 292, 2880. doi:10.1001/jama.292.23.2880
  • *van der Doef, M., Mbazzi, F. B., & Verhoeven, C. (2012). Job conditions, job satisfaction, somatic complaints and burnout among East African nurses. Journal of Clinical Nursing, 21, 1763–1775. doi:10.1111/j.1365-2702.2011.03995.x
  • *Wang, S., Yao, L., Li, S., Liu, Y., Wang, H., & Sun, Y. (2012). Sharps injuries and job burnout: A cross-sectional study among nurses in China. Nursing & Health Sciences, 14, 332–338. doi:10.1111/j.1442-2018.2012.00697.x
  • *Wu, H., Liu, L., Sun, W., Zhao, X., Wang, J., & Wang, L. (2012). Factors related to burnout among Chinese female hospital nurses: Cross-sectional survey in Liaoning Province of China. Journal of Nursing Management, 22, 621–629. doi:10.1111/jonm.12015