1,620
Views
3
CrossRef citations to date
0
Altmetric
Research Article

Increased professionalization and lower burnout scores were associated with structured residency training program: results of a cross sectional survey

, , ORCID Icon, , , & ORCID Icon show all
Article: 1959284 | Received 20 Apr 2021, Accepted 20 Jul 2021, Published online: 29 Jul 2021

ABSTRACT

The competence centre for Residency Training in Family Medicine Bavaria (CCRTB) was established to improve the quality of postgraduate medical education by offering training and mentoring programmes for residents, and by providing train-the-trainer and mentoring courses for supervisors. Beyond that, regional Residency Training Networks (RTN) on avoluntary basis were developed to facilitate structured and efficient clinical rotation programs. Primary aim was to investigate the burden of burnout and the development of professionalism among CCRTB-residencies within a cross-sectional study. Secondary aim was to evaluate differences between CCRTB-residents with and without participation in aregional RTN. Burnout was determined with the Maslach Burnout Inventory (MBI), comprising the scales emotional exhaustion, depersonalization, and personal accomplishment. Ambulatory professionalization was evaluated using the German Professional Scale (Pro-D), comprising the scales professionalism towards the patient, towards other professionals, towards society, and towards oneself. Statistical significance of group differences was calculated by nonparametric tests. Multivariable linear regression modelling was performed to estimate the independent impact of professionalization and RTN participation on burnout scores. 347 CRRTB residents in ambulatory postgraduate training were invited, 212 (61.1%) participated, and 197 (92.9%) were included in our analyses. Lower emotional exhaustion and depersonalization, and increased personal accomplishment was associated with increased professionalisation, which was significant for nearly all Pro-D scales (p ≤ 0.05). RTN residents showed higher professionalism towards the patient (p = 0.031), other professionals (p = 0.012), and towards the society (p = 0.007) than residents of unstructured programs, and higher levels of personal accomplishment (p < 0.05). Early and efficient professionalization might be akey to reduce burnout and to establish asatisfying career in family medicine. Train-the-trainer and mentoring concepts should be implemented regularly for the training of residents. Thus, increased engagement in medical didactics should be aprerequisite for accreditation as atraining practice for residents.

Introduction

According to Maslach et al. burnout is defined as a continuous construct characterized by emotional exhaustion, depersonalization and reduced personal accomplishment [Citation1]. Physicians’ burnout represents a special matter of concern because burnout is more common among physicians than in the general population [Citation2] . This psychological burden is already visible during medical school and residency. A systematic review of Ishak et al. identified a burnout prevalence of 28–45% in medical students and 27–75% in medical residents [Citation3]. The phase of postgraduate medical training represents a peak time of distress [Citation4] and a new level of personal involvement has to be solved [Citation5]. Sudden assumption of responsibility, fear of showing imperfection in front of supervisors, lack of recognition from senior doctors, the interaction with the medical team or patients [Citation5], as well as a high workload, an insufficient work-life balance and on-call duties can be stressors [Citation6,Citation7]. Burnout is also an important issue for family practice [Citation8]. Less control over workload, small scope of practice, management, and budget-related responsibilities might contribute to workplace distress specifically to family practice [Citation9–11]. Focusing on trainees in family medicine, a prevalence of 36% was found [Citation12]. The adverse effects of leaving the issue of burnout unaddressed are medical errors and poorer health outcomes [Citation13]. Beyond that, increased burnout may make physicians less willing to start their own family practice. In this context, it is of particular importance that mentoring and a supportive learning environment can be approaches to reduce burnout in medical residents [Citation14,Citation15].

In Germany, postgraduate medical specialization for family medicine residents (FMR) lasts at least 5 years. Although the state medical boards in Germany have detailed regulations for postgraduate medical training, the residency training is structurally and educationally disorganized. Clinical rotations are generally not tied to training programs or academic centres. During this time, 24 months have to be completed in family practice. In addition, 12 months must be completed in the field of internal medicine in acute inpatient care. Furthermore, 6 months have to be completed in at least one other area of direct patient care. Following a modular concept, up to 18 months of continuing education in other areas of direct patient care must then be completed. Normally, FMRs organize the individual units of their residency training themselves. This is disadvantageous due to inefficient timing and organizational challenges, since, for example, new employment contracts have to be concluded for each new section. These organizational constraints lead to an extension of the further training period by up to 8 years for male and 10 years for female physicians [Citation16].

FMR in Bavaria, Germany, has the possibility to enroll in the ‘Competence Centre for Residency Training in Family Medicine Bavaria’ (CCRTB) (German: Kompetenzzentrum Weiterbildung Allgemeinmedizin Bayern, KWAB) since 2017 [Citation17]. The competence centres were implemented in all federal states of Germany to improve the educational situation of the FMR. The aim of a postgraduate training in the CCRTB is a structural and professional organisation of educational training in family medicine, in order to reach a higher level of coordination and quality [Citation18]. The enrolment in the CCRTB is free, without competition, and on a voluntary basis for the FMR. The development of professionalism, one of the seven required core competencies of family medicine, plays a central role and should be promoted by establishing a competence-based curriculum [Citation19,Citation20]. Therefore, the CCRTB network offers specific didactic courses and mentoring programs for trainees, and also train-the-trainer courses for supervising physicians on a voluntary basis. These criteria were established as quality indicators for good postgraduate training [Citation18,Citation21].

In addition to their enrolment in the CCRTB, residents have the opportunity to participate in a regional residents training network (RTN) on voluntary basis. The regional RTN was implemented to foster residency training in family medicine. A regional RTN consists of hospitals and medical practices with a structured organisation to enable a scheduled and efficient clinical rotation of the residents within the various clinical wards and practices [Citation22]. The regional RTN was established on the basis of local initiatives in cooperation with the CCRTB to enable a time-efficient and didactically attractive residency training. In this context, an appealing RTN concept is intended to motivate young physicians for residency training in areas with a shortage of physicians. Therefore, the liabilities for regional RTN are more distinct because they are characterized by binding commitments with regard to rotation options, contract duration, and time-offs for medical education events. Beyond that, the medico-didactic concepts are intensified within the regional RTN. For example, the supervising physicians of an RTN are more committed to participate in medico-didactic courses, train-the-trainer and mentoring seminars of the CCRTB to ensure high quality in education and to enable a fast professionalization of the FMR [Citation18]. The FMR participate in regional RTN on a voluntary basis without competitive selection. The primary aim of the study was to investigate the burden of burnout and the development of ambulatory professionalism among postgraduate FMR enrolled in the competence centre. The secondary aim was to evaluate differences between CCRTB-residents with and without participation in a regional RTN.

Methods

Study design

We performed a cross-sectional study. All residents in family medicine training that were enrolled in the Bavarian CCRTB were personally invited by email to participate in our study and to complete an online self-report survey on the internet-based platform LimeSurvey®. The reminder was sent out four times by email every 3 weeks. If residents had not completed the survey after the fourth reminder, a paper-pencil version of the questionnaire was sent by post. Again, all non-respondents received a postal reminder after 5 weeks.

Questionnaires

To assess the amount of resident’s burnout, we used the Maslach Burnout Inventory Human Services Survey for Medical Personnel (MBI-HSS MP) [Citation23]. The MBI-HSS MP contains 22 items, which are aggregated in three subscales: 1) the emotional exhaustion (EE) scale measures feelings of being emotionally overextended and exhausted by one’s work (9 items; range 0–54), 2) the depersonalization (DP) scale measures an unfeeling and impersonal response toward recipients of one’s care or treatment (5 items; range 0–30), and 3) the personal accomplishment (PA) scale measures feelings of competence and successful achievement in one’s work (8 items; range 0–48). Scores of the online survey are recorded on a 7-point Likert scale from ‘Never’ (0) to ‘Every day’ (6). Higher scores on EE and DP and lower scores on PA indicate a higher risk of burnout. We calculated the sum scores for each dimension, using the following cut-off values according to Maslach et al. [Citation23]:

  • EE: ≤18 low burnout level; 19–26 average burnout level; ≥27 high burnout level

  • DP: ≤5 low burnout level; 6–9 average burnout level; ≥10 high burnout level

  • PA: ≥40 low burnout level; 39–34 average burnout level; ≤33 high burnout level

For the assessment of ambulatory professionalization, we used the German Professional Scale (Pro-D) [Citation24], a German adaptation of the Nijmegen Professional Scale [Citation25]. The Pro-D consists of 67 items, which are aggregated in four subscales: 1) professionalism towards the patient (21 items; range 21–84), 2) professionalism towards other professionals (14 items; range 14–56), 3) professionalism towards society (10 items; range 10–40), and 4) professionalism towards oneself (22 items; range 22–88) (see Supplement, Table S 5). According to Tromp et al. [Citation25], scores are recorded on a 4-point Likert scale from ‘seldom’ (1) to ‘always’ (4). A higher sum score represents a higher level of professionalization. The Pro-D showed good internal consistencies with Cronbach's alpha coeficients of the scales ranging from 0.79 to 0.95 [Citation25].

Beyond that, age, gender, year of postgraduate training, working hours per week, and participation in a regional RTN were documented.

Data analyses

We performed descriptive analyses (means, standard deviations, and frequencies) for the sociodemographic data (age, gender, participation in a regional RTN, total number of hours spent working per week, and MBI subscales) of the included residents. In addition, hypothesis testing of the differences between gender, participation in a regional RTN, and years of training in terms of ‘burnout’, as well as differences between gender, participation in a regional RTN, and years of training was performed by non-parametric tests. For dichotomous characteristics (gender and participation in a regional RTN) we applied the Mann–Whitney U-test, for ‘years of training’ the Kruskal-Wallis-test was used. Multivariable linear regression modelling was performed to estimate the independent effect of ambulatory professionalism, years of training, and participation in a regional RTN on the degree of burnout symptoms.

Due to a transmission error, the postal survey was carried out with a 6-point scale (missing category 5: ’A few times a week’). To achieve an approximation of online and postal results, answers in category 4 of the postal questionnaires were replaced by the mean values of 4 and 5 of the online questionnaires. In order to assess the amount of possible bias, sensitivity analyses without postal questionnaires were performed.

All data were analysed with SPSS version 25 (IBM Corp., New York, USA). Questionnaires with >50% missing answers were excluded from the analyses. Single missing items (≤20% within a scale) were imputed using the scale mean. Overall, a level of significance of p < 0.05 was used. The study was approved by the Ethics Committee of the Medical Faculty of the Technical University Munich (161/19 S). Participation in this study was voluntary and all family medical residents were informed in detail about the study's aims. In addition, anonymity and confidentiality regarding the data were granted. Informed consent was obtained from all participants.

Results

Sample

According to the annual balance, a total of 1720 FMRs in family practice were registered in Bavaria in 2019. Three hundred and forty-seven (27.3%) FMR were enrolled in the CCRBT in May 2019; 288 (83.0%) were female, the mean age was 37.4 years. They were invited to participate via email. Two hundred and twelve (61.1%) participated. One hundred and ninety-seven (92.9% of 212) FMR were included into the analysis, 15 (7.1% of 212) were not included due to missing data. One hundred and sixty-six participants (84.3% of 197) were female, mean age was 37.2 years (). Forty-one (20.8%) participated in a regional RTN (11 (5.6%) data missing). There were no significant differences between responder and non-responder; the mean age of non-responders was 37.7 years (p = 0.52), 135 (78.9%) were female (p = 0.08), and 36 (20.0%) participated in a regional RTN (p = 0.67) (not in Table).

Table 1. Characteristics of the included ambulatory residents

Thirty-nine (19.8% of 197) of the residents showed high burnout scores regarding emotional exhaustion, 40 (20.3%) in terms of depersonalization, and 23 (11.7%) in terms of personal accomplishment (). The highest emotional exhaustion, depersonalization and lowest personal accomplishment scores were observed within the first year (). This effect attenuates over the years of training. However, the differences were not significant. Men showed higher scoring in the depersonalization scale (p = 0.006). There were no significant differences between RTN participants and the other residents.

Table 2. Burnout symptoms (mean values of emotional exhaustion, depersonalization, personal accomplishment), differentiated by gender, participation in a regional RTN, training phase, and year of training

Residents of regional RTN showed significantly higher scores in the professionalism scales towards the patient (p = 0.031), towards other professionals (p = 0.012), and towards society (p = 0.007) (). Females showed a higher professionalism towards the patient (p = 0.039). Professionalism towards the patients increased significantly with increasing years of training (p = 0.040).

Table 3. Degree of professionalism (sum score), differentiated by gender, participation in a regional network, and year of training

The multivariable linear regression model showed that lower emotional exhaustion was associated with increased professionalization, which was significant for all scales of the Pro-D (p ≤ 0.05) (). Lower depersonalization was associated with higher professionalism towards the patient (p = 0.003), towards other professionals (p = 0.048), and professionalism towards oneself (p < 0.001). Increased personal accomplishments were significantly associated with all scales of the Pro-D (p < 0.01). The years of training showed no significant effect in the regression model. The participation in a regional RTN had a significant positive influence on personal accomplishment with respect to all scales of the Pro-D (p < 0.05).

Table 4. Multivariable linear regression modelling of professionalism, years of training, and participation in a regional network. Outcome: Burnout sums up scores of emotional exhaustion, depersonalization, and personal accomplishment

The sensitivity analyses showed even more pronounced results when the analyses were performed without postal questionnaires. The mean values of emotional exhaustion and depersonalization of the ´online group´ were slightly higher, and personal accomplishment slightly lower than for the whole group. Beyond that, there were significant associations between ´year of training´ and professionalism towards other professionals (p = 0.021), and professionalism towards oneself (p = 0.009) (see Supplement, Table S3). The association between ´RTN participation and personal accomplishments was stronger for the ´online group´ (p < 0.01) (see Supplement, Table S4) than for the whole group (p < 0.05) (). Details of the sensitivity analyses are depicted in the supplement (see Supplement, Table S 1–4)

Discussion

The present study showed that FMR had moderate burnout scores in family practice, with around 20% having a critical score in the emotional exhaustion and depersonalization scales. Increased professionalization was associated with lower emotional exhaustion and depersonalization, and increased personal accomplishment. RTN residents showed higher professionalization and personal accomplishment compared with residents in unstructured training.

Several studies in different disciplines have shown increased burnout symptoms in residents [Citation26–29]. This is also true for family medicine, especially when residents have fewer years of experience [Citation9,Citation30]. This is attributed to higher workplace stress, but also to contrasting expectations of their ideals of family medicine and the reality of the current workplace [Citation9]. Compared to our results, a recently published study by Bugaj et al., which investigates the burnout in a postgraduate training programme in Baden-Württemberg, observed slightly higher degrees of burnout (EE: 33.5%; DP: 35.2%; PA: 14.6%) [Citation31]. This might be explained by the fact that the physicians in their evaluation were younger, accompanied with lower clinical experience. Matching this, we also found the highest burnout scores during the first year of residency training. Kramer et al. described that self-perceived clinical competence of residents in family medicine training accumulates during postgraduate training [Citation32]. Kocalevent et al. found that personal accomplishments increased continuously over time [Citation33]; they concluded that this might act as a buffer compensating to some extent for the physicians’ stress experience. With respect to these studies, one could speculate whether ´years of training´ represent a surrogate parameter for professionalism. Fitting to this, ‘years of training’ was not significant in our regression model, whereas increased professionalization as determined with the Pro-D was significantly related with decreased burnout scores.

Previous studies have already described that burnout was associated with poorer professionalization in terms of unprofessional behaviour, e.g., suboptimal adherence to treatment guidelines, poor empathy, or dishonesty [Citation34,Citation35]. We identified an intense association between MBI and Pro-D scores, which might imply a protective effect of professionalization against burnout. In this context, the increased levels of professionalization and personal accomplishment of RTN residents are of particular importance. This effect might be explained by the increased engagement and cooperation between regional hospitals and family physicians, and their stronger commitment to mentorship and binding rotation concepts. Beyond that, the supervising physicians in hospitals and practices of the regional RTN might be more engaged in mentoring and participate intensively in medico-didactic trainings due to a higher intrinsic motivation. While other countries with strong primary care orientation have a longstanding tradition and elaborated concepts in FMR training [Citation36–39], the improvement of FMR training in Germany has just begun. Our evaluation shows the effects of a training in a population that is still raw. This may alleviate to discover the relation between decreased burnout and increased professionalization. Therefore, our results underline the need to implement efficient professionalization programs on a regular, nationwide basis, similar to more ´advanced´ countries with strong primary care. Structured regional RTNs should be supported to ensure scheduled rotations and in-depth training programs. It might be valuable to evaluate within future FRM training programs, which aspects of professionalization specifically contribute to burnout prophylaxis, and how to use them to ensure a high level of job satisfaction.

Strengths and limitations

The main strength of our investigation is the combination of burnout measurement using the Maslach Burnout Inventory [Citation23] and the direct measurement of professionalization using the Pro-D [Citation24], in contrast to just applying the parameter ‘years of training’. However, our study has several limitations. A limitation is that the postal survey (N = 58) of the Maslach Burnout Inventory was conducted with a 6-point scale (missing category 5: ’A few times a week’) due to a transmission error. As described in the methods section, we made an adjustment to reach a better comparability of online and postal respondents. Sensitivity analyses without postal questionnaires showed an even more pronounced effect in this group. We have chosen a more conservative approach in the analysis of our data by using all responders. However, this might have led to a slight underestimation of our results.

We performed several statistical procedures, which carry the increased risk of false-positive findings due to the multiple testing problem. However, all analyses have been performed in an exploratory, i.e., non-confirmatory, manner. In addition, we consider the risk of false negatives to be more relevant in the discussion of the present findings given the limited sample size and associated limited power of hypothesis testing. Beyond that, the results tend in the same direction, which points towards a consistency of the results. Another limitation is that only 61.1% responded to the invitation. However, we found no significant differences between responders and non-responders with respect to age, gender, or RTN participation. We had only six first-year residents, which limits the generalizability regarding stressful early years. However, these effects are consistent with previous studies. Beyond that, it has to be mentioned that we only observed residents who were enrolled in the CCRTB. One could speculate that these residents have inherently protective characteristics against burnout, such as more effective coping mechanisms or genuinely increased professionalism. Therefore, future investigations should compare residents within and outside the CCRTB with respect to different levels of burnout and professionalism. Finally, the evaluation was performed within a cross-sectional study design, which does not allow causal conclusion. Therefore, future controlled studies should apply longitudinal methods to identify possible causal relationships of the regional RTN.

Conclusions

Early and efficient professionalization might be a key to reduce burnout and to establish a satisfying career in family medicine. However, these effects should ideally be confirmed within longitudinal controlled trials. Train-the-trainer and mentoring concepts should be implemented regularly for the training of residents. Thus, increased engagement in medical didactics should be a prerequisite for accreditation as a training practice for residents.

Authors’ contributions

M.O. and A.S. designed the study. M.O., A.H., and A.S. performed the analysis. All authors were involved in the interpretation of the data. M.O. and A.S. wrote the initial version of the manuscript. M.R., A.H., D.S., P.B., and J.G. revised it critically for important intellectual content. All authors reviewed the final manuscript.

Members of the Bavarian Competence Center for Residency Training (BCCRT) Network

Ildikó Gagyor, Jochen Gensichen, Thomas Kühlein, Marco Roos, Antonius Schneider, Dagmar Schneider, Anne Simmenroth

Availability of data and materials

The data of this study are available from the corresponding author on reasonable request.

Supplemental material

Supplemental Material

Download MS Word (36.7 KB)

Acknowledgments

We are grateful to the FMR for their time and efforts to participate in our survey.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplementary material

Supplemental data for this article can be accessed here.

References

  • Maslach C. Burnout: a multidimensional perspective. In: Schaufeli WB, Maslach C, Marek T, editors. Professional burnout: recent developments in theory and research. Series in applied psychology: social issues and questions. Philadelphia: Taylor & Francis; 1993. p. 19–8.
  • Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):1377–1385.
  • Ishak WW, Lederer S, Mandili C, et al. Burnout during residency training: a literature review. J Grad Med Educ. 2009;1(2):236–242.
  • Dyrbye LN, West CP, Satele D, et al. Burnout among U.S. medical students, residents, and early career physicians relative to the general U.S. population. Acad Med. 2014;89(3):443–451.
  • Bugaj TJ, Valentini J, Miksch A, et al. Work strain and burnout risk in postgraduate trainees in general practice: an overview. Postgrad Med. 2020;132(1):7–16.
  • Prins JT, Gazendam-Donofrio SM, Tubben BJ, et al. Burnout in medical residents: a review. Med Educ. 2007;41(8):788–800.
  • Patel RS, Sekhri S, Bhimanadham NN, et al. A Review on strategies to manage physician burnout. Cureus. 2019;11(6):e4805.
  • Smith F, Goldacre MJ, Lambert TW. Adverse effects on health and wellbeing of working as a doctor: views of the UK medical graduates of 1974 and 1977 surveyed in 2014. J R S Med. 2017;110(5):198–207.
  • Buck K, Williamson M, Ogbeide S, et al. Family physician burnout and resilience: a cross-sectional analysis. Fam Med. 2019;51(8):657–663.
  • Rassolian M, Peterson LE, Fang B, et al. Workplace factors associated with burnout of family physicians. JAMA Intern Med. 2017;177(7):1036–1038.
  • Weidner AKH, Phillips RL Jr., Fang B, et al. Burnout and scope of practice in new family physicians. Ann Fam Med. 2018;16(3):200–205.
  • Low ZX, Yeo KA, Sharma VK, et al. Prevalence of burnout in medical and surgical residents: a meta-analysis. Int J Environ Res Public Health. 2019;16:9.
  • Dewa CS, Loong D, Bonato S, et al. The relationship between physician burnout and quality of healthcare in terms of safety and acceptability: a systematic review. BMJ Open. 2017;7(6):e015141.
  • Van Vendeloo SN, Godderis L, Brand PLP, et al. Resident burnout: evaluating the role of the learning environment. BMC Med Educ. 2018;18(1):54.
  • Dyrbye L, Shanafelt T. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50(1):132–149.
  • Schaefer M, Donnachie E, Schneider A. The relation between place of birth, place of medical school, and subsequent work as a family physician. Z Allg Med. 2018;94(9):345–349.
  • KWAB. Für mehr Qualität in der Weiterbildung. http://kwab.info/wp-content/uploads/2020/07/Flyer_KWAB-1.pdf (accessed 2021 Jul 12
  • DEGAM. Kriterien für Kompetenzzentren Allgemeinmedizin 2015. https://www.degam.de/files/Inhalte/Degam-Inhalte/Presse/Presseordner_2015/DEGAM-Positionspapier_Kriterien%20fuer%20Kompetenzzentren%20Allgemeinmedizin.pdf (accessed 2021 Jul 12
  • Iobst WF, Sherbino J, Cate OT, et al. Competency-based medical education in postgraduate medical education. Med Teach. 2010;32(8):651–656.
  • Steinhäuser J (for the DEGAM). Kompetenzbasiertes Curriculum Allgemeinmedizin 2015. https://www.weiterbildung-allgemeinmedizin.de/downloads/Curriculum_01-10-15.pdf (accessed 2021 Jul 12
  • David DM, Euteneier A, Fischer MR, et al. The future of graduate medical education in Germany–position paper of the Committee on Graduate Medical Education of the Society for Medical Education (GMA). GMS Z Med Ausbild. 2013;30:2.
  • Verbundweiterbildung. (accessed 2021 Jul 12). https://www.kosta-bayern.de/verbundweiterbildung/verbundweiterbildung
  • Maslach C, Jackson S, Leiter M. Maslach burnout inventory manual. 3rd. Palo Alto, CA: Consulting Psychologists Press; 1996.
  • Roos M, Pfisterer D, Krug D, et al. Adaptation, psychometric properties and feasibility of the professionalism scale Germany. Z Evid Fortbild Qual Gesundhwes. 2016;113:66–75.
  • Tromp F, Vernooij-Dassen M, Kramer A, et al. Behavioural elements of professionalism: assessment of a fundamental concept in medical care. Med Teach. 2010;32(4):e161–e9.
  • Kader N, Elhusein B, Elhassan NM, et al. Burnout and job satisfaction among psychiatrists in the mental health service, Hamad medical corporation, Qatar. Asian J Psychiatr. 2021;58:102619.
  • Kelly M, Soles R, Garcia E, et al. Job stress, burnout, work-life balance, well-being, and job satisfaction among pathology residents and fellows. Am J Clin Pathol. 2020;153(4):449–469.
  • Rodrigues H, Cobucci R, Oliveira A, et al. Burnout syndrome among medical residents: a systematic review and meta-analysis. PloS One. 2018;13(11):e0206840.
  • Pantenburg B, Luppa M, König HH, et al. Burnout among young physicians and its association with physicians’ wishes to leave: results of a survey in Saxony, Germany. J Occup Med Toxicol. 2016;11:2.
  • Adam S, Mohos A, Kalabay L, et al. Potential correlates of burnout among general practitioners and residents in Hungary: the significant role of gender, age, dependent care and experience. BMC Fam Pract. 2018;19(1):193.
  • Bugaj TJ, Krug K, Rentschler A, et al. Mental health of postgraduate trainees in primary care: a cross-sectional study. BMC Fam Pract. 2020;21(1):123.
  • Kramer A, Zuithoff P, Jansen J, et al. Growth of self-perceived clinical competence in postgraduate training for general practice and its relation to potentially influencing factors. Adv Health Sci Educ Theory Pract. 2007;12(2):135–145.
  • Kocalevent R, Pinnschmidt H, Selch S, et al. Burnout is associated with work-family conflict and gratification crisis among German resident physicians. BMC Med Educ. 2020;20(1):145.
  • Dyrbye LN, Massie FS Jr., Eacker A, et al. Relationship between burnout and professional conduct and attitudes among US medical students. Jama. 2010;304(11):1173–1180.
  • Shanafelt TD, Mungo M, Schmitgen J, et al. Longitudinal study evaluating the association between physician burnout and changes in professional work effort. Mayo Clin Proc. 2016;91(4):422–431.
  • Grol R, Mokkink H, Helsper-Lucas A, et al. Effects of the vocational training of general practice consultation skills and medical performance. Med Educ. 1989;23(6):512–521.
  • Olde Hartman TC, Poels PJP, Licht-Strunk E, et al. Combining vocational and research training. Aust Fam Physician. 2008;37(6):486–488.
  • The HJ. RCGP and other countries: a beginning. Br J Gen Pract. 1990;40(334):206–209.
  • Brown J, Reid H, Dornan T, et al. Becoming a clinician: trainee identity formation within the general practice supervisory relationship. Med Educ. 2020;54(11):993–1005.