Exploring the Validity Based on Internal Structure of the Oldenburg Burnout Inventory – Medical Student (OLBI-MS)

References

• World Health Organization. QD85 Burn-out. World Health Organization. https://icd.who.int/browse11/l-m/en#/http://id.who.int/icd/entity/129180281. Accessed March 8, 2021.
   Google Scholar
• Dyrbye LN, Shanafelt TD. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50(1):132–149. doi:10.1111/medu.12927.
   PubMed Web of Science ®Google Scholar
• Brazeau CM, Schroeder R, Rovi S, Boyd L. Relationships between medical student burnout, empathy, and professionalism climate. Acad Med. 2010;85(10 Suppl):S33–S36. doi:10.1097/ACM.0b013e3181ed4c47.
   PubMed Web of Science ®Google Scholar
• Dyrbye LN, Thomas MR, Power DV, et al. Burnout and serious thoughts of dropping out of medical school: a multi-institutional study. Acad Med. 2010;85:94–102. doi:10.1097/ACM.0b013e3181c46aad.
   PubMed Web of Science ®Google Scholar
• Dyrbye LN, Thomas MR, Massie FS, et al. Burnout and suicidal ideation among us medical students. Ann Intern Med. 2008;149(5):334–341. doi:10.7326/0003-4819-149-5-200809020-00008.
   PubMed Web of Science ®Google Scholar
• Jackson ER, Shanafelt TD, Hasan O, Satele DV, Dyrbye LN. Burnout and alcohol abuse/dependence among us medical students. Acad Med. 2016;91:1251–1256. doi:10.1097/ACM.0000000000001138.
   PubMed Web of Science ®Google Scholar
• Dyrbye LN, Sciolla AF, Dekhtyar M, et al. Medical school strategies to address student well-being: a national survey. Acad Med. 2019;94(6):861–868. doi:10.1097/ACM.0000000000002611.
   PubMed Web of Science ®Google Scholar
• Dzau VJ, Kirch DG, Nasca TJ . To care is human – collectively confronting the clinician-burnout crisis. N Engl J Med. 2018;378(4):312–314. doi:10.1056/nejmp1715127.
   PubMed Web of Science ®Google Scholar
• Shanafelt TD, Schein E, Minor LB, Trockel M, Schein P, Kirch D. Healing the professional culture of medicine. Mayo Clin Proc. 2019;94(8):1556–1566. doi:10.1016/j.mayocp.2019.03.026.
   PubMed Web of Science ®Google Scholar
• National Academies of Sciences, Engineering, and Medicine. Taking Action against Clinician Burnout: A Systems Approach to Professional Well-Being. Washington, DC: The National Academies Press; 2019. doi:10.17226/25521.
   Google Scholar
• National Academy of Medicine. Valid and reliable survey instruments to measure burnout, well-being, and other work-related dimensions. National Academy of Medicine. https://nam.edu/valid-reliable-survey-instruments-measure-burnout-well-work-related-dimensions. Accessed March 8, 2021.
   Google Scholar
• Schaufeli WB, Enzmann D, Girault N. Measurement of burnout: a review. In: Schaufeli WB, Maslach C, Marek T , eds. Professional Burnout: Recent Developments in Theory and Research. London: Taylor and Francis; 2018:199–215.
   Google Scholar
• Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual. 4th ed. Menlo Park, CA: Mindgarden; 2018.
   Google Scholar
• Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory. In: Zalaquett CP, Wood RJ, eds. Evaluating Stress: A Book of Resources. 3rd ed. Lanham, MD: Scarecrow Education; 1997:191–218.
   Google Scholar
• Demerouti E, Bakker AB. The Oldenburg burnout inventory: a good alternative to measure burnout and engagement. In: Halbesleben JR, ed. Handbook of Stress and Burnout in Health Care. New York: Nova Science Publishers; 2008:65–78.
   Google Scholar
• Kristensen TS, Borritz M, Villadsen E, Christensen KB. The Copenhagen Burnout Inventory: a new tool for the assessment of burnout. Work Stress. 2005;19(3):192–207. 2005; doi:10.1080/02678370500297720.
   Web of Science ®Google Scholar
• Pines A, Aronson E. Career Burnout: Causes and Cures. New York: Free Press, 1988.
   Google Scholar
• Ackerley GD, Burnell J, Holder DC, Kurdek LA. Burnout among licensed psychologists. Prof Psychol Res Pr. 1988;19(6):624–631. doi:10.1037/0735-7028.19.6.624.
   Web of Science ®Google Scholar
• Salmela-Aro K, Rantanen J, Hyvönen K, Tilleman K, Feldt T. Bergen Burnout Inventory: reliability and validity among Finnish and Estonian managers. Int Arch Occup Environ Health. 2011;84(6):635–645. doi:10.1007/s00420-010-0594-3.
   PubMed Web of Science ®Google Scholar
• Załuska U, Ślazyk-Sobol M, Kwiatkowska-Ciotucha D. Burnout and its correlates − an empirical study conducted among education, higher education and health care professionals. Ekon. 2018;22(1):26–38. doi:10.15611/eada.2018.1.02.
   Google Scholar
• Melamed S, Kushnir T, Shirom A. Burnout and risk factors for cardiovascular diseases. Behav Med. 1992;18(2):53–60. doi:10.1080/08964289.1992.9935172.
   PubMed Web of Science ®Google Scholar
• Bakker AB, Demerouti E, Schaufeli WB. Validation of the Maslach burnout inventory-general survey: an internet study. Anxiety Stress Coping. 2002;15(3):245–260. doi:10.1080/1061580021000020716.
   Web of Science ®Google Scholar
• Koeske GF, Koeske RD. Construct validity of the Maslach Burnout Inventory: a critical review and reconceptualization. J Appl Behav Sci. 1989;25(2):131–144. doi:10.1177/0021886389252004.
   Web of Science ®Google Scholar
• Vanheule S, Rosseel Y, Vlerick P. The factorial validity and measurement invariance of the Maslach Burnout Inventory for human services. Stress Health. 2007;23(2):87–91. doi:10.1002/smi.1124.
   Web of Science ®Google Scholar
• Schutte N, Toppinen S, Kalimo R, Schaufeli W. The factorial validity of the Maslach Burnout Inventory‐General Survey (MBI‐GS) across occupational groups and nations. J Occup Organ Psychol. 2000;73(1):53–66. doi:10.1348/096317900166877.
   Web of Science ®Google Scholar
• Kim H, Ji J. Factor structure and longitudinal invariance of the Maslach Burnout Inventory. Res Soc Work Pract. 2009;19:325–339. doi:10.1177/1049731508318550.
   Web of Science ®Google Scholar
• Aguayo R, Vargas C, Emilia I, Lozano LM. A meta-analytic reliability generalization study of the Maslach Burnout Inventory. Int J Clin Health Psychol. 2011;11:343–361.
   Web of Science ®Google Scholar
• Demerouti E, Bakker AB, Nachreiner F, Schaufeli WB. A model of burnout and life satisfaction amongst nurses. J Adv Nurs. 2000;32(2):454–464. doi:10.1046/j.1365-2648.2000.01496.x.
   PubMed Web of Science ®Google Scholar
• Demerouti E, Bakker AB, Nachreiner F, Schaufeli WB. The job demands-resources model of burnout. J Appl Psychol. 2001;86(3):499–512.
   PubMed Web of Science ®Google Scholar
• Demerouti E, Demerouti E, Bakker AB, Vardakou I, Kantas A. The convergent validity of two burnout instruments: a multitrait-multimethod analysis. Eur J Psychol Assess. 2003;19(1):12–23. doi:10.1027//1015-5759.19.1.12.
   Web of Science ®Google Scholar
• Halbesleben JR, Demerouti E. The construct validity of an alternative measure of burnout: investigating the English translation of the Oldenburg burnout inventory. Work Stress. 2005;19(3):208–220. doi:10.1080/02678370500340728.
   Web of Science ®Google Scholar
• Bakker AB, Demerouti E, Sanz-Vergel AI. Burnout and work engagement: the JD–R approach. Annu Rev Organ Psychol Organ Behav. 2014;1(1):389–411. doi:10.1146/annurev-orgpsych-031413-091235.
   Google Scholar
• Bakker AB, Demerouti E, Verbeke W. Using the job demands‐resources model to predict burnout and performance. Hum Resour Manage. 2004;43(1):83–104. doi:10.1002/hrm.20004.
   Web of Science ®Google Scholar
• Lee RT, Ashforth BE. A meta-analytic examination of the correlates of the three dimensions of job burnout. J Appl Psychol. 1996;81(2):123–133. doi:10.1037/0021-9010.81.2.123.
   PubMed Web of Science ®Google Scholar
• Podsakoff PM, MacKenzie SB, Lee JY, Podsakoff NP. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol. 2003;88(5):879–903. doi:10.1037/0021-9010.88.5.879.
   PubMed Web of Science ®Google Scholar
• Dahlin M, Fjell J, Runeson B. Factors at medical school and work related to exhaustion among physicians in their first postgraduate year. Nord J Psychiatry. 2010;64(6):402–408. doi:10.3109/08039481003759219.
   PubMed Web of Science ®Google Scholar
• Dahlin M, Joneborg N, Runeson B. Performance-based self-esteem and burnout in a cross-sectional study of medical students. Med Teach. 2007;29(1):43–48. doi:10.1080/01421590601175309.
   PubMed Web of Science ®Google Scholar
• National Academy of Medicine. A Pragmatic Approach for Organizations to Measure Health Care Professional Well-Being. National Academy of Medicine. https://nam.edu/a-pragmatic-approach-for-organizations-to-measure-health-care-professional-well-being/. Accessed March 8, 2021.
   Google Scholar
• American Association of Medical Colleges. Medical School Year Two Questionnaire 2019 All Schools Summary Report. https://www.aamc.org/media/43656/download. April 2019. Accessed October 20, 2021.
   Google Scholar
• American Association of Medical Colleges . Medical School Graduation Questionnaire 2019. All Schools Summary Report. https://www.aamc.org/media/33566/download. April 2019. Accessed October 20, 2021.
   Google Scholar
• Dahlin ME, Runeson B. Burnout and psychiatric morbidity among medical students entering clinical training: a three year prospective questionnaire and interview-based study. BMC Med Educ. 2007;7:6. doi:10.1186/1472-6920-7-6.
   PubMedGoogle Scholar
• Dahlin M, Nilsson C, Stotzer E, Runeson B. Mental distress, alcohol use and help-seeking among medical and business students: a cross-sectional comparative study. BMC Med Educ. 2011;11:92–98. doi:10.1186/1472-6920-11-92.
   PubMed Web of Science ®Google Scholar
• Shad R, Thawani R, Goel A. Burnout and sleep quality: a cross-sectional questionnaire-based study of medical and non-medical students in India. Cureus. 2015;7:e361.
   PubMed Web of Science ®Google Scholar
• Dyrbye LN, Satele D, West CP. Association of characteristics of the learning environment and US Medical Student Burnout, Empathy, and Career Regret. JAMA Netw Open. 2021;4(8):e2119110. doi:10.1001/jamanetworkopen.2021.19110.
   PubMed Web of Science ®Google Scholar
• Green SB, Lissitz RW, Mulaik SA. Limitations of coefficient alpha as an index of test unidimensionality. Educ Psychol Meas. 1977;37(4):827–838. doi:10.1177/001316447703700403.
   Web of Science ®Google Scholar
• Sijtsma K . On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika. 2009;74(1):107–120. doi:10.1007/s11336-008-9101-0.
   PubMed Web of Science ®Google Scholar
• Crutzen R, Peters GJY. Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all. Health Psychol Rev. 2017;11(3):242–247. doi:10.1080/17437199.2015.1124240.
   PubMed Web of Science ®Google Scholar
• Dunn TJ, Baguley T, Brunsden V. From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br J Psychol. 2014;105(3):399–412. doi:10.1111/bjop.12046.
   PubMed Web of Science ®Google Scholar
• American Educational Research Association, American Psychological Association, National Council on Measurement in Education, & Joint Committee on Standards for Educational and Psychological Testing. Standards for educational and psychological testing. 2014.
   Google Scholar
• Benson J. Developing a strong program of construct validation: a test anxiety example. J Educ Meas Issues Pract. 2005;17(1):10–17. doi:10.1111/j.1745-3992.1998.tb00616.x.
   Google Scholar
• McNeish D, Wolf MG. Thinking twice about sum scores. Behav Res Methods. 2020;52(6):2287–2305. doi:10.3758/s13428-020-01398-0.
   PubMed Web of Science ®Google Scholar
• Bandalos DL. Measurement Theory and Applications for the Social Sciences. New York: Guilford Publications; 2018.
   Google Scholar
• Bandalos DL, Finney SJ. Factor analysis: exploratory and confirmatory. In: Hancock GR, Mueller RO, Stapleton LM, eds. The Review’s Guide to Quantitative Methods in the Social Sciences. 2nd ed. London: Routledge; 2010:98–122.
   Google Scholar
• Peugh JL, Enders CK. Missing data in educational research: a review of reporting practices and suggestions for improvement. Rev Educ Res. 2004;74(4):525–556. doi:10.3102/00346543074004525.
   Web of Science ®Google Scholar
• Enders CK. Applied Missing Data Analysis. New York: Guilford Press, 2010.
   Google Scholar
• Shrive FM, Stuart H, Quan H, Ghali WA. Dealing with missing data in a multi-question depression scale: a comparison of imputation methods. BMC Med Res Methodol. 2006;6(1):10. doi:10.1186/1471-2288-6-57.
   PubMedGoogle Scholar
• American Association of Medical Colleges. Medical School Year Two Questionnaire 2015 All Schools Summary Report. 2016. Obtained via email request August 5, 2021.
   Google Scholar
• American Association of Medical Colleges. Medical School Year Two Questionnaire 2016 All Schools Summary Report. 2017. Obtained via email request August 5, 2021.
   Google Scholar
• Li CH. Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936–949. doi:10.3758/s13428-015-0619-7.
   PubMed Web of Science ®Google Scholar
• Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55. doi:10.1080/10705519909540118.
   Web of Science ®Google Scholar
• Marsh HW, Hau KT, Wen Z. In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Struct Equ Modeling. 2004;11(3):320–341. doi:10.1207/s15328007sem1103_2.
   Web of Science ®Google Scholar
• Qiao H, Schaufeli WB. The convergent validity of four burnout measures in a Chinese sample: a confirmatory factor-analytic approach. Appl Psychol. 2011;60(1):87–111. doi:10.1111/j.1464-0597.2010.00428.x.
   Web of Science ®Google Scholar
• West CP, Dyrbye LN, Shanafelt TD. Physician burnout: contributors, consequences and solutions. J Intern Med. 2018;283(6):516–529. doi:10.1111/joim.12752.
   PubMed Web of Science ®Google Scholar
• Chang L. Connotatively consistent and reversed connotatively inconsistent items are not fully equivalent: generalizability study. Educ Psychol Meas. 1995;55(6):991–997. doi:10.1177/0013164495055006007.
   Web of Science ®Google Scholar
• Zeng B, Wen H, Zhang J. How does the valence of wording affect features of a scale? The method effects in the Undergraduate Learning Burnout Scale. Front Psychol. 2020;11(2638):585179.
   PubMedGoogle Scholar
• Clifton JD. Managing validity versus reliability trade-offs in scale-building decisions. Psychol Methods. 2020;25(3):259–270. doi:10.1037/met0000236.
   PubMed Web of Science ®Google Scholar
• Erschens R, Keifenheim KE, Herrmann-Werner A, et al. Professional burnout among medical students: systematic literature review and meta-analysis. Med Teach. 2019;41(2):172–183. doi:10.1080/0142159X.2018.1457213.
   PubMed Web of Science ®Google Scholar