Unpacking Medical Students’ Mixed Engagement in Health Systems Science Education

References

• Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573–576. doi:10.1370/afm.1713.
   PubMed Web of Science ®Google Scholar
• Thibault GE. Reforming health professions education will require culture change and closer ties between classroom and practice. Health Aff (Millwood). 2013;32(11):1928–1932. doi:10.1377/hlthaff.2013.0827.
   PubMed Web of Science ®Google Scholar
• Skochelak SE. A decade of reports calling for change in medical education: what do they say? Acad Med. 2010;85(9 Suppl):S26–S33. doi:10.1097/ACM.0b013e3181f1323f.
   PubMed Web of Science ®Google Scholar
• Skochelak SE. Commentary: a century of progress in medical education: what about the next 10 years? Acad Med. 2010;85(2):197–200. doi:10.1097/ACM.0b013e3181c8f277.
   PubMed Web of Science ®Google Scholar
• Lucey CR. Medical education: part of the problem and part of the solution. JAMA Intern Med. 2013;173(17):1639–1643. doi:10.1001/jamainternmed.2013.9074.
   PubMed Web of Science ®Google Scholar
• Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923–1958. doi:10.1016/S0140-6736(10)61854-5.
   PubMed Web of Science ®Google Scholar
• Combes JR, Arespacochaga E. Lifelong Learning – Physician Competency Development. American Hospital Association Physician Leadership Forum. August 19, 2014.
   Google Scholar
• Crosson FJ, Leu J, Roemer BM, et al. Gaps in residency training should be addressed to better prepare doctors for a twenty-first-century delivery system. Health Aff (Millwood). 2011;30(11):2142–2148. doi:10.1377/hlthaff.2011.0184.
   PubMed Web of Science ®Google Scholar
• Cooke M, Irby DM, O'Brien BC, Carnegie Foundation for the Advancement of Teaching. Educating Physicians: A Call for Reform of Medical School and Residency. 1st ed. San Francisco, CA: Jossey-Bass; 2010.
   Google Scholar
• Ludmerer KM. Let Me Heal: The Opportunity to Preserve Excellence in American Medicine. Oxford: Oxford University Press; 2015.
   Google Scholar
• Gonzalo JD, Haidet P, Papp KK, et al. Educating for the 21st-century health care system: an interdependent framework of basic, clinical, and systems sciences. Acad Med. 2017;92(1):35–39. doi:10.1097/ACM.0000000000000951.
   PubMed Web of Science ®Google Scholar
• Ogrinc G, Headrick LA, Mutha S, et al. A framework for teaching medical students and residents about practice-based learning and improvement, synthesized from a literature review. Acad Med. 2003;78(7):748–756. doi:10.1097/00001888-200307000-00019.
   PubMed Web of Science ®Google Scholar
• Starr SR, Reed DA, Essary A, et al. Science of health care delivery as a first step to advance undergraduate medical education: a multi-institutional collaboration. Healthc (Amst). 2017;5(3):98–104. doi:10.1016/j.hjdsi.2017.01.003.
   PubMedGoogle Scholar
• Skochelak SE, Hawkins RE, AMA Education Consortium. Health Systems Science. St. Louis, MI: Elsevier; 2016.
   Google Scholar
• Ehrenfeld J, Gonzalo JD. Health Systems Science Review. 1st ed. Philadelphia, Pennsylvania: Elsevier; 2019.
   Google Scholar
• Gonzalo JD, Lucey C, Wolpaw T, et al. Value-added clinical systems learning roles for medical students that transform education and health: a guide for building partnerships between medical schools and health systems. Acad Med. 2017;92(5):602–607. doi:10.1097/ACM.0000000000001346.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Graaf D, Johannes B, et al. Adding value to the health care system: identifying value-added systems roles for medical students. Am J Med Qual. 2017;32(3):261–270. doi:10.1177/1062860616645401.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Dekhtyar M, Hawkins RE, et al. How can medical students add value? Identifying roles, barriers, and strategies to advance the value of undergraduate medical education to patient care and the health system. Acad Med. 2017;92(9):1294–1301. doi:10.1097/ACM.0000000000001662.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Wolpaw D, Graaf D, et al. Educating patient-centered, systems-aware physicians: a qualitative analysis of medical student perceptions of value-added clinical systems learning roles. BMC Med Educ. 2018;18(1):248. doi:10.1186/s12909-018-1345-5.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Caverzagie KJ, Hawkins RE, et al. Concerns and responses for integrating health systems science into medical education. Acad Med. 2018;93(6):843–849. doi:10.1097/ACM.0000000000001960.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Baxley E, Borkan J, et al. Priority areas and potential solutions for successful integration and sustainment of health systems science in undergraduate medical education. Acad Med. 2017;92(1):63–69. doi:10.1097/ACM.0000000000001249.
   PubMed Web of Science ®Google Scholar
• Dennhardt S, Apramian T, Lingard L, et al. Rethinking research in the medical humanities: a scoping review and narrative synthesis of quantitative outcome studies. Med Educ. 2016;50(3):285–299. doi:10.1111/medu.12812.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Chang A, Wolpaw DR. New educator roles for health systems science: implications of new physician competencies for U.S. medical school faculty. Acad Med. 2018;94(4):501–506.
   Web of Science ®Google Scholar
• Gonzalo JD, Ogrinc G. Health systems science: the “broccoli” of undergraduate medical education. Acad Med. 2019;94(10):1425–1432. doi:10.1097/ACM.0000000000002815.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Haidet P, Blatt B, et al. Exploring challenges in implementing a health systems science curriculum: a qualitative analysis of student perceptions. Med Educ. 2016;50(5):523–531. doi:10.1111/medu.12957.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Graaf D, Ahluwalia A, et al. A practical guide for implementing and maintaining value-added clinical systems learning roles for medical students using a diffusion of innovations framework. Adv Health Sci Educ. 2018;23(4):699–720. doi:10.1007/s10459-018-9822-5.
   PubMed Web of Science ®Google Scholar
• Thompson BM, Schneider VF, Haidet P, et al. Factors influencing implementation of team-based learning in health sciences education. Acad Med. 2007;82(Suppl):S53–S56. doi:10.1097/ACM.0b013e3181405f15.
   PubMedGoogle Scholar
• Thompson BM, Schneider VF, Haidet P, et al. Team-based learning at ten medical schools: two years later. Med Educ. 2007;41(3):250–257. doi:10.1111/j.1365-2929.2006.02684.x.
   PubMed Web of Science ®Google Scholar
• O'Brien BC, Irby DM. Enacting the Carnegie Foundation call for reform of medical school and residency. Teach Learn Med. 2013;25(Suppl 1):S1–S8. doi:10.1080/10401334.2013.842915.
   PubMedGoogle Scholar
• Whitehead CR, Hodges BD, Austin Z. Captive on a carousel: discourses of 'new' in medical education 1910–2010. Adv Health Sci Educ. 2013;18(4):755–768. doi:10.1007/s10459-012-9414-8.
   PubMed Web of Science ®Google Scholar
• Mills LM, Hoffman A, Khan A, et al. Integrating health systems science in early undergraduate medical education: barriers to implementation and lessons learned. MedEdPublish. 2017;6(4):1–5. doi:10.15694/mep.2017.000204.
   Google Scholar
• Davis CR, Gonzalo JD. How medical schools can promote community collaboration through health systems science education. AMA J Ethics. 2019;21(3):E239–247. doi:10.1001/amajethics.2019.239.
   PubMedGoogle Scholar
• Bernard HR, Ryan GW. Analyzing Qualitative Data: systematic Approaches. Los Angeles CA: Sage; 2010.
   Google Scholar
• Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Pyschol. 2006;3(2):77–101. doi:10.1191/1478088706qp063oa.
   Google Scholar
• Billett S. Learning in the Workplace: strategies for Effective Practice. Crows Nest, NSW: Allen & Unwin; 2001.
   Google Scholar
• Boyatzis RE. Transforming Qualitative Information: thematic Analysis and Code Development. Thousand Oaks, CA: Sage Publications; 1998.
   Google Scholar
• Gonzalo JD, Wolpaw T, Wolpaw D. Curricular transformation in health systems science: the need for global change. Acad Med. 2018;93(10):1431–1433. doi:10.1097/ACM.0000000000002284.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Dekhtyar M, Starr SR, et al. Health systems science curricula in undergraduate medical education: identifying and defining a potential curricular framework. Acad Med. 2017;92(1):123–131. doi:10.1097/ACM.0000000000001177.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Haidet P, Wolpaw DR. Authentic clinical experiences and depth in systems: toward a 21st century curriculum. Med Educ. 2014;48(2):104–105. doi:10.1111/medu.12400.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Graaf D, Kass LE, et al. Medical students as systems ethnographers: exploring patient experiences and systems vulnerabilities in the emergency department. AEM Educ Train. 2017;1(3):225–233. doi:10.1002/aet2.10038.
   PubMedGoogle Scholar
• Weinstein Y, Madan CR, Sumeracki MA. Teaching the science of learning. Cogn Res Princ Implic. 2018;3(1):2. doi:10.1186/s41235-017-0087-y.
   PubMedGoogle Scholar
• Friedlander MJ, Andrews L, Armstrong EG, et al. What can medical education learn from the neurobiology of learning? Acad Med. 2011;86(4):415–420. doi:10.1097/ACM.0b013e31820dc197.
   PubMed Web of Science ®Google Scholar
• Shenton A. Strategies for ensuring trustworthiness in qualitative research projects. Educ Inform. 2004;22(2):63–75. doi:10.3233/EFI-2004-22201.
   Google Scholar
• Elo S, Kyngas H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–115. doi:10.1111/j.1365-2648.2007.04569.x.
   PubMed Web of Science ®Google Scholar
• Miles J, Gilbert P. A Handbook of Research Methods for Clinical and Health Psychology. New York, NY: Oxford University Press; 2005.
   Google Scholar
• Alessio H. Student perceptions about and performance in problem-based learning. J Scholarship Teach Learn. 2004;4(1):23–34.
   Google Scholar
• Desmarchais JE, Bureau MA, Dumais B, et al. From traditional to problem-based learning - a case-report of complete curriculum reform. Med Educ. 1992;26(3):190–199. doi:10.1111/j.1365-2923.1992.tb00153.x.
   PubMed Web of Science ®Google Scholar
• West SA. Objectives in response to students’ uncertainty in a pre-clinical problembased learning curriculum. Educ Health. 1998;11:343–347.
   Google Scholar
• Walton HJ, Matthews MB. Essentials of problem-based learning. Med Educ. 1989;23(6):542–558. doi:10.1111/j.1365-2923.1989.tb01581.x.
   PubMed Web of Science ®Google Scholar
• Ellis DE. What discourages students from engaging with innovative instructional methods: creating a barrier framework. Innov High Educ. 2015;40(2):111–125. doi:10.1007/s10755-014-9304-5.
   Web of Science ®Google Scholar
• Howard GS, Maxwell SE. Correlation between student satisfaction and grades - a case of mistaken causation. J Educ Psychol. 1980;72(6):810–820. doi:10.1037/0022-0663.72.6.810.
   Web of Science ®Google Scholar
• Prave RS, Baril GL. Instructor ratings: controlling for bias from initial student interest. J Educ Bus. 1993;68(6):362–366. doi:10.1080/08832323.1993.10117644.
   Google Scholar
• Sadoski M, Sanders CW. Student course evaluations: common themes across courses and years. Med Educ Online. 2007;12(1):4463. doi:10.3402/meo.v12i.4463.
   PubMedGoogle Scholar
• Schiekirka S, Raupach T. A systematic review of factors influencing student ratings in undergraduate medical education course evaluations. BMC Med Educ. 2015;15(1):30. doi:10.1186/s12909-015-0311-8.
   PubMedGoogle Scholar
• West RF. The short-term stability of student ratings of instruction in medical school. Med Educ. 1988;22(2):104–112. doi:10.1111/j.1365-2923.1988.tb00419.x.
   PubMed Web of Science ®Google Scholar
• Irby DM, Shannon NF, Scher M, et al. The use of student ratings in multiinstructor courses . J Med Educ. 1977;52(8):668–673. doi:10.1097/00001888-197708000-00008.
   PubMedGoogle Scholar
• McLaughlin K, Coderre S, Woloschuk W, et al. Does blueprint publication affect students' perception of validity of the evaluation process? Adv Health Sci Educ Theory Pract. 2005;10(1):15–22. doi:10.1007/s10459-004-8740-x.
   PubMed Web of Science ®Google Scholar
• Woodruff JN. Accounting for complexity in medical education: a model of adaptive behaviour in medicine. Med Educ. 2019;53(9):861–873. doi:10.1111/medu.13905.
   PubMed Web of Science ®Google Scholar
• Cristancho S, Lingard L, Regehr G. From problem solving to problem definition: scrutinizing the complex nature of clinical practice. Perspect Med Educ. 2017;6(1):54–57. doi:10.1007/s40037-016-0314-0.
   PubMed Web of Science ®Google Scholar
• Cook DA, Durning SJ, Sherbino J, et al. Management reasoning: implications for health professions educators and a research agenda. Acad Med. 2019;94(9):1310–1316. doi:10.1097/ACM.0000000000002768.
   PubMed Web of Science ®Google Scholar
• Hafferty FW, Franks R. The hidden curriculum, ethics teaching, and the structure of medical education. Acad Med. 1994;69(11):861–871. doi:10.1097/00001888-199411000-00001.
   PubMed Web of Science ®Google Scholar
• Prober CG, Kolars JC, First LR, et al. A plea to reassess the role of United States medical licensing examination step 1 scores in residency selection. Acad Med. 2016;91(1):12–15. doi:10.1097/ACM.0000000000000855.
   PubMed Web of Science ®Google Scholar
• Senge PM. Systems citizenship: the leadership mandate for this millennium. 2006:7. https://www.conservationgateway.org/ConservationPlanning/cbd/guidance-document/key-advances/Documents/Systems%20Citizenship_The%20Leadership%20Mandate%20for%20this%20Millenium.pdf. Accessed December 26, 2018.
   Google Scholar
• Hafferty FW, Levinson D. Moving beyond nostalgia and motives: towards a complexity science view of medical professionalism. Perspect Biol Med. 2008;51(4):599–615. doi:10.1353/pbm.0.0044.
   PubMed Web of Science ®Google Scholar
• Brennan TA. Physicians' professional responsibility to improve the quality of care. Acad Med. 2002;77(10):973–980. doi:10.1097/00001888-200210000-00008.
   PubMed Web of Science ®Google Scholar
• Gonzalo JD, Singh MK. Building systems citizenship in health professions education: the continued call for health systems science curricula AHRQ PSNet [serial online]. 2019. https://psnet.ahrq.gov/perspectives/perspective/265. Accessed February 5, 2019.
   Google Scholar
• LaDonna KA, Taylor T, Lingard L. Why open-ended survey questions are unlikely to support rigorous qualitative insights. Acad Med. 2018;93(3):347–349. doi:10.1097/ACM.0000000000002088.
   PubMed Web of Science ®Google Scholar