39,853
Views
107
CrossRef citations to date
0
Altmetric
Introduction

The clinical learning environment

, , , , , ORCID Icon, ORCID Icon & show all

Abstract

Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches the CLE through six different lenses, termed “avenues:” architectural, digital, diversity and inclusion, education, psychological, and sociocultural, with each avenue represented by a paper. The aim is to facilitate dialog around the contributions of different academic disciplines to research on the CLE. Collectively the papers highlight the overlap between the various “avenues” in how they influence each other, and how they collectively have shaped the work to understand and improve the CLE. The expectation is that the various avenues can add to existing knowledge and create new ideas for interventions to improve the clinical learning environment across nations for learners and teachers with the ultimate aim of improving patient care. Research and efforts to improve the CLE are critical to learning, professional socialization and well-being for trainees as they learn and participate in patient care, and to the quality of care they will deliver over decades of practice after graduation.

The subject of the clinical learning environment (CLE) is at the forefront of discussions by educators, accreditors, educational organizations, and health care professionals and has long been a focus of research and improvement efforts in medical education. A suboptimal CLE has been associated with adverse patient care and learning outcomes (GMC Citation2016; Kilty et al. Citation2017; Gruppen et al. Citation2018; Macy Foundation Citation2018). The current climate of financially constrained and understaffed health systems has increased pressure and expectation of, and negative consequences for trainee well-being. Financial constraints and clinical productivity expectations have negatively affected available time for educational pursuits (Norman and Dogra Citation2014; Kilty et al. Citation2017; Weiss et al. Citation2018) and have contributed to higher levels of stress, burnout, depersonalization, and emotional exhaustion in medical trainees and in their teachers (Gruppen et al. Citation2018; Macy Foundation Citation2018). This in turn has added negative effect on the working and learning climate for trainees and their trainers.

Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. Simulation may prepare learners for the CLE; however, there is no comparison to the learning that comes from managing patients in a real clinical context. In addition, many healthcare systems rely on the service that learners provide to patients, and to remove them from teaching institutions may have a negative impact on patient care.

An effective and supportive CLE thus is important to the quality and safety of patient care, to the health and well-being of the medical workforce, and to trainee learning and socialization into the profession. Studies from North America have shown that the quality of the learning environment that provided the context for training was a predictor of the quality of care provided by graduates for years after graduation (Tamblyn et al. Citation2005; Asch et al. Citation2009) and influenced prescribing patterns (Cadieux et al. Citation2007) and patient management and use of health care resources (Chen et al. Citation2014; Sirovich et al. Citation2014; Dine et al. Citation2015). Similarly, complication rates for practicing general surgeons were associated with the ranking of the residency program in which they had trained—with higher ranked residency programs correlated with lower complication rates (Bansal et al. Citation2016). Therefore, efforts to improve the CLE not only have a positive impact in the settings where trainees learn and participate in patient care but also affect the practice of future graduates, potentially for decades to come. This provides the rationale for Clinical Learning Environment Review (CLER) program in the United States, as physicians in training represent both frontline of health care delivery today and the future of the practice of medicine (Weiss et al. Citation2013, Citation2018). The importance of the CLE to both the current and future practice of medicine raises two critical questions: (1) what is known about the CLE from prior scientific study; and (2) what can be done in the short- and the long-term to increase the effectiveness of the CLE as the critical site for physician education, and how this in turn, has a positive impact on the well-being, engagement, and professional socialization of learners and their teachers. This themed issue of Medical Teacher is devoted to these topics.

The clinical learning environment–An elusive concept

Clinical learning environments involve three key elements: clinical work; learning; and environment. Early definition focused on the climate and overall ambiance of the medical education environment (Genn and Harden Citation1986) and highlighted the importance of the climate in which learning occurs (Roff and McAleer Citation2001). The CLE has been described as foundation of postgraduate medical education (Weiss et al. Citation2013; Kilty et al. Citation2017) by comprising “the social, cultural and material context is which residents learn while they work” (Kilty et al. Citation2017, p. 1) The Macy Foundation (Citation2018) defined the learning environment as: “…social interactions, organizational cultures and structures, and physical and virtual spaces that surround and shape participants’ experiences, perceptions, and learning.” These differences in existing definitions highlight the complexity of the CLE concept, with different dimensions and elements examined in prior studies and editorials (e.g. environment, climate, atmosphere, milieu, and culture).

In this thematic examination, we take a pragmatic stance and define the CLE as the overlapping space between the “work environment” (the clinical context in which trainees learn and participate in patient care), and the “educational context” (the syllabi, curricula, and goals that define methods for learning, expected learning outcomes, and assessment practices), shown in .

Figure 1. The CLE constitutes the overlap between the domains of work and learning and their congruent and competing rationales.

Figure 1. The CLE constitutes the overlap between the domains of work and learning and their congruent and competing rationales.

Figure 2. The “avenue” framework to deconstruct and explore fundamental aspects of clinical learning environments.

Figure 2. The “avenue” framework to deconstruct and explore fundamental aspects of clinical learning environments.

A historical perspective on assessment of the learning environment

Kurt Lewin’s research in social psychology in the 1930s and 1940s (Lewin Citation1947) laid the foundation for the development of instruments to measure educational climates (Genn and Harden Citation1986 and Palmgren Citation2016). Researchers examined factors such as stressors, pressure, and rewards in relation to what characterized specific educational environments (Genn and Harden Citation1986; Palmgren Citation2016). This set in motion a series of initiatives that aimed to measure quantifiable elements of environments, allowing for longitudinal and comparative studies on learners’ and teachers’ perceptions. Early instruments included the Medical School Environmental Index (Hutchins Citation1961), which was adopted by the Association of American Medical Colleges for the assessment of the medical student learning environment. These studies showed that learners’ perceptions of their environment “were essentially unrelated to, or were independent of the students’ personality needs” (Genn and Harden Citation1986).

As many of the existing instruments for assessing the learning environment were in the field of general education, Genn and Harden (Citation1986) identified the need to create instruments specific to health professions education. This led to the development of a new, global and culturally nonspecific measurement of the educational climate in health professions education—the Dundee Ready Educational Environment Measure or DREEM (Roff et al. Citation1997)—a 50-item measure of students’ perception of a specific environment allowing for various forms of comparative assessments of the learning environment. The development of the DREEM was timely. The first Tomorrow’s Doctor report published by the General Medical Council in the UK opened a critical dialog on the suboptimal conditions under which medical students were trained (GMC Citation1993). The report highlighted problems such as bullying, gender discrimination, harassment, quality of supervision and the presence of poor role models among clinical teaching faculty, bringing the enterprise of clinical learning environments to the attention of educators and regulators (Roff et al. Citation2005 and Palmgren Citation2016) Ultimately, this was a patient safety issue with a potentially devastating impact on the public’s trust in the profession.

Instruments for measuring clinical learning environment for postgraduate medical education have also been developed, with the Postgraduate Hospital Educational Environment Measure (PHEEM) one of the most widely used and validated instruments (Roff et al. Citation2005). Studies of the use of the PHEEM across contexts found variability by specialty, level of training and clinical settings, as well as validating the instrument in different national contexts (Chan et al. Citation2016). Instruments for assessing the CLE also exist for some specialties, such as anesthesiology and surgery (Roff et al. Citation2005; Kanashiro et al. Citation2006), and for non-physician health professions (Palmgren Citation2016).

Parallel to the movement to enhance assessment of the learning environment, ripples of change were felt in the United States as a result of the 1984 death of Libby Zion in a New York teaching hospital, with long working hours and inadequate supervision cited as contributing factors (Barron Citation2006). In 1989, the New York State’ health regulation Section 405 enforced work hour limits for physicians in training of 80 hours per week (Asch and Parker Citation1988). The ground-breaking report To Err is Human by the Institute of Medicine in the United States placed patient safety on the public agenda with an impact on expectations for safety and quality of care, and on training regulations (IOM Citation2000), and the associated dialog highlighted the conditions under which health care professionals were being trained and the culture in which training was imbedded. Under pressure from pending legislation, the ACGME instituted a national limit on work hours for physicians in training (Philibert et al. Citation2002). In Europe, implementation of the European Working Time Directive in 1998 severely reduced the working hours of physicians in training (Datta and Davies Citation2014), with mixed reactions from the medical community (Maisonneuve et al. Citation2014), indications of a negative impact on training, particularly in surgical specialties (Hopmans et al. Citation2015), and little evidence of improvement in trainee working conditions and well-being (Rodriguez-Jareño et al. Citation2014). These increased the need for valid and actionable assessment of the learning environment to assess the impact of these changes and to facilitate improvements.

Assessments of the learning environment currently are used by accreditors in undergraduate medical education in the United States and Canada (LCME Citation2018; Mavis et al. Citation2014; Lockwood et al. Citation2004) and by the US accreditation body for postgraduate medical education (the Accreditation Council for Graduate Medical Education) as an important, sensitive and valid tool to collect learners’ and teachers’ perception of the learning environment in the US and internationally (Holt et al. Citation2018; Ibrahim et al. Citation2014). The results are used in accreditation and internally for program improvement. When the US accreditation body for postgraduate medical education (the Accreditation Council for Graduate Medical Education) launched a new accreditation system in 2013, this included both learner and teaching faculty assessments of the CLE in annual data screening for programs trainees, and a dedicated review of the CLE through the Clinical Learning Environment Review (CLER) program (Wagner et al. Citation2016; Co et al. Citation2018; Weiss et al. Citation2018). Learner and teacher assessments of the CLE impact learning outcomes, with noncompliance in internal medicine programs identified via the ACGME’s annual surveys associated with lower performance on graduates on the board certification examination. The CLER program both provides insight into and feedback on, strengths and challenges in US-accredited institutions’ learning environment, as well as a window into the future practice and practice style of graduates. Despite relatively recent implementation, CLER has provided a powerful tool to leverage institutional and health system-level change (Weiss et al. Citation2018).

Current challenges in the learning environment

There are currently significant challenges in the learning environment. A national stakeholder consensus document identified overcrowded clinical environments, understaffing and service pressures and clinical workload as barriers to learning in the CLE (Kilty et al. Citation2017). Consistent with other studies, the domains identified as most challenging from an improvement perspective were the “organization and conditions of work” and “time to learn with senior doctors during patient care” (Kilty et al. Citation2017). The Bawa-Garba case in the United Kingdom is a poignant example of this (Vaughan Citation2018). This case and similar general observations further support the hypothesis that “service pressures impact opportunities to learn, resulting in cognitive overload, limiting time to reflect and discuss and through constraints on physical space” (Kilty et al. Citation2017, p. 8).

In April 2018, the Macy Foundation organized a conference to address challenges and improve the environment for learning in the health professions, which framed the critical issues as:“…revolutionary changes in the health care delivery; increasing demands on practitioners to increase clinical productivity and improve patient safety and quality of care; structural systems of inequities and exclusion and health disparities. Among health profession learners, educators, and practitioners, these trends are producing increasing rates of burnout, distress, and depression.” (Macy Foundation Citation2018).

The Macy Foundation also commissioned a scoping review of the current literature on interventions designed to improve learning environments in the health professions (Gruppen et al. Citation2018). The review introduced a conceptual model that deconstructed the CLE into four central components (personal, social, physical and virtual, and organizational). It also highlighted that, despite considerable academic efforts, there is a lack of conceptual clarity in studies that have explored the clinical learning environment (Gruppen et al. Citation2018).

Introducing the avenues framework

Our overview of the study of the CLE from the 1930s to the present day shows that focus on the CLE and on the conditions under which physicians (and to some degree other health professional are being trained), intermittently reemerge at the forefront of investigative work, dialog within the educational community, and public and political discussions. There are internal and external reasons. Externally, drivers of the dramatic increase in interest in the CLE over the past two decades include challenges to the quality and hours, bullying and suppressing learning culture, stress and burnout, as a host of factors with the potential for having a serious deleterious effect on health care and health professions training. This is recognized by the education community, and by regulators, accreditors and the public, resulting in calls for change and improvement. Less well understood by the public is the impact the CLE has on the subsequent practice of graduates, which is a critical internal driver for the medical education community to better understand and effect positive change in the learning environment.

While much has been done at an academic and policy level to identify challenges, levers for action and recommendations for the future of the CLE, the question, “What is next?” remains largely unanswered. What do these challenges look like practically, within a given institution, and how can the educators, the profession and accreditors and regulators affect positive change?

In October 2018, the Royal College of Physicians and Surgeons of Canada hosted a global consensus conference on the clinical learning environment, held just prior to the International Conference on Residency Education. Attendees at the conference were from a number of different countries and backgrounds, adding to the richness and candidness of the discussions. The objectives of this conference were to reflect on the current literature, identify gaps in the current body of knowledge, and delineate tangible short- and longer-term goals towards improving clinical learning environments. Based on the literature, a group of experts used an informal consensus approach to develop a conceptual model to deconstruct clinical learning environment, using work in established academic disciplines, to better understand the various aspects and attributes. The model approaches the CLE through six different lenses, which we have termed “avenues” for this exploration (). The conference provided a forum for discussion and identification of connection and overlap between the various avenues in how they influence each other and the CLE. Six papers presented in this themed issue are the outcome of these discussions and address the various avenues of the model.

To examine how different academic fields and foci have informed the study of the CLE, in , we highlight the history of the study of the CLE using the six avenues, along with current challenges and salient points, and critical topics of interest to the public. These topics are discussed in detail in the individual papers. In each paper, we seek to identify actionable areas for research and improvement efforts that have the potential for positive impact on the quality and safety of care, trainee learning, and well-being, and though the link to their performance as graduates, the public’s trust. Each paper also provides actionable “Practice Points” for the avenue it addresses.

Table 1. Chronological overview of the clinical learning environment “avenues” and public trust concerns.

Conclusions

While a thorough examination of the clinical learning environment is important, by itself it is insufficient. There is a need to identify strategies and approaches that allow the medical education community and the profession to improve the environment that provides the context for physician education. This themed issue of Medical Teacher builds on and seeks to expand the existing, somewhat fragmented understanding of the clinical learning environment. The expectation is that the various avenues within the theme can add to existing knowledge, and create new ideas for interventions to improve the clinical learning environment across nations for learners and teachers with the ultimate aim of improving patient care. Given what is known about the role of the CLE, further study and efforts to improve the CLE are critical to the learning, professional socialization and well-being of trainees as they learn and participate in patient care, and to the future quality of care, they will deliver over decades of practice following graduation.

Disclosure statement

The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this article.

Notes

Additional information

Notes on contributors

Jonas Nordquist

Jonas Nordquist, PhD, is the associate residency director at the Karolinska University Hospital in Sweden. He is also the director of the Medical Case Centre at Karolinska Institutet.

Jena Hall

Jena M. Hall, MD, MEd, is a senior resident in Obstetrics and Gynecology and the Competency-Based Medical Education Resident Lead at Queen’s University in Kingston, Ontario. She is passionate about engagement of trainees in medical education improvement and reform and optimization of surgical coaching.

Kelly Caverzagie

Kelly J. Caverzagie, MD, serves as the Associate Dean for Educational Strategy for the University of Nebraska Medical Center (UNMC) and Vice-President for Education at Nebraska Medicine. He is actively practicing as an academic hospitalist and enjoys working with students, residents and faculty to improve health professions education.

Linda Snell

Linda Snell is Professor of Medicine at the Department of Medicine and the Centre for Medical Education, McGill University, Canada and Senior Clinician Educator at the Royal College of Physicians and Surgeons of Canada.

Ming-Ka Chan

Ming-Ka Chan is a Clinician Educator and Associate Professor in the Department of Pediatrics and Child Health, University of Manitoba and Children's Hospital of Winnipeg, Winnipeg, Manitoba, Canada.

Brent Thoma

Brent Thoma, MD, MA, MSc is an Assistant Professor in the Department of Emergency Medicine at the University of Saskatchewan where he studies technology enhanced medical education.

Saleem Razack

Saleem Razack is a pediatric critical care physician, professor of pediatrics appointed to the Centre for Medical Education, and director of the Social Accountability and Community Engagement Office, McGill University, Montreal, Canada. His research interests in medical education are in equity, diversity and inclusion, using both qualitative and quantitative methods.

Ingrid Philibert

Ingrid Philibert, PhD, MBA is a US-based education researcher and writer, and former Sr. VP of the Accreditation Council for Graduate Medical Education and managing editor of the Journal of Graduate Medical Education. She received her PhD from the University of Iowa. Her interest is reducing burden in medical education.

Notes

1 Gill, CJ, Gill GC. 2005. Nightingale in Scutari: Her Legacy Reexamined. Clin Infect Dis. 40(12):1799–1805.

2 Ackerman J. 1969. Listening to architecture. Harvard Educ Rev. 39(4):4–10.

3 Ulrich RS. 1984. View through a window may influence recovery from surgery. Science. 224(4647):420–421.

4 Temple P, Filippakou O. 2007. Learning spaces for the 21st century. A review of the literature. London (UK): Centre for Higher Education Studies Institute of Education, University of London. https://www.researchgate.net/publication/237472897_Learning_spaces_for_the_21st_century_A_review_of_the_literature/download; [accessed 2018 December 21].

5 Nordquist J, Laing A. 2015. Designing spaces for the networked learning landscape. Med Teach. 37(4):337–343. Epub 2015 Feb 6.

6 Nordquist J, Laing A. 2014. Spaces for learning–a neglected area in curriculum change and strategic educational leadership. Med Teach. 36(7):555–356. Epub 2014 Jun 4.

7 Nordquist J, Sundberg K, Laing A. 2016. Aligning physical learning spaces with the curriculum: AMEE Guide No. 107. Med Teach. 38(8):755–768. Epub 2016 Mar 23.

8 Nordquist J. 2016. Alignment achieved? The learning landscape and curricula in health profession education. Med Educ. 50(1):61–68.

9 Huber GP. 1990. A theory of the effects of advanced information technologies on organizational design, intelligence, and decision making. Acad Manage Rev. 15(1):47–71.

10 Wilson J. 2006. Health Insurance Portability and Accountability Act Privacy rule causes ongoing concerns among clinicians and researchers. Ann Intern Med. 145(4):313–316.

11 Harley EH. 2006. The forgotten history of defunct black medical schools in the 19th and 20th centuries and the impact of the Flexner Report. JNMA. 98(9):1425–1429.

12 MacLaury J. 2010. President Kennedy's E.O.10925: seedbed of affirmative action. Washington (DC): Federal History; Society for History in the Federal Government. http://www.shfg.org/resources/Documents/FH%202%20(2010)%20MacLaury.pdf; [retrieved 2018 December 20].

13 DeVille K. 1999. Defending diversity: affirmative action and medical education. Am J Public Health. 89(8):1256–1261.

14 United Nations. 2007. Declaration on the Rights of Indigenous Peoples. United Nations Permanent Forum on Indigenous Issues. https://web.archive.org/web/20151101044521/http:/undesadspd.org/IndigenousPeoples/DeclarationontheRightsofIndigenousPeoples.aspx; [accessed 2018 December 20].

15 Truth and Reconciliation Commission of Canada, 2012. Truth and Reconciliation Commission of Canada: Calls to Action (Report). http://www.trc.ca/websites/trcinstitution/File/2015/Findings/Calls_to_Action_English2.pdf; [retrieved 2018 December 20].

16 Nivet MA. 2011. Commentary: Diversity 3.0: a necessary systems upgrade. Acad Med. 86(12):1487–1489.

17 Britt LD. 2007. Graduate medical education and the residency review committee: history and challenges. Am Surg. 73(2):136–139.

18 Fleming ND, Mills C. 1992. Not another inventory, rather a catalyst for reflection. To improve the academy. 246. http://digitalcommons.unl.edu/podimproveacad/246; [accessed 2018 December 20].

19 Leach DC. 2001. Changing education to improve patient care. Qual Health Care. Suppl 2:ii54–58.

20 Pavlov IP. 1927/1960. Conditional reflexes. New York: Dover Publications.

21 Skinner BF. 1953. Science and human behavior. New York: Macmillan.

22 Vygotsky LS. 1978. Mind in society - the development of higher psychological processes. Cambridge (MA): Harvard University Press.

23 Bandura A. 1977. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 84(2):191–215.

24 Bandura A. 1991. Social cognitive theory of self-regulation. Org Behav Hum Decis Process. 50(2):248–287.

25 van Merriënboer JJ, Sweller J. 2010. Cognitive load theory in health professional education: design principles and strategies. Med Educ. 44(1):85–93.

26 Dewey J. 1938. Experience and education. New York: Collier Books.

27 Merton RK, Reeder LG, Kendall PL 1957. The student–physician: introductory studies in the sociology of medical education. Cambridge (MA): Harvard University Press.

28 Bosk CL. 1979. Forgive and remember: managing medical failure. Chicago (IL): University of Chicago Press.

29 Hafferty FW, Franks R. 1994. The hidden curriculum, ethics teaching, and the structure of medical education. Acad Med. 69(11):861–871.

30 Rotenstein LS, Torre M, Ramos MA, Rosales RC, Guille C, Sen S, Mata DA. 2018 Prevalence of burnout among physicians: a systematic review. JAMA. 320(11):1131–1150.

31 Dyrbye L, Shanafelt T. 2016,. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50(1):132–149.

32 Leiter MP, Maslach C. 2004. Areas of worklife: a structured approach to organizational predictors of job burnout. In: Perrewe PL, Ganster DC, editords. Research in occupational stress and wellbeing3. Oxford: Elsevier; p. 91–134.

33 Bowman MA, Walsh WB Jr. 1982. Perspectives on the GMENAC Report. Health Aff (Millwood). 1(4):55–66.

34 Berwick DM, Nolan TW, Whittington J. 2008. The triple aim: care, health, and cost. Health Aff (Millwood). 27(3):759–769.

References

  • Asch DA, Nicholson S, Srinivas S, Herrin J, Epstein AJ. 2009. Evaluating obstetrical residency programs using patient outcomes. JAMA. 302:1277–1283.
  • Asch DA, Parker RM. 1988. The Libby Zion case. One step forward or two steps backward? N Engl J Med. 318:771–775.
  • Bansal N, Simmons KD, Epstein AJ, Morris JB, Kelz RR. 2016. Using patient outcomes to evaluate general surgery residency program performance. JAMA Surg. 151:111–119.
  • Barron HL. 2006. A Case that Shook Medicine. Washington Post. November 28.
  • Cadieux G, Tamblyn R, Dauphinee D, Libman M. 2007. Predictors of inappropriate antibiotic prescribing among primary care physicians. CMAJ. 177:877–883.
  • Chan CY, Sum MY, Lim WS, Chew NW, Samarasekera DD, Sim K. 2016. Adoption and correlates of Postgraduate Hospital Educational Environment Measure (PHEEM) in the evaluation of learning environments – a systematic review. Med Teach. 38:1248–1255.
  • Chen C, Petterson S, Phillips R, Bazemore A, Mullan F. 2014. Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries. JAMA. 312:2385–2393.
  • Co JPT, Weiss KB, Koh NJ, Wagner R. 2018. CLER Program. CLER National Report of Findings 2018: Executive Summary. Chicago (IL): Accreditation Council for Graduate Medical Education.
  • Datta ST, Davies SJ. 2014. Training for the future NHS: training junior doctors in the United Kingdom within the 48-hour European working time directive. BMC Med Educ. 14:S12.
  • Dine CJ, Bellini LM, Diemer G, Ferris A, Rana A, Simoncini G, Surkis W, Rothschild C, Asch DA, Shea JA, et al. 2015. Assessing correlations of physicians' practice intensity and certainty during residency training. J Grad Med Educ. 7:603–609.
  • [GMC] General Medical Council. 1993. Tomorrow’s doctor: recommendations on undergraduate medical curriculum. London (UK): General Medical Council.
  • [GMC] General Medical Council. 2016. The state of medical education and practice in the UK. London (UK): General Medical Council. [accessed 2018 Nov 30]. https://www.gmc-uk.org/-/media/documents/gmc-somep-2016—executive-summary_pdf-68137466.pdf.
  • Genn J, Harden R. 1986. What is medical education here really like? Suggestions for action research studies of climates of medical education – unifying perspective. Med Teach. 8:111–124.
  • Gruppen L, Irby D, Durning, Maggio L. 2018. Interventions designed to improve the learning environment in the health professions: a scoping review. AMEE MedEd Pub. 7:73.
  • Holt KD, Miller RS, Vasilias J, Byrne LM, Cable C, Grosso L, Bellini LM, McDonald FS. 2018. Relationships between the ACGME resident and faculty surveys and program pass rates on the ABIM internal medicine certification examination. Acad Med. 93:1205–1211.
  • Hopmans CJ, den Hoed PT, van der Laan L, van der Harst E, van der Elst M, Mannaerts GH, Dawson I, Timman R, Wijnhoven BP, Jzermans JN. 2015. Impact of the European Working Time Directive (EWTD) on the operative experience of surgery residents. Surgery. 157:634–641.
  • Hutchins EB. 1961. The 1960 medical school graduate: his perception of his faculty, peers, and environment. J Med Educ. 36:322–329.
  • Ibrahim H, Lindeman B, Matarelli SA, Nair SC. 2014. International Residency Program Evaluation: assessing the reliability and initial validity of the ACGME-I resident survey in Abu Dhabi, United Arab Emirates. J Grad Med Educ. 6:517–520.
  • [IOM] Institute of Medicine. 2000. To err is human. Washington (DC): National Academy Press.
  • Josiah M. Jr. Foundation. 2018. Improving environments for learning in the health professions. Recommendations from the Macy Foundation Conference. New York: Josiah Macy Jr. Foundation.
  • Kanashiro J, McAleer S, Roff S. 2006. Assessing the educational environment in the operating room-a measure of resident perception at one Canadian institution. Surgery. 139:150–158.
  • Kilty C, Flood P, Fu N, Horgan M, Higgins A, Bridget M, O’Kane G, Prihodova L, Slattery D, Stoyanov S, et al. 2017. A national stakeholder consensus study of challenges and priorities for clinical learning environments in postgraduate medical education. BMC Med Educ. 17. DOI: 10.1186/s12909-017-1065-2.
  • Lewin K. 1947. Frontiers of Group Dynamics: concept, method and reality in social science, social equilibria, and social change. Hum Relat. 1:5–41.
  • Lockwood JH, Sabharwal RK, Danoff D, Whitcomb ME. 2004. Quality improvement in medical students' education: the AAMC medical school graduation questionnaire. Med Educ. 38:234–236.
  • [LCME] Liaison Committee for Medical Education. 2018. The Role of Students in the Accreditation of Medical Education Programs in the US. Published June 2017 For Medical Education Programs with Full Accreditation Surveys in the 2018–19 academic year. [accessed 2018 Dec 18]. http://lcme.org/publications/#Guidelines–amp–Procedures
  • Maisonneuve JJ, Lambert TW, Goldacre MJ. 2014. UK doctors' views on the implementation of the European Working Time Directive as applied to medical practice: a quantitative analysis. BMJ Open. 4:e004391.
  • Mavis B, Sousa A, Lipscomb W, Rappley MD. 2014. Learning about medical student mistreatment from responses to the medical school graduation questionnaire. Acad Med. 89:705–711.
  • Norman RI, Dogra N. 2014. A survey of the practice and experience of clinical educators in UK secondary care. BMC Med Educ. 14:229.
  • Palmgren P. 2016. It Takes Two to Tango: an inquiry into healthcare professional education environments [PhD-thesis]. Karolinska Institutet, Stockholm.
  • Philibert I, Friedmann P, Williams WT. 2002. ACGME Work Group on Resident Duty Hours. Accreditation Council for Graduate Medical Education. 2002. New requirements for resident duty hours. JAMA. 288:1112–1114.
  • Rodriguez-Jareño MC, Demou E, Vargas-Prada S, Sanati KA, Skerjanc A, Reis PG, Helimäki-Aro R, Macdonald EB, Serra C. 2014. European Working Time Directive and doctors' health: a systematic review of the available epidemiological evidence. BMJ Open. 4:e004916.
  • Roff S, McAleer S. 2001. What is educational climate? Med Teach. 23:333–334.
  • Roff S, McAleer S, Harden R, Al-Qahtani M, Ahmed A, Deza H, Groenen G, Primparyon P. 1997. Development and validation of the Dundee ready education environment measure (DREEM). Med Teach. 19:295–299.
  • Roff S, McAleer S, Skinner A. 2005. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach. 27:326–331.
  • Sirovich BE, Lipner RS, Johnston M, Holmboe E. 2014. The association between residency training and internists' ability to practice conservatively. JAMA Intern Med. 174:1640–1648.
  • Tamblyn R, Abrahamowicz M, Dauphinee D, Girard N, Bartlett G, Grand'Maison P, Brailovsky C. 2005. Effect of a community oriented problem based learning curriculum on quality of primary care delivered by graduates: historical cohort comparison study. BMJ. 331:1002.
  • Vaughan J. 2018. The long road to justice for Hadiza Bawa-Garba. BMJ Opinion. [accessed 2018 Nov 19]. https://blogs.bmj.com/bmj/2018/08/14/jenny-vaughan-the-long-road-to-justice-for-hadiza-bawa-garba/.
  • Wagner R, Koh NJ, Patow C, Newton R, Casey BR, Weiss KB. 2016. CLER Program. 2016 detailed findings from the CLER national report of findings. J Grad Med Educ. 8:35–54.
  • Weiss KB, Bagian JP, Nasca TJ. 2013. The clinical learning environment: the foundation of graduate medical education. JAMA. 309:1687–1688.
  • Weiss KB, Co JPT, Bagian JP. 2018. Challenges and opportunities in the 6 focus areas: CLER national report of findings 2018. J Grad Med Educ. 10:25–48.