A teaching encounter card to evaluate clinical supervisors across clerkship rotations

Abstract

Background: Evaluation of faculty teaching is critical to improving the educational experience for both students and faculty.

Aim: Our objectives were to implement an evaluation system, using the teaching encounter card, across multiple rotations in the clerkship and determine the feasibility, reliability and validity of this evaluation tool in this expanded setting.

Methods: Students were asked to rate clinical supervisors on nine teaching behaviours using a 6-point rating scale and asked whether they would like to nominate the teacher for a clinical teaching award.

Results: A total of 3971 cards for 587 clinical supervisors across seven clerkship rotations were analyzed. There was an average of 7.3 cards per supervisor (median = 5, range 2–66). There was high internal consistency between items on the card (Cronbach's alpha 0.965). The reliability was fair at 0.63. Seventeen cards per supervisor would be required to achieve a reliability >0.8 (G study). Ratings were higher for encounters that occurred in the operating room and within the anaesthesia rotation. The teachers who had a positive recommendation for teaching award nomination received higher scores than their colleagues.

Conclusion: We successfully implemented a faculty evaluation card across clerkship rotations that was flexible enough to use in multiple learning environments and allowed the identification of outstanding clinical teachers.

Additional information

Notes on contributors

Erin Keely

ERIN KEELY, MD FRCPC, is currently Chief, Division of Endocrinology and Metabolism at the Ottawa Hospital. As a clinician-educator, she has developed an interest in ambulatory care teaching.

Lawrence Oppenheimer

LAWRENCE OPPENHEIMER is Division Head of Maternal–Foetal Medicine in the Department of Obstetrics and Gynaecology and Director of the University of Ottawa Clerkship programme.

Timothy Woods

TIMOTHY J. WOOD is currently the Manager, Research and Development for the Medical Council of Canada and is an Adjunct Professor with the Department of Medicine, University of Ottawa. He has a PhD in Cognitive Psychology from McMaster University. His research interests are in evaluation, licensure and expertise.

Meridith Marks

MERIDITH MARKS, MD, MEd, is a clinician educator with a particular interest in faculty development and the assessment of interventions to improve teaching quality.