Faculty development program evaluation: a need to embrace complexity

References

• Hesketh E, Bagnall G, Buckley E, et al. A framework for developing excellence as a clinical educator. Med Educ. 2001;35(6):555–564.
   PubMed Web of Science ®Google Scholar
• Bligh J, Prideaux D, Parsell G. PRISMS: new educational strategies for medical education. Medical Education, 35 (6):520-521. Med Educ. 2001;35(6):520–521.
   PubMed Web of Science ®Google Scholar
• Steinert Y, Mann K. Faculty development: principles and practice. J Vet Med Educ. 2006;33:317–324.
   PubMed Web of Science ®Google Scholar
• Ramani S. Twelve tips for excellent physical examination teaching. Med Teach. 2008;30(9):851–856. doi:10.1080/01421590802206747
   Web of Science ®Google Scholar
• McLean M, Cilliers F, van Wyk J. Faculty Development: Yesterday,Today and Tomorrow, AMEE GUIDE in Medical Education No 33. Dundee: Association for Medical Education in Europe (AMEE); 2010.
   Google Scholar
• Irby DM. Excellence in clinical teaching: knowledge transformation and development required. Med Educ. 2014;48:776–784. doi:10.1111/medu.2014.48.issue-8
   PubMed Web of Science ®Google Scholar
• Harden R, Crosby J. The good teacher is more than a lecturer: the twelve roles of the teacher; AMEE Guide N0 20. Med Teach. 2000;22(4):334–347. doi:10.1080/014215900409429
   Web of Science ®Google Scholar
• Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: from Flexner to competencies. Acad Med. 2002;77(5):361–367.
   PubMed Web of Science ®Google Scholar
• Boucher A, Ste-Marie LG. Towards A Competency-Based Medical Education Curriculum : A Training Framework. Montréal: Les Presses du CPASS; 2013.
   Google Scholar
• Frank J, Sherbino J, Snell L. CanMEDS 2015 Physician Competency Framework. Ottawa: Royal College of Physicians and Surgeons of Canada; 2015.
   Google Scholar
• Walsh A, Antao V, Bethune C, et al. Activités pédagogiques fondamentales en médecine familiale: Un référentiel pour le développement professoral. Mississauga (ON): Le Collège des médecins de famille du Canada; 2015.
   Google Scholar
• Fernandez N, Dory V, Ste-Marie L, Chaput M, Charlin B, Boucher A. Varying conceptions of competence: an analysis of how health sciences educators define competence. Med Educ. 2012;46:357–365. doi:10.1111/j.1365-2923.2011.04183.x
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Edgar L, Hamstra S The Milestones Guidebook, Graduate-medical-education/milestonesguidebook2016. Downloaded November 23rd, 2017: http://www.umm.edu/~/media/umm/pdfs/for-healthprofessionals/2016.
   Google Scholar
• Steinert Y. Faculty development in the new millenium: key challenges and future directions. Med Teach. 2000;22(1):44–50. doi:10.1080/01421590078814
   Web of Science ®Google Scholar
• Steinert Y. Faculty development: on becoming a medical educator. Med Teach. 2012;34(1):74–76. doi:10.3109/0142159X.2011.596588
   PubMed Web of Science ®Google Scholar
• Knight AMA, Carrese JAJ, Wright SMS. Qualitative assessment of the long-term impact of a faculty development programme in teaching skills. Med Educ. 2007;41(6):592–600. doi:10.1111/j.1365-2923.2007.02770.x
   PubMed Web of Science ®Google Scholar
• Wilkerson L, Irby D. Strategies for improving teaching practices: a comprehensive approach to faculty development. Acad Med. 1998;73:387–396.
   PubMed Web of Science ®Google Scholar
• Steinert Y. Faculty development: from workshops to communities of practice. Med Teach. 2010;32:425–428.
   PubMed Web of Science ®Google Scholar
• Haji F, Morin M, Parker K. Rethinking programme evaluation in health professions education: beyond ‘did it work?’. Med Educ. 2013;47:342–351. doi:10.1111/medu.2013.47.issue-4
   PubMed Web of Science ®Google Scholar
• Durning S, Hemmer P, Pangaro N. The structure of program evaluation: an approach for evaluating a course, clerkship, or components of residency or fellowship training program. Teach Learn Med. 2007;19(3):308–318. doi:10.1080/10401330701366796
   PubMed Web of Science ®Google Scholar
• Stufflebeam DL. Evaluation models. New Direct Eval. 2001;89:7–98. doi:10.1002/ev.3
   Google Scholar
• Frye A, Hemmer P. Program evaluation models and related theories: AMEE Guide No. 67. Med Teach. 2012;34(5):e288–e299. doi:10.3109/0142159X.2012.668637
   PubMed Web of Science ®Google Scholar
• Thoma B, Gottlieb M, Boysen-Osborn M, et al. Curated collections for educators: five key papers about program evaluation. Cureus. 2017;9(5):e1224.
   Web of Science ®Google Scholar
• Goldie J. Evaluating educational programmes, AMEE Education Guide no. 29. Med Teach. 2006;28(3):210–224. doi:10.1080/01421590500271282
   PubMed Web of Science ®Google Scholar
• Cook DA. Twelve tips for evaluating educational programs. Med Teach. 2010;32(4):296–301. doi:10.3109/01421590903480121
   PubMed Web of Science ®Google Scholar
• Cook DA, Steinert Y. Online learning for faculty development: a review of the literature. Med Teach. 2013;35::930–937. doi:10.3109/0142159X.2013.827328
   Web of Science ®Google Scholar
• Leslie K, Baker L, Egan-Lee E, Esdaile M, Reeves S. Advancing faculty development in medical education: a systematic review. Acad Med. 2013;88(7):1038–1045. doi:10.1097/ACM.0b013e318294fd29
   PubMed Web of Science ®Google Scholar
• Swanwick T. See one, do one, then what? Faculty development in postgraduate medical education. Postgrad Med J. 2008;84:339–343. doi:10.1136/pgmj.2008.068288
   PubMed Web of Science ®Google Scholar
• Kemmis S, McTaggart R. Participatory Action Research: Communicative Action and the Public Sphere. In: Denzin NK, Lincoln YS, editors. The Sage Handbook of Qualitative Research. Thousand Oaks, CA, USA: Sage Publications Ltd; 2005:559-603.
   Google Scholar
• Parker K, Burrows G, Nash H, Rosenblum ND. Going beyond Kirkpatrick in evaluating a clinician scientist program: it’s not “if it works” but “how it works. Acad Med. 2011;86:1389–1396. doi:10.1097/ACM.0b013e31823053f3
   PubMed Web of Science ®Google Scholar
• Yelon SL, Ford JK, Anderson WA. Twelve tips for increasing transfer of training from faculty development programs. Med Teach. 2014;36(11):945–950. doi:10.3109/0142159X.2014.929098
   PubMed Web of Science ®Google Scholar
• Pawson R, Tilley N. Realistic Evaluation. London: Sage; 1997.
   Google Scholar
• Stufflebeam DL. The CIPP Model for Program Evaluation. In: Madaus FF, Scriven M, Stufflebeam DL, editors. Evaluation Models: Viewpoints on Educational and Human Services Evaluation. Kluwer: Norwell; 1983:117–141.
   Google Scholar
• Kraiger K. Decision-Based Evaluation. Creating, Implementing and Managing Effective Training and Development. State-Of-The-Art Lessons for Practice. San Francisco: Jossey-Bass; 2002.
   Google Scholar
• Kirkpatrick D. Evaluating Training Programs : The Four Levels. San Francisco: Berrett-Koehler; 1998.
   Google Scholar
• Stufflebeam D, Shinkfield A. Evaluation Theory, Models, & Applications. San Francisco: Jossey Bass/John Wiley & Sons, Inc; 2007.
   Google Scholar
• Sturmberg JP, Martin CM, editors. Complexity in health: an introduction. In: Handbook of Systems and Complexity in Health. New York, NY, USA: Springer Science+Business Media; 2013:1–17.
   Google Scholar
• Fullan M. The New Meaning of Educational Change. 3rd ed. New York: Teachers College; 2001.
   Google Scholar
• Kumar K, Greenhill J. Factors shaping how clinical educators use their educational knowledge and skills in the clinical workplace: a qualitative study. BMC Med Educ. 2016;16(68):1–7. doi:10.1186/s12909-015-0506-z
   Web of Science ®Google Scholar
• Brown J, Collins A, Duguid P. Situated cognition and the culture of learning. Educ Res. 1989;18:32–42. doi:10.3102/0013189X018001032
   Google Scholar
• Stalmeijer R, Dolmans DHJM, Ham S-B, Van Santen-Hoeuff M, Wolfhagen IHAP, Scherpbier AJJA. Clinical teaching based on principles of cognitive apprenticeship: views of experienced clinical teachers. Acad Med. 2013;88:1–5. doi:10.1097/ACM.0b013e31828fff12
   Web of Science ®Google Scholar
• Kogan JR, Conforti LN, Yamazaki K, Lobst W, Holmboe ES. Commitment to change and challenges to implementing changes after workplace based assessment rater training. Acad Med. 2017;92:394–402. doi:10.1097/ACM.0000000000001319
   PubMed Web of Science ®Google Scholar
• Ingham G, Fry J, O’Meara P, Tourle V. Why and how do general practitioners teach? An exploration of the motivations and experiences of rural Australian general practitioner supervisors. BMC Med Educ. 2015;15(190): EarlyOnline. doi:10.1186/s12909-015-0474-3
   Web of Science ®Google Scholar
• Dotters-Katz S, Hargette CW, Zaas AK, Cricione-Schreiber LG. What motivates residents to teach? The Attitudes in Clinical Teaching study. Med Educ. 2016;50:768–777. doi:10.1111/medu.13075
   PubMed Web of Science ®Google Scholar
• Slade B. Professional learning in rural practice: a sociomaterial analysis. Journal of Workplace Learning. 2013;25(2):114–124. doi:10.1108/13665621311299799
   Google Scholar
• Raemdonck I, Gijbels D, van Groen W. The influence of job characteristics and selfdirected learning orientation on workplace learning. International Journal of Training and Development. 2014;18(3):188–203. doi:10.1111/ijtd.2014.18.issue-3
   Google Scholar
• Prideaux D, Alexander H, Bower A, et al. Clinical teaching: maintaining an educational role for doctors in the new health care environment. Med Educ. 2000;34:820–826.
   PubMed Web of Science ®Google Scholar
• Irby D, Bowen J. Time-efficient strategies for learning and performance. Clin Teach. 2004;1:23–28. doi:10.1111/j.1743-498X.2004.00013.x
   Google Scholar
• Audétat MC, Laurin S. Clinicien et superviseur, même combat !. Le Médecin du Québec. 2010;45(5):53–57.
   Google Scholar
• M-C A, Grégoire G, Fernandez N, Laurin S. From intuition to professionalization: a qualitative study about the development of teacher identity in internal medicine senior residents. Int J Health Educ. 2017;1(1):5–12. doi:10.17267/2594-7907ijhe.v1i1.1234
   Google Scholar
• Steinert Y, Mann K, Centeno A, et al. systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach. 2006;28(6):497–526. doi:10.1080/01421590601102956
   PubMed Web of Science ®Google Scholar
• Audétat MC, Faguy A, Jacques A, Blais J, Charlin B. Étude exploratoire des perceptions et pratiques de médecins cliniciens enseignants engagés dans une démarche de diagnostic et de remédiation des lacunes du raisonnement clinique. Pédagogie Médicale. 2011;12(1):7–16. doi:10.1051/pmed/2011014
   Google Scholar
• Higgs J, Mc Allister L. Being a Clinical Educator. Adv Health Sci Educ. 2006;12:187. doi:10.1007/s10459-005-5491-2
   PubMed Web of Science ®Google Scholar
• Cruess RL, Cruess SR, Boudreau JD, Steinert Y. Reframing Medical Education to Support Professional Identity Formation. Acad Med. 2014;89(11):1446–1451. doi:10.1097/ACM.0000000000000427
   PubMed Web of Science ®Google Scholar
• Jarvis-Selinger S, Pratt D, Regehr G. Competency is not enough: integrating identity formation into the medical education discourse. Acad Med. 2012;87:1185–1190. doi:10.1097/ACM.0b013e3182604968
   PubMed Web of Science ®Google Scholar
• Hafferty F. Professionalism and the socialization of medical students. In: Cruess RL, Steinert Y, editors. Teaching Medical Professionalism. Cambridge UK: Cambridge University Press; 2009:53–73.
   Google Scholar
• Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923–1958. doi:10.1016/S0140-6736(10)61854-5
   PubMed Web of Science ®Google Scholar
• Starr S, Ferguson WJ, Haley HL, Quirk M. Community preceptors’ views of their identities as teachers. Acad Med. 2003;78(8):820–825.
   PubMed Web of Science ®Google Scholar
• Starr S, Haley HL, Mazor K, Ferguson W, Philbin M, Quirk M. Initial testing of an instrument to measure teacher identity in physicians. Teaching and Learning in Medicine 2006. 2006;18(2):117–125. doi:10.1207/s15328015tlm1802_5
   PubMed Web of Science ®Google Scholar
• Monrouxe LV. Identity, identification and medical education: why should we care?. Med Educ. 2010;44(1):40–49. doi:10.1111/j.1365-2923.2009.03440.x
   PubMed Web of Science ®Google Scholar
• Ramani S, Leinster S. Teaching in the clinical environment: AMEE Guide No 34. Med Teach. 2008;30:347–364. doi:10.1080/01421590802061613
   PubMed Web of Science ®Google Scholar
• Lachman N, Christensen KN, Pawlina W. Anatomy teaching assistants: facilitating teaching skills for medical students through apprenticeship and mentoring. Med Teach. 2013;35(1):e919. doi:10.3109/0142159X.2012.714880
   PubMed Web of Science ®Google Scholar
• Bing-You RG, Blondeau W, Dreher GK, Irby DM. T2 (teaching & thinking)-in-action skills of highly rated medical teachers: how do we help faculty attain that expertise?. Innovations in Education and Teaching International. 2015;52:1–9.
   Google Scholar
• Orlander JD, Gupta M, Fincke BG, Manning ME, Hershman W. Co-teaching: a faculty development strategy. Med Educ. 2000;34:257–265.
   PubMed Web of Science ®Google Scholar
• Verma S, Flynn L, Faculty’s SR. Residents’ Perceptions of teaching and evaluating the role of health advocate: a study at one Canadian university. Acad Med. 2005;80(1):103–108.
   PubMed Web of Science ®Google Scholar
• Bourdieu P. The Logic of Practice. Cambridge, UK: Polity Press; 1990.
   Google Scholar
• Goldie J. The formation of professional identity in medical students: considerations for educators. Med Teach. 2012;34(9): e641-e648. doi:10.3109/0142159X.2012.687476
   Web of Science ®Google Scholar
• Baker GR. Evidence Boost: A Review of Research Highlighting How Patient Engagement Contributes to Improved Care. Ottawa (ON): Canadian Foundation for Healthcare Improvement; 2014.
   Google Scholar
• Karazivan P, Dumez V, Flora L, et al. The patient-as-partner approach in health care: a conceptual framework for a necessary transition. Acad Med. 2015;90:4. doi:10.1097/ACM.0000000000000603
   Web of Science ®Google Scholar
• Pomey M-P, Ghadiri DP, Karazivan P, Fernandez N, Clavel N. Patients as partners: a qualitative study of patients’ engagement in their health care. PLOSone. 2015;10(4):e01–19. doi:10.1371/journal.pone.0122499
   Web of Science ®Google Scholar
• Abu-Rish E, Kim S, Choe L, et al. Current trends in interprofessional education of health sciences students: a literature review. J Interprof Care. 2012;26(6):444–451. doi:10.3109/13561820.2012.715604
   PubMed Web of Science ®Google Scholar
• Thistlethwaite J. Interprofessional education: a review of context, learning and the research agenda. Med Educ. 2012;46(1):58–70. doi:10.1111/j.1365-2923.2011.04143.x
   PubMed Web of Science ®Google Scholar
• Hugh Barr H. Enigma variations: Unraveling interprofessional education in time and place. J Interprof Care. 2013;27(Supl2): 9-13. doi: 10.3109/13561820.2013.766157.
   Google Scholar
• Reeves S, Hean S. Why we need theory to help us better understand the nature of interprofessional education, practice and care. J Interprof Care. 2013;27(1):1–3. doi:10.3109/13561820.2013.751293
   Web of Science ®Google Scholar
• Steinert Y. Commentary: faculty development: the road less traveled. Acad Med. 2011;86(4):409–411. doi:10.1097/ACM.0b013e31820c6fd3
   PubMed Web of Science ®Google Scholar
• Skeff K, Stratos G, Mygdal W, et al. Clinical teaching improvement: past and future for faculty Development. Fam Med. 1997;29:252–257.
   PubMedGoogle Scholar
• Sutkin G, Wagner E, Harris I, Schiffer R. What makes a good clinical teacher in medicine? A review of the literature. Acad Med. 2008;83(5):452–466. doi:10.1097/ACM.0b013e31816bee61
   PubMedGoogle Scholar
• Srinivasan M, Le S, Meyers FJ, et al. Teaching as a Competency”: competencies for Medical Educators. Acad Med. 2011;86(10):1211–1220. doi:10.1097/ACM.0b013e31822c5b9a
   PubMed Web of Science ®Google Scholar
• Giddens A. The Constitution of Society. Oakland, CA: University of California Press; 1986.
   Google Scholar
• Joynes VCT. Defining and understanding the relationship between professional identity and interprofessional responsibility: implications for educating health and social care students. Advances in Health Sciences Education. 2017;23:133–149. doi:10.1007/s10459-017-9778-x
   Web of Science ®Google Scholar
• Schultz K, Griffiths J, Lacasse M. The application of entrustable professional activities to inform competency decisions in a family medicine residency program. Acad Med. 2015;90(7):888–897. doi:10.1097/ACM.0000000000000671
   Web of Science ®Google Scholar