Core principles of assessment in competency-based medical education

References

• Archer JC. 2010. State of the science in health professional education: effective feedback. Med Educ. 44:101–108.
   PubMed Web of Science ®Google Scholar
• Berendonk C, Stalmeijer RE, Schuwirth LWT. 2013. Expertise in performance assessment: assessors’ perspectives. Adv Health Sci Educ Theory Pract. 18:559–571.
   PubMed Web of Science ®Google Scholar
• Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: from Flexner to competencies. Acad Med. 77:361–367.
   PubMed Web of Science ®Google Scholar
• Courts B, Tucker J. 2012. Using technology to create a dynamic classroom experience. TLC. 9:121–128.
   Google Scholar
• Dewey J. 1974. John Dewey on education: selected writings. Chicago: University of Chicago Press.
   Google Scholar
• Dijkstra J, van der Vleuten CPM, Schuwirth LWT. 2010. A new framework for designing programmes of assessment. Adv Health Sci Educ Theory Pract. 15:379–393.
   PubMed Web of Science ®Google Scholar
• Eva KW. 2005. What every teacher needs to know about clinical reasoning. Med Educ. 39:98–106.
   PubMed Web of Science ®Google Scholar
• Eva K, Bordage G, Campbell C, Galbraith R, Ginsberg S, Holmboe E, Regehr G. 2013. Report to the Medical Council of Canada on current issues in health professional and health professional trainee assessment [Internet]. Ottawa: Medical Council of Canada; [cited 2014 Sep 4]. Available from: http://mcc.ca/wp-content/uploads/Reports-MEAAC.pdf.
   Google Scholar
• Eva KW, Hodges BD. 2012. Scylla or charbydis? Can we navigate between objectification and judgement in assessment? Med Educ. 46:414–419.
   Web of Science ®Google Scholar
• Eva KW, Regehr G. 2005. Self-assessment in the health professions: a reformulation and research agenda. Acad Med. 80:S46–S54.
   PubMed Web of Science ®Google Scholar
• Eva KW, Regehr G. 2007. Knowing when to look it up: a new conception of self-assessment ability. Acad Med. 82(10 Suppl):S81–S84.
   Web of Science ®Google Scholar
• Eva KW, Regehr G. 2008. “I'll never play professional football”; and other fallacies of self-assessment. J Contin Educ Health Prof. 28:14–19.
   PubMed Web of Science ®Google Scholar
• Felkey BG, Fox BI, Thrower MR. 2005. Health care informatics: a skills-based resource. Washington: American Pharmacists Association.
   Google Scholar
• Frank JR, Danoff D. 2007. The CanMEDs initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 29:642–647.
   PubMed Web of Science ®Google Scholar
• Friedman Ben David M, Davis MH, Harden RM, Howie PW, Ker J, Pippard MJ. 2001. AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment. Med Teach. 23:535–551.
   PubMed Web of Science ®Google Scholar
• General Medical Council. 2013. Good Medical Practice: Working with doctors, working with patients [Internet]. General Medical Council: Manchester; [cited 2014 Oct 28]. Available from: www.gmc-uk.org/guidance.
   Google Scholar
• Gingerich A, Regehr G, Eva KW. 2011. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 86:S1–S7.
   PubMed Web of Science ®Google Scholar
• Govaerts MJB, Schuwirth LWT, van der Vleuten CPM, Muijtjens AMM. 2011. Workplace-based assessment: effects of rater expertise. Adv Health Sci Educ. 16:151–165.
   PubMed Web of Science ®Google Scholar
• Govaerts M, van der Vleuten CPM. 2013. Validity in work-based assessment: expanding our horizons. Med Educ. 47:1164–1174.
   PubMed Web of Science ®Google Scholar
• Govaerts MJB, van de Wiel MWJ, Schuwirth LWT, van der Vleuten CPM, Muijtjens AMM. 2013. Workplace-based assessment: raters’ performance theories and constructs. Adv Health Sci Educ. 18:375–396.
   PubMed Web of Science ®Google Scholar
• Harris P, Bhanji F, Topps M, Ross S, Lieberman S, Frank JR, Snell L, Sherbino J; ICBME Collaborators. 2017. Evolving concepts of assessment in a competency-based world. Med Teach. 39:603--608.
   PubMed Web of Science ®Google Scholar
• Hawkins RE, Durning SJ. 2017. Program evaluation. In: Holmboe ES, Durning SJ, Hawkins RE, editors. Practical guide to the evaluation of clinical competence. 2nd ed. Philadelphia: Elsevier; p. 303–331.
   Google Scholar
• Hemmer PA, Hawkins R, Jackson JL, Pangaro LN. 2000. Assessing how well three evaluation methods detect deficiencies in medical students' professionalism in two settings of an internal medicine clerkship. Acad Med. 75:167–173.
   PubMed Web of Science ®Google Scholar
• Hicks PJ, Schwartz A, Clyman SG, Nichols DG. 2014. The Pediatrics Milestones: pursuit of a national system of workplace-based assessment through key stakeholder collaboration. Acad Pediatr. 14:S10–S12.
   PubMed Web of Science ®Google Scholar
• Hodges B. 2013. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 35:564–568.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Davis MH, Carraccio C. 2008. Portfolios. In: Holmboe ES, RE Hawkins RE, editors. Practical guide to the evaluation of clinical competence. Philadelphia: Mosby.
   Google Scholar
• Holmboe ES, Hawkins RE, Huot SJ. 2004. Effects of training in direct observation of medical residents' clinical competence: a randomized trial. Ann Intern Med. 140:874–881.
   PubMed Web of Science ®Google Scholar
• Kane MT. 2013. Validating the interpretations and uses of test scores. J Educ Meas. 50:1–73.
   Web of Science ®Google Scholar
• Knowles M. 1975. Self-directed learning: a guide for learners and teachers. New York: Pearson Learning/Cambridge Adult Education.
   Google Scholar
• Kogan JR, Conforti LN, Iobst WF, Holmboe ES. 2014. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med. 89:721–727.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Holmboe E. 2013. Realizing the promise and importance of performance-based assessment. Teach Learn Med. 25:S68–S74.
   PubMed Web of Science ®Google Scholar
• Lievens F. 2001. Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity. J Appl Psychol. 86:255–264.
   PubMed Web of Science ®Google Scholar
• Miller GM. 1990. The assessment of clinical skills/competence/performance. Acad Med. 65:S63–S67.
   PubMed Web of Science ®Google Scholar
• Nasca TJ, Philibert I, Brigham T, Flynn TC. 2012. The next GME accreditation system-rationale and benefits. N Engl J Med. 366:1051–1056.
   PubMed Web of Science ®Google Scholar
• Norcini J, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, Galbraith R, Hays R, Kent A, Perrott V, et al. 2011. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 33:206–214.
   PubMed Web of Science ®Google Scholar
• Nyquist JG. 2014. Techniques for assessment of learner performance in teaching and assessing the competencies, 10th ed. Los Angeles: University of Southern California.
   Google Scholar
• Pawson R. 2013. The science of evaluation: a realist manifesto. London: Sage Publications.
   Google Scholar
• Pawson R, Tilley N. 1997. Realistic evaluation. San Francisco: Sage Publications.
   Google Scholar
• Pelgrim EAM, Kramer AWM, Mokkink HGA, van der Vleuten CPM. 2013. Reflection as a component of formative assessment appears to be instrumental in promoting the use of feedback: an observational study. Med Teach. 35:772–778.
   PubMed Web of Science ®Google Scholar
• Ponnamperuma G. 2013. Workplace based assessment. In: Walsh E, editor. Oxford textbook of medical education. Oxford: Oxford University Press.
   Google Scholar
• Regehr G, MacRae H, Reznick RKS, D. 1998. Comparing psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 73:993–997.
   PubMed Web of Science ®Google Scholar
• Sargeant J, Armson H, Chesluk B, Dornan T, Eva K, Holmboe E, Lockyer J, Loney E, Mann K, van der Vleuten CP. 2010. The processes and dimensions of informed self-assessment: a conceptual model. Acad Med. 85:1212–1220.
   PubMed Web of Science ®Google Scholar
• Sargeant J, Eva KW, Armson H, Chesluk B, Dornan T, Holmboe E, Lockyer JM, Loney E, Mann KV, van der Vleuten CP. 2011. Features of assessment learners use to make informed self-assessments of clinical performance. Med Educ. 45:636–647.
   PubMed Web of Science ®Google Scholar
• Schumacher DJ, Spector ND, Calaman S, West DC, Cruz M, Frohna JG, Gonzalez Del Ray Gustafson KK, Poynter SE, Rosenbluth G, et al. 2014. Putting the pediatrics milestones into practice: a consensus roadmap and resource analysis. Pediatrics. 133:898–906.
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, Ash J. 2013. Assessing tomorrow’s learners: in competency-based education only a radically different holistic method of assessment will work. Six things we could forget. Med Teach. 35:555–559.
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, van der Vleuten CPM. 2006. A plea for new psychometric models in educational assessment. Med Educ. 40:296–300.
   PubMed Web of Science ®Google Scholar
• Schwind CJ, Williams RG, Boehler ML, Dunnington GL. 2004. Do individual attendings' post-rotation performance ratings detect residents' clinical performance deficiencies? Acad Med. 79:453–457.
   PubMed Web of Science ®Google Scholar
• Smithers JW. 1998. Performance appraisal: state of the art in practice. San Francisco: Jossey-Bass.
   Google Scholar
• Surowiecki J. 2005. The wisdom of crowds. New York: Anchor Books.
   Google Scholar
• Swing SR. 2007. The ACGME outcome project: retrospective and prospective. Med Teach. 29:648–654.
   PubMed Web of Science ®Google Scholar
• ten Cate O, Scheele F. 2007. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 82:542–547.
   PubMed Web of Science ®Google Scholar
• ten Cate O. 2013. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 5:157–158.
   PubMedGoogle Scholar
• van der Vleuten CPM. 1996. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1:41–67.
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Schuwirth LWT. 2005. Assessing professional competence: from methods to programmes. Med Educ. 39:309–317.
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Schuwirth LWT, Driessen EW, Dijkstra J, Tigelaar D, Baartman LKJ, van Tartwijk J. 2012. A model for programmatic assessment fit for purpose. Med Teach. 34:205–214.
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Schuwirth LWT, Scheele F, Driessen EW, Hodges B. 2010. The assessment of professional competence: building blocks for theory development. Best Pract Res Clin Obstet Gynaecol. 24:703–719.
   PubMed Web of Science ®Google Scholar
• van Tartwijk J, Driessen EW. 2009. Portfolios for assessment and learning: AMEE Guide no. 45. Med Teach. 31:790–801.
   PubMed Web of Science ®Google Scholar
• Watling C, Driessen E, van der Vleuten CPM, Vanstone M, Lingard L. 2012. Understanding responses to feedback: the potential and limitations of regulatory focus theory. Med Educ. 46:593–603.
   PubMed Web of Science ®Google Scholar
• Woehr DJ, Huffcutt AI. 1994. Rater training for performance appraisal: a quantitative review. J Occup Org Psych. 67:189–205.
   Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva KW. 2012. Effect of exposure to good vs poor medical trainee performance on attending physician ratings of subsequent performances. JAMA. 308:2226–2232.
   PubMed Web of Science ®Google Scholar