Programmatic assessment: From assessment of learning to assessment for learning

References

• ACGME 2007. [Published 2008 September 28]. Available from: http://www.acgme.org/outcome/comp/compCPRL.asp.Chicago
   Google Scholar
• Albanese MA, Mejicano G, Mullan P, Kokotailo P, Gruppen L. Defining characteristics of educational competencies. Med Educ 2008; 42: 248–255
   PubMed Web of Science ®Google Scholar
• Baartman LKJ. Assessing the assessment. ETEC, Open University, HeerlenThe Netherlands 2008
   Google Scholar
• Berk RA. A consumers’ guide to criterion-referenced test reliability. J Educ Meas 1980; 17: 323–349
   Web of Science ®Google Scholar
• Boud D. Assessment and the promotion of academic values. Stud High Educ 1990; 15: 101–111
   Web of Science ®Google Scholar
• Brown S. Assessment for learning. Learn Teach Higher Ed 2004; 1: 81–89
   Google Scholar
• CanMeds. 1996. Available from http://rcpsc.medical.org/publications/index.php#canmeds. Ottawa
   Google Scholar
• Carr S. The foundation programme assessment tools: An opportunity to enhance feedback to trainees?. Postgrad Med J 2006; 82: 576–579
   PubMed Web of Science ®Google Scholar
• Cilliers FJ, Schuwirth LWT, Adendorff HJ, Herman N, Van Der Vleuten CPM. The mechanisms of impact of summative assessment on medical students’ learning. Adv Health Sci Educ Theory Pract 2010; 15(5): 695–715
   Google Scholar
• Cilliers FJ, Schuwirth LWT, Herman N, Adendorff HJ, van der Vleuten CPM. A model of the sources, consequences and mechanism of impact of summative assessment on how students learn. Adv Health Sci Educ. DOI: 10.1007/s10459-011-9292-5
   Google Scholar
• Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull 1955; 52: 281–302
   PubMed Web of Science ®Google Scholar
• Cusimano MD. Standard setting in medical education. Acad Med 1996; 71: S112–S120
   PubMed Web of Science ®Google Scholar
• Dannefer EF, Henson LC. The portfolio approach to competency-based assessment at the Cleveland Clinic Lerner College of Medicine. Acad Med 2007; 82: 493–502
   PubMed Web of Science ®Google Scholar
• Davies H, Archer J, Heard S, Southgate L. Assessment tools for foundation programmes – a practical guide. BMJ Career Focus 2005; 330: 195–196
   Google Scholar
• Dawes RM, Faust D, Meehl PE. Clinical versus actuarial judgment. Science 1989; 243: 1668–1674
   PubMed Web of Science ®Google Scholar
• Dijkstra J, Galbraith R, Hodges B, Mcavoy P, McCrorie P, Southgate L, van der Vleuten CPM, Wass V, Schuwirth LWT. Development and validation of guidelines for designing programmes of assessment: A modified Delphi-study (submitted)
   Google Scholar
• Dijkstra J, Van Der Vleuten CPM, Schuwirth LWT. A new framework for designing programmes of assessment. Adv Health Sci Educ Theory Pract 2009; 15(3): 379–393
   Google Scholar
• Driessen E, Van Der Vleuten CPM, Schuwirth LWT, Van Tartwijk J, Vermunt J. The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: A case study. Med Educ 2005; 39: 214–220
   PubMed Web of Science ®Google Scholar
• Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002; 287: 226–235
   PubMed Web of Science ®Google Scholar
• Ericsson KA, Charness N. Expert performance. Am Psychol 1994; 49: 725–747
   Web of Science ®Google Scholar
• Eva KW. What every teacher needs to know about clinical reasoning. Med Educ 2004; 39: 98–106
   Web of Science ®Google Scholar
• Fishleder AJ, Henson LC, Hull AL. Cleveland Clinic Lerner College of Medicine: An innovative approach to medical education and the training of physician investigators. Acad Med 2007; 82: 390–396
   PubMed Web of Science ®Google Scholar
• Govaerts MJB. Educational competencies or education for professional competence?. Med Educ 2008; 42: 234–236
   PubMed Web of Science ®Google Scholar
• Govaerts MJB, Schuwirth LWT, Van Der Vleuten CPM, Muijtjens AMM. 2011. Workplace-based assessment: Effects of rater expertise. Adv Health Sci Educ 16:151–165
   Google Scholar
• Govaerts MJB, Van Der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sci educ 2007; 12: 239–260
   PubMed Web of Science ®Google Scholar
• Harden RM, Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979; 13: 41–54
   PubMed Web of Science ®Google Scholar
• Kane MT. Validation. Educational measurement, RL Brennan. ACE/Praeger, Westport 2006; 17–64
   Google Scholar
• Klein G. Naturalistic decision making. Hum Factors 2008; 50: 456–460
   PubMed Web of Science ®Google Scholar
• Koretz D. Large-scale portfolio assessments in the US: Evidence pertaining to the quality of measurement. Assessment Educ 1998; 5: 309–334
   Google Scholar
• Marewski JN, Gaissmaier W, Gigerenzer G. Good judgements do not require complex cognition. Cogn Process 2009; 11: 103–121
   PubMedGoogle Scholar
• Martinez ME, Lipson JI. Assessment for learning. Educ Leader 1989; 47: 73–75
   Google Scholar
• Messick S. The interplay of evidence and consequences in the validation of performance assessments. Educ Res 1994; 23: 13–23
   Google Scholar
• Metz JCM, Pels Rijcken Van Erp Taalman Kip EH, Van De Brand Valkenburg BWM. 1994. Raamplan 1994, eindtermen van de artsenopleiding [Blueprint 1994, endgoals for the education of doctors], Nijmegen, The Netherlands: Univesitair Publicatiebureau
   Google Scholar
• Newble DI, Baxter A, Elsmlie RG. A comparison of multiple-choice tests and free-response tests in examinations of clinical competence. Med Educ 1979; 13: 263–268
   PubMed Web of Science ®Google Scholar
• Norcini J, Blank LL, Arnold GK, Kimball HR. The Mini-CEX (Clinical Evaluation Exercise); A preliminary investigation. Ann Intern Med 1995; 123: 795–799
   PubMed Web of Science ®Google Scholar
• Norman G, Swanson D, Case S. Conceptual and methodology issues in studies comparing assessment formats, issues in comparing item formats. Teach Learn Med 1996; 8: 208–216
   Web of Science ®Google Scholar
• Norman G, Tugwell P, Feightner J, Muzzin L, Jacoby L. Knowledge and clinical problem-solving. Med Educ 1985; 19: 344–356
   PubMed Web of Science ®Google Scholar
• Painvin C, Neufeld V, Norman G, Walker I, Whelan G. The “triple jump” exercise: A structured measure of problem solving and self-directed learning. Proceedings of the Eighteenth Annual Conference on Research in Medical Education, November 6–7, Washington, DC, 1979; 18: 73–77
   PubMedGoogle Scholar
• Plous S. The psychology of judgment and decision making. McGraw-Hill Inc, New Jersey 1993
   Google Scholar
• Prescott L, McKinlay P, Rennie J. The development of an assessment system for dental vocational training and general professional training: A Scottish approach. Br Dent J 2001; 190: 41–44
   PubMedGoogle Scholar
• Prescott L, Norcini J, Mckinlay P, Rennie J. Facing the challenges of competency-based assessment of postgraduate dental training: Longitudinal evaluation of performance (LEP). Med Educ 2002; 36: 92–97
   PubMed Web of Science ®Google Scholar
• Ram P. Comprehensive assessment of general practitioners. General practice. University of Maastricht, Maastricht 1998
   Google Scholar
• Rickets C. A plea for the proper use of criterion-referenced test in medical assessment. Med Educ 2009; 53: 1141–1146
   Google Scholar
• Schmidt HG, Boshuizen HP. On acquiring expertise in medicine. Special issue: European educational psychology. Educ Psychol Rev 1993; 5: 205–221
   Web of Science ®Google Scholar
• Schuwirth LWT, Muijtjens AMM, Ricketts C, The matrix unloaded: Various models to determine reliability or universe representation (submitted)
   Google Scholar
• Schuwirth LWT, Southgate L, Page GG, Paget NS, Lescop JMJ, Lew SR, Wade WB, Baron-Maldonado M. When enough is enough: A conceptual basis for fair and defensible practice performance assessment. Med Educ 2002; 36: 925–930
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, Van Der Vleuten CPM. A plea for new psychometrical models in educational assessment. Med Educ 2006; 40: 296–300
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, Vleuten CPMVD, Donkers HHLM. A closer look at cueing effects in multiple-choice questions. Med Educ 1996; 30: 44–49
   PubMed Web of Science ®Google Scholar
• Shepard L. The role of assessment in a learning culture. Educ Res 2009; 29: 4–14
   Google Scholar
• Shute VJ. Focus on formative feedback. Rev Educ Res 2008; 78: 153–189
   Web of Science ®Google Scholar
• Van Der Vleuten CPM. The assessment of professional competence: Developments, research and practical implications. Adv Health Sci Educ 1996; 1: 41–67
   PubMed Web of Science ®Google Scholar
• Van Der Vleuten CPM, Norman GR, De Graaf E. Pitfalls in the pursuit of objectivity: Issues of reliability. Med Educ 1991; 25: 110–118
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: From methods to programmes. Med Educ 2005; 39: 309–317
   PubMed Web of Science ®Google Scholar
• Van Merrienboer JJ, Sweller J. Cognitive load theory in health professional education: Design principles and strategies. Med Educ 2010; 44: 85–93
   PubMed Web of Science ®Google Scholar
• Ward WC. A comparison of free-response and multiple-choice forms of verbal aptitude tests. Appl Psych Meas 1982; 6: 1–11
   Web of Science ®Google Scholar