Content validity of workplace-based portfolios: A multi-centre study

References

• Amsellem-Ouazana D, Van Pee D, Godin V. 2007. Utilisation du portfolio au cours du deuxième cycle des études médicales dans un service d'urologie [Use of a portfolio during the second cycle of medical studies in a urology department]. Prog Urol 17:978–982
   PubMed Web of Science ®Google Scholar
• Biggs J, Tang C. 2011. Teaching for quality learning at university. Buckingham: Open University Press/McGraw Hill
   Google Scholar
• Braun V, Clarke V. 2006. Using thematic analysis in psychology. Qual Res Psychol 3:77–101
   Google Scholar
• Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, Morley D, Pollard D, Ashcroft T, Popovic C, Sayers J. 2009. The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach 31:282–298
   PubMed Web of Science ®Google Scholar
• CanMEDS. 2000. Extract from the CanMEDS 2000 project societal needs working group report. Med Teach 22:549–554
   PubMed Web of Science ®Google Scholar
• Carraccio C, Englander R. 2004. Evaluating competence using a portfolio: A literature review and Web-based application to the ACGME competencies. Teach Learn Med 16:381–387
   PubMed Web of Science ®Google Scholar
• Challis M. 1999. AMEE guide n°11 (revised): Portfolio-based learning and assessment in medical education. Med Teach 21:370–386
   Web of Science ®Google Scholar
• Chou S, Cole G, Mclaughlin K, Lockyer J. 2008. CanMEDS evaluation in Canadian postgraduate training programmes: Tools used and programme director satisfaction. Med Educ 42:879–886
   PubMed Web of Science ®Google Scholar
• Colbert CY, Ownby AR, Butler PM. 2008. A review of portfolio use in residency programs and considerations before implementation. Teach Learn Med 20:340–345
   PubMed Web of Science ®Google Scholar
• Davis MH, Friedman Ben-David M, Harden RM, Howie P, Ker J, Mcghee C, Snadden D. 2001. Portfolio assessment in medical students' final examinations. Med Teach 23:357–366
   PubMed Web of Science ®Google Scholar
• Dobson S, Voyer S, Regher G. 2012. Perspective: Agency and activism: Rethinking health advocacy in the medical profession. Acad Med 87:1161–1164
   PubMed Web of Science ®Google Scholar
• Downing SM. 2003. Validity: On the meaningful interpretation of assessment data. Med Educ 37:830–837
   PubMed Web of Science ®Google Scholar
• Driessen EW, Overeem K, Van Tartwijk J, Van Der Vleuten CP, Muijtjens AM. 2006. Validity of portfolio assessment: Which qualities determine ratings? Med Educ 40:862–866
   PubMed Web of Science ®Google Scholar
• Driessen EW, Van Tartwijk J, Govaerts M, Teunissen P, Van Der Vleuten CPM. 2012. The use of programmatic assessment in the clinical workplace: A Maastricht case report. Med Teach 34:226–231
   PubMed Web of Science ®Google Scholar
• Driessen EW, Van Tartwijk J, Van Der Vleuten C, Wass V. 2007. Portfolios in medical education: Why do they meet with mixed success? A systematic review. Med Educ 41:1224–1233
   PubMed Web of Science ®Google Scholar
• Epstein RM. 2007. Assessment in medical education. N Engl J Med 356:387–396
   PubMed Web of Science ®Google Scholar
• Fleiss JL. 1981. Statistical methods for rates and proportions. New York: Wiley
   Google Scholar
• Frank J, editor. 2005. The CanMEDS 2005 physician competency framework. Better standards. Better physicians. Better care. Ottawa: The Royal College of Physicians and Surgeons of Canada
   Google Scholar
• Frank J, Snell L, Sherbino J, editors. 2015. The draft CanMEDS 2015 physician competency framework – Series IV. Ottawa: The Royal College of Physicians and Surgeons of Canada
   Google Scholar
• Frank J, Snell L, Sherbino J, et al. 2014. Draft CanMEDS 2015 milestones guide. Ottawa.
   Google Scholar
• Friedman Ben David M, Davis MH, Harden RM, Howie PW, Ker J, Pippard MJ. 2001. AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment. Med Teach 23:535–551
   PubMed Web of Science ®Google Scholar
• Gordon J. 2003. Assessing students' personal and professional development using portfolios and interviews. Med Educ 37:335–340
   PubMed Web of Science ®Google Scholar
• Harden RM, Crosby JR, Davis MH, Friedman M. 1999. AMEE guide no. 14: Outcome-based education: Part 5 – From competency to meta-competency: A model for the specification of learning outcomes. Med Teach 21:546–552
   PubMed Web of Science ®Google Scholar
• Haynes SN, Richard DCS, Kubany ES. 1995. Content validity in psychological assessment: A functional apporach to concepts and methods. Psychol Assess 7:238–247
   Web of Science ®Google Scholar
• Kane M. 2001. Current concerns in validity theory. J Educat Meas 38:319–342
   Web of Science ®Google Scholar
• Kane M. 2006a. Content-related validity evidence. In: Downing SM, Haladyna TM, editors. Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates
   Google Scholar
• Kane M. 2006b. Validation. In: Brennan R, editor. Educational measurement (4th ed.). Westport, CT: American Council on Education/Praeger
   Google Scholar
• Kear ME, Bear M. 2007. Using portfolio evaluation for program outcome assessment. J Nurs Educ 46:109–114
   Google Scholar
• Mathers NJ, Challis MC, Howe AC, Field NJ. 1999. Portfolios in continuing medical education – effective and efficient? Med Educ 33:521–530
   PubMed Web of Science ®Google Scholar
• Mccready T. 2007. Portfolios and the assessment of competence in nursing: A literature review. Int J Nurs Stud 44:143–151
   PubMed Web of Science ®Google Scholar
• Messick S. 1995. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. Am Psychoh 50:741–749
   Web of Science ®Google Scholar
• Michels NR, Denekens J, Driessen EW, Van Gaal LF, Bossaert LL, De Winter BY. 2012. A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment. BMC Med Educ 12:86
   PubMed Web of Science ®Google Scholar
• Michels NR, Driessen EW, Muijtjens AM, Van Gaal LF, Bossaert LL, De Winter BY. 2009. Portfolio assessment during medical internships: How to obtain a reliable and feasible assessment procedure? Educ Health 22:313
   PubMedGoogle Scholar
• Michels NR, Van Gaal LF, Bossaert LL, De Winter BY. 2010. Portfolio in medisch onderwijs: Ontwikkeling en eerste ervaringen. Tijdschr Geneeskd 66:386–393
   Google Scholar
• Miller GE. 1990. The assessment of clinical skills/competence/performance. Acad Med 65:63–67
   PubMed Web of Science ®Google Scholar
• Mu L, Shroff F, Dharamsi S. 2011. Inspiring health advocacy in family medicine: A qualitative study. Educ Health 24:534
   PubMedGoogle Scholar
• O’Sullivan P, Reckase M, Mcclain T, Savidge M, Clardy J. 2004. Demonstration of portfolios to assess competency of residents. Adv Health Sci Educ 9:309–323
   PubMed Web of Science ®Google Scholar
• Pitts J, Collin C, Thomas P. 2001. Enhancing reliability in portfolio assessment: “shaping” the portfolio. Med Teach 23:351–356
   Google Scholar
• Puddester D, Macdonald CJ, Clements D, Gaffney J, Wiesenfeld L. 2015. Designing faculty development to support the evaluation of resident competency in the intrinsic CanMEDS roles: practical outcomes of an assessment of program director needs. BMC Med Educ 15:100
   PubMed Web of Science ®Google Scholar
• Rees CE. Sheard CE. 2004. The reliability of assessment criteria for undergraduate medical students' communication skills portfolios: the Nottingham experience. Med Educ 38:138–144
   PubMed Web of Science ®Google Scholar
• Roberts C, Cromarty I, Crossley J, Jolly B. 2006. The reliability and validity of a matrix to assess the completed reflective personal development plans of general practitioners. Med Educ 40:363–370
   PubMed Web of Science ®Google Scholar
• Royal College of General Practitioners. 1993. Portfolio-based Learning in General Practice: Report of a Working Group on Higher Professional Education: December 1993. Occasional paper 63
   Google Scholar
• Royal College of Physicians and Surgeons of Canada. 2015. Milestones and EPAs: Practical and manageable teaching and assessment in residency training. [Online]. [Accessed October 2015] Available from http://www.royalcollege.ca/portal/page/portal/rc/canmeds/canmeds(2015)/milestones
   Google Scholar
• Sherbino J, Bonnycastle D, Côte B, Flynn L, Hunter A, Ince-Cushman D, Konkin J, Oandasan I, Regehr G, Richardson D, Zigby J. 2014. The CanMEDS 2015 health advocate expert working group report. Ottawa: The Royal College of Physicians and Surgeons of Canada
   Google Scholar
• Simpson J, Furnace J, Crosby J, Cumming A, Evans P, Friedman Ben David M, Harden R, Lloyd D, Mckenzie H, Mclachlan J. et al. 2002. The Scottish doctor – learning outcomes for the medical undergraduate in Scotland: A foundation for competent and reflective practitioners. Med Teach 24:136–143
   PubMed Web of Science ®Google Scholar
• Snadden D, Thomas M. 1998. The use of portfolio learning in medical education. Med Teach 20:192–199
   Web of Science ®Google Scholar
• Streiner D, Norman G. 2008. Health measurement scales: A practical guide to their development and use. Oxford: Oxford University Press
   Google Scholar
• Ten Cate OT, Snell L, Carraccio C. 2010. Medical competence: The interplay between individual ability and the health care environment. Med Teach 32:669–675
   PubMed Web of Science ®Google Scholar
• Tochel C, Haig A, Hesketh A, Cadzow A, Beggs K, Colthart I, Peacock H. 2009. The effectiveness of portfolios for post-graduate assessment and education: BEME guide no. 12. Med Teach 31:299–318
   PubMed Web of Science ®Google Scholar