From Grading to Assessment for Learning: A Qualitative Study of Student Perceptions Surrounding Elimination of Core Clerkship Grades and Enhanced Formative Feedback

References

• NRMP. NRMP-2018-Program-Director-Survey-for-WWW.pdf. Accessed June 10, 2020. https://mk0nrmp3oyqui6wqfm.kinstacdn.com/wp-content/uploads/2018/07/NRMP-2018-Program-Director-Survey-for-www.pdf.
   Google Scholar
• Alexander EK, Osman NY, Walling JL, Mitchell VG. Variation and imprecision of clerkship grading in U.S. medical schools. Acad Med. 2012;87(8):1070–1076. doi:10.1097/ACM.0b013e31825d0a2a.
   PubMed Web of Science ®Google Scholar
• AAMC. Grading systems use by US medical schools. AAMC. Accessed June 13, 2020. https://www.aamc.org/data-reports/curriculum-reports/interactive-data/grading-systems-use-us-medical-schools.
   Google Scholar
• Bullock JL, Lai CJ, Lockspeiser T, et al. In pursuit of honors: a multi-institutional study of students’ perceptions of clerkship evaluation and grading. Acad Med. 2019;94:S48–S56. doi:10.1097/ACM.0000000000002905.
   PubMed Web of Science ®Google Scholar
• Duffield KE, Spencer JA. A survey of medical students' views about the purposes and fairness of assessment. Med Educ. 2002;36(9):879–886. doi:10.1046/j.1365-2923.2002.01291.x.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Lucey CR. Core clerkship grading: the illusion of objectivity. Acad Med. 2019;94(4):469–472. doi:10.1097/ACM.0000000000002413.
   PubMed Web of Science ®Google Scholar
• Sadler DR. Interpretations of criteria‐based assessment and grading in higher education. Assess Eval High Educ. 2005;30(2):175–194. doi:10.1080/0260293042000264262.
   Google Scholar
• Schopper H, Rosenbaum M, Axelson R. I wish someone watched me interview:’ medical student insight into observation and feedback as a method for teaching communication skills during the clinical years. BMC Med Educ. 2016;16(1):286. doi:10.1186/s12909-016-0813-z.
   PubMed Web of Science ®Google Scholar
• Wimmers PF, Kanter SL, Splinter TAW, Schmidt HG. Is clinical competence perceived differently for student daily performance on the wards versus clerkship grading? Adv Health Sci Educ Theory Pract. 2008;13(5):693–707. doi:10.1007/s10459-007-9075-1.
   PubMed Web of Science ®Google Scholar
• Wright SR, Boyd VA, Ginsburg S. The hidden curriculum of compassionate care: can assessment drive compassion? Acad Med. 2019;94(8):1164–1169. doi:10.1097/ACM.0000000000002773.
   PubMed Web of Science ®Google Scholar
• Teherani A, Hauer KE, Fernandez A, King TE, Lucey C. How small differences in assessed clinical performance amplify to large differences in grades and awards: a cascade with serious consequences for students underrepresented in medicine. Acad Med. 2018;93(9):1286–1292. doi:10.1097/ACM.0000000000002323.
   PubMed Web of Science ®Google Scholar
• Cilliers FJ, Schuwirth LW, Adendorff HJ, Herman N, van der Vleuten CP. The mechanism of impact of summative assessment on medical students' learning. Adv Health Sci Educ Theory Pract. 2010;15(5):695–715. doi:10.1007/s10459-010-9232-9.
   PubMed Web of Science ®Google Scholar
• Cook DA, Lineberry M. Consequences validity evidence: evaluating the impact of educational assessments. Acad Med. 2016;91(6):785–795. doi:10.1097/ACM.0000000000001114.
   PubMed Web of Science ®Google Scholar
• Birenbaum M. Assessment preferences and their relationship to learning strategies and orientations. High Educ. 1997;33(1):71–84. doi:10.1023/A:1002985613176.
   Web of Science ®Google Scholar
• Al Kadri HMF, Al-Moamary MS, Elzubair M, et al. Exploring factors affecting undergraduate medical students' study strategies in the clinical years: a qualitative study. Adv Health Sci Educ Theory Pract. 2011;16(5):553–567. doi:10.1007/s10459-010-9271-2.
   PubMed Web of Science ®Google Scholar
• Klapp A. Does grading affect educational attainment? A longitudinal study. Assess Educ. 2015;22:302–323. doi:10.1080/0969594X.2014.988121.
   Google Scholar
• Shepard LA. The role of assessment in a learning culture. Educ Res. 2000;29(7):4–14. doi:10.3102/0013189X09007004.
   Google Scholar
• Dweck CS. Motivational processes affecting learning. Am Psychol. 1986;41(10):1040–1048. doi:10.1037/0003-066X.41.10.1040.
   Web of Science ®Google Scholar
• Dweck CS, Leggett EL. A social-cognitive approach to motivation and personality. Psychol Rev. 1988;95(2):256–273. doi:10.1037/0033-295X.95.2.256.
   Web of Science ®Google Scholar
• Chen HC, ten Cate O, O’Sullivan P, et al. Students' goal orientations, perceptions of early clinical experiences and learning outcomes. Med Educ. 2016;50(2):203–213. doi:10.1111/medu.12885.
   PubMed Web of Science ®Google Scholar
• Cerasoli CP, Ford MT. Intrinsic motivation, performance, and the mediating role of mastery goal orientation: a test of self-determination theory. J Psychol. 2014;148(3):267–286. doi:10.1080/00223980.2013.783778.
   PubMed Web of Science ®Google Scholar
• Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55(1):68–78. doi:10.1037//0003-066x.55.1.68.
   PubMed Web of Science ®Google Scholar
• de Jong LH, Favier RP, van der Vleuten CPM, Bok HGJ. Students' motivation toward feedback-seeking in the clinical workplace. Med Teach. 2017;39(9):954–958. doi:10.1080/0142159X.2017.1324948.
   PubMed Web of Science ®Google Scholar
• Ten Cate TJ, Kusurkar RA, Williams GC. How self-determination theory can assist our understanding of the teaching and learning processes in medical education. AMEE guide No. 59. Med Teach. 2011;33(12):961–973. doi:10.3109/0142159X.2011.595435.
   PubMed Web of Science ®Google Scholar
• White CB, Fantone JC. Pass-fail grading: laying the foundation for self-regulated learning. Adv Health Sci Educ Theory Pract. 2010;15(4):469–477. doi:10.1007/s10459-009-9211-1.
   PubMed Web of Science ®Google Scholar
• Schneider J. Opinion | Pass-fail raises the question: What’s the point of grades? The New York Times. June 25, 2020. https://www.nytimes.com/2020/06/25/opinion/coronavirus-school-grades.html. Accessed July 4, 2020.
   Google Scholar
• Rohe DE, Barrier PA, Clark MM, Cook DA, Vickers KS, Decker PA. The benefits of pass-fail grading on stress, mood, and group cohesion in medical students. Mayo Clin Proc. 2006;81(11):1443–1448. doi:10.4065/81.11.1443.
   PubMed Web of Science ®Google Scholar
• Reed DA, Shanafelt TD, Satele DW, et al. Relationship of pass/fail grading and curriculum structure with well-being among preclinical medical students: a multi-institutional study. Acad Med. 2011;86(11):1367–1373. doi:10.1097/ACM.0b013e3182305d81.
   PubMed Web of Science ®Google Scholar
• Bloodgood RA, Short JG, Jackson JM, Martindale JA. A change to pass/fail grading in the first two years at one medical school results in improved psychological well-being . Acad Med. 2009;84(5):655–662. doi:10.1097/ACM.0b013e31819f6d78.
   PubMed Web of Science ®Google Scholar
• Wasson LT, Cusmano A, Meli L, et al. Association between learning environment interventions and medical student well-being: a systematic review. JAMA. 2016;316(21):2237–2252. doi:10.1001/jama.2016.17573.
   PubMed Web of Science ®Google Scholar
• Spring L, Robillard D, Gehlbach L, Simas TAM. Impact of pass/fail grading on medical students' well-being and academic outcomes . Med Educ. 2011;45(9):867–877. doi:10.1111/j.1365-2923.2011.03989.x.
   PubMed Web of Science ®Google Scholar
• Kim S, George P. The relationship between preclinical grading and USMLE scores in US Allopathic Medical Schools. Fam Med. 2018;50(2):128–131. doi:10.22454/FamMed.2018.145163.
   PubMed Web of Science ®Google Scholar
• McDuff SGR, McDuff D, Farace JA, Kelly CJ, Savoia MC, Mandel J. Evaluating a grading change at UCSD school of medicine: pass/fail grading is associated with decreased performance on preclinical exams but unchanged performance on USMLE step 1 scores. BMC Med Educ. 2014;14(1):127. doi:10.1186/1472-6920-14-127.
   PubMedGoogle Scholar
• Fagan R, Harkin E, Wu K, Salazar D, Schiff A. The lack of standardization of allopathic and osteopathic medical school grading systems and transcripts. J Surg Educ. 2020;77(1):69–73. doi:10.1016/j.jsurg.2019.06.016.
   PubMed Web of Science ®Google Scholar
• Konopasek L, Norcini J, Krupat E. Focusing on the formative: building an assessment system aimed at student growth and development. Acad Med. 2016;91(11):1492–1497. doi:10.1097/ACM.0000000000001171.
   PubMed Web of Science ®Google Scholar
• Sadler DR. Formative assessment and the design of instructional systems. Instr Sci. 1989;18(2):119–144. doi:10.1007/BF00117714.
   Web of Science ®Google Scholar
• Pereira AG, Woods M, Olson APJ, van den Hoogenhof S, Duffy BL, Englander R. Criterion-based assessment in a norm-based world: how can we move past grades? Acad Med. 2018;93(4):560–564. doi:10.1097/ACM.0000000000001939.
   PubMed Web of Science ®Google Scholar
• Watling CJ, Ginsburg S. Assessment, feedback and the alchemy of learning. Med Educ. 2019;53(1):76–85. doi:10.1111/medu.13645.
   PubMed Web of Science ®Google Scholar
• Govaerts M, van der Vleuten CPM. Validity in work-based assessment: expanding our horizons. Med Educ. 2013;47(12):1164–1174. doi:10.1111/medu.12289.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Holmboe ES, Kogan JR. Twelve tips for implementing tools for direct observation of medical trainees' clinical skills during patient encounters. Med Teach. 2011;33(1):27–33. doi:10.3109/0142159X.2010.507710.
   PubMed Web of Science ®Google Scholar
• Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. doi:10.1191/1478088706qp063oa.
   Google Scholar
• Bowen GA. Grounded theory and sensitizing concepts. Int J Qual Methods. 2006;5(3):12–23. doi:10.1177/160940690600500304.
   Google Scholar
• Thistlethwaite JE, Bartle E, Chong AAL, et al. A review of longitudinal community and hospital placements in medical education: BEME Guide No. 26. Med Teach. 2013;35(8):e1340–e1364. doi:10.3109/0142159X.2013.806981.
   PubMed Web of Science ®Google Scholar
• Frank AK, O'Sullivan P, Mills LM, Muller-Juge V, Hauer KE. Clerkship grading committees: the impact of group decision-making for clerkship grading. J Gen Intern Med. 2019;34(5):669–676. doi:10.1007/s11606-019-04879-x.
   PubMed Web of Science ®Google Scholar
• Norcini JJ. Work based assessment. BMJ. 2003;326(7392):753–755. doi:10.1136/bmj.326.7392.753.
   PubMedGoogle Scholar
• Robinson OC. Sampling in interview-based qualitative research: a theoretical and practical guide. Qual Res Psychol. 2014;11(1):25–41. doi:10.1080/14780887.2013.801543.
   Web of Science ®Google Scholar
• Schut S, Driessen E, van Tartwijk J, van der Vleuten C, Heeneman S. Stakes in the eye of the beholder: an international study of learners' perceptions within programmatic assessment. Med Educ. 2018;52(6):654–663. doi:10.1111/medu.13532.
   PubMed Web of Science ®Google Scholar
• Saunders B, Sim J, Kingstone T, et al. Saturation in qualitative research: exploring its conceptualization and operationalization. Qual Quant. 2018;52(4):1893–1907. doi:10.1007/s11135-017-0574-8.
   PubMed Web of Science ®Google Scholar
• Birt L, Scott S, Cavers D, Campbell C, Walter F. Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qual Health Res. 2016;26(13):1802–1811. doi:10.1177/1049732316654870.
   PubMed Web of Science ®Google Scholar
• Ramani S, Könings KD, Mann K, van der Vleuten CPM. A guide to reflexivity for qualitative researchers in education. Acad Med. 2018;93(8):1257. doi:10.1097/ACM.0000000000002263.
   PubMedGoogle Scholar
• Ortlipp M. Keeping and using reflective journals in the qualitative research process. Qual Rep. 2008;13(4):695–705.
   Google Scholar
• Klamen DL, Williams R, Hingle S. Getting real: aligning the learning needs of clerkship students with the current clinical environment. Acad Med. 2019;94(1):53–58. doi:10.1097/ACM.0000000000002434.
   PubMed Web of Science ®Google Scholar
• Pelaccia T, Viau R. Motivation in medical education. Med Teach. 2017;39(2):136–140. doi:10.1080/0142159X.2016.1248924.
   PubMed Web of Science ®Google Scholar
• Harrison CJ, Könings KD, Schuwirth LWT, Wass V, van der Vleuten CPM. Changing the culture of assessment: the dominance of the summative assessment paradigm. BMC Med Educ. 2017;17(1):73. doi:10.1186/s12909-017-0912-5.
   PubMed Web of Science ®Google Scholar
• Schumacher DJ, Englander R, Carraccio C. Developing the master learner: applying learning theory to the learner, the teacher, and the learning environment. Acad Med. 2013;88(11):1635–1645. doi:10.1097/ACM.0b013e3182a6e8f8.
   PubMed Web of Science ®Google Scholar
• Cutrer WB, Miller B, Pusic MV, et al. Fostering the development of master adaptive learners: a conceptual model to guide skill acquisition in medical education. Acad Med. 2017;92(1):70–75. doi:10.1097/ACM.0000000000001323.
   PubMed Web of Science ®Google Scholar
• Brady KJS, Trockel MT, Khan CT, et al. What do we mean by physician wellness? A systematic review of its definition and measurement. Acad Psychiatry. 2018;42(1):94–108. doi:10.1007/s40596-017-0781-6.
   PubMed Web of Science ®Google Scholar
• Hill MR, Goicochea S, Merlo LJ. In their own words: stressors facing medical students in the millennial generation. Med Educ Online. 2018;23(1):1530558. doi:10.1080/10872981.2018.1530558.
   PubMed Web of Science ®Google Scholar
• Ludwig AB, Burton W, Weingarten J, Milan F, Myers DC, Kligler B. Depression and stress amongst undergraduate medical students. BMC Med Educ. 2015;15(1):141. doi:10.1186/s12909-015-0425-z.
   PubMedGoogle Scholar
• Dyrbye LN, Thomas MR, Shanafelt TD. Systematic review of depression, anxiety, and other indicators of psychological distress among U.S. and Canadian medical students. Acad Med. 2006;81(4):354–373. doi:10.1097/00001888-200604000-00009.
   PubMed Web of Science ®Google Scholar
• Ayala EE, Winseman JS, Johnsen RD, Mason HRC. U.S. medical students who engage in self-care report less stress and higher quality of life. BMC Med Educ. 2018;18(1):189. doi:10.1186/s12909-018-1296-x.
   PubMedGoogle Scholar
• Dunn LB, Iglewicz A, Moutier C. A conceptual model of medical student well-being: promoting resilience and preventing burnout. Acad Psychiatry. 2008;32(1):44–53. doi:10.1176/appi.ap.32.1.44.
   PubMed Web of Science ®Google Scholar
• Neufeld A, Malin G. How medical students’ perceptions of instructor autonomy-support mediate their motivation and psychological well-being. Med Teach. 2020;42(6):650–656. doi:10.1080/0142159X.2020.1726308.
   PubMed Web of Science ®Google Scholar
• Slavin SJ, Schindler DL, Chibnall JT. Medical student mental health 3.0: improving student wellness through curricular changes. Acad Med. 2014;89(4):573–577. doi:10.1097/ACM.0000000000000166.
   PubMed Web of Science ®Google Scholar
• Govaerts MJB, van der Vleuten CPM, Holmboe ES. Managing tensions in assessment: moving beyond either-or thinking. Med Educ. 2019;53(1):64–75. doi:10.1111/medu.13656.
   PubMed Web of Science ®Google Scholar
• LaDonna KA, Hatala R, Lingard L, Voyer S, Watling C. Staging a performance: learners' perceptions about direct observation during residency. Med Educ. 2017;51(5):498–510. doi:10.1111/medu.13232.
   PubMed Web of Science ®Google Scholar
• Han H, Roberts NK, Korte R. Learning in the real place: medical students' learning and socialization in clerkships at one medical school. Acad Med. 2015;90(2):231–239. doi:10.1097/ACM.0000000000000544.
   PubMed Web of Science ®Google Scholar
• Fetter M, Robbs R, Cianciolo AT. Clerkship curriculum design and USMLE Step 2 performance: exploring the impact of self-regulated exam preparation. Med Sci Educ. 2019;29(1):265–276. doi:10.1007/s40670-019-00691-8.
   Google Scholar
• Harrison CJ, Könings KD, Dannefer EF, Schuwirth LWT, Wass V, van der Vleuten CPM. Factors influencing students' receptivity to formative feedback emerging from different assessment cultures. Perspect Med Educ. 2016;5(5):276–284. doi:10.1007/s40037-016-0297-x.
   PubMed Web of Science ®Google Scholar
• Watling C, Driessen E, van der Vleuten CPM, Lingard L. Learning culture and feedback: an international study of medical athletes and musicians. Med Educ. 2014;48(7):713–723. doi:10.1111/medu.12407.
   PubMed Web of Science ®Google Scholar
• Nowell LS, Norris JM, White DE, Moules NJ. Thematic analysis: striving to meet the trustworthiness criteria. Int J Qual Methods. 2017;16(1):160940691773384. doi:10.1177/1609406917733847.
   Web of Science ®Google Scholar