Advanced search
Publication Cover
Medical Education Online Volume 28, 2023 - Issue 1
Submit an article Journal homepage
1,752
Views
2
CrossRef citations to date
0
Altmetric
Research Article

Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools

Stefan Appelhausa Institute of Medical Sociology and Rehabilitation Science, Charité—Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany;b Department of Radiology and Nuclear Medicine, Universitätsmedizin Mannheim, Heidelberg University, Mannheim, GermanyCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0002-1325-6422
ORCID Icon,
Susanne Wernerc Assessment Unit, Charité—Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, GermanyORCID Iconhttps://orcid.org/0000-0002-7710-6677
ORCID Icon,
Pascal Grossed Dean of Students Office and Department of Neurology, Charité—Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, GermanyORCID Iconhttps://orcid.org/0000-0002-0114-0430
ORCID Icon &
Juliane E. Kämmere Department of Emergency Medicine, University of Bern, Bern, SwitzerlandORCID Iconhttps://orcid.org/0000-0001-6042-8453
ORCID Icon
Article: 2143298 | Received 26 Aug 2022, Accepted 31 Oct 2022, Published online: 09 Nov 2022

References

  • Green ML, Moeller JJ, Spak JM. Test-enhanced learning in health professions education: a systematic review: BEME Guide No. 48. Med Teach. 2018;40(4):337–7.
  • Watling CJ, Ginsburg S. Assessment, feedback and the alchemy of learning. Med Educ. 2019;53(1):76–85.
  • Boulet JR, Durning SJ. What we measure … and what we should measure in medical education. Med Educ. 2019;53(1):86–94.
  • Sam AH, Wilson R, Westacott R, et al. Thinking differently–Students’ cognitive processes when answering two different formats of written question. Med Teach. 2021;43(11):1278–1285.
  • Epstein RM, Cox M, Irby DM. Assessment in medical education [Internet]. N Engl J Med. 2007;356:387–396.
  • Joncas SX, St-Onge C, Bourque S, et al. Re-using questions in classroom-based assessment: an exploratory study at the undergraduate medical education level. Perspect Med Educ. 2018;7(6):373–378.
  • Tonkin AL. “Lifting the carpet” on cheating in medical school exams. BMJ. 2015 ;351:h4014.
  • FSMB/NBME. Federation of State Medical Boards (FSMB) and National Board of Medical Examiners (NBME). Exam Security. 2021. [cited 2021 Dec 22]. Available from: https://www.usmle.org/step-exams/exam-security.
  • Larsen DP, Butler AC, Roediger IIIHL. Test-enhanced learning in medical education. Med Educ. 2008;42(10):959–966.
  • Butler AC, Roediger HL. Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Mem Cogn. 2008;36(3):604–616.
  • Park YS, Yang EB. Three controversies over item disclosure in medical licensure examinations. Med Educ Online. 2015;20(1):28821.
  • Wadi M, Yusoff MSB, Abdul Rahim AF, et al. Factors affecting test anxiety: a qualitative analysis of medical students’ views. BMC Psychol. 2022;10(1):8.
  • Guraya SY, Guraya SS, Habib F, et al. Medical students’ perception of test anxiety triggered by different assessment modalities. Med Teach. 2018;40(sup1):S49–S55.
  • Encandela J, Gibson C, Angoff N, et al. Characteristics of test anxiety among medical students and congruence of strategies to address it. Med Educ Online. 2014;19(1):25211.
  • Yang EB, Lee MA, Park YS. Effects of test item disclosure on medical licensing examination. Adv Heal Sci Educ. 2018;23(2):265–274.
  • Herskovic P. Reutilization of multiple-choice questions. Med Teach. 1999;21(4):430–431.
  • Wood TJ. The effect of reused questions on repeat examinees. Adv Heal Sci Educ. 2009;14(4):465–473.
  • Möltner A, Schellberg D, Jünger J. Basic quantitative analyses of medical examinations. GMS Z Med Ausbild. 2006;23:Doc53.
  • Cohen J. Statistical power analysis for the behavioral sciences. New York: NY: Routledge Academic; 1988.
  • SPSS Statistics for Windows [Computer software]. Version 25.0. Armonk: NY: IBM Corp; 2017.
  • GraphPad Prism [Computer software]. Version 9.1. San Diego. CA: GraphPad Software; 2021.
  • Bestehens- und Notengrenzen. Institut für medizinische und pharmazeutische Prüfungsfragen, Mainz. [cited 2020 Dec 16]. Available from: https://www.impp.de/pruefungen/allgemein/bestehens-und-notengrenzen.html.
  • Möltner A. Dealing with flawed items in examinations: using the compensation of disadvantage as used in German state examinations in items with partial credit scoring. GMS J Med Educ. 2018;35(4):Doc49.
  • Tavakol M, Dennick R. Post-examination analysis of objective tests. Med Teach. 2011;33(6):447–458.
  • Gierl MJ, Lai H, Turner SR. Using automatic item generation to create multiple-choice test items. Med Educ. 2012;46(8):757–765.
  • Herrero JI, Lucena F, Quiroga J. Randomized study showing the benefit of medical study writing multiple choice questions on their learning. BMC Med Educ. 2019;19(1):42.
  • Touissi Y, Hjiej G, Hajjioui A, et al. Does developing multiple-choice questions improve medical students’ learning? A systematic review. Med Educ Online. 2022;27:1.
  • Roa Romero Y, Tame H, Holzhausen Y, et al. Design and usability testing of an in-house developed performance feedback tool for medical students. BMC Med Educ. 2021;21(1):1–9.
  • van der Vleuten C, Freeman A, Collares CF. Progress test utopia. Perspect Med Educ. 2018;7(2):136–138.
  • Pugh D, Regehr G. Taking the sting out of assessment: is there a role for progress testing? Med Educ. 2016;50(7):721–729.
  • Nouns ZM, Georg W. Progress testing in German speaking countries. Med Teach. 2010;32(6):467–470.
  • Kämmer JE, Hautz WE, März M. Self-monitoring accuracy does not increase throughout undergraduate medical education. Med Educ. 2020;54(4):320–327.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.