Writing Multiple Choice Questions—Has the Student Become the Master?

References

• Schuwirth LW, van der Vleuten CP. ABC of learning and teaching in medicine: written assessment. BMJ. 2003;326(7390):643–645. doi:10.1136/bmj.326.7390.643.
   PubMedGoogle Scholar
• Hift RJ. Should essays and other “open-ended”-type questions retain a place in written summative assessment in clinical medicine? BMC Med Educ. 2014;14:249. doi:10.1186/s12909-014-0249-2.
   PubMed Web of Science ®Google Scholar
• Palmer EJ, Devitt PG. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper. BMC Med Educ. 2007;7:49. doi:10.1186/1472-6920-7-49.
   PubMedGoogle Scholar
• Scouller K. The influence of assessment method on students’ learning approaches: multiple choice question examination versus assignment essay. Higher Educ. 1998;35:453–472.
   Google Scholar
• Cobb KA, Brown G, Jaarsma DA, Hammond RA. The educational impact of assessment: a comparison of DOPS and MCQs. Med Teach. 2013;35(11):e1598–e1607. doi:10.3109/0142159X.2013.803061.
   PubMed Web of Science ®Google Scholar
• Tarrant M, Knierim A, Hayes SK, Ware J. The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments. Nurse Educ Today. 2006;26(8):662–671. doi:10.1016/j.nedt.2006.07.006.
   PubMed Web of Science ®Google Scholar
• Tarrant M, Ware J. Impact of item-writing flaws in multiple-choice questions on student achievement in high-stakes nursing assessments. Med Educ. 2008;42(2):198–206. doi:10.1111/j.1365-2923.2007.02957.x.
   PubMed Web of Science ®Google Scholar
• McLeod PJ, Snell L. Student-authored items. Med Teach. 1996;18(1):23–25.
   Web of Science ®Google Scholar
• McQueen HA, Shields C, Finnegan DJ, Higham J, Simmen MW. Peerwise provides significant academic benefits to biological science students across diverse learning tasks, but with minimal instructor intervention. Biochem Mol Biol Educ. 2014;42(5):371–381. doi:10.1002/bmb.20806.
   PubMed Web of Science ®Google Scholar
• Galloway KW, Burns S. Doing it for themselves: students creating a high quality peer-learning environment. Chem Educ Res Pract. 2015;16(1):82–92. doi:10.1039/C4RP00209A.
   Web of Science ®Google Scholar
• Bottomley S, Denny P. A participatory learning approach to biochemistry using student authored and evaluated multiple-choice questions. Biochem Mol Biol Educ. 2011;39(5):352–361. doi:10.1002/bmb.20526.
   PubMed Web of Science ®Google Scholar
• Olde Bekkink M, Donders ARTR, Kooloos JG, de Waal RMW, Ruiter DJ . Uncovering students’ misconceptions by assessment of their written questions. BMC Med Educ. 2016;16:221. doi:10.1186/s12909-016-0739-5.
   PubMed Web of Science ®Google Scholar
• Gooi AC, Sommerfeld CS. Medical School 2.0: how we developed a student-generated question bank using small group learning. Med Teach. 2015;37(10):892–896. doi:10.3109/0142159X.2014.970624.
   PubMed Web of Science ®Google Scholar
• Hardy J, Bates SP, Casey MM, et al. Student-authored content: enhancing learning through sharing multiple choice questions. Int J Sci Educ. 2014;36(13):2180–2194. doi:10.1080/09500693.2014.916831.
   Web of Science ®Google Scholar
• Hancock D, Hare N, Denny P, Denyer G . Improving large class performance and engagement through student-generated question banks. Biochem Mol Biol Educ. 2018;46(4):306–317. doi:10.1002/bmb.21119.
   PubMed Web of Science ®Google Scholar
• Shakurnia A, Aslami M, Bijanzadeh M. The effect of question generation activity on students’ learning and perception. J Adv Med Educ Prof. 2018;6(2):70–77.
   PubMedGoogle Scholar
• Smith C, Worsfold K, Davies L, et al. Assessment literacy and student learning: the case for explicitly developing students “assessment literacy”. Assess Eval Higher Educ. 2013;38(1):44–60. doi:10.1080/02602938.2011.598636.
   Web of Science ®Google Scholar
• Haladyna TM, Downing SM, Rodriguez MC. A review of multiple-choice item-writing guidelines for classroom assessment. Appl Meas Educ. 2002;15(3):309–333. doi:10.1207/S15324818AME1503_5.
   Web of Science ®Google Scholar
• Janzen BW, Sommerfeld C, Gooi ACC. Effectiveness of e-learning in a medical school 2.0 model: comparison of item analysis for student-generated vs. faculty-generated multiple-choice questions. Stud Health Technol Inform. 2019;257:184–188.
   PubMedGoogle Scholar
• Bates SP, Galloway RK, Riise J, Homer D. Assessing the quality of a student-authored question repository. Phys Rev Special Topics–Phys Educ Res. 2014;10:020105.
   Web of Science ®Google Scholar
• Harris BHL, Walsh JL, Tayyaba S, Harris DA, Wilson DJ, Smith PE. A novel student-led approach to multiple-choice question generation and online database creation, with targeted clinician input. Teach Learn Med. 2015;27(2):182–188. doi:10.1080/10401334.2015.1011651.
   PubMed Web of Science ®Google Scholar
• Wagener S, Möltner A, Tımbıl S, et al. Development of a competency-based formative progress test with student-generated MCQs: results from a multi-centre pilot study. GMS Z Med Ausbild. 2015;32(4):Doc46.
   PubMedGoogle Scholar
• Walsh JL, Harris BHL, Denny P, Smith P. Formative student-authored question bank: perceptions, question quality and association with summative performance. Postgrad Med J. 2018;94(1108):97–103. doi:10.1136/postgradmedj-2017-135018.
   PubMed Web of Science ®Google Scholar
• Grainger R, Dai W, Osborne E, Kenwright D. Medical students create multiple-choice questions for learning in pathology education: a pilot study. BMC Med Educ. 2018;18(1):201. doi:10.1186/s12909-018-1312-1.
   PubMedGoogle Scholar
• Hamamoto Filho PT, Silva E, Ribeiro ZMT, Hafner MLMB, Cecilio-Fernandes D, Bicudo AM. Relationships between Bloom’s taxonomy, judges’ estimation of item difficulty and psychometric properties of items from a progress test: a prospective observational study. Sao Paulo Med J. 2020;138(1):33–39. doi:10.1590/1516-3180.2019.0459.r1.19112019.
   PubMed Web of Science ®Google Scholar
• Kim MK, Patel RA, Uchizono JA, Beck L. Incorporation of Bloom’s taxonomy into multiple-choice examination questions for a pharmacotherapeutics course. AJPE. 2012;76(6):114. doi:10.5688/ajpe766114.
   Google Scholar
• Pham H, Besanko J, Devitt P. Examining the impact of specific types of item-writing flaws on student performance and psychometric properties of the multiple choice question. MedEdPublish. 2018;7(4):225. doi:10.15694/mep.2018.0000225.1.
   Google Scholar
• Ebel RL. Essentials of Educational Measurement. Englewood Cliffs, NJ: Prentice-Hall; 1972.
   Google Scholar
• Jozefowicz RF, Koeppen BM, Case S, Galbraith R, Swanson D, Glew RH. The quality of in-house ­medical school examinations. Acad Med. 2002;77(2):156–161.
   PubMed Web of Science ®Google Scholar
• Abdulghani HM, Ahmad F, Irshad M, et al. Faculty development programs improve the quality of multiple choice questions items writing. Sci Rep. 2015;5(1):9556. doi:10.1038/srep09556.
   PubMedGoogle Scholar
• Abdulghani HM, Irshad M, Haque S, Ahmad T, Sattar K, Khalil M. Effectiveness of longitudinal faculty development programs on MCQs items writing skills: a follow-up study. PLoS One. 2017;12(10):e0185895. doi:10.1371/journal.pone.0185895.
   PubMed Web of Science ®Google Scholar
• Ali SH, Ruit KG. The impact of item flaws, testing at low cognitive level, and low distractor functioning on multiple-choice question quality. Perspect Med Educ. 2015;4(5):244–251. doi:10.1007/s40037-015-0212-x.
   PubMed Web of Science ®Google Scholar
• Tarrant M, Ware J, Mohammed AM. An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis. BMC Med Educ. 2009;9:40. doi:10.1186/1472-6920-9-40.
   PubMed Web of Science ®Google Scholar
• Rodriguez MC. Three options are optimal for multiple-choice test items: a meta-analysis of 80 years of research. Educ Meas Issues Pract. 2005;24(2):3–13. doi:10.1111/j.1745-3992.2005.00006.x.
   Google Scholar
• Papinczak T, Peterson R, Babri AS, Ward K, Kippers V, Wilkinson D. Using student-authored questions for student-centred assessment. Assess Eval Higher Educ. 2012;37(4):439–452. doi:10.1080/02602938.2010.538666.
   Web of Science ®Google Scholar
• Jobs A, Twesten C, Göbel A, Bonnemeier H, Lehnert H, Weitz G . Question-writing as a learning tool for students-outcomes from curricular exams. BMC Med Educ. 2013;13(89):89–87. doi:10.1186/1472-6920-13-89.
   PubMedGoogle Scholar