Improving the fairness of multiple-choice questions: a literature review

References

• BEN-DAVID, M.F. (2000) AMEE Guide No. 18: Standard setting in student assessment, Medical Teacher, 22, pp. 120–130.
   Google Scholar
• BERK, R.A. (1986) A consumer's guide to setting performance standards on criterion-referenced tests, Review of Educational Research, 56, pp. 137–172.
   Google Scholar
• BEULLENS, J., VAN DAMME, B., JAspAERT, H. & JANssEN, P.J. (2002) Are extended-matching multiple-choice items appropriate for a final test in medical education, Medical Teacher, 24, pp. 390–395.
   Google Scholar
• BROWN, S. (1992) Trends in assessment, in: R. Harden, I. Hart & H. Mulholland (Eds) Approaches to the Assessment of Clinical Competence, Vol. 1 (Dundee, Centre for Medical Education), pp. 3–8. CASE, S.M. (1994) The use of imprecise terms in examination questions: how frequently is frequently?, Academic Medicine, 69, pp. S4—S6.
   Google Scholar
• CASE, S.M. & SWANSON, D.B. (1993) Extended matching items: a practical alternative to free response questions, Teaching and Learning in Medicine, 5, pp. 107–115.
   Google Scholar
• CASE, S.M. & SWANSON, D.B. (2001) Constructing Written Test Questions for the Basic and Clinical Sciences, 3rd edn (Philadelphia, National Board of Medical Examiners).
   Google Scholar
• CASE, S.M., SWANSON, D.B. & BECKER, D.F. (1996) Verbosity, window dressing and red herrings: do they make a better test item?, Academic Medicine, 71, pp. S28—S30.
   Google Scholar
• CLAUSER, B.E. & SCHUWIRTH, L.W.T. (2002) The use of computers in assessment, in: G. Norman, C. van der Vleuten & D. Newble (Eds) International Handbook of Research in Medical Education, Vol. 2 (Dordrecht, Kluwer), pp. 757–792.
   Google Scholar
• COLES, C.R. (1998) How students learn: the process of learning, in: B. Jolly & L. Rees (Eds) Medical Education in the Millennium (Oxford, Oxford University Press), pp. 63–82.
   Google Scholar
• CUSIMANO, M.D. (1996) Standard setting in medical education, Academic Medicine, 71, pp. S112–119.
   Google Scholar
• DIXON, R.A. (1994) Evaluating and improving multiple choice papers: true—false questions in public health medicine, Medical Education, 28, pp. 400–408.
   Google Scholar
• DOWNING, S.M. (2002) Assessment of knowledge with written test formats, in: G. NORMAN, C. VAN DER ViEurEN & D. NEWBLE (Eds) International Handbook of Research in Medical Education, Vol. 2 (Dordrecht, Kluwer), pp. 647–672.
   Google Scholar
• DUFFIELD, K.E. & SPENCER, J.A (2002) A survey of medical students' views about the purposes and fairness of assessment. Medical Education, 36,879–886.
   Google Scholar
• FAJARDO, L.L. & CHAN, K.M. (1993) Evaluation of medical students in radiology: written testing using uncued multiple choice questions, Investigative Radiology, 28, pp. 964–968.
   Google Scholar
• FENDERSON, B.A., DAMJANOV, I., ROBESON, M.R., VELOSIU, J.J. & RustN, E. (1997) The virtues of extended matching and uncued tests as alternatives to multiple choice questions, Human Pathology, 28, pp. 526–532.
   Google Scholar
• FOWELL, S.L., MAUDSLEY, G., MAGUIRE, P., LEINSTER, S.J. & BLIGH, J. (2000) Student assessment in undergraduate medical education in the United Kingdom 1998: report of findings, Medical Education, 34, pp. 1–61.
   Web of Science ®Google Scholar
• GLASER, R. (1984) Education and thinking: the role of knowledge, American Psychology, 39, pp. 193–202.
   Web of Science ®Google Scholar
• Gucx, S.M. (2001) Cheating at medical school, British Medical Journal, 322, pp. 250–251.
   Google Scholar
• HERSKOVIC, P (1999) Reutilization of multiple-choice questions. Medical Teacher, 21,430–431.
   Web of Science ®Google Scholar
• HOISGROVE, G. & ELZUBEIR, M. (1998) Imprecise terms in UK medical multiple-choice questions: what examiners think they mean, Medical Education, 32, pp. 342–350.
   Google Scholar
• HurcmNsoN, L., ArrxEN, P. & HAYES, T. (2002) Are medical postgraduate certification processes valid? A systematic review of the published evidence, Medical Education, 36, pp. 73–91.
   Google Scholar
• JOLLY, B. (1999) Assessment and examination, Advances in Psychiatric Treatment, 5, pp. 405–414.
   Google Scholar
• KAUFMAN, D.M. (2001) Assessing medical students: hit or miss, Student BMJ, 9, pp. 87–88.
   Google Scholar
• LEE, G. & WEERAKOON, P. (2001) The role of computer-aided assessment in health professional education: a comparison of student performance in computer-based and paper-and-pen multiple choice tests, Medical Teacher, 23, pp. 152–157.
   Google Scholar
• Lowe, D.G., FOULKES, J. & RUSSELL, R.C.G. (1998) ABS to MRCS at the RCS: philosophy, format and future, Annals of the Royal College of Surgeons of England, 80, pp. 213–218.
   Web of Science ®Google Scholar
• MILLER, D.R., BLACKMORE, D.E., BOULAIS, A.-P. & DAUPHINEE, W.D. (2002) The challenges of creating a computer program designed to administer a high-stake licensing examination, in: ANIEE 2002: Approaches to Better Teaching (Conference Proceedings) Lisbon, Portugal, pp. 4–105.
   Google Scholar
• NEWBLE, D.I. & JAEGER, K. (1983) The effect of assessment and examinations on the learning of medical students, Medical Education, 13, pp. 263–268.
   Google Scholar
• NORMAN, G.R. (1996) Multiple choice questions, in: S. Shannon & G. Norman (Eds) Evaluation Methods: A Resource Handbook, 3rd edn (Hamilton, Canada), pp. 47–54.
   Google Scholar
• PEtrzmAN, S.J., NIEMAN, L.Z. & GRACLEY, E.J. (1990) Comparison of fact recall with high order questions in multiple choice examinations as predictors of clinical performance of medical students, Academic Medicine, 65, pp. S59–560.
   Google Scholar
• SCHUWIRTH, L.W.T. (2001) General concerns about assessment [available online at: wwwidg.unimaas.nlieduc/lambertiubc, accessed 12 December 2002].
   Google Scholar
• SCHUWIRTH, L.W.T., VAN DER VLEUTEN, C., STOFFERS, H.E.J.H. & PEPERKAMP, A.G.W. (1996a) Computerized long-menu questions as an alternative to open-ended questions in computerized assessment, Medical Education, 30, pp. 50–55.
   Google Scholar
• SCHUWIRTH, L.W.T., VAN DER VLEUTEN, C.P.M. & DONKERS, H.H.L.M. (1996b) A closer look a cueing effects in multiple-choice questions, Medical Education, 30, pp. 44–49.
   Google Scholar
• SINCLAIR, S. (1997) Making Doctors: An Institutional Apprenticeship (Oxford, Berg).
   Google Scholar
• SWANSON, D.B. & CASE, S.M. (1997) Assessment in basic science instruction: directions for practice and research, Advances in Health Sciences Education, 2, pp. 71–84.
   Web of Science ®Google Scholar
• SYNDER, B.R. (1971) The Hidden Curriculum (New York, Knopf).
   Google Scholar
• VAN DER ViEurEN, C. (1996) The assessment of professional competence: developments, research and practical implications, Advances in Health Sciences Education, 1, pp. 41–67.
   Web of Science ®Google Scholar
• VELOSIU, J.J., RABstowrrz, H.K., ROBESON, M.R. & YOUNG, P.R. (1999) Patients don't present with five choices: an alternative to multiple-choice tests in assessing physicians' competence, Academic Medicine, 74, pp. 539–546.
   Google Scholar
• WrmAms, C., TIUGWELL, P. & YEOMANS, D. (1996) MCQ technique, British Journal of Hospital Medicine, 55, pp. 479–481.
   Web of Science ®Google Scholar
• WISE, S.L. & KINGSBURY, G.G. (2000) Practical issues in developing and maintaining a computerized adaptive testing program, Psicologica, 21, pp. 135–155.
   Google Scholar