Computer-based testing of the modified essay question: the Singapore experience

Abstract

Background: The modified essay question (MEQ), featuring an evolving case scenario, tests a candidate's problem-solving and reasoning ability, rather than mere factual recall. Although it is traditionally conducted as a pen-and-paper examination, our university has run the MEQ using computer-based testing (CBT) since 2003.

Aims: We describe our experience with running the MEQ examination using the IVLE, or integrated virtual learning environment (https://ivle.nus.edu.sg), provide a blueprint for universities intending to conduct computer-based testing of the MEQ, and detail how our MEQ examination has evolved since its inception.

Methods: An MEQ committee, comprising specialists in key disciplines from the departments of Medicine and Paediatrics, was formed. We utilized the IVLE, developed for our university in 1998, as the online platform on which we ran the MEQ. We calculated the number of man-hours (academic and support staff) required to run the MEQ examination, using either a computer-based or pen-and-paper format.

Results: With the support of our university's information technology (IT) specialists, we have successfully run the MEQ examination online, twice a year, since 2003. Initially, we conducted the examination with short-answer questions only, but have since expanded the MEQ examination to include multiple-choice and extended matching questions. A total of 1268 man-hours was spent in preparing for, and running, the MEQ examination using CBT, compared to 236.5 man-hours to run it using a pen-and-paper format. Despite being more labour-intensive, our students and staff prefer CBT to the pen-and-paper format.

Conclusions: The MEQ can be conducted using a computer-based testing scenario, which offers several advantages over a pen-and-paper format. We hope to increase the number of questions and incorporate audio and video files, featuring clinical vignettes, to the MEQ examination in the near future.

Additional information

Notes on contributors

Erle Chuen-Hian Lim

ERLE CHUEN-HIAN LIM is consultant neurologist and Associate Professor of Medicine and Assistant Dean (Clinical, Admissions and Student Affairs).

Raymond Chee-Seong Seet

RAYMOND CHEE-SEONG SEET is Associate Consultant in Neurology and Assistant Professor of Medicine.

Vernon M. S. Oh

VERNON MIN-SEN OH is Senior Consultant in General Medicine and Clinical Pharmacology and Professor of Medicine.

Boon-Lock Chia

BOON-LOCK CHIA is Senior Consultant in Cardiology and Professor of Medicine.

Marion Aw

MARION AW is Consultant Gastroenterologist and Assistant Professor of Paediatrics.

Seng-Hock Quak

SENG-HOCK QUAK is Senior Consultant Gastroenterologist and Professor of Paediatrics.

Benjamin K. C. Ong

BENJAMIN KIAN-CHUNG ONG is Senior Consultant Neurologist and Associate Professor of Medicine.