Dear Sir
Ubiquitous-based testing (UBT) is a variation of electronic assessment using smart devices (Huh Citation2012). UBT provides the same advantages as computer-based testing (CBT) (Peterson et al. Citation2004) whilst requiring lesser budget and space than CBT. We performed UBT with 920 Korean medical students in 2013. The test consisted of multiple-choice questions comprising clinical vignettes with multimedia.
The tests were delivered using 10.1-inch tablet PCs with Android operating system. To reproduce traditional test-taking behaviour, we created an overview button, a bookmark button, a calculator, a note function, and a button to detect unanswered items. The tablets featured a countdown timer and an item counter. The examinees downloaded the test onto their own devices and took it in pre-assigned seats under the supervision of the proctor. A total of five minutes per 50 questions was required to download the exam questions. No technical problems were experienced during the UBT.
Our students felt confident in using smart devices in the exam and had a positive attitude toward the UBT interface. Students experienced in CBT and male students favoured UBT. However, some students had a negative attitude toward the UBT measurement accuracy. Some students raised concerns about the limitations of using pencil and paper in the UBT context. No statistically significant score difference was observed when examining tablet proficiency or CBT experiences. There was no statistically significant score difference between examinees who preferred paper-and-pencil test and those who preferred UBT. Students with a positive attitude toward UBT measurement accuracy obtained better scores.
Therefore, we make three suggestions on how to improve student performance in UBT environments. First, we should develop a more convenient UBT interface. In particular, the note-taking functionality should be improved. Second, support should be given to students who are unfamiliar with smart devices. Finally, we should encourage students’ positive attitude toward UBT.
Acknowledgements
We acknowledge the support from educators at five medical schools in the Busan-GyeongNam region of Korea.
Declaration of interest: The authors report no conflicts of interest.
References
- Huh S. 2012. Can computerized tests be introduced to the Korean Medical Licensing Examination? J Korean Med Assoc 55(2):124–130
- Peterson MW, Gordon J, Elliott S, Kreiter C. 2004. Computer-based testing: Initial report of extensive use in a medical school curriculum. Teach Learn Med 16:51–59