The Effect of Mode of Response on a Semidirect Test of Oral Proficiency

Abstract

This article reports on a study conducted with 42 participants from a Chilean university, which aimed to determine the effect of mode of response on test performance and test-taker perception of test features by comparing a semidirect online version and a direct face-to-face version of a speaking test. Candidate performances on both test versions were double-marked and analysed using both classical test theory and many-facet Rasch measurement. To gain an insight into students' perceptions of the two modes of delivery, we also asked candidates to complete a questionnaire after sitting each version. The many-facet Rash analysis showed no significant difference in the difficulty of the two versions of test. Nonetheless, there was a significant preference among candidates for the face-to-face version across a number of different features of the test.