Assessing interactional competence in the computer-based CET-SET: An investigation of the use of communication strategies

ABSTRACT

The computer-based College English Test─Spoken English Test (CET-SET) in China incorporates interactional competence in its construct by using a non-face-to-face paired discussion task. To build validity arguments for this unique computer-mediated interactive task, the present study investigated the impact of delivery mode on test performance in terms of communication strategy use. Data were collected from 60 test-takers who sat both the computer-based CET-SET and its face-to-face equivalent. Through an analysis of test-taker discourse combined with post-test test-taker interviews, the study examined their use of strategies in the discussion task under each mode. The findings of the study provided empirical evidence for the comparability of the two modes. Some differences, however, emerged in the use of interaction strategies, which were primarily attributed to the presence/absence of the visual elements of oral interaction. Hence, suggestions were made to address the issues concerning the computer-delivered mode.

KEYWORDS:

• Test mode
• communication strategy
• paired discussion
• computer-based CET-SET
• interactional competence

Acknowledgments

We extend our sincere gratitude to the anonymous reviewers and the two editors of this special issue for their insightful, detailed comments on earlier drafts of this article.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by the National Planning Office for Philosophy and Social Sciences of the People’s Republic of China [19BYY234].

Notes on contributors

Lin Zhang

Dr Lin Zhang is a lecturer of English language at the School of Foreign Languages, Shanghai Jiao Tong University, China. She is also a member of the Administration Office of the National College English Testing Committee in China. She received her PhD in Linguistics and Applied Linguistics from Shanghai Jiao Tong University. Her research interests include speaking assessment, language test development and validation.

Yan Jin

Dr Yan Jin is a professor of Linguistics and Applied Linguistics at the School of Foreign Languages, Shanghai Jiao Tong University, China. Her research focuses on the theory and practice of language testing and assessment, especially the development and validation of large-scale language tests. She is currently Chair of the National College English Testing Committee, in charge of the research and development of the College English Test (CET) Band 4 and Band 6. She is also President of the Asian Association for Language Assessment, of which she was also a founding member. She is co-editor-in-chief of the Springer open-access journal Language Testing in Asia and is on the editorial boards of Language Testing, Language Assessment Quarterly, Classroom Discourse, The International Journal of Computer-Assisted Language Learning and Teaching, Asia TEFL, and a number of academic journals published in China.