Computer-based diagnostic assessment of high school students’ grammar skills with automated feedback – an international trial

ABSTRACT

An effective diagnostic test can play a key role in language learning, allowing strengths and weaknesses in students’ linguistic development to be identified and addressed. This paper describes the online Cambridge English diagnostic test, assessing English grammatical knowledge at A2 level. As most language tests focus on proficiency or achievement, relatively little research into diagnostic assessment has been conducted, and no real agreement exists on what it entails. For learners of approximately 15 years old, the test provides diagnostic feedback on seven grammatical categories at individual and class levels, to improve curriculum and lesson planning and accommodate students’ needs. The test was trialled internationally, using surveys and focus groups. This paper outlines the trial and planned modifications for the next version, in addition to implications for wider practice. It should be clarified that this is a first iteration of the diagnostic test, rather than a fully established final model. 

KEYWORDS:

• Diagnostic test
• grammar
• young learners
• automated feedback
• computer-based testing
• test validity

Acknowledgment(s)

We thank Dr Jing Xu, Dr Edmund Jones, John Savage and Tom Booth (all of Cambridge Assessment English) for their valuable contributions to the initial Diagnostic Test project.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplementary material

Supplemental data for this article can be accessed here.

Additional information

Notes on contributors

Tony Clark

Tony Clark is a Principal Research Manager at Cambridge Assessment English, managing IELTS research. His interests include language assessment, writing acquisition, standard setting, accommodations, test preparation, diagnostic assessment, and lexical studies. He has published in and reviews for major testing journals, and holds a PhD from Bristol University.

Heidi Endres

Heidi Endres is a Senior Assessment Manager at Cambridge Assessment English working on a range of assessments. Her interests include test development, adaptive testing, learning-oriented and diagnostic assessment. She holds an MA in Applied Linguistics from the University of Leicester.