Testing-Context Analysis: Assessment is Just Another Part of Language Curriculum Development

Abstract

In keeping with the theme of the International Language Testing Association/Language Testing Research Colloquium Conference in 2008, “Focusing on the Core: Justifying the Use of Language Assessments to Stakeholders,” I define stakeholder-friendly tests, defensible testing, and testing-context analysis. I then go on to discuss the rational for stakeholder-friendly testing and testing-context analysis and delineate the stages (and steps) involved in any testing-context analysis as follows: (a) get ready to do the testing-context analysis (define the purpose of the test, delimit the stakeholders, decide on options, recognize constraints, and select data collection procedures), (b) do the testing-context analysis (collect data, analyze data, and interpret results), and (c) use the testing-context analysis (determine the impact of the results on testing, implement testing procedures and decision making, report on the testing-context analysis, and decide on directions for further research). I also briefly describe and discuss an example testing-context analysis (the ongoing Eiken testing-context analysis) that illustrates how this framework can be applied. I end by considering the benefits that can be derived from testing-context analysis and how it can help justify the use of language assessments to stakeholders.

ACKNOWLEDGMENTS

This article is a revised version of the Samuel J. Messick Memorial Lecture I presented in 2008 at the joint annual meeting of the International Language Testing Association and the Language Testing Research Colloquium in Hangzhou, China.