Reporting error and reliability to test-takers: an international review

Abstract

This review examined a range of approaches internationally to the reporting of assessment results for individual students, with a particular focus on how results are represented, the level of detail reported and the steps taken to quantify, report and explain error and uncertainty in the results’ reports or certificates given to students in a range of countries. The review focused specifically on high-stakes assessments taken towards the end of schooling with the purpose of providing certification for employment or further study. Outside the USA, there were few examples of the inclusion of information on error or uncertainty in students’ individual results. The paper discusses the possibilities for including such information in a way which will be understood by a non-technical audience and will not be misinterpreted by test users. The balance required between ensuring that there are high standards of information for individuals and the dangers of damaging public confidence in the assessment system is considered.

Keywords:

• assessment
• examinations
• reliability
• tests
• testing
• qualifications

Notes

1. Uniform Mark Scale marks are converted from raw scores and have a scale with predefined grade boundaries. This ensures that modules with different cut scores for grade boundaries can be compared.