Towards a model of the judgement processes involved in examination marking

Abstract

The judgement processes underpinning examination marking are central to achieving fair assessment but are under‐researched. This article draws on existing literature and uses additional analysis of data collected in a previous article ‘Exploring the nature of examiner thinking during the process of examination marking’, to start to piece together the puzzle of the judgement processes involved in marking. In that study six experienced examiners were asked to ‘think aloud’ whilst marking a number of scripts from each of two geography examinations and the resulting ‘verbal protocols’ were analysed. The analysis identified and discussed the nature of examiner behaviours and reactions in relation to a number of themes: reading and comprehension behaviours; social, emotional and personal reactions; and evaluative behaviours. Drawing on these findings and by conducting further qualitative analyses of the sequences of behaviours, the article develops a tentative five‐phase model of the marking process and uses this to evaluate and link relevant theories from psychology. Thus, the paper builds on existing understandings of judgements in assessment to further our comprehension of the cognitive processes involved in exam marking. The findings may inform marker training and decisions regarding changes to assessment systems.

Acknowledgement

The author would like to thank the examiners who participated for their time and enthusiasm.

Notes

1. General Certificate of Education A levels (‘Advanced’ Levels) are national general qualifications taken by many students in England, Wales and Northern Ireland at age 17/18 years and A level results are often a substantial factor in university entrance decisions. For any one A level course in a particular subject students take a number of units, some at AS (Advanced Subsidiary) level and some at A2. AS units, which are less demanding, are taken earlier and can be used to gain an AS qualification. A2 units, which are more demanding, are taken later to achieve a full A level qualification. The units are assessed individually often via traditional pen‐and‐paper examinations. A levels are also available internationally via some UK‐based Awarding Bodies.

2. GCSEs (General Certificate of Secondary Education) are national general qualifications taken by most students in England, Wales and Northern Ireland at the end of compulsory schooling at age 16 years.