Making the Grade - How Question Choice and Type Affect the Development of Grade Descriptors

Abstract

This paper reports on a method for the development of grade descriptors for an international Economics A-level syllabus. The syllabus assessment provided the opportunity to explore how different examination paper structures (compulsory short answer written questions and longer essay type questions) and different mark schemes affected this relatively new method for developing grade descriptors. Quantitative analyses of candidates' marks on each question on the November 1999 examination were carried out to identify the grade (A to E) at which candidates 'mastered' the question. Qualitative differences between answers to the question from candidates achieving different grades were identified by expert judges using Kelly's Repertory Grid. These qualitative data were edited to form grade descriptors which were used in the process of grading economics examinations taken in summer 2000, and their usefulness was evaluated. The effects of the question choice and type on the development process are discussed.