What goes through an examiner's mind? Using verbal protocols to gain insights into the GCSE marking process

References

• Baddeley , A. 1999 . Essentials of human memory , Hove : Psychology Press .
   Google Scholar
• Baird , J. , Greatorex , J. and Bell , J. F. 2004 . What makes marking reliable? Experiments with UK examinations . Assessment in Education , 11 : 331 – 348 .
   Google Scholar
• Best , W. , Bryan , K. and Maxim , J. 2000 . Semantic processing: theory and practice , London : Whurr .
   Google Scholar
• Cumming , A. 1990 . Expertise in evaluating second language compositions . Language Testing , 7 : 31 – 51 .
   Google Scholar
• Department for Education and Skills . 2005 . 14–19 Education and skills , London : HMSO .
   Google Scholar
• Ericsson , K. and Simon , H. 1993 . Protocol analysis: verbal reports as data , London : MIT Press .
   Google Scholar
• Garner , W. 1954 . Context effects and the validity of loudness scales . Journal of Experimental Psychology , 48 : 218 – 224 .
   PubMedGoogle Scholar
• Garner , W. 1959 . The development of context effects in half‐loudness judgments . Journal of Experimental Psychology , 58 : 212 – 219 .
   PubMedGoogle Scholar
• Gilovich , T. , Griffin , D. and Kahneman , D. 2002 . Heuristics and biases: the psychology of intuitive judgment , Cambridge : Cambridge University Press .
   Google Scholar
• Green , A. 1998 . Studies in language testing 5: Verbal protocol analysis in language testing research—a handbook , Cambridge : Cambridge University Press/University of Cambridge Local Examinations Syndicate .
   Google Scholar
• Hall , K. and Harding , A. 2002 . Level descriptors and teacher assessment in England: towards a community of assessment practice . Educational Research , 44 : 1 – 16 .
   Web of Science ®Google Scholar
• Kahneman , D. 1991 . Judgment and decision making: a personal view . Psychological Science , 2 : 142 – 145 .
   Web of Science ®Google Scholar
• Kahneman , D. and Frederick , S. 2002 . “ Representativeness revisited: attribute substitution in intuitive judgment ” . In Heuristics and biases: the psychology of intuitive judgment , Edited by: Gilovich , T , Griffin , D and Kahneman , D . Cambridge : Cambridge University Press .
   Google Scholar
• Kahneman , D. and Tversky , A. 1982 . On the study of statistical intuitions . Cognition , 11 : 123 – 141 .
   PubMed Web of Science ®Google Scholar
• Kahneman , D. and Tversky , A. 1996 . On the reality of cognitive illusions . Psychological Review , 103 : 582 – 591 .
   PubMed Web of Science ®Google Scholar
• Kahneman , D. and Tversky , A. 2000 . Choices, values, and frames , Cambridge : Cambridge University Press .
   Google Scholar
• Kahneman , D. , Slovic , P. and Tversky , A. 1982 . Judgment under uncertainty: heuristics and biases , Cambridge : Cambridge University Press .
   Google Scholar
• Kramer , A. , Coles , M. and Logan , G. 1996 . Converging operations in the study of visual selective attention , Washington, DC : American Psychological Association .
   Google Scholar
• Laming , D. 1990 . The reliability of a certain university examination compared with the precision of absolute judgments . Quarterly Journal of Experimental Psychology , 42A : 239 – 254 .
   Web of Science ®Google Scholar
• Laming , D. 2004 . Human judgment. The eye of the beholder , London : Thomson .
   Google Scholar
• Lave , J. 1997 . Cognition in practice: mind, mathematics and culture in everyday life , Cambridge : Cambridge University Press .
   Google Scholar
• Leighton , J. 2004 . Avoiding misconception, misuse, and missed opportunities: the collection of verbal reports in educational achievement testing . Educational Measurement , Winter : 6 – 15 .
   Google Scholar
• Milanovic , M. , Saville , N. and Shuhong , S. 1996 . “ A study of the decision‐making behaviour of composition markers ” . In Studies in language testing 3: Performance testing, cognition and assessment—selected papers from the 15th Language Testing Research Colloquium, Cambridge and Arnhem , Edited by: Milanovic , M and Saville , N . Cambridge : Cambridge University Press/University of Cambridge Local Examinations Syndicate .
   Google Scholar
• Nobel Foundation . 2002 . “ The Bank of Sweden Prize in Economic Sciences in memory of Alfred Nobel 2002 ” . Available online at: http://nobelprize.org/economics/laureates/2002/ (accessed 7 February 2006)
   Google Scholar
• O'Donnell , S. 2004 . International review of curriculum and assessment frameworks: comparative tables and factural summaries—2004 , London : Qualifications and Curriculum Authority & National Foundation for Educational Research .
   Google Scholar
• Oxford , Cambridge and RSA Examinations . 2006 . Qualification finder Available online at: http://www.ocr.org.uk (accessed 7 February 2006)
   Google Scholar
• Pollack , I. 1952 . The information from elementary auditory displays . Journal of the Acoustical Society of America , 24 : 745 – 749 .
   Web of Science ®Google Scholar
• Pollack , I. 1953 . The information from elementary auditory displays II . Journal of the Acoustical Society of America , 24 : 745 – 749 .
   Web of Science ®Google Scholar
• Qualifications and Curriculum Authority . 2005 . GCSE, GCE, VCE, GNVQ, and AEA code of practice 2005/6 , London : Qualifications and Curriculum Authority .
   Google Scholar
• Rabbitt , R. and Dornic , S. 1975 . Attention and performance V , London : Academic Press .
   Google Scholar
• Shaw , S. 2004 . On‐screen marking: investigating the examiners' experience through verbal protocol analysis , Cambridge : University of Cambridge Local Examinations Syndicate . Unpublished report
   Google Scholar
• Sherif , M. 1937 . An experimental approach to the study of attitudes . Sociometry , 1 : 90 – 98 .
   Google Scholar
• Stanovich , K. and West , R. 2002 . “ Individual differences in reasoning ” . In Heuristics and biases: the psychology of intuitive judgment , Edited by: Gilovich , T , Griffin , D and Kahneman , D . Cambridge : Cambridge University Press .
   Google Scholar
• Stevens . 1956 . The direct estimation of sensory magnitudes—loudness . American Journal of Psychology , 69 : 1 – 25 .
   PubMed Web of Science ®Google Scholar
• Van Someren , M. , Barnard , Y. and Sandberg , J. 1994 . The think aloud method: a practical guide to modelling cognitive processes , London : Academic Press .
   Google Scholar
• Vaughan , C. 1992 . “ Holistic assessment: what goes on in the rater's mind? ” . In Assessing second language writing in academic contexts , Edited by: Hamp‐Lyons , L . Norwood : NJ, Ablex .
   Google Scholar
• Webster , F. , Pepper , D. and Jenkins , A. 2000 . “ Assessing the undergraduate dissertation ” . In Assessment and Evaluation in Higher Education Vol. 25 , 71 – 80 .
   Google Scholar
• Wenger , E. 1998 . Communities of practice: learning, meaning and identity , Cambridge : Cambridge University Press .
   Google Scholar
• Yorke , M. , Bridges , P. and Woolf , H. 2000 . “ Mark distributions and marking practices in UK higher education ” . In Active Learning in Higher Education Vol. 1 , 7 – 27 .
   Google Scholar