What do GCSE examiners think of ‘thinking aloud’? Findings from an exploratory study

References

• Anderson , M. J. 1985 . Some evidence on the effect of verbalisation on process: A methodological note . Journal of Accounting Research , 23 : 843 – 852 .
   Web of Science ®Google Scholar
• Clark , H. H. and Haviland , S. E. 1977 . “ Comprehension and the given-new contract ” . In Discourse production and comprehension , Edited by: Freidle , R. O. 1 – 40 . Norwood, NJ : Ablex .
   Google Scholar
• Crisp , V. 2008 . The validity of using verbal protocol analysis to investigate the processes involved in examination marking . Research in Education , 79 : 1 – 12 .
   Google Scholar
• Cumming , A. 1990 . Expertise in evaluating second language compositions . Language Testing , 7 : 31 – 51 .
   Google Scholar
• Dreyfus , H. L. and Dreyfus , S. E. 1986 . Mind over machine: The power of human intuition and expertise in the era of the computer , Oxford : Blackwell .
   Google Scholar
• Ericsson , K. and Simon , H. 1980 . Verbal reports as data . Psychological Review , 87 ( 3 ) : 215 – 51 .
   Web of Science ®Google Scholar
• Ericsson , K. and Simon , H. 1993 . Protocol analysis: Verbal reports as data , Cambridge, MA : MIT Press .
   Google Scholar
• Green , A. 1998 . Studies in language testing, 5: Verbal protocol analysis in language testing research , Cambridge : Cambridge University Press .
   Google Scholar
• Hamilton , L. S. , Nussbaum , E. M. and Snow , E. M. 1997 . Interview procedures for validating science assessments . Applied Measurement in Education , 10 : 181 – 200 .
   Web of Science ®Google Scholar
• Hayes , J. R. and Flower , L. 1980 . “ Identifying organisation of writing process ” . In Cognitive processes in writing , Edited by: Gregg , L. and Steinberg , E. 3 – 30 . Mahwah, NJ : Lawrence Erlbaum .
   Google Scholar
• Jankowicz , D. 2004 . The easy guide to repertory grids , Chichester : John Wiley .
   Google Scholar
• Johnson , M. J. and Green , S. 2006 . Online mathematics assessment: The impact of mode on performance and question answering strategies . Journal of Technology, Learning and Assessment , 4 http://www.jtla.org (last accessed 7 October 2008).
   Google Scholar
• Kahneman , D. and Frederick , S. 2002 . “ Representativeness revisited: Attribute substitution in intuitive judgment ” . In Heuristics and biases: The psychology of intuitive judgement , Edited by: Gilovich , T. , Griffin , D. and Kahneman , D. Cambridge : Cambridge University Press .
   Google Scholar
• Katz , I. R. , Bennett , E. and Berger , A. E. 2000 . Effects of response format on difficulty of SAT Mathematics items: It's not a strategy . Journal of Educational Measurement , 37 : 39 – 57 .
   Web of Science ®Google Scholar
• Kuusela , H. and Paul , P. 2000 . A comparison of concurrent and retrospective verbal protocol analysis . American Journal of Psychology , 113 : 387 – 404 .
   PubMed Web of Science ®Google Scholar
• Leighton , J. 2004 . Avoiding misconception, misuse, and missed opportunities: The collection of verbal reports in educational achievement testing . Educational Measurement: Issues and Practice , : 6 – 15 .
   Google Scholar
• Milanovic , M. , Saville , N. and Shuhong , S. 1996 . “ A study of decision-making behaviour of composition markers ” . In Studies in language testing: 3 , Edited by: Milanovic , M. and Saville , N. Cambridge : Cambridge University Press .
   Google Scholar
• Nisbett , R. E. and Wilson , T. D. 1977 . Telling more than we can know: Verbal reports on mental processes . Psychological Review , 84 : 231 – 259 .
   Web of Science ®Google Scholar
• Robinson , K. M. 2001 . The validity of verbal reports in children's subtraction . Journal of Educational Psychology , 93 : 211 – 222 .
   Web of Science ®Google Scholar
• Sanderson , P. J. 2001 . Language and differentiation in examining at ‘A’-level Unpublished doctoral dissertation, University of Leeds
   Google Scholar
• Stanovich , K. and West , R. 2002 . “ Individual differences in reasoning ” . In Heuristics and biases: The psychology of intuitive judgment , Edited by: Gilovich , T. , Griffin , D. and Kahneman , D. Cambridge : Cambridge University Press .
   Google Scholar
• Sütő , W. M.I. and Greatorex , J. 2006 . A cognitive psychological exploration of the GCSE marking process . Research Matters: A Cambridge Assessment Publication , 2 : 7 – 11 .
   Google Scholar
• Suto , W. M.I. and Greatorex , J. 2008 . What goes through an examiner's mind? Using verbal protocols to gain insights into the GCSE marking process . British Educational Research Journal , 34 : 213 – 33 .
   Web of Science ®Google Scholar
• Taylor , K. L. and Dionne , J.-P. 2000 . Accessing problem-solving strategy knowledge: The complementary use of concurrent verbal protocols and retrospective debriefing . Journal of Educational Psychology , 92 : 413 – 425 .
   Web of Science ®Google Scholar
• Van Someren , M. , Barnard , Y. and Sandberg , J. 1994 . The think aloud method: A practical guide to modelling cognitive processes , London : Academic Press .
   Google Scholar
• Vaughan , C. 1992 . “ Holistic assessment: What goes on in the rater's mind? ” . In Assessing second language writing in academic contexts , Edited by: Hamp-Lyons , L. Norwood, NJ : Ablex .
   Google Scholar
• Weigle , S. C. 1994 . Effects of training on raters of ESL composition . Language Testing , 11 : 197 – 223 .
   Google Scholar
• Wilson , T. 1994 . The proper protocol: Validity and completeness of verbal reports . Psychological Science , 5 : 249 – 252 .
   Web of Science ®Google Scholar
• Wood, A., and A. Pollitt, forthcoming. The development of the Preferred Alternative Construct Ellicitation (PACE) approach to eliciting the construct of demand from student reviewers. QCA report
   Google Scholar
• Zucker , S. , Sassman , C. and Case , B. J. 2004 . Cognitive labs: Harcourt technical report , San Antonio, TX : Harcourt Assessment Inc .
   Google Scholar