What makes AS marking reliable? An experiment with some stages from the standardisation process

References

• Baird , J. , Greatorex , J. and Bell , J.F. 2004 . What makes marking reliable? Experiments with UK examinations . Assessment in Education Principles, Policy and Practice , 11 ( 3 ) : 331 – 48 .
   Google Scholar
• Black , E.L. 1962 . The marking of GCE scripts . British Journal of Educational Studies , 11 : 61 – 71 .
   Google Scholar
• Black , J.H. , Hall , J. , Martin , S. and Yates , J. 1989 . The quality of assessments: Case studies in the National Certificate , Edinburgh : Scottish Council for Research in Education .
   Google Scholar
• Branthwaite , A. , Trueman , M. and T. Berrisford , T. 1981 . Unreliability of marking: Further evidence and a possible explanation . Education Review , 33 ( 1 ) : 41 – 6 .
   Web of Science ®Google Scholar
• Elder , C. , Knoch , U. , Barkhuizen , G. and Randow , J. von . 2005 . Individual feedback to enhance rater training: Does it work? . Language Assessment Quarterly , 2 ( 3 ) : 175 – 96 .
   Google Scholar
• Greatorex , J. , Baird , J. and Bell , J.F. . ‘Tools for the trade’: What makes GCSE marking reliable? . Paper presented at the Learning Communities and Assessment Cultures: Connecting Research and Practice Conference, jointly organised by the EARLI Special Interest group on Assessment and Evaluation and the Univ. of Northumbria . August 28–30 .
   Google Scholar
• Greatorex , J. and Bell , J.F. 2004 . Does the gender of examiners influence their marking? . Research in Education , 71 : 25 – 36 .
   Google Scholar
• Hartog , P. and Rhodes , E.C. 1935 . An examination of examinations , London : Macmillan .
   Google Scholar
• Laming , D. 2004 . Human judgement: The eye of the beholder , Cambridge : Cambridge Univ. Press .
   Google Scholar
• Lave , J. and Wenger , E. 1991 . Situated learning legitimate peripheral participation , Cambridge : Cambridge Univ. Press .
   Google Scholar
• Lunz , M.E. , Wright , B.D. and Linacre , J.M. 1990 . Measuring the impact of judge severity on examination scores . Applied Measurement in Education , 3 : 331 – 45 .
   Google Scholar
• Newton , P. 1996 . The reliability of marking General Certificate of Secondary Education scripts: Mathematics and English . British Journal of Educational Research , 22 ( 4 ) : 405 – 20 .
   Google Scholar
• Pinot de Moira , A. , Massey , C. , Baird , J. and Morrissy , M. 2002 . Marking consistency over time . Research in Education , 67 : 79 – 87 .
   Google Scholar
• Qualifications and Curriculum Authority (QCA) . 2006 . GCSE, GCE, VCE, GNVQ and AEA code of practice 2006/7 , London : Qualifications and Curriculum Authority .
   Google Scholar
• Ruth , L. and Murphy , S. 1988 . Designing writing tasks for the assessment of writing , Norwood, NJ : Ablex Publishing .
   Google Scholar
• Sadler , D.R. 1987 . Specifying and promulgating achievement standards . Oxford Review of Education , 13 ( 2 ) : 191 – 209 .
   Web of Science ®Google Scholar
• Shaw , S. 2002 . The effect of training and standardisation on rater judgement and inter‐rater reliability . Research Notes , 8 : 13 – 17 .
   Google Scholar
• Shohamy , E. , Gordon , C.M. and Kraemer , R. 1992 . The effect of raters’ background and training on the reliability of direct writing tests . The Modern Language Journal , 76 : 27 – 33 .
   Web of Science ®Google Scholar
• Spear , M. 1997 . The influence of contrast effects upon teachers’ marks . Educational Research , 39 ( 2 ) : 229 – 33 .
   Web of Science ®Google Scholar
• Strong , G. 1995 . A survey of issues and item writing in language testing . Thought Currents in English Literature , 68 : 281 – 312 .
   Google Scholar
• Weigle , S. 1999 . Investigating rater/prompt interactions in writing assessment: Quantitative and qualitative approaches . Assessing Writing , 6 ( 2 ) : 145 – 78 .
   Google Scholar
• Wenger , E. 1998 . Communities of practice learning, meaning and identity , Cambridge : Cambridge Univ. Press .
   Google Scholar
• Wigglesworth , G. 1993 . Exploring bias analysis as a tool for improving rater consistency in assessing oral interaction . Language Testing , 10 ( 3 ) : 305 – 35 .
   Google Scholar
• Willmott , A. and Nuttall , D. 1975 . The reliability of examinations at 16+, Schools Council Research Studies , London : Macmillan Education .
   Google Scholar
• Wiseman , S. and Wrigley , J. 1958 . Essay‐reliability: The effect of choice and essay title . Educational and Psychological Measurement , 18 ( 1 ) : 129 – 38 .
   Web of Science ®Google Scholar
• Wolf , A. 1995 . Competence based assessment , Buckingham : Open Univ. Press .
   Google Scholar