891
Views
13
CrossRef citations to date
0
Altmetric
Articles

How accurate are examiners’ holistic judgements of script quality?

&
Pages 308-324 | Received 13 Jun 2011, Accepted 18 Feb 2013, Published online: 10 Apr 2013

References

  • Baird, J.-A., & Dhillon, D. 2005. Qualitative expert judgments on examination standards: Valid, but inexact. AQA research report RPA_05_JB_RP_077. Guildford: AQA.
  • Black, B., & Bramley, T. 2008. Investigating a judgmental rank-ordering method for maintaining standards in UK examinations. Research Papers in Education, 23, 357–373.
  • Bramley, T. 2007. Paired comparison methods. In: P. E. Newton, J. Baird, H. Goldstein, H. Patrick & P. Tymms (Eds.), Techniques for monitoring the comparability of examination standards (pp. 246–294). London: Qualifications and Curriculum Authority.
  • Cohen, A. S., Kane, M. T., & Crooks, T. J. 1999. A generalized examinee-centered method for setting standards on achievement tests. Applied Measurement in Education, 12, 343–366.
  • Cresswell, M. J. 1997. Examining judgements: Theory and practice of awarding public examination grades. (PhD Thesis). Institute of Education, University of London, London.
  • Forster, M. 2005. Can examiners successfully distinguish between scripts that vary by only a small range on marks? Unpublished internal paper. Cambridge: Oxford Cambridge and RSA Examinations.
  • Hosmer, D. W., Jr, & Lemeshow, S. 2000. Applied logistic regression. (2nd ed.). New York, NY: Wiley.
  • Jaeger, R. M., & Mills, C. N. 2001. An integrated judgment procedure for setting standards on complex, large-scale assessments. In: G. J. Cizek (Ed.), Setting performance standards (pp. 313–338). Mahwah, NJ: Erlbaum.
  • Kingston, N. M., Kahl, S. R., Sweeney, K. P. and Bay, L. 2001. Setting performance standards using the body of work method. In G. J. Cizek (Ed.), In G. J. Cizek (Ed.), Setting performance standards. (pp. 219–248) Mahwah, NJ. Erlbaum.
  • Laming, D. 2004. Human judgment: The eye of the beholder. London: Thomson.
  • Loomis, S. C. 2000. Developing achievement levels on the 1998 national assessment of educational progress in civics: Validation research. Iowa City, IA: ACT.
  • Loomis, S. C., & Borque, M. L. 2011. From tradition to innovation: Standard setting on the national assessment of educational progress. In G. J. Cizek (Ed.), Setting performance standards. Mahwah, NJ: Erlbaum.
  • Murphy, R. J. L. 1978. Reliability of marking in eight GCE examinations. British Journal of Educational Psychology, 48, 196–200.
  • Murphy, R. J. L. 1982. A further report of investigations into the reliability of marking of GCE examinations. British Journal of Educational Psychology, 52, 58–63.
  • Murphy, R. J. L., Burke, P., Cotton, T., Hancock, J., Partington, J., Robinson, C., …, , & Gower, R. 1996. The dynamics of GCSE awarding: Report of a project conducted for the School Curriculum and Assessment Authority. London: SCAA.
  • Newton, P. E. 1996. The reliability of marking of General Certificate of Secondary Education scripts: Mathematics and English. British Educational Research Journal, 22, 405–420.
  • Pollitt, A. 2004, June. Let’s stop marking exams. Paper presented at the annual conference of the International Association for Educational Assessment (IAEA), Philadelphia, USA. Retrieved from http://www.cambridgeassessment.org.uk/ca/Our_Services/Research/Conference_Papers
  • Pollitt, A. & Elliott, G. 2003, April 4. Finding a proper role for human judgment in the examination system. Paper given at the QCA ‘Comparability and Standards’ seminar,Newport Pagnell. Retrieved from http://www.cambridgeassessment.org.uk/ca/Our_Services/Research/Conference_Papers
  • QCA 2006. GCSE, GCE, VCE, GNVQ and AEA code of practice 2006/7. London: Qualifications and Curriculum Authority.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.