‘You can see the quality in front of your eyes’: grounding academic standards between rationality and interpretation

References

• Alderman , G. 2009 . Defining and measuring academic standards: a British perspective . Higher Education Management and Policy , 21 ( 3 ) : 11 – 22 .
   Google Scholar
• Ashworth , M. , Bloxham , S. and Pearce , L. 2010 . Examining the tension between academic standards and inclusion for disabled students: the impact on marking of individual academics’ frameworks for assessment . Studies in Higher Education , 35 ( 2 ) : 209 – 23 .
   Web of Science ®Google Scholar
• Bloxham, S. & Boyd, P., 2011, ‘Accountability in grading student work: securing academic standards in a twenty-first century quality assurance context’, British Educational Research Journal. Available online at: http://dx.doi.org/10.1080/01411926.2011.569007.
   Google Scholar
• Bloxham , S. , Boyd , P. and Orr , S. 2011 . Mark my words: the role of assessment criteria in UK higher education grading practices . Studies in Higher Education , 36 ( 6 ) : 655 – 70 .
   Web of Science ®Google Scholar
• Boyd, P. & Bloxham, S., 2011, ‘Grading student work: the workplace learning of university lecturers in their role as assessors of student coursework’, paper presented at the Society for Research in Higher Education Conference, Newport, Wales, 7–9 December.
   Google Scholar
• Brennan , J. 1996 . “ Introduction: the standards debate ” . In Changing Conceptions of Academic Standards , Edited by: Brennan , J. London : Open University Quality Support Centre .
   Google Scholar
• Broad , B. 2000 . Pulling your hair out: crises of standardization in communal writing . Research in the Teaching of English , 35 : 213 – 60 .
   Web of Science ®Google Scholar
• Broad , B. 2003 . What We Really Value: Beyond rubrics in teaching and assessing writing , Logan : Utah State University Press .
   Google Scholar
• Bruner , J.S. 1996 . The Culture of Education , Cambridge , MA : Harvard University Press .
   Google Scholar
• Carless , D. 2009 . Trust, distrust and their impact on assessment reform . Assessment & Evaluation in Higher Education , 34 ( 1 ) : 78 – 89 .
   Web of Science ®Google Scholar
• Coates , H. 2010 . Defining and monitoring academic standards in Australian higher education . Higher Education Management and Policy , 22 ( 1 ) : 41 – 58 .
   Google Scholar
• Crisp , V. 2008 . Exploring the nature of examiner thinking during the process of examination marking . Cambridge Journal of Education , 38 ( 2 ) : 247 – 64 .
   Google Scholar
• Delandshere , G. 2001 . Implicit theories, unexamined assumptions and the status quo of educational assessment . Assessment in Education , 8 ( 2 ) : 113 – 33 .
   Google Scholar
• Delaney, C.M., 2005, ‘The evaluation of university students’ written work’, paper presented at the British Educational Research Association Annual Conference, Glamorgan, Wales, 14–17 September.
   Google Scholar
• den Outer, B. & Handley, K., 2010, ‘Standards, situation and self-criticality: exploring situational analysis, grounded theory and the postmodern turn, to enhance reflexive practice in higher education research’, paper presented at the Higher Education Close Up 5 Conference, Lancaster, UK, 20–22 July.
   Google Scholar
• Dobson , S. 2008a . Applying a validity argument model to three examples of the viva . Nordisk Pedagogik , 28 : 332 – 44 .
   Google Scholar
• Dobson , S. 2008b . Theorising the viva: a qualitative approach . Assessment & Evaluation in Higher Education , 33 ( 3 ) : 277 – 88 .
   Web of Science ®Google Scholar
• Elander , J. and Hardman , D. 2002 . An application of judgement analysis to examination marking in psychology . British Journal of Psychology , 93 : 303 – 28 .
   PubMed Web of Science ®Google Scholar
• Gaunt , D. 1999 . The practitioner as external examiner . Quality in Higher Education , 5 ( 1 ) : 81 – 90 .
   Google Scholar
• Grainger , P. , Purnell , K. and Zipf , R. 2008 . Judging quality through substantive conversations between markers . Assessment & Evaluation in Higher Education , 33 ( 2 ) : 133 – 42 .
   Web of Science ®Google Scholar
• Greatorex, J., 2000, ‘Is the glass half full or half empty? What examiners really think of candidates’ achievement’, paper presented at the British Educational Research Association Conference, Cardiff, Wales, 7–10 September.
   Google Scholar
• Hartley , J. , Trueman , M. , Betts , L. and Brodie , L. 2006 . What price presentation? The effects of typographic variables on essay grades . Assessment & Evaluation in Higher Education , 31 ( 5 ) : 523 – 34 .
   Google Scholar
• Harvey , L. 2002 . Evaluation for what? . Teaching in Higher Education , 7 ( 3 ) : 246 – 63 .
   Google Scholar
• Hawe , E. 2002 . Assessment in a pre-service teacher education programme: the rhetoric and the practice of standards-based assessment . Asia Pacific Journal of Teacher Education , 30 : 93 – 106 .
   Google Scholar
• Hunter , K. and Docherty , P. 2011 . Reducing variation in the assessment of student writing . Assessment & Evaluation in Higher Education , 36 ( 1 ) : 109 – 24 .
   Web of Science ®Google Scholar
• Jackson , N. 1999 . “ Foreword ” . In Benchmarking and Threshold Standards in Higher Education , Edited by: Smith , H. , Armstrong , M. and Brown , S. London : Kogan Page .
   Google Scholar
• Jawitz , J. 2009 . Learning in the academic workplace. the harmonization of the collective and individual habitus . Studies in Higher Education , 34 ( 6 ) : 601 – 14 .
   Web of Science ®Google Scholar
• Kangis , P. 2001 . Presentational dimensions and marks awarded to assignments . Quality in Higher Education , 7 ( 3 ) : 199 – 206 .
   Google Scholar
• Kappler, K., 2004, ‘NCATE: wolf in shepherd’s clothes’, in Poetter, T., Goodney, T. & Bird. J. (Eds.), Critical Perspectives on the Curriculum of Teacher Education (Lanham, MD, University Press of America).
   Google Scholar
• Knight , P. 2006 . The local practices of assessment . Assessment & Evaluation in Higher Education , 31 ( 4 ) : 435 – 52 .
   Google Scholar
• Leach , L. , Neutze , G. and Zepke , N. 2001 . Assessment and empowerment: some critical questions . Assessment & Evaluation in Higher Education , 26 ( 4 ) : 293 – 305 .
   Google Scholar
• Martin , S. and Cloke , C. 2000 . Standards for the award of qualified teacher status: reflections on assessment implications . Assessment & Evaluation in Higher Education , 25 ( 2 ) : 183 – 90 .
   Google Scholar
• Middlehurst , R. 1996 . “ Degree standards and quality assurance: a discussion ” . In Changing Conceptions of Academic Standards , Edited by: Brennan , J. London : Open University Quality Support Centre .
   Google Scholar
• Milanovic , M. , Saville , N. and Shuhong , S. 1996 . “ A study of the decision-making behaviour of composition markers ” . In Performance Testing, Cognition and Assessment , Edited by: Milanovic , M. and Saville , N. Cambridge : Cambridge University Press .
   Google Scholar
• Morgan , W. and Wyatt-Smith , C.M. 2000 . Im/proper accountability: towards a theory of critical literacy and assessment . Assessment in Education , 7 ( 1 ) : 123 – 42 .
   Google Scholar
• Moss , P.A. and Schutz , A. 2001 . Educational standards, assessment and the search for consensus . American Educational Research Journal , 38 ( 1 ) : 37 – 70 .
   Web of Science ®Google Scholar
• Mullins , G. and Kiley , M. 2002 . It’s a PhD, not a Nobel prize”: how experienced examiners assess research theses . Studies in Higher Education , 27 ( 4 ) : 369 – 86 .
   Web of Science ®Google Scholar
• Neil , D.T. and Wadley , D.A. 1999 . A generic framework for criterion-referenced assessment of undergraduate essays . Journal of Geography in Higher Education , 23 ( 3 ) : 303 – 19 .
   Web of Science ®Google Scholar
• Norcini , J.J. and Shea , J.A. 1997 . The credibility and comparability of standards . Applied Measurement in Education , 10 ( 1 ) : 39 – 59 .
   Web of Science ®Google Scholar
• O’Donovan , B. , Price , M. and Rust , C. 2004 . Know what I mean? Enhancing student understanding of assessment standards and criteria . Teaching in Higher Education , 9 ( 3 ) : 325 – 35 .
   Web of Science ®Google Scholar
• O’Donovan , B. , Price , M. and Rust , C. 2008 . Developing student understanding of assessment standards: a nested hierarchy of approaches . Teaching in Higher Education , 13 ( 2 ) : 205 – 17 .
   Web of Science ®Google Scholar
• Orr , S. 2008 . “ Real or imagined? The shift from norm referencing to criterion referencing ” . In Balancing Dilemmas in Assessment and Learning in Contemporary Education , Edited by: Havnes , A. and McDowell , L. London : Routledge .
   Google Scholar
• Orr , S. 2010 . We kind of try to merge our own experience with the objectivity of the criteria”: the role of connoisseurship and tacit practice in undergraduate fine art assessment . Art, Design and Communication in Higher Education , 9 ( 1 ) : 5 – 19 .
   Google Scholar
• Orrell , J. 2003 . “ Congruence and disjunctions between academics’ thinking when assessing and their beliefs about assessment practice ” . In Improving Student Learning: Theory, research and scholarship , Edited by: Rust , C. Oxford : Oxford Centre for Staff and Learning Development .
   Google Scholar
• Orrell , J. 2008 . “ Assessment beyond belief: the cognitive process of grading ” . In Balancing Dilemmas in Assessment and Learning in Contemporary Education , Edited by: Havnes , A. and McDowell , L. London : Routledge .
   Google Scholar
• Popham , W.J. 2009 . Unlearned Lessons: Six stumbling blocks to our schools’ success , Cambridge , MA : Harvard Educational Press .
   Google Scholar
• Price , M. , O’Donovan , B. and Rust , C. 2001 . The student experience of criterion-referenced assessment (through the introduction of a common criteria assessment grid) . Innovations in Education and Teaching International , 38 ( 1 ) : 74 – 85 .
   Web of Science ®Google Scholar
• Quality Assurance Agency for Higher Education (QAA) . 2010 . Evaluation of the Academic Infrastructure: Final report , Gloucester , , UK : QAA .
   Google Scholar
• Ross , V. 2009 . External music examiners: micro-macro tasks in quality assurance practices . Music Education Research , 11 ( 4 ) : 473 – 84 .
   Web of Science ®Google Scholar
• Rust , C. , O’Donovan , B. and Price , M. 2003 . Improving students learning by developing their understanding of assessment criteria and processes . Assessment & Evaluation in Higher Education , 28 ( 2 ) : 147 – 64 .
   Google Scholar
• Rust , C. , O’Donovan , B. and Price , M. 2005 . A social constructivist assessment process model: how the research literature shows us this could be best practice . Assessment & Evaluation in Higher Education , 30 ( 3 ) : 231 – 40 .
   Google Scholar
• Sadler , D.R. 1987 . Specifying and promulgating achievement standards . Oxford Review of Education , 13 ( 2 ) : 191 – 209 .
   Web of Science ®Google Scholar
• Sadler , D.R. 1989 . Formative assessment and the design of instructional systems . Instructional Science , 18 ( 2 ) : 119 – 44 .
   Web of Science ®Google Scholar
• Sadler , D.R. 2005 . Interpretations of criteria-based assessment and grading in higher education . Assessment & Evaluation in Higher Education , 30 ( 2 ) : 175 – 94 .
   Google Scholar
• Sadler , D.R. 2009a . Indeterminancy in the use of preset criteria for assessment and grading . Assessment & Evaluation in Higher Education , 34 ( 2 ) : 159 – 79 .
   Web of Science ®Google Scholar
• Sadler , D.R. 2009b . “ Transforming holistic assessment and grading into a vehicle for complex learning ” . In Assessment, Learning and Judgement in Higher Education , Edited by: Joughin , G. New York : Springer .
   Google Scholar
• Sadler , D.R. 2011 . Academic freedom, achievement standards and professional identity . Quality in Higher Education , 17 ( 1 ) : 85 – 100 .
   Google Scholar
• Salmi , J. 2009 . The Growing Accountability Agenda in Tertiary Education: Progress or missed blessing? , Washington , DC : World Bank .
   Google Scholar
• Shay, S., 2004, ‘The assessment of complex performance. a socially situated interpretive act’, Harvard Educational Review, 74(3), pp. 307–29.
   Google Scholar
• Shay , S. 2005 . The assessment of complex tasks: a double reading . Studies in Higher Education , 30 ( 6 ) : 663 – 79 .
   Web of Science ®Google Scholar
• Shay , S. 2008 . Beyond social constructivist perspectives on assessment: the centring of knowledge . Teaching in Higher Education , 13 ( 5 ) : 595 – 605 .
   Web of Science ®Google Scholar
• Silver , H. and Williams , S. 1996 . “ Academic standards and the external examiner ” . In Changing Conceptions of Academic Standards , Edited by: Brennan , J. London : Open University Quality Support Centre .
   Google Scholar
• Stiggins , R.J. 1991 . Assessment literacy . Phi Delta Kappan , 72 ( 7 ) : 534 – 39 .
   Web of Science ®Google Scholar
• Tang , S.Y.F. 2008 . Issues in field experience assessment in teacher education in a standards based context . Journal of Education for Teaching , 34 ( 1 ) : 17 – 32 .
   Google Scholar
• Vaughan , C. 1991 . “ Holistic assessment: what goes on in the rater’s mind? ” . In Assessing Second Language Writing in Academic Contexts , Edited by: Hamp-Lyons , L. Norwood , NJ : Ablex .
   Google Scholar
• Warren Piper , D. 1994 . Are Professors Professional , London : Jessica Kingsley .
   Google Scholar
• Wolf , A. 1995 . Competence-based Assessment , Buckingham , , UK : Open University Press .
   Google Scholar
• Woolf , H. 2004 . Assessment criteria: reflections on current practices . Assessment & Evaluation in Higher Education , 29 ( 4 ) : 479 – 93 .
   Google Scholar
• Woolf , H. and Cooper , A. 1999 . Benchmarking academic standards in history: an empirical exercise . Quality in Higher Education , 5 ( 2 ) : 145 – 54 .
   Google Scholar
• Yorke , M. 2008 . Grading Student Achievement in Higher Education , London : Routledge .
   Google Scholar
• Yorke , M. 2009 . “ Faulty signals? Inadequacies of grading systems and a possible response ” . In Assessment, Learning and Judgement in Higher Education , Edited by: Joughin , G. New York : Springer .
   Google Scholar
• Yorke , M. 2011 . Summative assessment: dealing with the ‘measurement fallacy . Studies in Higher Education , 36 ( 3 ) : 251 – 73 .
   Web of Science ®Google Scholar