The development of students’ evaluative expertise: enabling conditions for integrating criteria into pedagogic practice

References

• Adie, L. (2013). The development of teacher assessment identity through participation in online moderation. Assessment in Education: Principles, Policy & Practice, 20(1), 91–106.
   Google Scholar
• Adie, L., Klenowski, V., & Wyatt-Smith, C. (2012). Towards an understanding of teacher judgement in the context of social moderation. Educational Review, 64(2), 223–240.
   Web of Science ®Google Scholar
• Adie, L., Van der Kleij, F., & Cumming, J. (2018). The development and application of coding frameworks to explore dialogic feedback interactions and self-regulated learning. British Educational Research Journal, 44(4), 704–723.
   Web of Science ®Google Scholar
• Adie, L., & Willis, J. (2014). Using annotations to inform an understanding of achievement standards. Assessment Matters, 6, 112–136.
   Google Scholar
• Andrade, H., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced self-assessment on elementary school students’ writing. Educational Measurement: Issues and Practice, 27, 3–13.
   Google Scholar
• Baird, J.-A., Hopfenbeck, T. N., Newton, P., Stobart, G., & Steen-Utheim, A. T. (2014). Assessment and learning: State of the field review. Lysaker, Norway: Knowledge Centre for Education. Retrieved from https://www.forskningsradet.no/servlet/Satellite?c=Rapport&cid=1253996755700&lang=en&pagename=kunnskapssenter%2FHovedsidemal
   Google Scholar
• Bearman, M., & Ajjawi, R. (2018). From “Seeing Through” to “Seeing With”: assessment criteria and the myths of transparency. Frontiers in Education, 3(96), 1–8.
   Google Scholar
• Biggs, J. B. (2003). Teaching for quality learning at university (2nd ed.). Buckingham: Open University Press/Society for Research into Higher Education.
   Google Scholar
• Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 551–575.
   Web of Science ®Google Scholar
• Boomer, G. (1992). Negotiating the curriculum. In G. Boomer, N. Lester, C. Onore, & J. Cook (Eds.), Negotiating the curriculum: Educating for the 21st century (pp. 4–13). London: Falmer.
   Google Scholar
• Boud, D., & Soler, R. (2016). Sustainable assessment revisited. Assessment and Evaluation in Higher Education, 41(3), 400–413.
   Web of Science ®Google Scholar
• Bourgeois, L. (2016). Supporting students’ learning: From teacher regulation to co-regulation. In D. Laveault & L. Allal (Eds.), Assessment for learning: Overcoming the challenges of implementation (pp. 345–363). Dordrecht, Netherlands: Springer.
   Google Scholar
• Brookhart, S. M. (2016). Section discussion: Building assessments that work in classrooms. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of human and social conditions in assessment (pp. 351–365). New York: Routledge.
   Google Scholar
• Brown, G. T. L., Lake, R., & Matters, G. (2011). Queensland teachers’ conceptions of assessment: The impact of policy priorities on teacher attitudes. Teaching and Teacher Education, 27(1), 210–220.
   Web of Science ®Google Scholar
• Carless, D. (2013). Trust and its role in facilitating dialogic feedback. In D. Boud & E. Molloy (Eds.), Feedback in higher and professional education: Understanding it and doing it well (pp. 90–103). London: Routledge.
   Google Scholar
• Clark, I. (2012). Formative assessment: Assessment is for self-regulated learning. Educational Psychology Review, 24(2), 205–249.
   Web of Science ®Google Scholar
• Connolly, S., Klenowski, V., & Wyatt-Smith, C. M. (2012). Moderation and consistency of teacher judgement: Teachers’ views. British Educational Research Journal, 38(4), 593–614.
   Web of Science ®Google Scholar
• Dann, R. (2015). Developing the foundations for dialogic feedback in order to better understand the “learning gap” from a pupil’s perspective. London Review of Education, 13(3), 5–20.
   Web of Science ®Google Scholar
• Delandshere, G. (2002). Assessment as inquiry. Teachers College Record, 104(7), 1461–1484.
   Web of Science ®Google Scholar
• Eisenhart, M. (1995). The fax, the jazz player, and the self-story teller: How “do” people organize culture? Anthropology and Education Quarterly, 26(1), 3–26.
   Web of Science ®Google Scholar
• Elwood, J., & Murphy, P. (2015). Assessment systems as cultural scripts: A sociocultural theoretical lens on assessment practice and products. Assessment in Education: Principles, Policy & Practice, 22(2), 182–192.
   Web of Science ®Google Scholar
• Gao, M. (2009). Students’ voices in school-based assessment of Hong Kong: A case study. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Student perspectives on assessment: What students can tell us about assessment for learning (pp. 107–130). Charlotte, NC: Information Age Publishing.
   Google Scholar
• Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. New York: Aldine De Gruyter.
   Google Scholar
• Glogger-Frey, I., Herppich, S., & Seidel, T. (2018). Linking teachers’ professional knowledge and teachers’ actions: Judgment processes, judgments and training. Teaching and Teacher Education, 76, 176–180.
   Web of Science ®Google Scholar
• Graham, L. J., Tancredi, H., Willis, J., & McGraw, K. (2018). Designing out barriers to student access and participation in secondary school assessment. Australian Educational Researcher, 45(1), 103–124.
   Web of Science ®Google Scholar
• Harris, L. R., Brown, G. T. L., & Dargusch, J. (2018). Not playing the game: Student assessment resistance as a form of agency. Australian Educational Researcher, 45(1), 125–140.
   Web of Science ®Google Scholar
• Harris, L. R., Brown, G. T. L., & Harnett, J. A. (2014). Understanding classroom feedback practices: A study of New Zealand student experiences, perceptions, and emotional responses. Educational Assessment, Evaluation and Accountability, 26(2), 107–133.
   Web of Science ®Google Scholar
• Harris, L. R., Brown, G. T. L., & Harnett, J. A.  (2015). Analysis of New Zealand primary and secondary student peer- and self-assessment comments: Applying Hattie and Timperley’s feedback model. Assessment in Education: Principles, Policy & Practice, 22(02), 265–281.
   Google Scholar
• Harris, L. R., Harnett, J. A., & Brown, G. T. L. (2009). ‘Drawing’ out student conceptions: Using pupils’ pictures to examine their conceptions of assessment. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Student perspectives on assessment: What students can tell us about assessment for learning (pp. 321–330). Charlotte, NC US: Information Age Publishing.
   Google Scholar
• Hawe, E. M., & Dixon, H. R. (2014). Building students’ evaluative and productive expertise in the writing classroom. Assessing Writing, 19, 66–79.
   Web of Science ®Google Scholar
• James, M., & McCormick, R. (2009). Teachers learning how to learn. Teaching and Teacher Education, 25(7), 973–982.
   Web of Science ®Google Scholar
• Jonsson, A. (2014). Rubrics as a way of providing transparency in assessment. Assessment & Evaluation in Higher Education, 39, 840–852.
   Web of Science ®Google Scholar
• Klenowski, V., Adie, L., Gunn, S., Looney, A., Elwood, J., Wyatt-Smith, C., & Colbert, P. (2007, November). Moderation as judgement practice: Reconciling system level accountability and local level practice. Paper presented at the Australian Association for Research in Education [AARE] 2007 Conference: Research impacts: Proving or improving, Freemantle, Australia.
   Google Scholar
• Klenowski, V., & Wyatt-Smith, C. (2010). Standards, teacher judgement and moderation in contexts of national curriculum and assessment reform. Assessment Matters, 2, 107–131.
   Google Scholar
• Klenowski, V., & Wyatt-Smith, C. (2014). Assessment for education: Standards, judgement and moderation. London: SAGE.
   Google Scholar
• Kress, G. (2000). “You’ve just got to learn how to see”: Curriculum subjects, young people and schooled engagement with the world. Linguistics and Education, 11(4), 401–415.
   Google Scholar
• Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press.
   Google Scholar
• Looney, A., Cumming, J., Van Der Kleij, F., & Harris, K. (2018). Reconceptualising the role of teachers as assessors: Teacher assessment identity. Assessment in Education: Principles, Policy & Practice, 25(5), 442–467.
   Web of Science ®Google Scholar
• Lyle, S. (2008). Dialogic teaching: Discussing theoretical contexts and reviewing evidence from classroom practice. Language and Education, 22(3), 222–240.
   Web of Science ®Google Scholar
• Merriam-Webster dictionary. (2018). https://www.merriam-webster.com/
   Google Scholar
• Murillo, F. J., & Hidalgo, N. (2017). Students’ conceptions about a fair assessment of their learning. Studies in Educational Evaluation, 53, 10–16.
   Web of Science ®Google Scholar
• Peterson, E. R., & Irving, S. E. (2008). Secondary school students’ conceptions of assessment and feedback. Learning and Instruction, 18(3), 238–250.
   Web of Science ®Google Scholar
• Phelps, L. (1989). Images of student writing: The deep structure of teacher response. In C. M. Anson (Ed.), Writing and response: Theory, practice, and research (pp. 37–67). Urbana: National Council of Teachers of English.
   Google Scholar
• Queensland Curriculum and Assessment Authority. (2019). School-based assessment. Retrieved from https://studentconnect.qcaa.qld.edu.au/12614.html
   Google Scholar
• Remesal, A. (2009). Accessing primary pupils’ conceptions of daily classroom assessment practices. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Student perspectives on assessment: What students can tell us about assessment for learning (pp. 25–51). Charlotte, NC: Information Age Publishing.
   Google Scholar
• Rogoff, B. (1995). Observing sociocultural activity on three planes: Participatory appropriation, guided participation, and apprenticeship. In J. V. Wertsch, P. Del Rio, & A. Alvarez (Eds.), Sociocultural studies of mind (pp. 139–164). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Rowntree, D. (1987). Assessing students: How shall we know them? (2nd rev ed.). London: Kogan Page.
   Google Scholar
• Sadler, D. R. (1985). The origins and functions of evaluative criteria. Educational Theory, 35(3), 285–297.
   Google Scholar
• Sadler, D. R. (1986). School-based assessment and school autonomy. Discussion paper 11. In Review of school-based assessment (ROSBA) Discussion Papers. Queensland Board of Secondary School Studies. Retrieved from https://www.qcaa.qld.edu.au/downloads/publications/research_qbssss_rosba_11.pdf
   Google Scholar
• Sadler, D. R. (1987). Specifying and promulgating achievement standards. Oxford Review of Education, 13(2), 191–209.
   Web of Science ®Google Scholar
• Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144.
   Web of Science ®Google Scholar
• Sadler, D. R. (2009). Indeterminacy in the use of preset criteria for assessment and grading. Assessment and Evaluation in Higher Education, 34(2), 159–179.
   Web of Science ®Google Scholar
• Silverman, D. (1993). Interpreting qualitative data: Methods for analysing talk, text and interaction. London: Sage.
   Google Scholar
• Smith, C. M. (1995). Teachers’ reading practices in the secondary school writing classroom: A reappraisal of the nature and function of pre-specified assessment criteria (Doctoral thesis). The University of Queensland, Brisbane, Australia.
   Google Scholar
• Stake, R. (2004). Standards-based & responsive evaluation. Thousand Oaks, CA: Sage.
   Google Scholar
• Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: Enabling students to make decisions about the quality of work. Higher Education, 76(3), 467–481.
   Web of Science ®Google Scholar
• Thrupp, M., & White, M. (2013). Research, analysis and insight into national standards [RAINS] project final report: National standards and the damage done. Wellington: The New Zealand Educational Institute.
   Google Scholar
• Tierney, R. D. (2014). Fairness as a multifaceted quality in classroom assessment. Studies in Educational Evaluation, 43, 55–69.
   Web of Science ®Google Scholar
• Torrance, H. (2007). Assessment as learning? How the use of explicit learning objectives, assessment criteria and feedback in post-secondary education and training can come to dominate learning. Assessment in Education: Principles, Policy & Practice, 14(3), 281–294.
   Google Scholar
• Torrance, H. (2012). Formative assessment at the crossroads: Conformative, deformative and transformative assessment. Oxford Review of Education, 38(3), 323–342.
   Web of Science ®Google Scholar
• Torrance, H., & Pryor, J. (2001). Developing formative assessment in the classroom: Using action research to explore and modify theory. British Educational Research Journal, 27(5), 615–631.
   Web of Science ®Google Scholar
• Van der Kleij, F., Adie, L., & Cumming, J. (2017). Using video technology to enable student voice in assessment feedback. British Journal of Educational Technology, 48(5), 1092–1105.
   Web of Science ®Google Scholar
• Van der Kleij, F. M., Adie, L. E., & Cumming, J. J. (2019). Feasibility and value of using a GoPro camera and iPad to study teacher-student assessment feedback interactions. In B. P. Veldkamp & C. Sluijter (Eds.), Theoretical and practical advances in computer-based educational measurement. Springer. ISBN 978-3-030-18479-7-0.
   Google Scholar
• Vincelette, E. J., & Bostic, T. (2013). Show and tell: Student and instructor perceptions of screencast assessment. Assessing Writing, 18(4), 257–277.
   Web of Science ®Google Scholar
• Vogl, E., & Pekrun, R. (2016). Emotions that matter to achievement: Student feelings about assessment. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of human and social conditions in assessment (pp. 111–128). New York: Routledge.
   Google Scholar
• Wenger, E. (1998). Communities of practice: Learning, meaning and identity. Cambridge: Cambridge University Press.
   Google Scholar
• Wiggins, G., & McTighe, J. (2005). Understanding by design (Expanded 2nd ed.). Alexandria, USA: Association for supervision and Curriculum (ASCD).
   Google Scholar
• Winne, P. H. (2018). Theorizing and researching levels of processing in self-regulated learning. British Journal of Educational Psychology, 88(1), 9–20.
   PubMed Web of Science ®Google Scholar
• Wyatt-Smith, C., & Bridges, S. (2007). Meeting in the middle – Assessment, pedagogy, learning and educational disadvantage. Evaluation Study for the Department of Education, Science and Training on Literacy and Numeracy in the Middle years of Schooling Initiative Strand A, Queensland Project Report.
   Google Scholar
• Wyatt-Smith, C., Bridges, S., Hedemann, M., & Neville, M. (2008). A professional learning model for rethinking educational disadvantage: Partnerships for local and system networks. The Australian Educational Researcher, 35(3), 1–20.
   Web of Science ®Google Scholar
• Wyatt-Smith, C., Castleton, G., Freebody, P., & Cooksey, R. (2003a). The nature of teachers’ qualitative judgements: A matter of context and salience: Part one: ‘In-context’ judgements. Australian Journal of Language and Literacy, 26(2), 11–32.
   Google Scholar
• Wyatt-Smith, C., Castleton, G., Freebody, P., & Cooksey, R. (2003b). The nature of teachers’ qualitative judgements: A matter of context and salience: Part two: ‘Out-of-context’ judgements. Australian Journal of Language and Literacy, 26(2), 33–42.
   Google Scholar
• Wyatt-Smith, C., & Cumming, J. J. (2003). Curriculum literacies: Expanding domains of assessment. Assessment in Education: Principles, Policy & Practice, 10(1), 47–59.
   Google Scholar
• Wyatt-Smith, C., & Klenowski, V. (2013). Explicit, latent and meta-criteria: Types of criteria at play in professional judgement practice. Assessment in Education: Principles, Policy & Practice, 20, 35–52.
   Google Scholar
• Wyatt-Smith, C., Klenowski, V., & Gunn, S. (2010). The centrality of teachers’ judgement practice in assessment: A study of standards in moderation. Assessment in Education: Principles, Policy & Practice, 17(1), 59–75.
   Google Scholar
• Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162.
   Web of Science ®Google Scholar
• Young, M. (2014). What is a curriculum and what can it do? Curriculum Journal, 25(1), 7–13.
   Google Scholar