Developing evaluative judgement for a time of generative artificial intelligence

References

• Alkaissi, H., and S. I. McFarlane. 2023. “Artificial Hallucinations in ChatGPT: Implications in Scientific Writing.” Cureus 15 (2): e35179. doi:10.7759/cureus.35179.
   PubMed Web of Science ®Google Scholar
• Aoun, J. E. 2017. Robot-Proof: Higher Education in the Age of Artificial Intelligence. Cambridge, Massachusetts: The MIT Press.
   Google Scholar
• Autor, D. H., F. Levy, and R. J. Murnane. 2003. “The Skill Content of Recent Technological Change: An Empirical Exploration.” The Quarterly Journal of Economics 118 (4): 1279–1333. doi:10.1162/003355303322552801.
   Web of Science ®Google Scholar
• Barnett, R., and S. Bengtsen. 2017. “Universities and Epistemology: From a Dissolution of Knowledge to the Emergence of a New Thinking.” Education Sciences 7 (1): 38. doi:10.3390/educsci7010038.
   Web of Science ®Google Scholar
• Bearman, M. 2018. “Prefigurement, Identities and Agency: The Disciplinary Nature of Evaluative Judgement.” In Developing Evaluative Judgement in Higher Education: Assessment for Knowing and Producing Quality Work, edited by David Boud, Rola Ajjawi, Phillip Dawson and Joanna Tai, 147–155. Abingdon: Routledge.
   Google Scholar
• Bearman, M., and R. Ajjawi. 2023. “Learning to Work with the Black Box: Pedagogy for a World with Artificial Intelligence.” British Journal of Educational Technology 54 (5): 1160–1173. doi:10.1111/bjet.13337.
   Web of Science ®Google Scholar
• Bearman, M., and R. Luckin. 2020. “Preparing University Assessment for a World with AI: Tasks for Human Intelligence.” In Re-Imagining University Assessment in a Digital World, edited by Margaret Bearman, Phillip Dawson, Rola Ajjawi, Joanna Tai and David Boud, 49–63. Cham: Springer.
   Google Scholar
• Bearman, M., J. H. Nieminen, and R. Ajjawi. 2023. “Designing Assessment in a Digital World: An Organising Framework.” Assessment & Evaluation in Higher Education 48 (3): 291–304. doi:10.1080/02602938.2022.2069674.
   Web of Science ®Google Scholar
• Bearman, M., J. Ryan, and R. Ajjawi. 2023. “Discourses of Artificial Intelligence in Higher Education: A Critical Literature Review.” Higher Education 86 (2): 369–385. doi:10.1007/s10734-022-00937-2.
   Web of Science ®Google Scholar
• Bender, E. M., T. Gebru, A. McMillan-Major, and S. Shmitchell. 2021. “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?.” Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. Virtual event, Canada.
   Google Scholar
• Boud, D. 2000. “Sustainable Assessment: Rethinking Assessment for the Learning Society.” Studies in Continuing Education 22 (2): 151–167. doi:10.1080/713695728.
   Google Scholar
• Chen, L., S. Howitt, D. Higgins, and S. Murray. 2022. “Students’ Use of Evaluative Judgement in an Online Peer Learning Community.” Assessment & Evaluation in Higher Education 47 (4): 493–506. doi:10.1080/02602938.2021.1933378.
   Web of Science ®Google Scholar
• Chong, S. W. 2021. “University Students’ Perceptions towards Using Exemplars Dialogically to Develop Evaluative Judgement: The Case of a High-Stakes Language Test.” Asian-Pacific Journal of Second and Foreign Language Education 6 (1): 12. doi:10.1186/s40862-021-00115-4.
   Web of Science ®Google Scholar
• Dawson, P. 2020. “Cognitive Offloading and Assessment.” In Re-Imagining University Assessment in a Digital World, edited by Margaret Bearman, Phillip Dawson, Rola Ajjawi, Joanna Tai, and David Boud, 37–48. Cham: springer.
   Google Scholar
• De Mello Heredia, J., M. Henderson, and M. Phillips. 2023. “Using Video Feedback to Support Students.” Evaluative Judgement Society for Information Technology & Teacher Education International Conference 2023, New Orleans, LA. https://www.learntechlib.org/p/222090
   Google Scholar
• Escalante, J., A. Pack, and A. Barrett. 2023. “AI-Generated Feedback on Writing: Insights into Efficacy and ENL Student Preference.” International Journal of Educational Technology in Higher Education 20 (1): 57. doi:10.1186/s41239-023-00425-2.
   Web of Science ®Google Scholar
• Freeman, J. 2024. Provide or Punish? Students’ Views on Generative AI in Higher Education. Oxford: Higher Education Policy Institute. https://www.hepi.ac.uk/2024/02/01/provide-or-punish-students-views-on-generative-ai-in-higher-education/
   Google Scholar
• Guo, Y., and D. Lee. 2023. “Leveraging ChatGPT for Enhancing Critical Thinking Skills.” Journal of Chemical Education 100 (12): 4876–4883. doi:10.1021/acs.jchemed.3c00505.
   Web of Science ®Google Scholar
• Gyamfi, G., B. E. Hanna, and H. Khosravi. 2022. “The Effects of Rubrics on Evaluative Judgement: A Randomised Controlled Experiment.” Assessment & Evaluation in Higher Education 47 (1): 126–143. doi:10.1080/02602938.2021.1887081.
   Web of Science ®Google Scholar
• Kuhn, D., R. Cheney, and M. Weinstock. 2000. “The Development of Epistemological Understanding.” Cognitive Development 15 (3): 309–328. doi:10.1016/S0885-2014(00)00030-7.
   Web of Science ®Google Scholar
• Lipnevich, A. A., and J. K. Smith. 2009a. “Effects of Differential Feedback on Students’ Examination Performance.” Journal of Experimental Psychology. Applied 15 (4): 319–333. doi:10.1037/a0017841.
   PubMed Web of Science ®Google Scholar
• Lipnevich, A. A., and J. K. Smith. 2009b. “I Really Need Feedback to Learn:” Students’ Perspectives on the Effectiveness of the Differential Feedback Messages.” Educational Assessment, Evaluation and Accountability 21 (4): 347–367. doi:10.1007/s11092-009-9082-2.
   Web of Science ®Google Scholar
• Luo, J., and C. K. Chan. 2023. “Conceptualising Evaluative Judgement in the Context of Holistic Competency Development: Results of a Delphi Study.” Assessment & Evaluation in Higher Education 48 (4): 513–528. doi:10.1080/02602938.2022.2088690.
   Web of Science ®Google Scholar
• Malecka, B., and D. Boud. 2023. “Fostering Student Motivation and Engagement with Feedback through Ipsative Processes.” Teaching in Higher Education 28 (7): 1761–1776. doi:10.1080/13562517.2021.1928061.
   Web of Science ®Google Scholar
• Markauskaite, L., R. Marrone, O. Poquet, S. Knight, R. Martinez-Maldonado, S. Howard, J. Tondeur, et al. 2022. “Rethinking the Entwinement between Artificial Intelligence and Human Learning: What Capabilities Do Learners Need for a World with AI?” Computers and Education: Artificial Intelligence 3: 100056. doi:10.1016/j.caeai.2022.100056.
   Google Scholar
• McIver, S., and B. Murphy. 2023. “Self-Assessment and What Happens over Time: Student and Staff Perspectives, Expectations and Outcomes.” Active Learning in Higher Education 24 (2): 207–219. doi:10.1177/14697874211054755.
   Web of Science ®Google Scholar
• Molloy, E., and M. Bearman. 2019. “Embracing the Tension between Vulnerability and Credibility: ‘Intellectual Candour’ in Health Professions Education.” Medical Education 53 (1): 32–41. doi:10.1111/medu.13649.
   PubMed Web of Science ®Google Scholar
• Nam, J. 2023, November 22). “56% of College Students Have Used AI on Assignments or Exams.” BestColleges.com. https://www.bestcolleges.com/research/most-college-students-have-used-ai-survey/
   Google Scholar
• Nicol, D. 2021. “The Power of Internal Feedback: Exploiting Natural Comparison Processes.” Assessment & Evaluation in Higher Education 46 (5): 756–778. doi:10.1080/02602938.2020.1823314.
   Web of Science ®Google Scholar
• Prather, J., P. Denny, J. Leinonen, B. A. Becker, I. Albluwi, M. Craig, H. Keuning, N. Kiesler, T. Kohn, and A. Luxton-Reilly. 2023. “The Robots Are Here: Navigating the Generative AI Revolution in Computing Education.” In Proceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education, 108–159. Turku, Finland. doi:10.1145/3623762.3633499.
   Google Scholar
• Sadler, D. R. 1989. “Formative Assessment and the Design of Instructional Systems.” Instructional Science 18 (2): 119–144. doi:10.1007/BF00117714.
   Web of Science ®Google Scholar
• Siiman, L. A., M. Rannastu-Avalos, J. Pöysä-Tarhonen, P. Häkkinen, and M. Pedaste. 2023. “Opportunities and Challenges for AI-Assisted Qualitative Data Analysis: An Example from Collaborative Problem-Solving Discourse Data.” International Conference on Innovative Technologies and Learning, Porto, Portugal.
   Google Scholar
• Tai, J., R. Ajjawi, D. Boud, P. Dawson, and E. Panadero. 2018. “Developing Evaluative Judgement: Enabling Students to Make Decisions about the Quality of Work.” Higher Education 76 (3): 467–481. doi:10.1007/s10734-017-0220-3.
   Web of Science ®Google Scholar
• Telio, S., G. Regehr, and R. Ajjawi. 2016. “Feedback and the Educational Alliance: Examining Credibility Judgements and Their Consequences.” Medical Education 50 (9): 933–942. doi:10.1111/medu.13063.
   PubMed Web of Science ®Google Scholar
• Watling, C., E. Driessen, C. P. van der Vleuten, and L. Lingard. 2012. “Learning from Clinical Work: The Roles of Learning Cues and Credibility Judgements.” Medical Education 46 (2): 192–200. doi:10.1111/j.1365-2923.2011.04126.x.
   PubMed Web of Science ®Google Scholar
• Welding, L. 2023, March 23. “Half of College Students Say Using AI on Schoolwork Is Cheating or Plagiarism.” BestColleges.com.
   Google Scholar
• Ziebell, N., and J. Skeat. 2023. “How Is Generative AI Being Used by University Students and Academics?.” Semester 1, 2023.
   Google Scholar