Assessing law students in a GenAI world to create knowledgeable future lawyers

References

• Adamopoulou, E. & Moussiades, L. (2020) Chatbots: history, technology, and applications, Machine Learning with Applications. Available at: https://www.sciencedirect.com/science/article/pii/S2666827020300062, accessed 15 August 2023.
   Google Scholar
• Ajevski, M., Barker, K., Gilbert, A., Hardie, L. & Ryan F. (2023) ChatGPT and the future of legal education and practice, The Law Teacher, 57, pp. 352–364. doi:10.1080/03069400.2023.2207426, accessed 19 November 2023.
   Web of Science ®Google Scholar
• Alarie, B., Niblett, A. & Yoon, A. H. (2018) How artificial intelligence will affect the practice of law, University of Toronto Law Journal, 68, pp. 106–124.
   Web of Science ®Google Scholar
• Allen & Overy LLP. (2023) Artificial Intelligence, Allen & Overy. Available at: https://www.allenovery.com/en-gb/global/expertise/practices/artificial-intelligence, accessed 28 December 2023.
   Google Scholar
• American Bar Association (ABA) (2023) Rule 1.1 Competence – Comment. Available at: https://www.americanbar.org/groups/professional_responsibility/publications/model_rules_of_professional_conduct/rule_1_1_competence/comment_on_rule_1_1/, accessed 1 November 2023.
   Google Scholar
• An, Q. (2023) Challenges and responses: reflection on legal education in the age of artificial intelligence, Advances in Education, Humanities and Social Science Research, 6(1), pp. 279–282.
   Google Scholar
• Australian Bureau of Statistics (ABS). (2023) National, state and territory population, Australian Bureau of Statistics. Available at: https://www.abs.gov.au/statistics/people/population/national-state-and-territory-population/mar-2023, accessed 6 December 2023.
   Google Scholar
• Brescia, R. H. (2023) Teaching to the tech: law schools and the duty of technology competence, Washburn Law Journal, 62(3), pp. 507–540.
   Google Scholar
• Casey, T. (2014) Reflective practice in legal education: the stages of reflection, Clinical Law Review, 20(2), pp. 317–354.
   Google Scholar
• Chan, C. K. Y. (2023) A comprehensive AI policy education framework for university teaching and learning, International Journal of Educational Technology in Higher Education, 20, pp. 38. doi:10.1186/s41239-023-00408-3
   Web of Science ®Google Scholar
• Chan, C. K. Y. & Hu, W. (2023) Students' voices on generative AI: perceptions, benefits, and challenges in higher education, International Journal of Educational Technology in Higher Education, 20, pp. 43. doi:10.1186/s41239-023-00411-8
   Web of Science ®Google Scholar
• Choi, J. H. & Schwarcz, D. (2023) AI Assistance in legal analysis: an empirical study, Minnesota Legal Studies Research Paper No. 23-22. Available at SSRN: https://ssrn.com/abstract=4539836, accessed 1 November 2023.
   Google Scholar
• Cotton, D. R. E., Cotton, P. A. & Shipway, J. R. (2024) Chatting and cheating: Ensuring academic integrity in the era of ChatGPT, Innovations in Education and Teaching International, pp. 228–239. Available at: doi:10.1080/14703297.2023.2190148, accessed 1 November 2023.
   Web of Science ®Google Scholar
• Croft, L. (2023) Authentic Law School assessments to combat use of ChatGPT to cheat, Lawyers Weekly. Available at: https://www.lawyersweekly.com.au/newlaw/36513-authentic-law-school-assessments-to-combat-use-of-chatgpt-to-cheat, accessed 15 August 2023.
   Google Scholar
• Dal Pont, G. E. (2021) Lawyers Professional Responsibility (Pyrmont, Thomson Reuters).
   Google Scholar
• De Poloni, G. (2023) Lawyers in the United States blame ChatGPT for tricking them into citing fake court cases, ABC News, 9 June.
   Google Scholar
• Farazouli, A., Cerratto-Pargman, T., Bolander-Laksov, K. & McGrath, C. (2023) Hello GPT! Goodbye home examination? An exploratory study of AI chatbots impact on university teachers’ assessment practices, Assessment & Evaluation in Higher Education, 49, pp. 363–375. Available at: doi:10.1080/02602938.2023.2241676, accessed 1 November 2023.
   Web of Science ®Google Scholar
• Farhi, F., Jeljeli, R., Aburezeq, I., Dweikat, F. F., Al-shami, S. A. & Slamene, R. (2023) Analyzing the students’ views, concerns, and perceived ethics about chat GPT usage. Computers and Education: Artificial Intelligence, 5: 100180.
   Google Scholar
• Firat, M. (2023) What ChatGPT means for universities: perceptions of scholars and students, Journal of Applied Learning and Teaching, 6(1), pp. 57–63.
   Google Scholar
• Galloway, K. (2020) Is legal education over-regulated or under-regulated?, Griffith University Law School Research Paper 21-2. Available at: https://ssrn.com/abstract=3719652, accessed 14 November 2023.
   Google Scholar
• Halaweh, M. (2023) ChatGPT in education: strategies for responsible implementation, Contemporary Educational Technology, 15(2), pp. 1–11.
   Google Scholar
• Hargreaves, S. (2023) ‘Words are flowing out like endless rain into a paper cup’: ChatGPT & Law School Assessments, Legal Education Review, 33(1), pp. 69–105.
   Web of Science ®Google Scholar
• Herbert-Lowe, S. (2021) Solicitors’ duties in the digital era – Is there a duty of technological competence? Law Society of NSW Journal Online. Available at: https://lsj.com.au/, accessed 2 November 2023.
   Google Scholar
• Huallpa, J. J., Arocutipa, J. P. F., Panduro, W. D., Huete, L. C., Limo, F. A. F., Herrera, E. E., Callacna, R. A. A., Flores, V. A., Romero, M. A. M., Quispe, I. M. & Hernández, F. A. (2023) Exploring the ethical considerations of using Chat GPT in university education, Periodicals of Engineering and Natural Sciences (PEN), 11(4), pp. 105–115.
   Google Scholar
• Hugging Face (2024) Hugging Face: The AI community building the future. Available at: https://huggingface.co/, accessed 3 February 2024.
   Google Scholar
• Iu, K. Y. & Wong, V. M. (2023) ChatGPT by OpenAI: the end of litigation lawyers? Available at SSRN: https://ssrn.com/abstract=4339839, accessed 2 November 2023.
   Google Scholar
• Katz, D. M., Bommarito, M. J., Gao, S. & Arredondo, P. D. (2023) GPT-4 passes the bar exam. Available at SSRN: https://ssrn.com/abstract=4389233, accessed 15 August 2023.
   Google Scholar
• Law Society of New South Wales, Professional Support Unit. (2023) A solicitor’s guide to the responsible use of artificial intelligence, Law Society of NSW Journal Online. Available at: https://lsj.com.au/articles/a-solicitors-guide-to-responsible-use-of-artificial-intelligence/, accessed 3 February 2024.
   Google Scholar
• Leiser, F., Eckhardt, S., Knaeble, M., Maedche, A., Schwabe, G. & Sunyaev, A. (2023) From ChatGPT to FactGPT: A participatory design study to mitigate the effects of large language model hallucinations on users, Proceedings of Mensch und Computer 2023, pp. 81–90.
   Google Scholar
• Lowe, M. S., Stone, S. M., Maxson, B. K., Snajdr, E. & Miller, W. (2020) Boolean redux: Performance of advanced versus simple boolean searches and implications for upper-level instruction. The Journal of Academic Librarianship, 46, pp. 102234. doi:10.1016/j.acalib.2020.102234
   Web of Science ®Google Scholar
• Muñoz, S. A. S., Gayoso, G. G., Huambo, A. C., Tapia, R. D. C., Incaluque, J. L., Aguila, O. E. P., Cajamarca, J. C. R., Acevedo, J. E. R., Rivera, H. V. H. & Arias-Gonzáles, J. L. (2023) Examining the impacts of ChatGPT on student motivation and engagement, Social Space, 23(1), pp. 1-27.
   Google Scholar
• Murray, M. D. (2023) Artificial Intelligence and the Practice of Law Part 1: Lawyers Must be Professional and Responsible Supervisors of AI. Available at SSRN: https://ssrn.com/abstract=4478588, accessed 7 December 2023.
   Google Scholar
• Perlman, A. (2022) The Implications of ChatGPT for Legal Services and Society, Suffolk University Law School Research Paper No. 22-14. Available at SSRN: https://ssrn.com/abstract=4294197, accessed 7 December 2023.
   Google Scholar
• Plata, S., De Guzman, M. A. & Quesada, A. (2023) Emerging research and policy themes on academic integrity in the age of Chat GPT and generative AI, Asian Journal of University Education, 19(4), pp. 743-758. Available at: doi:10.24191/ajue.v19i4.24697, accessed 6 December 2023.
   Google Scholar
• Rothman, D. (2022) Transformers for Natural Language Processing: Build, Train, and Fine-Tune Deep Neural Network Architectures for NLP with Python, Hugging Face, and OpenAI’s GPT-3, ChatGPT, and GPT-4 (Birmingham, Packt Publishing).
   Google Scholar
• Rudolph, J., Tan, S. & Tan, S. (2023(a)) ChatGPT: bullshit spewer or the end of traditional assessments in higher education?, Journal of Applied Learning and Teaching, 6(1), pp. 342–362.
   Google Scholar
• Rudolph, J., Tan, S. & Tan, S. (2023(b)) War of the chatbots: bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education, Journal of Applied Learning and Teaching, 6(1), pp. 364–389.
   Google Scholar
• Ryznar, M. (2023) Exams in the time of ChatGPT, Developments Washington and Lee Law Review Online, 80(5), pp. 305–322.
   Google Scholar
• Savelka, J., Ashley, K. D., Gray, M. A., Westermann, H. & Xu, H. (2023) Explaining legal concepts with augmented large language models (GPT-4). arXiv preprint arXiv:2306.09525.
   Google Scholar
• Sharma, A. (2023) The escalation of ChatGPT: how ChatGPT will exert influence on the legal profession?, Jus Corpus Law Journal, 3(3), pp. 106–118.
   Google Scholar
• Shoufan, A. (2023) Exploring students’ perceptions of CHATGPT: thematic analysis and follow-up survey, IEEE Access, 11, pp. 38805–38818.
   Web of Science ®Google Scholar
• Smolansky, A., Cram, A., Raduescu, C., Zeivots, S., Huber, E. & Kizilcec, R. F. (2023) Educator and student perspectives on the impact of generative AI on assessments in higher education, Proceedings of the tenth ACM conference on Learning@ Scale, pp. 378–382.
   Google Scholar
• Sullivan, M., Kelly, A. & McLaughlan, P. (2023) ChatGPT in higher education: considerations for academic integrity and student learning, Journal of Applied Learning and Teaching, 6(1), pp. 31–40.
   Google Scholar
• Tarves, T. K. (2023) Technology competence instruction and assessment under the principles and standards of legal research competency, Legal Reference Services Quarterly, 42(2), pp. 56–70.
   Google Scholar
• Tertiary Education Quality and Standards Agency (TEQSA). (2023) Assessment reform for the age of artificial intelligence (Canberra, Australian Government). Available at: https://www.teqsa.gov.au/sites/default/files/2023-09/assessment-reform-age-artificial-intelligence-discussion-paper.pdf
   Google Scholar
• Universities Australia (2017) UA academic integrity best practice principles. Available at: https://universitiesaustralia.edu.au/wp-content/uploads/2019/06/UA-Academic-Integrity-Best-Practice-Principles.pdf
   Google Scholar
• Yim, N. (2023) Australia’s biggest law firm, MinterEllison, is using a version of ChatGPT for its first draft of some legal advice, The Australian, 4 December.
   Google Scholar
• Yu, Y. (2023) Discussion on the reform of higher legal education in China based on the application and limitation of artificial intelligence in law represented by ChatGPT, Journal of Education, Humanities and Social Sciences, 14, pp. 220–228.
   Google Scholar