Expert or machine? Comparing the effect of pairing student teacher with in-service teacher and ChatGPT on their critical thinking, learning performance, and cognitive load in an integrated-STEM course

References

• Baer, J., Kaufman, J.C., & Gentile, C.A. (2004). Extension of the consensual assessment technique to nonparallel creative products. Creativity Research Journal, 16(1), 113–117. https://doi.org/10.1207/s15326934crj1601_11
   Web of Science ®Google Scholar
• Biswas, S. (2023). Role of chat GPT in education. Available at SSRN 4369981. https://ssrn.com/abstract=4369981
   Google Scholar
• Brown, K.T. (2017). Pre-service teachers’ acquisition of content knowledge, pedagogical skills, and professional dispositions through service learning. Science Education & Civic Engagement, 9(2), 13–26.
   Google Scholar
• Carrillo, C., & Flores, M.A. (2020). COVID-19 and teacher education: A literature review of online teaching and learning practices. European Journal of Teacher Education, 43(4), 466–487. https://doi.org/10.1080/02619768.2020.1821184
   Web of Science ®Google Scholar
• Chai, C.S. (2019). Teacher professional development for Science, Technology, Engineering and Mathematics (STEM) education: A review from the perspectives of Technological Pedagogical Content (TPACK). The Asia-Pacific Education Researcher, 28(1), 5–13. https://doi.org/10.1007/s40299-018-0400-7
   Web of Science ®Google Scholar
• Chen, C.C. (2000). An experimental study about implementing the teaching strategies of critical thinking in social class of 5th grade elementary school [ Unpublished master thesis]. National Chengchi University. (Master’s thesis, National Chengchi University). http://thesis.lib.nccu.edu.tw/cgi-bin/gs32/gsweb.cgi?o=dallcdr&s=id=%22A2002001685%22.&searchmode=basic
   Google Scholar
• Chen, X. (2020). Pre-service teachers’ self-efficacy of interdisciplinary team teaching through the use of collaborative concept map. International Journal of Technology in Teaching and Learning, 15(2), 76–94. https://doi.org/10.37120/ijttl.2019.15.2.01
   Google Scholar
• Chen, X., Xie, H., Zou, D., & Hwang, G.J. (2020). Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence, 1, 100002. https://doi.org/10.1016/j.caeai.2020.100002
   Google Scholar
• Chen, X., Zou, D., Xie, H., Cheng, G., & Liu, C. (2022). Two decades of artificial intelligence in education: Contributors, collaborations, research topics, challenges, and future directions. Educational Technology & Society, 25(1), 28–47. https://www.jstor.org/stable/48647028
   Web of Science ®Google Scholar
• Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P. (2019). In the shades of the uncanny valley: An experimental study of human–chatbot interaction. Future Generation Computer Systems, 92, 539–548. https://doi.org/10.1016/j.future.2018.01.055
   Web of Science ®Google Scholar
• Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 32(3), 444–452. https://doi.org/10.1007/s10956-023-10039-y
   Web of Science ®Google Scholar
• Dare, E.A., Ellis, J.A., & Roehrig, G.H. (2018). Understanding science teachers’ implementations of integrated STEM curricular units through a phenomenological multiple case study. International Journal of STEM Education, 5(1), 4. https://doi.org/10.1186/s40594-018-0101-z
   PubMedGoogle Scholar
• Dwivedi, Y.K., Kshetri, N., Hughes, L., Slade, E.L., Jeyaraj, A., Kar, A.K. et al (2023). Opinion paper: “so what if ChatGPT wrote it?” multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
   Web of Science ®Google Scholar
• English, L.D. (2016). STEM education K-12: Perspectives on integration. International Journal of STEM Education, 3(1), 1–8. https://doi.org/10.1186/s40594-016-0036-1
   Google Scholar
• Estapa, A.T., & Tank, K.M. (2017). Supporting integrated STEM in the elementary classroom: A professional development approach centered on an engineering design challenge. International Journal of STEM Education, 4. https://doi.org/10.1186/s40594-017-0058-3
   Web of Science ®Google Scholar
• Facione, P.A., Facione, N.C., & Giancarlo, C.A.F. (2000). The California critical thinking disposition inventory: CCTDI test manual. California Acad. Press.
   Google Scholar
• Farrokhnia, M., Banihashem, S.K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1–15. https://doi.org/10.1080/14703297.2023.2195846
   Web of Science ®Google Scholar
• Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating academic answers generated using ChatGPT. Journal of Chemical Education, 100(4), 1672–1675. https://doi.org/10.1021/acs.jchemed.3c00087
   Web of Science ®Google Scholar
• Geeraerts, K., Tynjälä, P., & Heikkinen, H.L.T. (2018). Inter-generational learning of teachers: What and how do teachers learn from older and younger colleagues? European Journal of Teacher Education, 41(4), 479–495. https://doi.org/10.1080/02619768.2018.1448781
   Web of Science ®Google Scholar
• Gupta, U., & Zheng, R.Z. (2020). Cognitive load in solving mathematics problems: Validating the role of motivation and the interaction among prior knowledge, worked examples, and task difficulty. European Journal of STEM Education, 5(1), 5. https://doi.org/10.20897/ejsteme/9252
   Google Scholar
• Guzman, A.L., & Lewis, S.C. (2020). Artificial intelligence and communication: A human–machine communication research agenda. New Media & Society, 22(1), 70–86. https://doi.org/10.1177/1461444819858691
   Web of Science ®Google Scholar
• Haas, B., Kreis, Y., & Lavicza, Z. (2021). Integrated STEAM approach in outdoor trails with elementary school pre-service teachers. Educational Technology & Society, 24(4), 205–219. https://doi.org/10.30191/ETS.202110_24(4).0016
   Web of Science ®Google Scholar
• Harlow, A., & Cobb, D.J. (2014). Planting the seed of teacher identity: Nurturing early growth through a collaborative learning community. Australian Journal of Teacher Education (Online), 39(7), 70–88. https://doi.org/10.14221/ajte.2014v39n7.8
   Google Scholar
• Honey, M., Pearson, G., & Schweingruber, H.A. (Eds.). (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. National Academies Press.
   Google Scholar
• Huang, B., Jong, M.S.Y., Tu, Y.F., Hwang, G.J., Chai, C.S., & Jiang, M.Y.C. (2022). Trends and exemplary practices of STEM teacher professional development programs in K-12 contexts: A systematic review of empirical studies. Computers & Education, 104577, 104577. https://doi.org/10.1016/j.compedu.2022.104577
   Google Scholar
• Huang, K., Lubin, I.A., & Ge, X. (2011). Situated learning in an educational technology course for pre-service teachers. Teaching and Teacher Education, 27(8), 1200–1212. https://doi.org/10.1016/j.tate.2011.06.006
   Web of Science ®Google Scholar
• Ji, Y., Zou, X., Li, T., & Zhan, Z. (2023). The effectiveness of ChatGPT on pre-service teachers’ STEM teaching literacy, learning performance, and cognitive load in a teacher training course. In 2023 7th International Conference on Education and Multimedia Technology (ICETM). ACM, New York, NY, USA. https://doi.org/10.1145/3637907.3637948
   Google Scholar
• Kelley, T.R., & Knowles, J.G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 1–11. https://doi.org/10.1186/s40594-016-0046-z
   Google Scholar
• Kelley, T.R., Knowles, J.G., Holland, J.D., & Han, J. (2020). Increasing high school teachers’ self-efficacy for integrated STEM instruction through a collaborative community of practice. International Journal of STEM Education, 7(1), 1–13. https://doi.org/10.1186/s40594-020-00211-w
   Web of Science ®Google Scholar
• Kim, B., & Bastani, R. (2017). Students as game designers: Transdisciplinary approach to STEAM education. Alberta Science Education Journal, 45(1), 45–52.
   Google Scholar
• Kim, J., Lee, H., & Cho, Y.H. (2022). Learning design to support student-AI collaboration: Perspectives of leading teachers for AI in education. Education and Information Technologies, 27(5), 6069–6104. https://doi.org/10.1007/s10639-021-10831-6
   Web of Science ®Google Scholar
• King, M.R., & ChatGPT. (2023). A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering, 16(1), 1–2. https://doi.org/10.1007/s12195-022-00754-8
   PubMed Web of Science ®Google Scholar
• Kostiainen, E., Ukskoski, T., Ruohotie-Lyhty, M., Kauppinen, M., Kainulainen, J., & Mäkinen, T. (2018). Meaningful learning in teacher education. Teaching and Teacher Education, 71, 66–77. https://doi.org/10.1016/j.tate.2017.12.009
   Web of Science ®Google Scholar
• Krügel, S., Ostermaier, A., & Uhl, M. (2023). ChatGPT’s inconsistent moral advice influences users’ judgment. Scientific Reports, 13(1), 4569. https://doi.org/10.1038/s41598-023-31341-0
   PubMed Web of Science ®Google Scholar
• Lau, W.W., & Jong, M.S. (2022). Typology of teachers’ stages of concern for STEM education. Research in Science & Technological Education, 1–19. https://doi.org/10.1080/02635143.2022.2064447
   Web of Science ®Google Scholar
• Li, T., Zhang, X., Lai, R., Zhang, M., Zhong, C., & Zhan, Z. (2023). Internet+ technology empowering C-STEAM educational collaboration in the greater Bay Area: A cross-regional project of “Chinese ancient hollowed windows”. In Proceedings of the 2023 5th International Workshop on Artificial Intelligence and Education (WAIE 2023). Tokyo, Japan.
   Google Scholar
• Lo, C.K. (2021). Design principles for effective teacher professional development in integrated STEM education. Educational Technology & Society, 24(4), 136–152. https://doi.org/10.30191/ETS.202110_24(4).0011
   Web of Science ®Google Scholar
• Lo, C.K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
   Web of Science ®Google Scholar
• Meschede, N., Fiebranz, A., Möller, K., & Steffensky, M. (2017). Teachers’ professional vision, pedagogical content knowledge and beliefs: On its relation and differences between pre-service and in-service teachers. Teaching & Teacher Education, 66, 158–170. https://doi.org/10.1016/j.tate.2017.04.010
   Web of Science ®Google Scholar
• Morris, J., Song, Y., Soloway, E., & Norris, C. (2021). Teacher professional development in STEM education. Journal of Educational Technology & Society, 24(4). https://doi.org/10.30191/ETS.202110_24(4).0006
   Web of Science ®Google Scholar
• Mukherjee, A., & Chang, H. (2023). Managing the creative frontier of generative AI: The Novelty-Usefulness Tradeoff. California Management Review. https://ssrn.com/abstract=4469983
   Google Scholar
• Näykki, P., Kontturi, H., Seppänen, V., Impiö, N., & Järvelä, S. (2021). Teachers as learners–a qualitative exploration of pre-service and in-service teachers’ continuous learning community OpenDigi. Journal of Education for Teaching, 47(4), 495–512. https://doi.org/10.1080/02607476.2021.1904777
   Web of Science ®Google Scholar
• Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K. (2023). Beyond semantic distance: Automated scoring of divergent thinking greatly improves with large language models. Thinking Skills and Creativity, 49, 101356. https://doi.org/10.1016/j.tsc.2023.101356
   Web of Science ®Google Scholar
• Paas, F., Tuovinen, J.E., Tabbers, H., & Van Gerven, P.W. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71. https://doi.org/10.1207/S15326985EP3801_8
   Web of Science ®Google Scholar
• Patel, S.B., & Lam, K. (2023). ChatGPT: The future of discharge summaries? Lancet Digital Health, 5(3), e107–e108. https://doi.org/10.1016/S2589-7500(23)00021-3
   PubMedGoogle Scholar
• Radloff, J., & Guzey, S. (2016). Investigating preservice STEM teacher conceptions of STEM education. Journal of Science Education and Technology, 25(5), 759–774. https://doi.org/10.1007/s10956-016-9633-5
   Web of Science ®Google Scholar
• Rani, P.S., Rani, K.R., Daram, S.B., & Angadi, R.V. (2023). Is it feasible to reduce academic stress in net-zero energy buildings? Reaction from ChatGPT. Annals of Biomedical Engineering, 51(12), 1–3. https://doi.org/10.1007/s10439-023-03286-y
   PubMed Web of Science ®Google Scholar
• Ray, P. P.(2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3,121–154. https://doi.org/10.1016/j.iotcps.2023.04.003
   Google Scholar
• Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.9
   Google Scholar
• Rusandi, M.A., Ahman Saripah, I., Khairun, D.Y., Khairun, D.Y., & Mutmainnah. (2023). No worries with ChatGPT: Building bridges between artificial intelligence and education with critical thinking soft skills. Journal of Public Health, 45(3), e602–e603. https://doi.org/10.1093/pubmed/fdad049
   PubMedGoogle Scholar
• Sá, M.V., & de Almeida, M.J.B.M. (2016). Physics teachers: A holistic plan for professional education during both the pedagogical stage and the probation year. Teachers & Teaching, 22(4), 504–518. https://doi.org/10.1080/13540602.2015.1082733
   Web of Science ®Google Scholar
• Schmid, E.C., & Hegelheimer, V. (2014). Collaborative research projects in the technology-enhanced language classroom: Pre-service and in-service teachers exchange knowledge about technology. ReCALL, 26(3), 315–332. https://doi.org/10.1017/S0958344014000135
   Web of Science ®Google Scholar
• Shernoff, D.J., Sinha, S., Bressler, D.M., & Ginsburg, L. (2017). Assessing teacher education and professional development needs for the implementation of integrated approaches to STEM education. International Journal of STEM Education, 4(1), 13. https://doi.org/10.1186/s40594-017-0068-1
   PubMed Web of Science ®Google Scholar
• Song, H., & Zhou, M. (2021). STEM teachers’ preparation, teaching beliefs, and perceived teaching competence: A multigroup structural equation approach. Journal of Science Education and Technology, 30(2), 394–407. https://doi.org/10.1007/s10956-020-09881-1
   Google Scholar
• Stokel-Walker, C. (2022). AI bot ChatGPT writes smart essays-should academics worry? Nature. https://doi.org/10.1038/d41586-022-04397-7
   Google Scholar
• Strzelecki, A. (2023). To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interactive Learning Environments, 1–14. https://doi.org/10.1080/10494820.2023.2209881
   Google Scholar
• Taber, K.S. (2019). Experimental research into teaching innovations: Responding to methodological and ethical challenges. Studies in Science Education, 55(1), 69–119. https://doi.org/10.1080/03057267.2019.1658058
   Web of Science ®Google Scholar
• Tan, E. (2022). ‘Heartware’for the compassionate teacher: Humanizing the academy through mindsight, attentive love, and storytelling. Journal of Applied Learning & Teaching, 5(2), 152–159. https://doi.org/10.37074/jalt.2022.5.2.ss1
   Google Scholar
• Tiatri, S., Veronica, C., Fiscarina, C., Nurkholiza, R., Wakano, V.Y., Ie, M., & Beng, J.T. (2023). Elementary school teachers’ perceptions of critical thinking in stem learning. International Journal of Application on Social Science and Humanities, 1(1), 648–658. https://doi.org/10.24912/ijassh.v1i1.25924
   Google Scholar
• Timothy, V., Fischer, F., Watzka, B., Girwidz, R., & Stadler, M. (2023). Applying cognitive load theory in teacher education: An experimental validation of the scale by leppink et al. Psychological Test Adaptation and Development, 4(1), 246. https://doi.org/10.1027/2698-1866/a000052
   Google Scholar
• Vangrieken, K., Dochy, F., Raes, E., & Kyndt, E. (2015). Teacher collaboration: A systematic review. Educational Research Review, 15, 17–40. https://doi.org/10.1016/j.edurev.2015.04.002
   Web of Science ®Google Scholar
• Willegems, V., Consuegra, E., Struyven, K., & Engels, N. (2017). Teachers and pre-service teachers as partners in collaborative teacher research: A systematic literature review. Teaching and Teacher Education, 64, 230–245. https://doi.org/10.1016/j.tate.2017.02.014
   Web of Science ®Google Scholar
• Wu, C.H., Liu, C.H., & Huang, Y.M. (2022). The exploration of continuous learning intention in STEAM education through attitude, motivation, and cognitive load. International Journal of STEM Education, 9(1), 35. https://doi.org/10.1186/s40594-022-00346-y
   Web of Science ®Google Scholar
• Xu, W., & Ouyang, F. (2022). The application of AI technologies in STEM education: A systematic review from 2011 to 2021. International Journal of STEM Education, 9(1), 1–20. https://doi.org/10.1186/s40594-022-00377-5
   Web of Science ®Google Scholar
• Ye, Y., You, H., & Du, J. (2023). Improved trust in human-robot collaboration with ChatGPT. Institute of Electrical and Electronics Engineers Access, 11, 55748–55754. https://doi.org/10.1109/ACCESS.2023.3282111
   Google Scholar
• Zhai, X. (2023). ChatGPT for next generation science learning. XRDS: Crossroads, the ACM Magazine for Students, 29(3), 42–46. https://doi.org/10.1145/3589649
   Google Scholar
• Zhai, X., Nyaaba, M., & Ma, W. (2023). Can AI Outperform Humans on cognitive-demanding tasks in science? Available at SSRN (May 17, 2023). https://doi.org/10.2139/ssrn.4451722
   Google Scholar
• Zhang, K., & Aslan, A.B. (2021). AI technologies for education: Recent research & future directions. Computers and Education: Artificial Intelligence, 2, 100025. https://doi.org/10.1016/j.caeai.2021.100025
   Google Scholar
• Zhan, Z., Ji, Y., & Lai, Y. (2023). How to implement interdisciplinary thematic learning based on the compulsory education curriculum standards: general guideline and operational model. Modern Distance Education Research, 35(1), 49–58. http://kns.cnki.net/kcms/detail/51.1580.G4.20230111.0950.007.html
   Google Scholar
• Zhan, Z., & Niu, S. (2023). Subject integration and theme evolution of STEM education in K-12 and higher education research. Humanities and Social Sciences Communications, 10(1), 1–13. https://doi.org/10.1057/s41599-023-02303-8
   Google Scholar
• Zhan, Z., Shen, W., Xu, Z., Niu, S., & You, G. (2022a). A bibliometric analysis of the global landscape on STEM education (2004-2021): Towards global distribution, subject integration, and research trends. Asia Pacific Journal of Innovation and Entrepreneurship, 16(2), 171–203. https://doi.org/10.1108/APJIE-08-2022-0090
   Web of Science ®Google Scholar
• Zhan, Z., Yao, X., & Li, T. (2022b). Effects of association interventions on students’ creative thinking, aptitude, empathy, and design scheme in a STEAM course: Considering remote and close association. International Journal of Technology and Design Education, 33(5), 1–23. https://doi.org/10.1007/s10798-022-09801-X
   Web of Science ®Google Scholar