The effect of evaluation and feedback in 360-degree video-based VR environments on language learning outcomes

References

• Adachi, C., Tai, J., & Dawson, P. (2018). A framework for designing, implementing, communicating and researching peer assessment. Higher Education Research & Development, 37(3), 453–467. https://doi.org/10.1080/07294360.2017.1405913
   Web of Science ®Google Scholar
• Alemdag, E., & Yildirim, Z. (2022). Effectiveness of online regulation scaffolds on peer feedback provision and uptake: A mixed methods study. Computers & Education, 188, 104574 https://doi.org/10.1016/j.compedu.2022.104574
   Web of Science ®Google Scholar
• Argyriou, L., Economou, D., & Bouki, V. (2020). Design methodology for 360° immersive video applications: The case study of a cultural heritage virtual tour. Personal and Ubiquitous Computing, 24(6), 843–859. https://doi.org/10.1007/s00779-020-01373-8
   Web of Science ®Google Scholar
• Barić, D., Havârneanu, G. M., & Măirean, C. (2020). Attitudes of learner drivers toward safety at level crossings: Do they change after a 360° video-based educational intervention? Transportation Research Part F, 69, 335–348. https://doi.org/10.1016/j.trf.2020.01.018
   Google Scholar
• Barrot, J. S. (2021). Using automated written corrective feedback in the writing classrooms: Effects on L2 writing accuracy. Computer Assisted Language Learning, 36, 1–24. https://doi.org/10.1080/09588221.2021.1936071
   Web of Science ®Google Scholar
• Bellocchi, A., King, D. T., & Ritchie, S. M. (2016). Context-based assessment: Creating opportunities for resonance between classroom fields and societal fields. International Journal of Science Education, 38(8), 1304–1342. https://doi.org/10.1080/09500693.2016.1189107
   Web of Science ®Google Scholar
• Breves, P., & Heber, V. (2019). Into the wild: The effects of 360° immersive nature videos on feelings of commitment to the environment. Environmental Communication, 14(3), 332–346. https://doi.org/10.1080/17524032.2019.1665566
   Google Scholar
• Chen, M., Chai, C.-S., Jong, M. S.-Y., & Chao, G. C.-N. (2021). Modeling learners’ self-concept in Chinese descriptive writing based on the affordances of a virtual reality-supported environment. Education and Information Technologies, 26(5), 6013–6032. https://doi.org/10.1007/s10639-021-10582-4
   Web of Science ®Google Scholar
• Chen, M., Chai, C.-S., Jong, M. S.-Y., & Jiang, M. Y.-C. (2021). Teachers’ conceptions of teaching Chinese descriptive composition with interactive spherical video-based virtual reality. Frontiers in Psychology, 12, 591708. https://doi.org/10.3389/fpsyg.2021.591708
   PubMed Web of Science ®Google Scholar
• Chen, M.-R A., & Hwang, G.-J. (2020). Effects of experiencing authentic contexts on English speaking performances, anxiety and motivation of EFL students with different cognitive styles. Interactive Learning Environments, 30, 1619–1639. https://doi.org/10.1080/10494820.2020.1734626
   Web of Science ®Google Scholar
• Chirico, A., Cipresso, P., Yaden, D. B., Biassoni, F., Riva, G., & Gaggioli, A. (2017). Effectiveness of immersive videos in inducing awe: An experimental study. Scientific Reports, 7(1), 1–11. https://doi.org/10.1038/s41598-017-01242-0
   PubMed Web of Science ®Google Scholar
• Dede, C. (2009). Immersive interfaces for engagement and learning. Science, 323, 66–69. https://doi.org/10.1126/science.1167311
   PubMed Web of Science ®Google Scholar
• Dressler, R., Chu, M.-W., Crossman, K., & Hilman, B. (2019). Quantity and quality of uptake: Examining surface and meaning level feedback provided by peers and an instructor in a graduate research course. Assessing Writing, 39, 14–24. https://doi.org/10.1016/j.asw.2018.11.001
   Web of Science ®Google Scholar
• Ellegaard, M., Damsgaard, L., Bruun, J., & Johannsen, B. F. (2018). Patterns in the form of formative feedback and student response. Assessment & Evaluation in Higher Education, 43(5), 727–744. https://doi.org/10.1080/02602938.2017.1403564
   Web of Science ®Google Scholar
• Enkin, E. (2022). Comparing Two Worlds: Spanish Learners’ Face-to-face and Immersive Social VR Speaking Experiences. Computer Assisted Language Learning Electronic Journal, 23(1), 22–42.
   Google Scholar
• Fan, J., & Yan, X. (2020). Assessing speaking proficiency: A narrative review of speaking assessment research within the argument-based validation framework. Frontiers in Psychology, 11, 330. https://doi.org/10.3389/fpsyg.2020.00330
   Web of Science ®Google Scholar
• Ferrara, L. A., & Butcher, K. R. (2012). Exploring students’ perceived needs and ideas about feedback in online learning environments: Implications for digital design. International Journal of Cyber Behavior Psychology and Learning, 2, 48–70.
   Google Scholar
• Freina, L., & Ott, M. (2015). A literature review on immersive virtual reality in education: State of the art and perspectives. eLearning & Software for Education, 1(133), 165–170. https://doi.org/10.12753/2066-026X-15-020
   Google Scholar
• Frisby, B. N., Kaufmann, R., Vallade, J. I., Frey, T. K., & Martin, J. C. (2020). Using virtual reality for speech rehearsals: An innovative instructor approach to enhance student public speaking efficacy. Basic Communication Course Annual, 32(1), 6.
   Google Scholar
• Gielen, M., & De Wever, B. (2015). Structuring peer assessment: Comparing the impact of the degree of structure on peer feedback content. Computers in Human Behavior, 52, 315–325. https://doi.org/10.1016/j.chb.20
   Web of Science ®Google Scholar
• Hanjani, A. M., & Li, L. (2014). Exploring L2 writers’ collaborative revision interactions and their writing performance. System, 44, 101–114. https://doi.org/10.1016/j.system.2014.03.004
   Web of Science ®Google Scholar
• Hattie, J. (2009). Visible learning. A synthesis of over 800 meta-analyses relating to achievement. Routledge.
   Google Scholar
• Hattie, J., & Gan, M. (2011). Instruction based on feedback. In Mayer R. E., Alexander P. A. (Eds.), Handbook of research on learning and instruction. (pp. 263–285) Routledge.
   Google Scholar
• Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77, 81–112. https://doi.org/10.3102/003465430298487
   Web of Science ®Google Scholar
• Howe, L., & Wig, A. V. (2017). Metacognition via creative writing: Dynamic theories of learning support habits of the mind in 21st century classrooms. Journal of Poetry Therapy, 30(3), 139–152. https://doi.org/10.1080/08893675.2017.1328830
   Web of Science ®Google Scholar
• Huang, H. L., Hwang, G. J., & Chang, C. Y. (2019). Learning to be a writer: A spherical video-based virtual reality approach to supporting descriptive article writing in high school Chinese courses. British Journal of Educational Technology, 54(1), 1386–1405. https://doi.org/10.1111/bjet.12893
   Google Scholar
• Huang, Y., & Gui, M. (2015). Articulating teachers; expectations afore: Impact of rubrics on Chinese EFL Learners’ self-assessment and speaking ability. Journal of Education and Training Studies, 3(3), 126–132. https://doi.org/10.11114/jets.v3i3.753
   Google Scholar
• Huisman, B., Saab, N., van Driel, J., & van den Broek, P. (2018). Peer feedback on academic writing: Undergraduate students’ peer feedback role, peer feedback perceptions and essay performance. Assessment & Evaluation in Higher Education, 43(6), 955–968. https://doi.org/10.1080/02602938.2018.1424318
   Web of Science ®Google Scholar
• Hwang, W. Y., Guo, B. C., Hoang, A., Chang, C. C., & Wu, N. T. (2022). Facilitating authentic contextual EFL speaking and conversation with smart mechanisms and investigating its influence on learning achievements. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2022.2095406
   Google Scholar
• Hwang, W.-Y., & Hariyanti, U. (2020). Investigation of students’ and parents’ perceptions of authentic contextual learning at home and their mutual influence on technological and pedagogical aspects of learning under COVID-19. Sustainability, 12, 10074. https://doi.org/10.3390/su122310074
   Google Scholar
• Jiang, L., Yu, S., & Wang, C. (2020). Second language writing instructors’ feedback practice in response to automated writing evaluation: A sociocultural perspective. System, 93, 102302. https://doi.org/10.1016/j.system.2020.102302
   Web of Science ®Google Scholar
• Jong, M. S. Y., Tsai, C. C., Xie, H., & Kwan-Kit Wong, F. (2020). Integrating interactive learner-immersed video-based virtual reality into learning and teaching of physical geography. British Journal of Educational Technology, 51(6), 2064–2079. https://doi.org/10.1111/bjet.12947
   Web of Science ®Google Scholar
• Kahng, J. (2019). Teaching and researching speaking skills. In Polat, N., Gregersen, T., & MacIntyre, P. D. (Eds.), Driven pedagogy: Implications of L2A theory and research for the teaching of language skills. Routledge.
   Google Scholar
• Kaplan-Rakowski, R., Papin, K., & Hartwick, P. (2023). Language teachers’ perceptions and use of extended reality. CALICO Journal, 40(1), 1–23. https://doi.org/10.1558/cj.22759
   Google Scholar
• Kerimbayev, N., Jotsov, V., Akramova, A., & Nurym, N. (2022). Modeling and feedback control for development of mobile technologies in virtual education environments. In: Shi, P., Stefanovski, J., Kacprzyk, J. (Eds.) Complex systems: Spanning control and computational cybernetics: applications. studies in systems, decision and control (vol. 415). Springer. https://doi.org/10.1007/978-3-031-00978-5_16
   Google Scholar
• Kim, J., Kim, K., & Kim, W. (2022). Impact of immersive virtual reality content using 360-degree videos in undergraduate education. IEEE Transactions on Learning Technologies, 15(1), 137–149. https://doi.org/10.1109/TLT.2022.3157250
   Web of Science ®Google Scholar
• Kim, S. H. (2014). Developing autonomous learning for oral proficiency using digital storytelling. Language Learning & Technology, 18(2), 20–35.
   Web of Science ®Google Scholar
• Kramer, M., Förtsch, C., Stürmer, J., Förtsch, S., Seidel, T., & Neuhaus, B. J. (2020). Measuring biology teachers’ professional vision: Development and validation of a video-based assessment tool. Cogent Education, 7(1), 1823155. https://doi.org/10.1080/2331186X.2020.1823155
   Web of Science ®Google Scholar
• Krause, U.-M., Stark, R., & Mandl, H. (2009). The effects of cooperative learning and feedback on e-learning in statistics. Learning and Instruction, 19, 158–170. https://doi.org/10.1016/j.learninstruc.2008.03.003
   Web of Science ®Google Scholar
• Lan, Y. J. (2020). Immersion, interaction and experience-oriented learning: Bringing virtual reality into FL learning. Language Learning & Technology, 24(1), 1–15. http://hdl.handle.net/10125/44704
   Web of Science ®Google Scholar
• Lin, V., Barrett, N. E., Liu, G.-Z., Chen, N.-S., & Jong, M. S.-Y. (2021). Supporting dyadic learning of English for tourism purposes with scenery-based virtual reality. Computer Assisted Language Learning, 36(4), 1–37. https://doi.org/10.1080/09588221.2021.1954663
   Google Scholar
• Lin, H. C.-S., Yu, S.-J., Sun, J. C.-Y., & Jong, M. S. (2021). Engaging university students in a library guide through wearable spherical video-based virtual reality: Effects on situational interest and cognitive load. Interactive Learning Environments, 29(8), 1272–1287. https://doi.org/10.1080/10494820.2019.1624579
   Web of Science ®Google Scholar
• Liu, Y. F., Hwang, W. Y., & Su, C. H. (2023). Investigating the impact of context-awareness smart learning mechanism on EFL conversation learning. Interactive Learning Environments, 1–16. https://doi.org/10.1080/10494820.2023.2194931
   Web of Science ®Google Scholar
• Lu, X. (2022). Research methodology and study design. In Novice mathematics teachers’ professional learning: A multi-case study in Shanghai (pp. 35–60) Springer Fachmedien Wiesbaden. https://doi.org/10.1007/978-3-658-37236-1_3
   Google Scholar
• Ma, M. (2022). Exploring student engagement with computer-mediated peer feedback on L2 writing. International Journal of Computer-Assisted Language Learning and Teaching, 12(2), 1–19. https://doi.org/10.4018/IJCALLT.305828
   Google Scholar
• McNeil, L. (2013). Exploring the relationship between situated activity and CALL learning in teacher education. ReCALL, 25(2), 215–232. https://doi.org/10.1017/S0958344013000086
   Web of Science ®Google Scholar
• Narciss, S., & Huth, K. (2006). Fostering achievement and motivation with bug-related tutoring feedback in a computer-based training for written subtraction. Learning and Instruction, 16, 310–322. https://doi.org/10.1016/j.learninstruc.2006.07.003
   Web of Science ®Google Scholar
• Nguyen, T. H., Hwang, W. Y., Pham, X. L., & Pham, T. (2022). Self-experienced storytelling in an authentic context to facilitate EFL writing. Computer Assisted Language Learning, 35(4), 666–695. https://doi.org/10.1080/09588221.2020.1744665
   Web of Science ®Google Scholar
• Nurym, N., Sambetova, R., Azybaev, M., & Kerimbayev, N. (2020, August). Virtual reality and using the unity 3D platform for Android games. 2020 IEEE 10th International Conference on Intelligent Systems (is) (pp. 539–544). IEEE. https://doi.org/10.1109/IS48319.2020.9199959
   Google Scholar
• Palomeque, C., & Pujolà, J. (2018). Managing multimodal data in virtual world research for language learning. ReCALL, 30(2), 177–195. https://doi.org/10.1017/S0958344017000374
   Web of Science ®Google Scholar
• Peterson, E. R., & Irving, S. E. (2008). Secondary school students’ conceptions of assessment and feedback. Learning and Instruction, 18, 238–250. https://doi.org/10.1016/j.learninstruc.2007.05.001
   Web of Science ®Google Scholar
• Peterson, M. (2018). Experiential learning in the age of web 2.0: The rap video project. Marketing Education Review, 28(2), 109–114. https://doi.org/10.1080/10528008.2018.1428107
   Google Scholar
• Repetto, C., Natale, A. F., Villani, D., Triberti, S., Germagnoli, S., & Riva, G. (2021). The use of immersive 360° videos for foreign language learning: A study on usage and efficacy among high-school students. Interactive Learning Environments, 31(5), 1–16. https://doi.org/10.1080/10494820.2020.1863234
   Google Scholar
• Rodríguez-González, E., & Castañeda, M. E. (2018). The effects and perceptions of trained peer feedback in L2 speaking: Impact on revision and speaking quality. Innovation in Language Learning and Teaching, 12(2), 120–136. https://doi.org/10.1080/17501229.2015.1108978
   Web of Science ®Google Scholar
• Shadiev, R., Wang, X. Y., & Huang, Y. M. (2020). Promoting intercultural competence in a learning activity supported by virtual reality technology. The International Review of Research in Open and Distributed Learning, 21(3), 157–174. https://doi.org/10.19173/irrodl.v21i3.4752
   Web of Science ®Google Scholar
• Shadiev, R., Wang, X. Y., & Huang, Y. M. (2021). Cross-cultural learning in virtual reality environment: Facilitating cross-cultural understanding, trait emotional intelligence, and sense of presence. Educational Technology Research and Development, 69, 2917–2936. https://doi.org/10.1007/s11423-021-10044-1
   Web of Science ®Google Scholar
• Shadiev, R., Yi, S., Dang C., & Sintawati, W. (2022). Facilitating students’ creativity, innovation and entrepreneurship in a telecollaborative project. Frontiers in Psychology, 13, 887620.
   Google Scholar
• Shadiev, R., & Yu, J. T. (2022). Review of research on computer-assisted language learning with a focus on intercultural education. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2022.2056616
   Google Scholar
• Shadiev, R. & Zhou, J. (2023). A review of research on the use of 360-degree video technology in language learning. Educational Technology & Society, 26(4), 14–37.
   Web of Science ®Google Scholar
• Shayakhmetova, L., Mukharlyamova, L., Zhussupova, R., & Beisembayeva, Z. (2020). Developing collaborative academic writing skills in English in CALL classroom. International Journal of Higher Education, 9(8), 13–18. https://doi.org/10.5430/ijhe.v9n8p13
   Google Scholar
• Smith, H., & Townsend, S. D. (2021). Investigating the efficacy of utilizing 360° camera technology as a language teaching and learning tool in a science content based EFL classroom. Innovation in Language Learning and Teaching, 15(2), 143–155. https://doi.org/10.1080/17501229.2019.1710515
   Web of Science ®Google Scholar
• Song, J. (2019). Enhancing intercultural competence with 360-degree virtual reality videos. The Korean Language in America, 23(1), 85–98. https://doi.org/10.5325/korelangamer.23.1.0085
   Web of Science ®Google Scholar
• Spiller, D. (2012). Assessment matters: Self-assessment and peer assessment. The University of Waikato, 13, 2–18.
   Google Scholar
• Strauss, A., & Corbin, J. M. (1990). Basics of qualitative research: Grounded theory procedures and techniques. Sage Publications.
   Google Scholar
• Suvorov, R., & Gruba, P. (2023). Integrating semiotic resources in CALL activity designs. Language Learning & Technology, 27(2), 97–117. https://hdl.handle.net/10125/73505
   Web of Science ®Google Scholar
• Tang, J., & Rich, C. S. (2017). Automated writing evaluation in an EFL setting: Lessons from China. JALT CALL Journal, 13(2), 117–146. https://doi.org/10.29140/jaltcall.v13n2.215
   Google Scholar
• Taylor, N., & Layland, A. (2018). Comparison study of the use of 360-degree video and non-360-degree video simulation and cybersickness symptoms in undergraduate healthcare curricula. BMJ Simulation and Technology Enhanced Learning, 5(3), 170–173. https://doi.org/10.1136/bmjstel-2018-000356
   Web of Science ®Google Scholar
• Thompson, G., & Alba-Juez, L. (Eds.). (2014). Evaluation in context (Vol. 242). John Benjamins Publishing Company.
   Google Scholar
• Tian, L., & Zhou, Y. (2020). Learner engagement with automated feedback, peer feedback and teacher feedback in an online EFL writing context. System, 91, 102247. https://doi.org/10.1016/j.system.2020.102247
   Web of Science ®Google Scholar
• Wiliam, D. (2012). Feedback: Part of a system. Educational Leadership, 70, 30–34. Retrieved from http://www.ascd.org/publications/educational-leadership.aspx
   Web of Science ®Google Scholar
• Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited: A meta-analysis of educational feedback research. Frontiers in Psychology, 10, 3087. https://doi.org/10.3389/fpsyg.2019.03087
   PubMed Web of Science ®Google Scholar
• Wu, W.-L., Hsu, Y., Yang, Q.-F., Chen, J.-J., & Jong, M. S.-Y. (2021). Effects of the self-regulated strategy within the context of spherical video-based virtual reality on students’ learning performances in an art history class. Interactive Learning Environments, 31(4), 1–24. https://doi.org/10.1080/10494820.2021.1878231
   Web of Science ®Google Scholar
• Xie, Y., Chen, Y., & Ryder, L. H. (2021). Effects of using mobile-based virtual reality on Chinese L2 students’ oral proficiency. Computer Assisted Language Learning, 34(3), 225–245. https://doi.org/10.1080/09588221.2019.1604551
   Web of Science ®Google Scholar