Understanding college students’ cognitive engagement in online collaborative problem-solving: A multimodal data analysis

References

• Apicella, A., Arpaia, P., Frosolone, M., Improta, G., Moccaldi, N., & Pollastro, A. (2022). EEG-based measurement system for monitoring student engagement in learning 4.0. Scientific Reports, 12(1), Article 5857. https://doi.org/10.1038/s41598-022-09578-y
   PubMed Web of Science ®Google Scholar
• Baanqud, N. S., Al-Samarraie, H., Alzahrani, A. I., & Alfarraj, O. (2020). Engagement in cloud-supported collaborative learning and student knowledge construction: A modeling study. International Journal of Educational Technology in Higher Education, 17(1), 1–23. https://doi.org/10.1186/s41239-020-00232-z
   Web of Science ®Google Scholar
• Barry, R. J., Clarke, A. R., Johnstone, S. J., Magee, C. A., & Rushby, J. A. (2007). EEG differences between eyes-closed and eyes-open resting conditions. Clinical Neurophysiology, 118(12), 2765–2773. https://doi.org/10.1016/j.clinph.2007.07.028
   PubMed Web of Science ®Google Scholar
• Ben-Eliyahu, A., Moore, D., Dorph, R., & Schunn, C. D. (2018). Investigating the multidimensionality of engagement: Affective, behavioral, and cognitive engagement across science activities and contexts. Contemporary Educational Psychology, 53, 87–105. https://doi.org/10.1016/j.cedpsych.2018.01.002
   Web of Science ®Google Scholar
• Boulos, M. N. K., Taylor, A. D., & Breton, A. (2005). A synchronous communication experiment within an online distance learning program: A case study. Telemedicine Journal & e-Health, 11(5), 583–593. https://doi.org/10.1089/tmj.2005.11.583
   PubMed Web of Science ®Google Scholar
• Chaouachi, M., & Frasson, C. (2010). Exploring the relationship between learner EEG mental engagement and affect. In V. Aleven, J. Kay, & J. Mostow (Eds.), Lecture notes in computer science: Vol. 6095. Proceedings of the 10th International Conference on Intelligent Tutoring Systems (pp. 291–293). Springer. https://doi.org/10.1007/978-3-642-13437-1_48
   Google Scholar
• Charland, P., Léger, P. M., Sénécal, S., Courtemanche, F., Mercier, J., Skelling, Y., & Labonté-Lemoyne, E. (2015). Assessing the multiple dimensions of engagement to characterize learning: A neurophysiological perspective. Journal of Visualized Experiments, 101, Article 52627. https://doi.org/10.3791/52627-v
   Google Scholar
• Chatterjee, R., & Correia, A. P. (2020). Online students’ attitudes toward collaborative learning and sense of community. American Journal of Distance Education, 34(1), 53–68. https://doi.org/10.1080/08923647.2020.1703479
   Web of Science ®Google Scholar
• Chen, C. H. (2019). The impacts of peer competition-based science gameplay on conceptual knowledge, intrinsic motivation, and learning behavioral patterns. Educational Technology Research and Development, 67, 179–198. https://doi.org/10.1007/s11423-018-9635-5
   Web of Science ®Google Scholar
• Chi, M. T., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/10.1080/00461520.2014.965823
   Web of Science ®Google Scholar
• Cohen, J. (1988). Set correlation and contingency tables. Applied Psychological Measurement, 12(4), 425–434. https://doi.org/10.1177/014662168801200410
   Web of Science ®Google Scholar
• Cohen, S. S., Madsen, J., Touchan, G., Robles, D., Lima, S. F., Henin, S., & Parra, L. C. (2018). Neural engagement with online educational videos predicts learning performance for individual students. Neurobiology of Learning and Memory, 155, 60–64. https://doi.org/10.1016/j.nlm.2018.06.011
   PubMed Web of Science ®Google Scholar
• Cramton, C. D. (2001). The mutual knowledge problem and its consequences for dispersed collaboration. Organization Science, 12(3), 346–371. https://doi.org/10.1287/orsc.12.3.346.10098
   Web of Science ®Google Scholar
• Curran, E. A., & Stokes, M. J. (2003). Learning to control brain activity: A review of the production and control of EEG components for driving brain–computer interface (BCI) systems. Brain and Cognition, 51(3), 326–336. https://doi.org/10.1016/S0278-2626(03)00036-8
   PubMed Web of Science ®Google Scholar
• Du, J., Fan, X., Xu, J., Wang, C., Sun, L., & Liu, F. (2019). Predictors for students’ self-efficacy in online collaborative groupwork. Educational Technology Research and Development, 67, 767–791. https://doi.org/10.1007/s11423-018-9631-9
   Web of Science ®Google Scholar
• Du, X., Dai, M., Tang, H., Hung, J., Li, H., & Zheng, Q. (2022). A multimodal analysis of college students’ collaborative problem solving in virtual experimentation activities: A perspective of cognitive load. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-022-09311-8
   Web of Science ®Google Scholar
• Dunn, T. J., & Kennedy, M. (2019). Technology enhanced learning in higher education: Motivations, engagement and academic achievement. Computers & Education, 137, 104–113. https://doi.org/10.1016/j.compedu.2019.04.004
   Web of Science ®Google Scholar
• Echeverria Barzola, V. I. (2020). Designing feedback for collocated teams using multimodal learning analytics [Doctoral dissertation, University of Technology Sydney]. OPUS. http://hdl.handle.net/10453/140936
   Google Scholar
• Eseryel, D., Law, V., Ifenthaler, D., Ge, X., & Miller, R. (2014). An investigation of the interrelationships between motivation, engagement, and complex problem solving in game-based learning. Journal of Educational Technology & Society, 17(1), 42–53. https://drive.google.com/open?id=16Hw53hJ7yunn0lDVa4Y41c_LSMMtyRxS
   Web of Science ®Google Scholar
• Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
   Web of Science ®Google Scholar
• Freeman, F. G., Mikulka, P. J., Prinzel, L. J., & Scerbo, M. W. (1999). Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biological Psychology, 50(1), 61–76. https://doi.org/10.1016/S0301-0511(99)00002-2
   PubMed Web of Science ®Google Scholar
• Ghergulescu, I., & Muntean, C. H. (2014). A novel sensor-based methodology for learner's motivation analysis in game-based learning. Interacting with Computers, 26(4), 305–320. https://doi.org/10.1093/iwc/iwu013
   Web of Science ®Google Scholar
• Giesbers, B., Rienties, B., Tempelaar, D., & Gijselaers, W. (2014). A dynamic analysis of the interplay between asynchronous and synchronous communication in online learning: The impact of motivation. Journal of Computer Assisted Learning, 30(1), 30–50. https://doi.org/10.1111/jcal.12020
   Web of Science ®Google Scholar
• Gillett-Swan, J. (2017). The challenges of online learning: Supporting and engaging the isolated learner. Journal of Learning Design, 10(1), 20–30. https://doi.org/10.5204/jld.v9i3.293
   Web of Science ®Google Scholar
• Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018). Advancing the science of collaborative problem solving. Psychological Science in the Public Interest, 19(2), 59–92. https://doi.org/10.1177/1529100618808244
   PubMed Web of Science ®Google Scholar
• Hernandez, R. (2012). Collaborative learning: Increasing students' engagement outside the classroom. US-China Education Review A, 9, 804–812. https://www.davidpublisher.com/Public/uploads/Contribute/55346ef49fab0.pdf
   Google Scholar
• Hernández-Sellés, N., Muñoz-Carril, P.-C., & González-Sanmamed, M. (2019). Computer-supported collaborative learning: An analysis of the relationship between interaction, emotional support and online collaborative tools. Computers & Education, 138, 1–12. https://doi.org/10.1016/j.compedu.2019.04.012
   Web of Science ®Google Scholar
• Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235–266. https://doi.org/10.1023/B:EDPR.0000034022.16470.f3
   Web of Science ®Google Scholar
• Hu, M., & Li, H. (2017). Student engagement in online learning: A review. In F. L. Wang, O. Au, K. K. Ng, J. Shang, & R. Kwan (Eds.), Proceedings of the 2017 International Symposium on Educational Technology (pp. 39–43). IEEE. https://doi.org/10.1109/ISET.2017.17
   Google Scholar
• Iglesias-Pradas, S., Hernández-García, Á., Chaparro-Peláez, J., & Prieto, J. L. (2021). Emergency remote teaching and students’ academic performance in higher education during the COVID-19 pandemic: A case study. Computers in Human Behavior, 119, 106713. https://doi.org/10.1016/j.chb.2021.106713
   PubMed Web of Science ®Google Scholar
• Jacoby, L. L. (1978). On interpreting the effects of repetition: Solving a problem versus remembering a solution. Journal of Verbal Learning and Verbal Behavior, 17(6), 649–667. https://doi.org/10.1016/S0022-5371(78)90393-6
   Google Scholar
• Janssen, J., & Kirschner, P. A. (2020). Applying collaborative cognitive load theory to computer-supported collaborative learning: Towards a research agenda. Educational Technology Research and Development, 68(2), 783–805. https://doi.org/10.1007/s11423-019-09729-5
   Web of Science ®Google Scholar
• Jara, C. A., Candelas, F. A., Torres, F., Dormido, S., Esquembre, F., & Reinoso, O. (2009). Real-time collaboration of virtual laboratories through the Internet. Computers & Education, 52(1), 126–40. https://doi.org/10.1016/j.compedu.2008.07.007
   Web of Science ®Google Scholar
• Kao, S.-C., Huang, C.-J., & Hung, T.-M. (2013). Frontal midline theta is a specific indicator of optimal attentional engagement during skilled putting performance. Journal of Sport and Exercise Psychology, 35(5), 470–478. https://doi.org/10.1123/jsep.35.5.470
   PubMed Web of Science ®Google Scholar
• Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86. https://doi.org/10.1207/s15326985ep4102_1
   Web of Science ®Google Scholar
• Ladouce, S., Donaldson, D. I., Dudchenko, P. A., & Ietswaart, M. (2019). Mobile EEG identifies the re-allocation of attention during real-world activity. Scientific Reports, 9(1), 1–10. https://doi.org/10.1038/s41598-019-51996-y
   PubMed Web of Science ®Google Scholar
• Law, Q., Chung, J., Leung, L., & Wong, T. (2017). Perceptions of collaborative learning in enhancing undergraduate education students’ engagement in teaching and learning English. US-China Education Review, 7(2), 89–100. https://doi.org/10.17265/2161-623X/2017.02.002
   Google Scholar
• Lin, K.-Y., Yu, K.-C., Hsiao, H.-S., Chang, Y.-S., & Chien, Y.-H. (2020). Effects of web-based versus classroom-based STEM learning environments on the development of collaborative problem-solving skills in junior high school students. International Journal of Technology and Design Education, 30, 21–34. https://doi.org/10.1007/s10798-018-9488-6
   Web of Science ®Google Scholar
• Mangaroska, K., Sharma, K., Gaševic, D., & Giannakos, M. (2020). Multimodal learning analytics to inform learning design: Lessons learned from computing education. Journal of Learning Analytics, 7(3), 79–97. https://doi.org/10.18608/jla.2020.73.7
   Google Scholar
• Newman, A., Obschonka, M., Schwarz, S., Cohen, M., & Nielsen, I. (2019). Entrepreneurial self-efficacy: A systematic review of the literature on its theoretical foundations, measurement, antecedents, and outcomes, and an agenda for future research. Journal of Vocational Behavior, 110, 403–419. https://doi.org/10.1016/j.jvb.2018.05.012
   Web of Science ®Google Scholar
• Noroozi, O., Alikhani, I., Järvelä, S., Kirschner, P. A., Juuso, I., & Seppänen, T. (2019, 2019/11/01/). Multimodal data to design visual learning analytics for understanding regulation of learning. Computers in Human Behavior, 100, 298–304. https://doi.org/10.1016/j.chb.2018.12.019
   Web of Science ®Google Scholar
• Ochoa, X., & Worsley, M. (2016). Augmenting learning analytics with multimodal sensory data​. Journal of Learning Analytics, 3(2), 213–219. https://doi.org/10.18608/jla.2016.32.10
   Google Scholar
• Olivier, E., Archambault, I., De Clercq, M., & Galand, B. (2019). Student self-efficacy, classroom engagement, and academic achievement: Comparing three theoretical frameworks. Journal of Youth and Adolescence, 48(2), 326–340. https://doi.org/10.1007/s10964-018-0952-0
   PubMed Web of Science ®Google Scholar
• Pintrich, P. R., Smith, D., Garcia, T., & McKeachie, W. J. (1991). A manual for the use of The Motivated Strategies For Learning Questionnaire [Technical Report 91-B-004]. National Center for Research to Improve Postsecondary Teaching and Learning.
   Google Scholar
• Pope, A. T., Bogart, E. H., & Bartolome, D. S. (1995, 1995/05/01/). Biocybernetic system evaluates indices of operator engagement in automated task. Biological Psychology, 40(1), 187–195. https://doi.org/10.1016/0301-0511(95)05116-3
   PubMed Web of Science ®Google Scholar
• Poulsen, A. T., Kamronn, S., Dmochowski, J., Parra, L. C., & Hansen, L. K. (2017). EEG in the classroom: Synchronised neural recordings during video presentation. Scientific Reports, 7(1), 1–9. https://doi.org/10.48550/arXiv.1604.03019
   PubMed Web of Science ®Google Scholar
• Roschelle, J., & Teasley, S. D. (1995). The construction of shared knowledge in collaborative problem-solving. In O’Malley (Ed.), NATO ASI Series: Vol. 128. Computer-supported collaborative learning (pp. 69–97). Springer. https://doi.org/10.1007/978-3-642-85098-1_5
   Google Scholar
• Serafin, J. M., & Chabra, J. (2020). Using a cooperative hands-on general chemistry laboratory framework for a virtual general chemistry laboratory. Journal of Chemical Education, 97(9), 3007–3010. https://doi.org/10.1021/acs.jchemed.0c00780
   Web of Science ®Google Scholar
• Shadiev, R., Huang, Y. M., & Hwang, J. P. (2017). Investigating the effectiveness of speech-to-text recognition applications on learning performance, attention, and meditation. Educational Technology Research and Development, 65, 1239–1261. https://doi.org/10.1007/s11423-017-9516-3
   Web of Science ®Google Scholar
• Sharma, K., & Giannakos, M. (2020). Multimodal data capabilities for learning: What can multimodal data tell us about learning? British Journal of Educational Technology, 51(5), 1450–1484. https://doi.org/10.1111/bjet.12993
   Web of Science ®Google Scholar
• Slof, B., van Leeuwen, A., Janssen, J., & Kirschner, P. A. (2021). Mine, ours, and yours: Whose engagement and prior knowledge affects individual achievement from online collaborative learning? Journal of Computer Assisted Learning, 37(1), 39–50. https://doi.org/10.1111/jcal.12466
   Web of Science ®Google Scholar
• Sottilare, R. A., Burke, C. S., Salas, E., Sinatra, A. M., Johnston, J. H., & Gilbert, S. B. (2018). Designing adaptive instruction for teams: A meta-analysis. International Journal of Artificial Intelligence in Education, 28(2), 225–264. https://doi.org/10.1007/s40593-017-0146-z
   Web of Science ®Google Scholar
• Sun, C., Shute, V. J., Stewart, A. E., Beck-White, Q., Reinhardt, C. R., Zhou, G., Duran, N., & D'Mello, S. K. (2022). The relationship between collaborative problem solving behaviors and solution outcomes in a game-based learning environment. Computers in Human Behavior, 128, Article 107120. https://doi.org/10.1016/j.chb.2021.107120
   Web of Science ®Google Scholar
• Sung, S. H., Li, C., Huang, X., & Xie, C. (2021). Enhancing distance learning of science: Impacts of remote labs 2.0 on students' behavioural and cognitive engagement. Journal of Computer Assisted Learning, 37(6), 1606–1621. https://doi.org/10.1111/jcal.12600
   Web of Science ®Google Scholar
• Tang, H., Dai, M., Du, X., Hung, J., & Li, H. (2023). An EEG study on college students' attention levels in a blended computer science class, Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2166562
   Web of Science ®Google Scholar
• Tang, H., Dai, M., Yang, S., Du, X., Hung, J., & Li, H. (2022). Multimodal analytics of students’ attention in online collaborative problem solving, Distance Education, 43(2), 290–317. https://doi.org/10.1080/01587919.2022.2064824
   Web of Science ®Google Scholar
• Tang, H., Xing, W., & Pei, B. (2018). Exploring the temporal dimension of forum participation in massive open online courses. Distance Education, 39(3), 353–372. https://doi.org/10.1080/01587919.2018.1476841
   Web of Science ®Google Scholar
• Tang, H., Xing, W., & Pei, B. (2019). Time really matters: Understanding the temporal dimension of online learning using educational data mining. Journal of Educational Computing Research, 57(5), 1326–1347. https://doi.org/10.1177/0735633118784705
   Web of Science ®Google Scholar
• Thomas, C., & Jayagopi, D. B. (2017). Predicting student engagement in classrooms using facial behavioral cues. In G. Volpe, M. Gori, N. Bianchi-Berthouze, G. Baud-Bovy, P. Alborno, & E. Volta (Eds.), Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education (pp. 33–40). Association for Computing Machinery. https://doi.org/10.1145/3139513.3139514
   Google Scholar
• Unal, E., & Cakir, H. (2021). The effect of technology-supported collaborative problem solving method on students’ achievement and engagement. Education and Information Technologies, 26(4), 4127–4150. https://doi.org/10.1007/s10639-021-10463-w
   Web of Science ®Google Scholar
• Voica, C., Singer, F. M., & Stan, E. (2020). How are motivation and self-efficacy interacting in problem-solving and problem-posing? Educational Studies in Mathematics, 105, 487–517. https://doi.org/10.1007/s10649-020-10005-0
   Web of Science ®Google Scholar
• Vrzakova, H., Amon, M. J., Stewart, A., Duran, N. D., & D'Mello, S. K. (2020). Focused or stuck together: Multimodal patterns reveal triads' performance in collaborative problem solving. In C. Rensing & H. Drachsler (Eds.), Proceedings of the Tenth International Conference on Learning Analytics & Knowledge (pp. 295–304). Association for Computing Machinery. https://doi.org/10.1145/3375462.3375467
   Google Scholar
• Wen, Y. (2021). Augmented reality enhanced cognitive engagement: Designing classroom-based collaborative learning activities for young language learners. Educational Technology Research and Development, 69(2), 843–860. https://doi.org/10.1007/s11423-020-09893-z
   Web of Science ®Google Scholar
• Winstone, N. E., Hepper, E. G., & Nash, R. A. (2021). Individual differences in self-reported use of assessment feedback: The mediating role of feedback beliefs. Educational Psychology, 41(7), 844–862. https://doi.org/10.1080/01443410.2019.1693510
   Web of Science ®Google Scholar
• Xing, W., Tang, H., & Pei, B. (2019). Beyond positive and negative emotions: Looking into the role of achievement emotions in discussion forums of MOOCs. The Internet and Higher Education, 43. Article 100690. https://doi.org/10.1016/j.iheduc.2019.100690
   Web of Science ®Google Scholar
• Xu, J., & Zhong, B. (2018). Review on portable EEG technology in educational research. Computers in Human Behavior, 81, 340–349. https://doi.org/10.1016/j.chb.2017.12.037
   Web of Science ®Google Scholar
• Yadav, A., Mayfield, C., Moudgalya, S. K., Kussmaul, C., & Hu, H. H. (2021). Collaborative learning, self-efficacy, and student performance in CS1 POGIL. In M. Sherriff & L. D. Merkle (Eds.), Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (pp. 775–781). Association for Computing Machinery. https://doi.org/10.1145/3408877.3432373
   Google Scholar
• Yang, Z., Su, Z., Liu, S., Liu, Z., Ke, W., & Zhao, L. (2020). Evolution features and behavior characters of friendship networks on campus life. Expert Systems with Applications, 158, Article 113519. https://doi.org/10.1016/j.eswa.2020.113519
   Web of Science ®Google Scholar