An intervention framework for developing interactive video lectures based on video clickstream behavior: a quasi-experimental evaluation

References

• Akçapınar, G., & Bayazıt, A. (2018). Investigating video viewing behaviors of students with different learning approaches. Turkish Online Journal of Distance Education, 19(4), 116–125. https://doi.org/10.17718/tojde.471907
   Web of Science ®Google Scholar
• Altinpulluk, H., Kilinc, H., Firat, M., & Yumurtaci, O. (2020). The influence of segmented and complete educational videos on the cognitive load, satisfaction, engagement, and academic achievement levels of learners. Journal of Computers in Education, 7(2), 155–182. https://doi.org/10.1007/s40692-019-00151-7
   Web of Science ®Google Scholar
• Bakharia, A., Corrin, L., De Barba, P., Kennedy, G., Gasevic, D., Mulder, R., Williams, D., Dawson, S., & Lockyer, L. (2016). A conceptual framework linking learning design with learning analytics. In Proceedings of LAK16 6th International Conference on analytics and knowledge (pp. 329–338). ACM. https://dl.acm.org/doi/proceedings/10.1145/2883851
   Google Scholar
• Bakla, A. (2017). Interactive videos in foreign language instruction : A new gadget in your toolbox. Mersin University Journal of the Faculty of Education, 13(1), 124–137. https://doi.org/10.17860/mersinefd.305769
   Google Scholar
• Banoor, R. Y., Mohammad Issack, S., & Frank, R. (2019). The use of learning analytics to improve online learning outcomes: A systematic literature review. Pan-Commonwealth Forum 9 (PCF9), (September), 9–12. http://oasis.col.org/handle/11599/3275
   Google Scholar
• Belarbi, N., Chafiq, N., Talbi, M., Namir, A., & Benlahmar, E. (2019). User profiling in a SPOC: A method based on user video clickstream analysis. International Journal of Emerging Technologies in Learning (iJET), 14(1), 110–124. https://doi.org/10.3991/ijet.v14i01.9091
   Web of Science ®Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate : A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society . Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
   Web of Science ®Google Scholar
• Bolliger, D. U., & Martindale, T. (2004). Key factors for determining student satisfaction in online courses. International Journal on E-Learning, 3(1), 61–67. https://doi.org/10.5771/9783845279893-1090-1
   Google Scholar
• Brame, C. J. (2016). Effective educational videos: Principles and guidelines for maximizing student learning from video content. CBE Life Sciences Education, 15(4), es6.1–es6.6. https://doi.org/10.1187/cbe.16-03-0125
   Web of Science ®Google Scholar
• Chatti, M. A., Marinov, M., Sabov, O., Laksono, R., Sofyan, Z., Fahmy Yousef, A. M., & Schroeder, U. (2016). Video annotation and analytics in CourseMapper. Smart Learning Environments, 3(1), 10. https://doi.org/10.1186/s40561-016-0035-1
   Google Scholar
• Chen, Y. C., Lu, Y. L., & Lien, C. J. (2021). Learning environments with different levels of technological engagement: A comparison of game-based, video-based, and traditional instruction on students’ learning. Interactive Learning Environments, 29(8), 1363–1379. https://doi.org/10.1080/10494820.2019.1628781
   Google Scholar
• Choi, S. P. M., Lam, S. S., Li, K. C., Wong, B. T. M., Journal, S., April, N., Choi, S. P. M., Lam, S. S., Li, K. C., & Wong, B. T. M. (2018). Learning analytics at low cost : At-risk student prediction with clicker data and systematic proactive interventions. Educational Technology & Society, 21(2), 273–290. http://www.jstor.org/stable/26388407
   Web of Science ®Google Scholar
• Cummins, S., Beresford, A. R., & Rice, A. (2016). Investigating engagement with in-video quiz questions in a programming course. IEEE Transactions on Learning Technologies, 9(1), 57–66. https://doi.org/10.1109/TLT.2015.2444374
   Web of Science ®Google Scholar
• Dimitrova, V., Mitrovic, A., Piotrkowicz, A., Lau, L., & Weerasinghe, A. (2017). Using learning analytics to devise interactive personalised nudges for active video watching. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization – UMAP, 17, 22–31. https://doi.org/10.1145/3079628.3079683
   Google Scholar
• Donkor, F. (2011). Assessment of learner acceptance and satisfaction with video-based instructional materials for teaching practical skills at a distance. International Review of Research in Open and Distance Learning, 12(5), 71–88. https://doi.org/10.19173/irrodl.v12i5.953
   Google Scholar
• Fernández-Gallego, B., Lama, M., Vidal, J. C., & Mucientes, M. (2013). Learning analytics framework for educational virtual worlds. Procedia Computer Science, 25, 443–447. https://doi.org/10.1016/j.procs.2013.11.056
   Google Scholar
• Field, A., & Hole, G. (2003). How to design and report experiments. Sage.
   Google Scholar
• Geller, E. S. (2005). Behavior-based safety and occupational risk management. Behavior Modification, 29(3), 539–561. https://doi.org/10.1177/0145445504273287
   PubMed Web of Science ®Google Scholar
• Gong, L., & Liu, Y. (2019). Design and application of intervention model based on learning analytics under blended learning environment. Proceedings of the 2019 7th International Conference on Information and Education Technology (ICET 2019), 225–229. https://doi.org/10.1145/3323771.3323825
   Google Scholar
• Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Educational Technology and Society, 15(3), 42–57. https://www.jstor.org/stable/jeductechsoci.15.3.42
   Web of Science ®Google Scholar
• Guay, F., Vallerand, R. J., & Blanchard, C. (2000). On the assessment of situational intrinsic and extrinsic motivation: The situational motivation scale. Motivation and Emotion, 24(3), 175–213. https://doi.org/10.1023/A:1005614228250
   Web of Science ®Google Scholar
• Harandi, S. R. (2015). Effects of e-learning on students’ motivation. Procedia – Social and Behavioral Sciences, 181, 423–430. https://doi.org/10.1016/j.sbspro.2015.04.905
   Google Scholar
• Holmes, W., Nguyen, Q., Zhang, J., Mavrikis, M., & Rienties, B. (2019). Learning analytics for learning design in online distance learning. Distance Education, 40(3), 309–329. https://doi.org/10.1080/01587919.2019.1637716
   Web of Science ®Google Scholar
• Hone, K. S., & El Said, G. R. (2016). Exploring the factors affecting MOOC retention: A survey study. Computers and Education, 98, 157–168. https://doi.org/10.1016/j.compedu.2016.03.016
   Web of Science ®Google Scholar
• Järvelä, S. (2001). Shifting research on motivation and cognition to an integrated approach on learning and motivation in context. In S. Volet & S. Järvelä (Eds.), Motivation in learning contexts: Theoretical advances and methodological implications (pp. 3–14). London: Pergamon/Elsevier.
   Google Scholar
• Jin, C. (2020). MOOC student dropout prediction model based on learning behavior features and parameter optimization. Interactive Learning Environments, 1–19. https://doi.org/10.1080/10494820.2020.1802300
   Web of Science ®Google Scholar
• Kim, J., Guo, P. J., Seaton, D. T., Mitros, P., Gajos, K. Z., & Miller, R. C. (2014a). Understanding in-video dropouts and interaction peaks in online lecture videos. In Proceedings of the first ACM conference on Learning @ scale conference (L@S '14) (pp. 31–40). Association for Computing Machinery. https://doi.org/10.1145/2556325.2566237
   Google Scholar
• Kim, J., Li, S.-W., Cai, C. J., Gajos, K. Z., & Miller, R. C. (2014b, April 26–May 1). Leveraging video interaction data and content analysis to improve video learning. CHI ‘14 Workshop on Learning Innovation at Scale, Toronto, Canada.
   Google Scholar
• Kleftodimos, A., & Evangelidis, G.. (2016). An interactive video-based learning environment that supports learning analytics for teaching ‘image editing’. In M. N. Giannakos, D. G. Sampson, Ł. Kidziński, & A. Pardo (Eds.), Proceedings of the LAK 2016 Workshop on Smart Environments and Analytics in Video-Based Learning (Vol. 1579, pp. 26–33). http://ceur-ws.org/Vol-1579/
   Google Scholar
• Li, Z., & Chen, M. Y. (2019). Application of ANCOVA and MANCOVA in language assessment research. In V. Aryadoust & M. Raquel (Eds.), Quantitative data analysis for language assessment volume I: Fundamental techniques (pp. 198–218). Routledge. https://doi.org/10.4324/9781315187815-10
   Google Scholar
• Lin, Y. T., & Chen, C. M. (2019). Improving effectiveness of learners’ review of video lectures by using an attention-based video lecture review mechanism based on brainwave signals. Interactive Learning Environments, 27(1), 86–102. https://doi.org/10.1080/10494820.2018.1451899
   Web of Science ®Google Scholar
• Lu, Y., Zhang, S., Zhang, Z., Xiao, W., & Yu, S. (2017). A framework for learning analytics using commodity wearable devices. Sensors, 17, 6, Article 1382. https://doi.org/10.3390/s17061382
   Web of Science ®Google Scholar
• Magdin, M., Cápay, M., & Mesárošová, M. (2011). Usage of interactive video in educational process to determine mental level and literacy of a learner. 2011 14th International Conference on Interactive Collaborative Learning, ICL 2011 – 11th International Conference Virtual University, VU’11, September, 510–513. https://doi.org/10.1109/ICL.2011.6059637
   Google Scholar
• Marshall, F. B. (2019). The effects of embedding questions at different locations within instructional videos on perception and performance. Florida State University.
   Google Scholar
• Mattingly, K. D., Rice, M. C., & Berge, Z. L. (2012). Learning analytics as a tool for closing the assessment loop in higher education. Knowledge Management and E-Learning: An International Journal, 4(3), 236–247. https://doi.org/10.34105/j.kmel.2012.04.020
   Google Scholar
• Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. https://doi.org/10.1207/S15326985EP3801_6
   Web of Science ®Google Scholar
• Mubarak, A. A., Cao, H., & Ahmed, S. A. (2021). Predictive learning analytics using deep learning model in MOOCs’ courses videos. Education and Information Technologies, 26(1), 371–392. https://doi.org/10.1007/s10639-020-10273-6
   Web of Science ®Google Scholar
• Nepal, B. (2017). Impact of gender and location on mathematical thinking and mathematics achievement. Journal of Advanced Academic Research, 3(3), 11–21. https://doi.org/10.3126/jaar.v3i3.16803
   Google Scholar
• Onah, D. F. O., Sinclair, J., & Boyatt, R. (2014). Dropout rates of massive open online courses: Behavioural patterns. Proceedings of the 6th International Conference on Education and New Learning Technologies (EDULEARN14), 1–10. https://doi.org/10.13140/RG.2.1.2402.0009
   Google Scholar
• Petan, S., Mocofan, M., & Vasiu, R. (2014). Enhancing learning in massive open online courses through interactive video conference. The 9th International Scientific Conference ELearning and Software for Education, April, 380–386.
   Google Scholar
• Quade, D. (1967). Rank analysis of covariance. Journal of the American Statistical Association, 62(320), 1187–1200. https://doi.org/10.2307/2283769
   Web of Science ®Google Scholar
• Reyes, M. C., & Trentin, G. (2019). Breaking sequentiality: An interactive MOOC. Proceedings of the European Conference on E-Learning, ECEL, 2019-Novem(c), 674–679. https://doi.org/10.34190/EEL.19.110
   Google Scholar
• Rienties, B., Boroowa, A., Cross, S., Kubiak, C., & Mayles, K. (2016). Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at the Open University UK. Journal of Interactive Media in Education, 2016(1), 1–11. https://doi.org/10.5334/jime.394
   Google Scholar
• Rienties, B., & Toetenel, L. (2015). ‘Scaling up’ learning design: Impact of learning design activities on LMS behavior and performance. In LAK ‘15: Proceedings of the Fifth international conference on learning analytics and knowledge (pp. 315–319). ACM. https://doi.org/10.1145/2723576.2723600
   Google Scholar
• Ronchetti, M.. (2013). Videolectures ingredients that can make analytics effective. In M. N. Giannakos, K. Chorianopoulos, M. Ronchetti, P. Szegedi, & S. Teasley (Eds.), Proceedings of the LAK 2013 Workshop on Analytics on Video-based Learning (Vol. 983, pp. 15–20). CEUR. http://ceur-ws.org/Vol-983/
   Google Scholar
• Şahin, M. (2018). E-Öğrenme Ortamlarına Yönelik Öğrenme Analitiklerine Dayalı Bir Müdahale Motoru Tasarımı. Hacettepe Üniversitesi Eğitim Bilimleri Enstitüsü.
   Google Scholar
• Şahin, M., & Yurdugül, H. (2019). An intervention engine design and development based on learning analytics: The intelligent intervention system (In2S). Smart Learning Environments, 6(1), 1. https://doi.org/10.1186/s40561-019-0100-7
   Google Scholar
• Scheffel, M. (2017). The evaluation framework for learning analytics. https://core.ac.uk/download/pdf/95759389.pdf
   Google Scholar
• Sinha, T., Jermann, P., Li, N., & Dillenbourg, P. (2014). Your click decides your fate: Inferring information processing and attrition behavior from MOOC video clickstream interactions. http://arxiv.org/abs/1407.7131
   Google Scholar
• Visser, L. N. C., Hillen, M. A., Verdam, M. G. E., Bol, N., de Haes, H. C. J. M., & Smets, E. M. A. (2016). Assessing engagement while viewing video vignettes; validation of the Video Engagement Scale (VES). Patient Education and Counseling, 99(2), 227–235. https://doi.org/10.1016/j.pec.2015.08.029
   PubMed Web of Science ®Google Scholar
• Wachtler, J., Khalil, M., Taraghi, B., & Ebner, M.. (2016). On using learning analytics to track the activity of interactive MOOC videos. In M. N. Giannakos, D. G. Sampson, Ł. Kidziński, & A. Pardo (Eds.), Proceedings of the LAK 2016 Workshop on Smart Environments and Analytics in Video-Based Learning (Vol. 1579, pp. 8–17). CEUR. http://ceur-ws.org/Vol-1579/
   Google Scholar
• West, D., Heath, D., & Huijser, H. (2016). Let’s talk learning analytics: A framework for implementation in relation to student retention. Journal of Asynchronous Learning Network, 20, 2. https://doi.org/10.24059/olj.v20i2.792
   Google Scholar
• Wong, B. T. m., & Li, K. C. (2020). A review of learning analytics intervention in higher education (2011–2018). Journal of Computers in Education, 7(1), 7–28. https://doi.org/10.1007/s40692-019-00143-7
   Web of Science ®Google Scholar
• Xiao, X. (2017). Improving mobile MOOC learning via implicit physiological signal sensing. University of Pittsburgh.
   Google Scholar
• Youssef, M., Mohammed, S., Hamada, E. K., & Wafaa, B. F. (2019). A predictive approach based on efficient feature selection and learning algorithms’ competition: Case of learners’ dropout in MOOCs. Education and Information Technologies, 24(6), 3591–3618. https://doi.org/10.1007/s10639-019-09934-y
   Web of Science ®Google Scholar
• Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker, J. F. (2006). Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information and Management, 43(1), 15–27. https://doi.org/10.1016/j.im.2005.01.004
   Web of Science ®Google Scholar
• Zhang, J. H., Zou, L. c., Miao, J. j., Zhang, Y. X., Hwang, G. J., & Zhu, Y. (2020). An individualized intervention approach to improving university students’ learning performance and interactive behaviors in a blended learning environment. Interactive Learning Environments, 28(2), 231–245. https://doi.org/10.1080/10494820.2019.1636078
   Web of Science ®Google Scholar
• Zhang, Y., & Wildemuth, B. M. (2005). Qualitative analysis of content. Human Brain Mapping, 30(7), 2197–2206. https://philpapers.org/rec/ZHAQAO
   Google Scholar