References
- Abramowitz, M., Stegun, I. A., & Romer, R. H. (1988). Handbook of mathematical functions with formulas, graphs, and mathematical tables. AAPT.
- Alpaydin, E. (2016). Machine learning: The new AI. MIT press.
- Arkorful, V., & Abaidoo, N. (2015). The role of e-learning, advantages and disadvantages of its adoption in higher education. International Journal of Instructional Technology and Distance Learning, 12(1), 29–42. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.694.3077&rep=rep1&type=pdf#page=33
- Aslan, S., Alyuz, N., Okur, E., Mete, S. E., Oktay, E., & Esme, A. A. (2018). Effect of emotion-aware interventions on students’ behavioral and emotional states. Educational Technology Research and Development, 66(6), 1399–1413. https://doi.org/10.1007/s11423-018-9589-7
- Asteriadis, S., Karpouzis, K., & Kollias, S. (2011). The importance of eye gaze and head pose to estimating levels of attention. In Proceedings of international conference on games and virtual worlds for serious applications (pp. 186–191). IEEE. http://dx.doi.org/10.1109/VS-GAMES.2011.38
- Balaban, C. D., Cohn, J., Redfern, M. S., Prinkey, J., Stripling, R., & Hoffer, M. (2004). Postural control as a probe for cognitive state: Exploiting human information processing to enhance performance. International Journal of Human-Computer Interaction, 17(2), 275–286. https://doi.org/10.1207/s15327590ijhc1702_9
- Ballenghein, U., & Baccino, T. (2019). Referential processing during reading: Concurrent recordings of eye movements and head motion. Cognitive Processing, 20(3), 371–384. https://doi.org/10.1007/s10339-018-0894-1
- Beinicke, A., & Bipp, T. (2018). Evaluating training outcomes in corporate e-learning and classroom training. In Vocations and learning (pp. 1–28). Springer. http://dx.doi.org/10.1007/s12186-018-9201-7
- Ben-Zadok, G., Leiba, M., & Nachmias, R. (2011). Drills, games or tests? Evaluating students’ motivation in different online learning activities using log file analysis. Journal of E-Learning and Learning Objects, 7(1), 235–248. http://dx.doi.org/10.28945/1522
- Bonnet, C. T., & Baudry, S. (2016). A functional synergistic model to explain postural control during precise visual tasks. Gait & Posture, 50, 120–125. https://doi.org/10.1016/j.gaitpost.2016.08.030
- Bonnet, C. T., Szaffarczyk, S., & Baudry, S. (2017). Functional synergy between postural and visual behaviors when performing a difficult precise visual task in upright stance. Cognitive Science, 41(6), 1675–1693. https://doi.org/10.1111/cogs.12420
- Borji, A., & Itti, L. (2015). Cat2000: A large scale fixation dataset for boosting saliency research. arXiv:1505.03581
- Bosch, N., & D’Mello, S. (2019). Automatic detection of mind wandering from video in the lab and in the classroom. IEEE Transactions on Affective Computing, 1. https://doi.org/10.1109/TAFFC.2019.2908837
- Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104
- Cruz, A. A., Garcia, D. M., Pinto, C. T., & Cechetti, S. P. (2011). Spontaneous eyeblink activity. The Ocular Surface, 9(1), 29–41. https://doi.org/10.1016/S1542-0124(11)70007-6
- D’Mello, S., Dieterle, E., & Duckworth, A. (2017). Advanced, analytic, automated (AAA) measurement of engagement during learning. Educational Psychologist, 52(2), 104–123. https://doi.org/10.1080/00461520.2017.1281747
- Dixson, M. D. (2015). Measuring student engagement in the online course: The online student engagement scale (ose). Online Learning, 19(4), n4. https://doi.org/10.24059/olj.v19i4.561
- Drutarovsky, T., & Fogelton, A. (2014). Eye blink detection using variance of motion vectors. In Proceedings of European conference on computer vision (pp. 436–448). http://dx.doi.org/10.1007/978-3-319-16199-0_31
- Duda, R. O., Hart, P. E., & Stork, D. G. (2012). Pattern Classification. John Wiley & Sons.
- Eldenfria, A., & Al-Samarraie, H. (2019). Towards an online continuous adaptation mechanism (OCAM) for enhanced engagement: An EEG study. International Journal of Human–Computer Interaction, 35(20), 1–15. http://dx.doi.org/10.1080/10447318.2019.1595303
- Eliot, J. A., & Hirumi, A. (2019). Emotion theory in education research practice: An interdisciplinary critical literature review. In Educational technology research and development (pp. 1–20). Springer. http://dx.doi.org/10.1007/s11423-018-09642-3
- Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378. https://doi.org/10.1037/h0031619
- Fredricks, J. A., Filsecker, M., & Lawson, M. A. (2016). Student engagement, context, and adjustment: Addressing definitional, measurement, and methodological issues. In J. Vermunt (Ed.), Learning and Instruction (pp. 1–5). Elsevier.
- Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
- Gautier, L. (2008). rpy2: A simple and efficient access to R from Python. Retrieved January 26, from http://rpy.sourceforge.net/rpy2.html
- Graesser, A. C., & D’Mello, S. (2012). Moment-to-moment emotions during reading. The Reading Teacher, 66(3), 238–242. https://doi.org/10.1002/TRTR.01121
- Greene, B. A. (2015). Measuring cognitive engagement with self-report scales: Reflections from over 20 years of research. Educational Psychologist, 50(1), 14–30. https://doi.org/10.1080/00461520.2014.989230
- Haßler, B., Major, L., & Hennessy, S. (2016). Tablet use in schools: A critical review of the evidence for learning outcomes. Journal of Computer Assisted Learning, 32(2), 139–156. https://doi.org/10.1111/jcal.12123
- Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). WCST: Wisconsin card sorting test. Psychological Assessment Resources.
- Heidenreich, N.-B., Schindler, A., & Sperlich, S. (2013). Bandwidth selection for kernel density estimation: A review of fully automatic selectors. AStA Advances in Statistical Analysis, 97(4), 403–433. https://doi.org/10.1007/s10182-013-0216-y
- Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015). Measuring student engagement in technology-mediated learning: A review. Computers & Education, 90, 36–53. https://doi.org/10.1016/j.compedu.2015.09.005
- Hunter, M. C., & Hoffman, M. A. (2001). Postural control: Visual and cognitive manipulations. Gait & Posture, 13(1), 41–48. https://doi.org/10.1016/S0966-6362(00)00089-8
- Ji, Q., Zhu, Z., & Lan, P. (2004). Real-time nonintrusive monitoring and prediction of driver fatigue. IEEE Transactions on Vehicular Technology, 53(4), 1052–1068. https://doi.org/10.1109/TVT.2004.830974
- Kaakinen, J. K., Ballenghein, U., Tissier, G., & Baccino, T. (2018). Fluctuation in cognitive engagement during reading: Evidence from concurrent recordings of postural and eye movements. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(10), 1671. http://dx.doi.org/10.1037/xlm0000539
- Kasinski, A., Florek, A., & Schmidt, A. (2008). The PUT face database. Image Processing and Communications, 13(3–4), 59–64. https://www.researchgate.net/profile/Adam_Schmidt/publication/232085001_The_PUT_face_database/links/09e4150d0bf1e5080f000000/The-PUT-face-database.pdf
- Kazemi, V., & Sullivan, J. (2014). One millisecond face alignment with an ensemble of regression trees. In Proceedings of IEEE conference on computer vision and pattern recognition (pp. 1867–1874). IEEE. http://dx.doi.org/10.1109/CVPR.2014.241
- Killingsworth, M. A., & Gilbert, D. T. (2010). A wandering mind is an unhappy mind. Science, 330(6006), 932. https://doi.org/10.1126/science.1192439
- King, D. (2018). Dlib C++ Library. Retrieved March 11, 2019, from http://dlib.net/
- Kong, S. C. (2011). An evaluation study of the use of a cognitive tool in a one-to-one classroom for promoting classroom-based dialogic interaction. Computers & Education, 57(3), 1851–1864. https://doi.org/10.1016/j.compedu.2011.04.008
- Koyama, S., Yücel, Z., & Monden, A. (2019). Quantitative evaluation of the relation between blink features and apparent task engagement. In Proceedings of European conference on visual perception (pp. 732). SAGE.
- Krippendorff, K. (2004). Reliability in content analysis: Some common misconceptions and recommendations. Human Communications Research, 30(3), 411–433. http://dx.doi.org/10.1093/hcr/30.3.411
- Li, M., Chen, X., Li, X., Ma, B., & Vitányi, P. (2003). The similarity metric. In Proceedings of the ACM-SIAM symposium on discrete algorithms (pp. 863–872). http://dx.doi.org/10.1109/TIT.2004.838101
- Liu, M., McKelroy, E., Corliss, S. B., & Carrigan, J. (2017). Investigating the effect of an adaptive learning intervention on students’ learning. Educational Technology Research and Development, 65(6), 1605–1625. https://doi.org/10.1007/s11423-017-9542-1
- MacKay, D. J. (2017). Information theory, inference and learning algorithms. Cambridge University Press.
- Matthews, G., & Desmond, P. A. (1998). Personality and multiple dimensions of task-induced fatigue: A study of simulated driving. Personality and Individual Differences, 25(3), 443–458. https://doi.org/10.1016/S0191-8869(98)00045-2
- Mayer, R. E. (2017). Using multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197
- Mbouna, R. O., Kong, S. G., & Chun, M.-G. (2013). Visual analysis of eye state and head pose for driver alertness monitoring. IEEE Transactions on Intelligent Transportation Systems, 14(3), 1462–1469. https://doi.org/10.1109/TITS.2013.2262098
- Miller, B. W. (2015). Using reading times and eye-movements to measure cognitive engagement. Educational Psychologist, 50(1), 31–42. https://doi.org/10.1080/00461520.2015.1004068
- Nelder, J. A., & Mead, R. (1965). A simplex method for function minimization. The Computer Journal, 7(4), 308–313. https://doi.org/10.1093/comjnl/7.4.308
- Neog, D. R. (2018). Measurement and animation of the eye region of the human face in reduced coordinates [Unpublished doctoral dissertation]. University of British Columbia.
- O’Donnell, E., Lawless, S., Sharp, M., & Wade, V. P. (2015). A review of personalised elearning: Towards supporting learner diversity. International Journal of Distance Education Technologies, 13(1), 22–47. https://doi.org/10.4018/ijdet.2015010102
- Pan, G., Sun, L., Wu, Z., & Lao, S. (2007). Eyeblink-based anti-spoofing in face recognition from a generic webcamera. In Proceedings of IEEE international conference on computer vision (pp. 1–8). IEEE. http://dx.doi.org/10.1109/ICCV.2007.4409068
- Piskurich, G. M. (2006). Online learning: E-learning. Fast, cheap, and good. Performance Improvement, 45(1), 18–24. https://doi.org/10.1002/pfi.2006.4930450105
- Rosenfield, M. (2011). Computer vision syndrome: A review of ocular causes and potential treatments. Ophthalmic and Physiological Optics, 31(5), 502–515. https://doi.org/10.1111/j.1475-1313.2011.00834.x
- Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2016). 300 faces in-the-wild challenge: Database and results. Image and Vision Computing, 47, 3–18. https://doi.org/10.1016/j.imavis.2016.01.002
- Schooler, J. W., Smallwood, J., Christoff, K., Handy, T. C., Reichle, E. D., & Sayette, M. A. (2011). Meta-awareness, perceptual decoupling and the wandering mind. Trends in Cognitive Sciences, 15(7), 319–326. https://doi.org/10.1016/j.tics.2011.05.006
- Seta, L., Kukulska-Hulme, A., & Arrigo, M. (2014). What have we learnt about mobile LifeLong Learning (mLLL)? International Journal of Lifelong Education, 33(2), 161–182. https://doi.org/10.1080/02601370.2013.831954
- Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The challenges of defining and measuring student engagement in science. Educational Psychologist, 50(1), 1–13. https://doi.org/10.1080/00461520.2014.1002924
- Smilek, D., Carriere, J. S., & Cheyne, J. A. (2010). Out of mind, out of sight: Eye blinking as indicator and embodiment of mind wandering. Psychological Science, 21(6), 786–789. https://doi.org/10.1177/0956797610368063
- Soukupová, T., & Cech, J. (2016). Real-time eye blink detection using facial landmarks. In Proceedings of computer vision winter workshop (pp. 1–8). http://cvww2016.vicos.si/index.html%3Fp=13.html
- Szafir, D., & Mutlu, B. (2012). Pay attention!: Designing adaptive agents that monitor and improve user engagement. In Proceedings of SIGCHI conference on human factors in computing systems (pp. 11–20). ACM. http://dx.doi.org/10.1145/2207676.2207679
- Thomas, C., & Jayagopi, D. B. (2017). Predicting student engagement in classrooms using facial behavioral cues. In Proceedings of ACM SIGCHI international workshop on multimodal interaction for education (pp. 33–40). ACM. http://dx.doi.org/10.1145/3139513.3139514
- Urhahne, D., & Zhu, M. (2015). Accuracy of teachers’ judgments of students’ subjective well-being. Learning and Individual Differences, 43, 226–232. https://doi.org/10.1016/j.lindif.2015.08.007
- Uřičář, M., Franc, V., Thomas, D., Sugimoto, A., & Hlaváč, V. (2016). Multi-view facial landmark detector learned by the structured output SVM. Image and Vision Computing, 47, 45–59. https://doi.org/10.1016/j.imavis.2016.02.004
- VanderPlas, J. (2016). Python data science handbook: Essential tools for working with data. O’Reilly Media Inc.
- Wang, N., Gao, X., Tao, D., Yang, H., & Li, X. (2018). Facial feature point detection: A comprehensive survey. Neurocomputing, 275, 50–65. https://doi.org/10.1016/j.neucom.2017.05.013
- Whitehill, J., Serpell, Z., Lin, Y.-C., Foster, A., & Movellan, J. R. (2014). The faces of engagement: Automatic recognition of student engagement from facial expressions. IEEE Transactions on Affective Computing, 5(1), 86–98. https://doi.org/10.1109/TAFFC.2014.2316163
- Wu, W., Qian, C., Yang, S., Wang, Q., Cai, Y., & Zhou, Q. (2018). Look at boundary: A boundary-aware face alignment algorithm. In Proceedings of IEEE International conference on computer vision and pattern recognition (pp. 2129–2138). IEEE. http://dx.doi.org/10.1109/CVPR.2018.00227
- Wu, X., Anderson, R. C., Nguyen-Jahiel, K., & Miller, B. (2013). Enhancing motivation and engagement through collaborative discussion. Journal of Educational Psychology, 105(3), 622. https://doi.org/10.1037/a0032792
- Wu, Y., & Ji, Q. (2019). Facial landmark detection: A literature survey. International Journal of Computer Vision, 127(2), 115–142. Springer. http://dx.doi.org/10.1007/s11263-018-1097-z
- Yücel, Z. (2020). Implementation of Wisconsin card sorting task in Java. Retrieved February, 2020, fromhttps://github.com/yucelzeynep/WCST
- Yücel, Z., Salah, A. A., Meric Li, C., Meric Li, T., Valenti, R., & Gevers, T. (2013). Joint attention by gaze interpolation and saliency. IEEE Transactions on Cybernetics, 43(3), 829–842. https://doi.org/10.1109/TSMCB.2012.2216979
- Zanlungo, F., Yücel, Z., Brščić, D., Kanda, T., & Hagita, N. (2017). Intrinsic group behaviour: Dependence of pedestrian dyad dynamics on principal social and personal features. PLoS One, 12(11), e0187253. https://doi.org/10.1371/journal.pone.0187253
- Zhu, M., & Urhahne, D. (2014). Assessing teachers’ judgements of students’ academic motivation and emotions across two rating methods. Educational Research and Evaluation, 20(5), 411–427. https://doi.org/10.1080/13803611.2014.964261