Communication skills training exploiting multimodal emotion recognition

References

• Abt, C. (1970). Serious games. New York, NY: Viking Press.
   Google Scholar
• Bahreini, K., Nadolski, R., & Westera, W. (2014, September 16–19). Multimodal emotion recognition for assessment of learning in a game-based communication skills training. In For and In Serious Games, Joint workshop of the GALA network of excellence and the LEA’s BOX Project at EC-TEL 2014, Graz, Austria, pp. 22–25.
   Google Scholar
• Bahreini, K., Nadolski, R., & Westera, W. (2015). Improved multimodal emotion recognition for better game-based learning. In A. De Gloria (Ed.), Games and learning alliance (pp. 107–120). Springer. doi:10.1007/978-3-319-22960-7_11
   Google Scholar
• Bahreini, K., Nadolski, R., & Westera, W. (2016a). Towards multimodal emotion recognition in e-learning environments. Interactive Learning Environments, 24(3), 590–605. doi:10.1080/10494820.2014.908927
   Web of Science ®Google Scholar
• Bahreini, K., Nadolski, R., & Westera, W. (2016b). Towards real-time speech emotion recognition for affective e-learning. Education and Information Technologies, 21(5), 1367–1386. doi:10.1007/s10639-015-9388-2
   Google Scholar
• Ben Ammar, M., Neji, M., Alimi, A. M., & Gouardères, G. (2010). The affective tutoring system. Expert Systems with Applications, 37(4), 3013–3023. doi:10.1016/j.eswa.2009.09.031
   Web of Science ®Google Scholar
• Bower, G. H. (1981). Mood and memory. American Psychologist, 36, 129–148. doi: 10.1037/0003-066X.36.2.129
   PubMed Web of Science ®Google Scholar
• Brantley, C. P., & Miller, M. G. (2008). Effective communication for colleges. Mason: Thomson Higher Education.
   Google Scholar
• Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W., & Weiss, B. (2005). A database of German emotional speech. Proceedings of the inter speech, Lissabon, pp. 1517–1520.
   Google Scholar
• Busso, C., Deng, Z., & Yildirim, S. (2004, October 13–15). Analysis of emotion recognition using facial expressions, speech and multimodal information. Proceedings of the 6th international conference on multimodal Interfaces, ICMI 2004, State College, PA, USA. ACM.
   Google Scholar
• Cantillon, P., & Sargeant, J. (2008). Giving feedback in clinical settings. BMJ, 337(a1961). doi:10.1136/bmj.a1961
   Web of Science ®Google Scholar
• Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers & Education, 59(2), 661–686. doi:10.1016/j.compedu.2012.03.004
   Web of Science ®Google Scholar
• Ekman, P., & Friesen, W. V. (1978). Facial action coding system: Investigator’s guide. Douglas, AZ: A Human Face.
   Google Scholar
• Feidakis, M., Daradoumis, T., & Caballe, S. (2011). Emotion measurement in intelligent tutoring systems: What when and how to measure (pp. 807–812). Third international conference on intelligent networking and col-laborative systems, Fukuoka, Japan.
   Google Scholar
• Hager, P. J., Hager, P., & Halliday, J. (2006). Recovering informal learning: Wisdom judgment and community. Lifelong learning book series. Dordrecht: Springer.
   Google Scholar
• Hyunjin, Y., Sang-Wook, P., Yong-Kwi, L., & Jong-Hyun, J. (2013, October). Emotion recognition of serious game players using a simple brain computer interface. International Conference on ICT Convergence (ICTC), pp. 783–786. doi:10.1109/ICTC.2013.6675478
   Google Scholar
• Jaimes, A., & Sebe, N. (2007). Multimodal human–computer interaction: A survey, computer vision and image understanding. Special Issue on Vision for Human-Computer Interaction, 108(1–2), 116–134.
   Google Scholar
• Kramer, A. F. (1991). Physiological metrics of mental workload: A review of recent progress. In D. L. Damos (Ed.), Multiple-task-performance (pp. 329–360). London: Taylor & Francis.
   Google Scholar
• Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. doi: 10.2307/2529310
   PubMed Web of Science ®Google Scholar
• Lang, G., & Van der Molen, H. T. (2008). Psychologische gespreksvoering book. Heerlen: Open University of the Netherlands.
   Google Scholar
• Leventhal, H. (1984). A perceptual motor theory of emotion. In K. R. Scherer & P. Ekman (Eds.), Approaches to emotion (pp. 271–291). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Norman, G. (2010). Likert scales, levels of measurement and the “laws” of statistics. Advances in Health and Science Education, 15(5), 625–632. doi:10.1007/s10459-010-9222-y
   PubMed Web of Science ®Google Scholar
• Pavlas, D. (2010). A model of flow and play in game-based learning: The impact of game characteristics, player traits, and player states (Ph.D. dissertation). University of Central Florida, Orlando, FL.
   Google Scholar
• Pekrun, R. (1992). The impact of emotions on learning and achievement: Towards a theory of cognitive/motivational mediators. Journal of Applied Psychology, 41, 359–376. doi:10.1111/j.1464-0597.1992.tb00712.x
   Web of Science ®Google Scholar
• Psotka, J., & Mutter, S. A. (1988). Intelligent tutoring systems: Lessons learned. Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Rodriguez, H., Beck, D., Lind, D., & Lok, B. (2008). Audio analysis of human/virtual-human interaction. In H. Prendinger, J. C. Lester, & M. Ishizuka (Eds.), IVA 2008. LNCS (LNAI), 5208 (pp. 154–161). Heidelberg: Springer.
   Google Scholar
• Saragih, J., Lucey, S., & Cohn, J. F. (2011). Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision (IJCV), 91(2), 200–215. doi: 10.1007/s11263-010-0380-4
   Web of Science ®Google Scholar
• Sarrafzadeh, A., Alexander, S., Dadgostar, F., Fan, C., & Bigdeli, A. (2008). How do you know that I don’t understand? A look at the future of intelligent tutoring systems. Computers in Human Behavior, 24(4), 1342–1363. doi:10.1016/j.chb.2007.07.008
   Web of Science ®Google Scholar
• Schwarz, N. (1990). Feeling as information. Informational and motivational functions of affective states. In E. T. Higgins & R. Sorrentino (Eds.), Handbook of motivation and cognition. Foundations of social behavior (pp. 527–560). New York, NY: Guilford Press.
   Google Scholar
• Sebe, N. (2009). Multimodal interfaces: Challenges and perspectives. Journal of Ambient Intelligence and Smart Environments, 1(1), 23–30.
   Web of Science ®Google Scholar
• Tijs, T., Brokken, D., & IJsselsteijn, W. (2009). Creating an emotionally adaptive game. In S. M. Stevens & S. Saldamarco (Eds.), Entertainment computing - ICEC 2008. 7th international conference, Pittsburgh, PA, USA, September 25–27, 2008, Proceedings (pp. 122–133). Berlin: Springer.
   Google Scholar
• Van der Molen, H. T., & Gramsbergen-Hoogland, Y. H. (2005). Communication in organizations: Basic skills and conversation models. New York, NY: Psychology Press.
   Google Scholar
• Van Eck, R. (2010). Interdisciplinary models and tools for serious games: Emerging concepts and future directions. Hershey, PA: IGI Global.
   Google Scholar
• Vorvick, L., Avnon, T., Emmett, R., & Robins, L. (2008). Improving teaching by teaching feedback. Medical Education, 42, 540–543. doi: 10.1111/j.1365-2923.2008.03069.x
   PubMed Web of Science ®Google Scholar
• Wallbott, H. G. (1998). Bodily expression of emotion. European Journal of Social Psychology, 28(6), 879–896. doi: 10.1002/(SICI)1099-0992(1998110)28:6<879::AID-EJSP901>3.0.CO;2-W
   Web of Science ®Google Scholar
• Westera, W. (2013). The digital turn. How the internet transforms our existence. Bloomington, IN: Author house.
   Google Scholar
• Westera, W., Nadolski, R., Hummel, H. G. K., & Wopereis, I. (2008). Serious games for higher education: A framework for reducing design complexity. Journal of Computer Assisted Learning, 24(5), 420–432. doi: 10.1111/j.1365-2729.2008.00279.x
   Web of Science ®Google Scholar
• Wouters, P., Van Nimwegen, C., Van Oostendorp, H., & Van der Spek, E. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. doi: 10.1037/a0031311
   Web of Science ®Google Scholar
• Wu, C. H., Huang, Y. M., & Hwang, J. P. (2015). Review of affective computing in education/learning: Trends and challenges. British Journal of Educational Technology. Advance online publication. doi:10.1111/bjet.12324
   PubMed Web of Science ®Google Scholar
• Zhang, T., Hasegawa-Johnson, M., & Levinson, S. E. (2003). Mental state detection of dialogue system users via spoken language. ISCA/IEEE workshop on spontaneous speech processing and recognition (SSPR), Kyoto, Japan.
   Google Scholar