The emotional design of an instructor: body gestures do not boost the effects of facial expressions in video lectures

References

• Abo Foul, Y., Eitan, R., & Aviezer, H. (2018). Perceiving emotionally incongruent cues from faces and bodies: Older adults get the whole picture. Psychology and Aging, 33(4), 660–666. https://doi.org/10.1037/pag0000255
   PubMed Web of Science ®Google Scholar
• Aviezer, H., Hassin, R. R., Ryan, J., Grady, C., Susskind, J., Anderson, A., Moscovitch, M., & Bentin, S. (2008). Angry, disgusted, or afraid? Psychological Science, 19(7), 724–732. https://doi.org/10.1111/j.1467-9280.2008.02148.x
   PubMed Web of Science ®Google Scholar
• Aviezer, H., Trope, Y., & Todorov, A. (2012a). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225–1229. https://doi.org/10.1126/science.1224313
   PubMed Web of Science ®Google Scholar
• Aviezer, H., Trope, Y., & Todorov, A. (2012b). Holistic person processing: Faces with bodies tell the whole story. Journal of Personality and Social Psychology, 103(1), 20–37. https://doi.org/10.1037/a0027411
   PubMed Web of Science ®Google Scholar
• Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49–59. https://doi.org/10.1016/0005-7916(94)90063-9
   PubMed Web of Science ®Google Scholar
• Butler, E. A. (2017). Emotions are temporal interpersonal systems. Current Opinion in Psychology, 17, 129–134. https://doi.org/10.1016/j.copsyc.2017.07.005
   PubMed Web of Science ®Google Scholar
• Castro–Meneses, L. J., Kruger, J.-L., & Doherty, S. (2020). Validating theta power as an objective measure of cognitive load in educational video. Educational Technology Research and Development, 68(1), 181–202. https://doi.org/10.1007/s11423-019-09681-4
   Web of Science ®Google Scholar
• Christ, S. E., Mccrae, C. S., & Abrams, R. A. (2002). Inhibition of return in static and dynamic displays. Psychonomic Bulletin & Review, 9(1), 80–85. https://doi.org/10.3758/BF03196258
   PubMed Web of Science ®Google Scholar
• Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48(4), 384–392. https://doi.org/10.1037/0003-066X.48.4.384
   PubMed Web of Science ®Google Scholar
• Franconeri, S. L., & Simons, D. J. (2005). The dynamic events that capture visual attention: A reply to abrams and christ (2005). Perception & Psychophysics, 67(6), 962–966. https://doi.org/10.3758/BF03193623
   PubMed Web of Science ®Google Scholar
• Grosbras, M. H., Ross, P. D., & Belin, P. (2018). Categorical emotion recognition from voice improves during childhood and adolescence. Scientific Reports, 8(1), 14791. https://doi.org/10.1038/s41598-018-32868-3
   PubMed Web of Science ®Google Scholar
• Horovitz, T., & Mayer, R. E. (2021). Learning with human and virtual instructors who display happy or bored emotions in video lectures. Computers in Human Behavior, 119, 106724. https://doi.org/10.1016/j.chb.2021.106724
   Web of Science ®Google Scholar
• Izard, C. E. (1994). Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin, 115(2), 288–299. https://doi.org/10.1037/0033-2909.115.2.288
   PubMed Web of Science ®Google Scholar
• Karaaslan, A., Durmus, B., & Amado, S. (2020). Does body context affect facial emotion perception and eliminate emotional ambiguity without visual awareness? Visual Cognition, 28(10), 605–620. https://doi.org/10.1080/13506285.2020.1846649
   Web of Science ®Google Scholar
• Keltner, D., Sauter, D., Tracy, J., & Cowen, A. (2019). Emotional expression: Advances in basic emotion theory. Journal of Nonverbal Behavior, 43(2), 133–160. https://doi.org/10.1007/s10919-019-00293-3
   PubMed Web of Science ®Google Scholar
• Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021aa). Do learners recognize and relate to the emotions displayed by virtual instructors? International Journal of Artificial Intelligence in Education, 31(1), 134–153. https://doi.org/10.1007/s40593-021-00238-2
   Web of Science ®Google Scholar
• Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021ba). The positivity principle: Do positive instructors improve learning from video lectures? Educational Technology Research and Development, 69(6), 3101–3129. https://doi.org/10.1007/s11423-021-10057-w
   PubMed Web of Science ®Google Scholar
• Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021bb). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114, 106554. https://doi.org/10.1016/j.chb.2020.106554
   Web of Science ®Google Scholar
• Lecker, M., Dotsch, R., Bijlstra, G., & Aviezer, H. (2020). Bidirectional contextual influence between faces and bodies in emotion perception. Emotion, 20(7), 1154–1164. https://doi.org/10.1037/emo0000619
   PubMed Web of Science ®Google Scholar
• Liebenthal, E., Silbersweig, D. A., & Stern, E. (2016). The language, tone and prosody of emotions: Neural substrates and dynamics of spoken-word emotion perception. Frontiers in Neuroscience, 10, 506. https://doi.org/10.3389/fnins.2016.00506
   PubMed Web of Science ®Google Scholar
• Mayer, R. E. (2020). Searching for the role of emotions in e-learning. Learning and Instruction, 70, 101213. https://doi.org/10.1016/j.learninstruc.2019.05.010
   Web of Science ®Google Scholar
• Moreno, R., & Mayer, R. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309–326. https://doi.org/10.1007/s10648-007-9047-2
   Web of Science ®Google Scholar
• Mori, Y., Noguchi, Y., Tanaka, A., & Ishii, K. (2022). Neural responses to facial and vocal displays of emotion in Japanese people. Culture and Brain. Advance Online Publication. https://doi.org/10.1007/s40167-021-00101-0
   Google Scholar
• Müller-Pinzler, L., Krach, S., Krämer, U. M., & Paulus, F. M. (2016). The Social Neuroscience of interpersonal emotions. In M. Wöhr, & S. Krach (Eds.), Social Behavior from rodents to humans. Current topics in Behavioral neurosciences (pp. 241–256). Springer.
   Google Scholar
• Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71. https://doi.org/10.1207/S15326985EP3801_8
   Web of Science ®Google Scholar
• Paas, F. G., & Van Merriënboer, J. J. (1994). Instructional control of cognitive load in the training of complex cognitive tasks. Educational Psychology Review, 6(4), 351–371. https://doi.org/10.1007/BF02213420
   Web of Science ®Google Scholar
• Park, B., Knörzer, L., Plass, J. L., & Brünken, R. (2015). Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms. Computers & Education, 86, 30–42. https://doi.org/10.1016/j.compedu.2015.02.016
   Web of Science ®Google Scholar
• Pekrun, R., & Stephens, E. J. (2010). Achievement emotions: A control-value approach. Social and Personality Psychology Compass, 4(4), 238–255. https://doi.org/10.1111/j.1751-9004.2010.00259.x
   Google Scholar
• Pi, Z., Chen, M., Zhu, F., Yang, J., & Hu, W. (2022a). Modulation of instructor’s eye gaze by facial expression in video lectures. Innovations in Education and Teaching International, 59(1), 15–23. https://doi.org/10.1080/14703297.2020.1788410
   Web of Science ®Google Scholar
• Pi, Z., Deng, L., Wang, X., Guo, P., Xu, T., & Zhou, Y. (2022b). The influences of a virtual instructor’s voice and appearance on learning from video lectures. Journal of Computer Assisted Learning. Advance online publication. https://doi.org/10.1111/jcal.12704
   Web of Science ®Google Scholar
• Pi, Z., Zhang, Y., Yang, J., Hu, W., & Yang, H. (2019). All roads lead to Rome: Instructors’ pointing and depictive gestures in video lectures promote learning through different patterns of attention allocation. Journal of Nonverbal Behavior, 43(4), 549–559. https://doi.org/10.1007/s10919-019-00310-5
   Web of Science ®Google Scholar
• Pi, Z., Zhang, Y., Zhu, F., Chen, L., Guo, X., & Yang, J. (2021a). The mutual influence of an instructor’s eye gaze and facial expression in video lectures. Interactive Learning Environments. Advance online publication. https://doi.org/10.1080/10494820.2021.1940213
   Web of Science ®Google Scholar
• Pi, Z., Zhu, F., Zhang, Y., & Yang, J. (2021b). An instructor’s beat gestures facilitate second language vocabulary learning from instructional videos: Behavioral and neural evidence. Language Teaching Research. Advance online publication. https://doi.org/10.1177/13621688211039023
   Web of Science ®Google Scholar
• Plass, J. L., & Kaplan, U. (2016). Emotional design in digital media for learning. In S. Tettegah, & M. Gartmeier (Eds.), Emotions, technology, design, and learning (pp. 131–161). Elsevier.
   Google Scholar
• Reschke, P. J., & Walle, E. A. (2021). The unique and interactive effects of faces, postures, and scenes on emotion categorization. Affective Science, 2(4), 468–483. https://doi.org/10.1007/s42761-021-00061-x
   PubMedGoogle Scholar
• Shroff, R. H., Vogel, D. R., Coombes, J., & Lee, F. (2007). Student E-learning intrinsic motivation: A qualitative analysis. Communications of the Association for Information Systems, 19, 12. https://doi.org/10.17705/1CAIS.01912
   Google Scholar
• Stull, A. T., Fiorella, L., Gainer, M. J., & Mayer, R. E. (2018). Using transparent whiteboards to boost learning from online stem lectures. Computers & Education, 120, 146–159. https://doi.org/10.1016/j.compedu.2018.02.005
   Web of Science ®Google Scholar
• Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. Springer.
   Google Scholar
• Vaish, A., Grossmann, T., & Woodward, A. (2008). Not all emotions are created equal: The negativity bias in social-emotional development. Psychological Bulletin, 134(3), 383–403. https://doi.org/10.1037/0033-2909.134.3.383
   PubMed Web of Science ®Google Scholar
• van Wermeskerken, M., & van Gog, T. (2017). Seeing the instructor’s face and gaze in demonstration video examples affects attention allocation but not learning. Computers & Education, 113, 98–107. https://doi.org/10.1016/j.compedu.2017.05.013
   Web of Science ®Google Scholar
• Wang, Y. (2022). To be expressive or not: The role of teachers’ emotions in students’ learning. Frontiers in Psychology, 12, 737310. https://doi.org/10.3389/fpsyg.2021.737310
   PubMed Web of Science ®Google Scholar
• Wang, Y., Liu, Q., Chen, W., Wang, Q., & David, S. (2019). Effects of instructor’s facial expressions on students’ learning with video lectures. British Journal of Educational Technology, 50(3), 1381–1395. https://doi.org/10.1111/bjet.12633
   Web of Science ®Google Scholar
• Zeidner, M. (1998). Test anxiety: The state of the art. Springer.
   Google Scholar
• Zhang, H., Miller, K. F., Sun, X., & Cortina, K. S. (2020). Wandering eyes: Eye movements during mind wandering in video lectures. Applied Cognitive Psychology, 34(2), 449–464. https://doi.org/10.1002/acp.3632
   Web of Science ®Google Scholar
• Zhang, Y., Xu, K., Pi, Z., & Yang, J. (2021). Instructor’s position affects learning from video lectures in Chinese context: An eye-tracking study. Behaviour & Information Technology. Advance online publication. https://doi.org/10.1080/0144929X.2021.1910731.
   Google Scholar