Publication Cover
Educational Psychology
An International Journal of Experimental Educational Psychology
Volume 43, 2023 - Issue 1
774
Views
1
CrossRef citations to date
0
Altmetric
Research Articles

Attention mediates the effect of emotional arousal on learning outcomes in multimedia learning: an eye-tracking study

& ORCID Icon
Pages 38-56 | Received 12 Aug 2021, Accepted 29 Nov 2022, Published online: 09 Dec 2022

References

  • Acarturk, C., & Ozcelik, E. (2017). Secondary-task effects on learning with multimedia: An investigation through eye-movement analysis. The Journal of Experimental Education, 85(1), 126–141. https://doi.org/10.1080/00220973.2016.1143793
  • Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. (1997). Deictic codes for the embodiment of cognition. The Behavioral and Brain Sciences, 20(4), 723–742. https://doi.org/10.1017/s0140525x97001611
  • Bradley, M. M., Sabatinelli, D., Lang, P. J., Fitzsimmons, J. R., King, W., & Desai, P. (2003). Activation of the visual cortex in motivated attention. Behavioral Neuroscience, 117(2), 369–380. https://doi.org/10.1037/0735-7044.117.2.369
  • Brom, C., Stárková, T., & D'Mello, S. K. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119. https://doi.org/10.1016/j.edurev.2018.09.004
  • Cagiltay, N. E., Ozcelik, E., & Ozcelik, N. S. (2015). The effect of competition on learning in games. Computers & Education, 87, 35–41. https://doi.org/10.1016/j.compedu.2015.04.001
  • Cahill, L., Haier, R. J., White, N. S., Fallon, J., Kilpatrick, L., Lawrence, C., Potkin, S. G., & Alkire, M. T. (2001). Sex-related difference in amygdala activity during emotionally influenced memory storage. Neurobiology of Learning and Memory, 75(1), 1–9. https://doi.org/10.1006/nlme.2000.3999
  • Chang, Y., & Choi, S. (2014). Effects of seductive details evidenced by gaze duration. Neurobiology of Learning and Memory, 109, 131–138. https://doi.org/10.1016/j.nlm.2014.01.005
  • Christianson, S. Å., & Engelberg, E. (1999). Organization of emotional memories. In T. Dalgleish & M. Power (Eds.), The handbook of cognition and emotion (pp. 211–227). John Wiley & Sons, Ltd.
  • Chung, S., & Cheon, J. (2020). Emotional design of multimedia learning using background images with motivational cues. Journal of Computer Assisted Learning, 36(6), 922–932. https://doi.org/10.1111/jcal.12450
  • Cullen, H., Kanai, R., Bahrami, B., & Rees, G. (2014). Individual differences in anthropomorphic attributions and human brain structure. Social Cognitive and Affective Neuroscience, 9(9), 1276–1280. https://doi.org/10.1093/scan/nst109
  • de Koning, B. B., Tabbers, H. K., Rikers, R. M., & Paas, F. (2010). Attention guidance in learning from a complex animation: Seeing is understanding? Learning and Instruction, 20(2), 111–122. https://doi.org/10.1016/j.learninstruc.2009.02.010
  • Dehn, D. M., & van Mulken, S. (2000). The impact of animated interface agents: A review of empirical research. International Journal of Human-Computer Studies, 52(1), 1–22. https://doi.org/10.1006/ijhc.1999.0325
  • Dolan, R. J. (2002). Emotion, cognition, and behavior. Science, 298(5596), 1191–1194. https://doi.org/10.1126/science.1076358
  • Dolcos, F., Iordan, A. D., & Dolcos, S. (2011). Neural correlates of emotion–cognition interactions: A review of evidence from brain imaging investigations. Journal of Cognitive Psychology, 23(6), 669–694. https://doi.org/10.1080/20445911.2011.594433
  • Endres, T., Weyreter, S., Renkl, A., & Eitel, A. (2020). When and why does emotional design foster learning? Evidence for situational interest as a mediator of increased persistence. Journal of Computer Assisted Learning, 36(4), 514–525. https://doi.org/10.1111/jcal.12418
  • Fox, E., Griggs, L., & Mouchlianitis, E. (2007). The detection of fear-relevant stimuli: Are guns noticed as quickly as snakes? Emotion, 7(4), 691–696. https://doi.org/10.1037/1528-3542.7.4.691
  • Hackländer, R. P., Janssen, S. M., & Bermeitinger, C. (2019). An in-depth review of the methods, findings, and theories associated with odor-evoked autobiographical memory. Psychonomic Bulletin & Review, 26(2), 401–429. https://doi.org/10.3758/s13423-018-1545-3
  • Hamann, S. (2001). Cognitive and neural mechanisms of emotional memory. Trends in Cognitive Sciences, 5(9), 394–400. https://doi.org/10.1016/s1364-6613(00)01707-1
  • Hannus, M., & Hyönä, J. (1999). Utilization of illustrations during learning of science textbook passages among low-and high-ability children. Contemporary Educational Psychology, 24(2), 95–123. https://doi.org/10.1006/ceps.1998.0987
  • Harp, S. F., & Mayer, R. E. (1997). The role of interest in learning from scientific text and illustrations: On the distinction between emotional interest and cognitive interest. Journal of Educational Psychology, 89(1), 92–102. https://doi.org/10.1037/0022-0663.89.1.92
  • Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: A theory of cognitive interest in science learning. Journal of Educational Psychology, 90(3), 414–434. https://doi.org/10.1037/0022-0663.90.3.414
  • Harris, C. R., & Pashler, H. (2005). Enhanced memory for negatively emotionally charged pictures without selective rumination. Emotion, 5(2), 191–199. https://doi.org/10.1037/1528-3542.5.2.191
  • Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. The Guilford Press.
  • Heidig, S., Müller, J., & Reichelt, M. (2015). Emotional design in multimedia learning: Differentiation on relevant design features and their effects on emotions and learning. Computers in Human Behavior, 44, 81–95. https://doi.org/10.1016/j.chb.2014.11.009
  • Hoch, E., Scheiter, K., & Schüler, A. (2020). Implementation intentions for improving self-regulation in multimedia learning: Why don’t they work? The Journal of Experimental Education, 88(4), 536–558. https://doi.org/10.1080/00220973.2019.1628693
  • Hoogerheide, V., Visee, J., Lachner, A., & van Gog, T. (2019). Generating an instructional video as homework activity is both effective and enjoyable. Learning and Instruction, 64, 101226–101213. https://doi.org/10.1016/j.learninstruc.2019.101226
  • Hyönä, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20(2), 172–176. https://doi.org/10.1016/j.learninstruc.2009.02.013
  • Irrazabal, N., & Burin, D. (2021). Effects of emotional valence and arousal on comprehension and assembly of instructions. Trends in Psychology, 29(1), 104–122. https://doi.org/10.1007/s43076-020-00057-9
  • Jarodzka, H., Scheiter, K., Gerjets, P., & Van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20(2), 146–154. https://doi.org/10.1016/j.learninstruc.2009.02.019
  • Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354.
  • Kalyuga, S., Chandler, P., & Sweller, J. (1999). Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology, 13(4), 351–371. https://doi.org/10.1002/(SICI)1099-0720(199908)13:4<351::AID-ACP589>3.0.CO;2-6
  • Kaplan, R. L., Van Damme, I., Levine, L. J., & Loftus, E. F. (2016). Emotion and false memory. Emotion Review, 8(1), 8–13. https://doi.org/10.1177/1754073915601228
  • Kensinger, E. A., & Corkin, S. (2003). Memory enhancement for emotional words: Are emotional words more vividly remembered than neutral words? Memory & Cognition, 31(8), 1169–1180. https://doi.org/10.3758/bf03195800
  • Kensinger, E. A., Garoff-Eaton, R. J., & Schacter, D. L. (2007). Effects of emotion on memory specificity: Memory tradeoffs elicited by negative visually arousing stimuli. Journal of Memory and Language, 56(4), 575–591. https://doi.org/10.1016/j.jml.2006.05.004
  • Le, Y., Liu, J., Deng, C., & Dai, D. Y. (2018). Heart rate variability reflects the effects of emotional design principle on mental effort in multimedia learning. Computers in Human Behavior, 89, 40–47. https://doi.org/10.1016/j.chb.2018.07.037
  • LeDoux, J. (2012). Rethinking the emotional brain. Neuron, 73(4), 653–676. https://doi.org/10.1016/j.neuron.2012.02.004
  • Lehman, S., Schraw, G., McCrudden, M. T., & Hartley, K. (2007). Processing and recall of seductive details in scientific text. Contemporary Educational Psychology, 32(4), 569–587. https://doi.org/10.1016/j.cedpsych.2006.07.002
  • Loderer, K., Pekrun, R., & Lester, J. C. (2020). Beyond cold technology: A systematic review and meta-analysis on emotions in technology-based learning environments. Learning and Instruction, 70, 101162. Article 101162. https://doi.org/10.1016/j.learninstruc.2018.08.002
  • Mayer, R. E., & Estrella, G. (2014). Benefits of emotional design in multimedia instruction. Learning and Instruction, 33, 12–18. https://doi.org/10.1016/j.learninstruc.2014.02.004
  • McGaugh, J. L. (2006). Make mild moments memorable: Add a little arousal. Trends in Cognitive Sciences, 10(8), 345–347. https://doi.org/10.1016/j.tics.2006.06.001
  • Moreno, R. (2009). Learning from animated classroom exemplars: The case for guiding student teachers’ observations with metacognitive prompts. Educational Research and Evaluation, 15(5), 487–501. https://doi.org/10.1080/13803610903444592
  • Münchow, H., & Bannert, M. (2019). Feeling good, learning better? Effectivity of an emotional design procedure in multimedia learning. Educational Psychology, 39(4), 530–549. https://doi.org/10.1080/01443410.2018.1524852
  • Münchow, H., Mengelkamp, C., & Bannert, M. (2017). The better you feel the better you learn: Do warm colours and rounded shapes enhance learning outcome in multimedia learning? Education Research International, 2017, 1–15. https://doi.org/10.1155/2017/2148139
  • Nairne, J. S., Thompson, S. R., & Pandeirada, J. N. (2007). Adaptive memory: Survival processing enhances retention. Journal of Experimental Psychology. Learning, Memory, and Cognition, 33(2), 263–273. https://doi.org/10.1037/0278-7393.33.2.263
  • Navratil, S. D., Kühl, T., & Heidig, S. (2018). Why the cells look like that–The influence of learning with emotional design and elaborative interrogations. Frontiers in Psychology, 9, 1653. Article 1653. https://doi.org/10.3389/fpsyg.2018.01653
  • Nummenmaa, L., Hyönä, J., & Calvo, M. G. (2006). Eye movement assessment of selective attentional capture by emotional pictures. Emotion, 6(2), 257–268. https://doi.org/10.1037/1528-3542.6.2.257
  • Öhman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology. General, 130(3), 466–478. https://doi.org/10.1037//0096-3445.130.3.466
  • Ozcelik, E. (2015). The effect of post-learning arousal on memory in education. International Journal of Innovation and Learning, 18(2), 266–276. https://doi.org/10.1504/IJIL.2015.070930
  • Ozcelik, E., & Arslan-Ari, I. (2022). Enhancing multimedia learning by emotional arousal. Manuscript submitted for publication.
  • Ozcelik, E., Cagiltay, N. E., & Ozcelik, N. S. (2013). The effect of uncertainty on learning in game-like environments. Computers & Education, 67, 12–20. https://doi.org/10.1016/j.compedu.2013.02.009
  • Ozcelik, E., Karakus, T., Kursun, E., & Cagiltay, K. (2009). An eye-tracking study of how color coding affects multimedia learning. Computers & Education, 53(2), 445–453. https://doi.org/10.1016/j.compedu.2009.03.002
  • Park, B., Knörzer, L., Plass, J. L., & Brünken, R. (2015). Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms. Computers & Education, 86, 30–42. https://doi.org/10.1016/j.compedu.2015.02.016
  • Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9
  • Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48. https://doi.org/10.1016/j.cedpsych.2010.10.002
  • Penny, J., Johnson, R. L., & Gordon, B. (2000). Using rating augmentation to expand the scale of an analytic rubric. The Journal of Experimental Education, 68(3), 269–287. https://doi.org/10.1080/00220970009600096
  • Plass, J. L., & Kalyuga, S. (2019). Four ways of considering emotion in cognitive load theory. Educational Psychology Review, 31(2), 339–359. https://doi.org/10.1007/s10648-019-09473-5
  • Plass, J. L., & Kaplan, U. (2016). Emotional design in digital media for learning. In Emotions, technology, design, and learning (pp. 131–161). Academic Press.
  • Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422. https://doi.org/10.1037/0033-2909.124.3.372
  • Rey, G. D. (2012). A review of research and a meta-analysis of the seductive detail effect. Educational Research Review, 7(3), 216–237. https://doi.org/10.1016/j.edurev.2012.05.003
  • Riggs, L., McQuiggan, D. A., Farb, N., Anderson, A. K., & Ryan, J. D. (2011). The role of overt attention in emotion-modulated memory. Emotion, 11(4), 776–785. https://doi.org/10.1037/a0022591
  • Rubin, D. C., & Kozin, M. (1984). Vivid memories. Cognition, 16(1), 81–95. https://doi.org/10.1016/0010-0277(84)90037-4
  • Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
  • Schneider, S., Häßler, A., Habermeyer, T., Beege, M., & Rey, G. D. (2019). The more human, the higher the performance? Examining the effects of anthropomorphism on learning with media. Journal of Educational Psychology, 111(1), 57–72. https://doi.org/10.1037/edu0000273
  • Schneider, S., Nebel, S., Beege, M., & Rey, G. D. (2020). The retrieval-enhancing effects of decorative pictures as memory cues in multimedia learning videos and subsequent performance tests. Journal of Educational Psychology, 112(6), 1111–1127. https://doi.org/10.1037/edu0000432
  • Schneider, S., Wirzberger, M., & Rey, G. D. (2019). The moderating role of arousal on the seductive detail effect in a multimedia learning setting. Applied Cognitive Psychology, 33(1), 71–84. https://doi.org/10.1002/acp.3473
  • Schnotz, W., Fries, S., & Horz, H. (2009). Motivational aspects of cognitive load theory. In M. Wosnitza, S. A. Karabenick, A. Efklides, & P. Nenniger (Eds.), Contemporary motivation research: From global to local perspectives (pp. 69–96). Hogrefe & Huber.
  • Shangguan, C., Wang, Z., Gong, S., Guo, Y., & Xu, S. (2019). More attractive or more interactive? The effects of multi-leveled emotional design on middle school students’ multimedia learning. Frontiers in Psychology, 10, 3065. https://doi.org/10.3389/fpsyg.2019.03065
  • Stark, L., Brünken, R., & Park, B. (2018). Emotional text design in multimedia learning: A mixed-methods study using eye tracking. Computers & Education, 120, 185–196. https://doi.org/10.1016/j.compedu.2018.02.003
  • Stárková, T., Lukavský, J., Javora, O., & Brom, C. (2019). Anthropomorphisms in multimedia learning: Attract attention but do not enhance learning. Journal of Computer Assisted Learning, 35(4), 555–568.
  • Tugade, M., Devlin, H. C., & Frederickson, B. L. (2021). Positive emotions. In C. R. Snyder, S. J. Lopez, L. M. Edwards, & S. C. Marques (Eds.), Oxford handbook of positive psychology (3rd ed.). Oxford University Press.
  • Um, E., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485–498. https://doi.org/10.1037/a0026609
  • Underwood, G., Jebbett, L., & Roberts, K. (2004). Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search. The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology, 57(1), 165–182.
  • Uzun, A. M., & Yıldırım, Z. (2018). Exploring the effect of using different levels of emotional design features in multimedia science learning. Computers & Education, 119, 112–128. https://doi.org/10.1016/j.compedu.2018.01.002
  • van Gog, T., & Jarodzka, H. (2013). Eye tracking as a tool to study and enhance cognitive and metacognitive processes in computer-based learning environments. In R. Azevedo & V. Aleven (Eds.), International handbook of metacognition and learning technologies (pp. 143–156). Springer.
  • van Merriënboer, J. J., Kirschner, P. A., & Kester, L. (2003). Taking the load off a learner’s mind: Instructional design for complex learning. Educational Psychologist, 38(1), 5–13. https://doi.org/10.1207/S15326985EP3801_2
  • Vosskühler, A., Nordmeier, V., Kuchinke, L., & Jacobs, A. M. (2008). OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs. Behavior Research Methods, 40(4), 1150–1162.
  • Vuilleumier, P. (2005). How brains beware: Neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585–594. https://doi.org/10.1016/j.tics.2005.10.011

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.