How Static and Animated Pictures Contribute to Multi-level Mental Representations of Auditory Text in Seven-, Nine-, and Eleven-Year-Old Children

References

• Ayres, P., & Paas, F. (2007). Making instructional animations more effective: A cognitive load approach. Applied Cognitive Psychology, 21, 695–700. doi:10.1002/acp.1343
   Web of Science ®Google Scholar
• Aziz-Zadeh, L., Wilson, S. M., Rizzolatti, G., & Iacoboni, M. (2006). Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Current Biology, 16, 1818–1823. doi:10.1016/j.cub.2006.07.060
   PubMed Web of Science ®Google Scholar
• Barnes, M. A., Raghubar, K. P., Faulkner, H., & Denton, C. A. (2014). The construction of visual-spatial situation models in children’s reading and their relation to reading comprehension. Journal of Experimental Child Psychology, 119, 101–111. doi:10.1016/j.jecp.2013.10.011
   PubMed Web of Science ®Google Scholar
• Barsalou, L. W. (1999). Language comprehension: Archival memory or preparation for situated action? Discourse Processes, 28(1), 61–80. doi:10.1080/01638539909545069
   Web of Science ®Google Scholar
• Barsalou, L. W. (2008). Grounded Cognition. Annual Review of Psychology, 59, 617–645. doi:10.1146/annurev.psych.59.103006.093639
   PubMed Web of Science ®Google Scholar
• Beagles-Roos, J., & Gat, I. (1983). Specific impact of radio and television on children’s story comprehension. Journal of Educational Psychology, 75(1), 128–137. doi:10.1037/0022-0663.75.1.128
   Web of Science ®Google Scholar
• Brunyé, T. T., Ditman, T., Mahoney, C. R., Walters, E. K., & Taylor, H. A. (2010). You heard it here first: Readers mentally simulate described sounds. Acta Psychologica, 135, 209–215. doi:10.1016/j.actpsy.2010.06.008
   PubMed Web of Science ®Google Scholar
• Butcher, K. R. (2014). The multimedia principle. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 174–205). New York, NY: Cambridge University Press.
   Google Scholar
• Donaldson, W. (1992). Measuring recognition memory. Journal of Experimental Psychology: General, 121(3), 275–277. doi:10.1037/0096-3445.121.3.275
   PubMed Web of Science ®Google Scholar
• Engelen, J. A. A., Bouwmeester, S., de Bruin, A. B. H., & Zwaan, R. A. (2011). Perceptual simulation in developing language comprehension. Journal of Experimental Child Psychology, 110, 659–675. doi:10.1016/j.jecp.2011.06.009
   PubMed Web of Science ®Google Scholar
• Engelkamp, J. (1980). Some studies on the internal structure of propositions. Psychological Research, 41, 355–371. doi:10.1007/BF00308880
   Web of Science ®Google Scholar
• Fecica, A. M., & O’Neill, D. K. (2010). A step at a time: Preliterate children’s simulation of narrative movement during story comprehension. Cognition, 116, 368–381. doi:10.1016/j.cognition.2010.05.014
   PubMed Web of Science ®Google Scholar
• Fletcher, C. R., & Chrysler, S. T. (1990). Surface forms, textbases, and situation models: Recognition memory for three types of textual information. Discourse Processes, 13(2), 175–190. doi:10.1080/01638539009544752
   Web of Science ®Google Scholar
• Gentner, D. (1989). The mechanisms of analogical learning. In S. Vosniadou & A. Ortony (Eds.), Similarity and analogical reasoning (pp. 199–241). Cambridge, United Kingdom: Cambridge University Press. doi:10.1017/CBO9780511529863.011
   Google Scholar
• Gibbons, J., Anderson, D. R., Smith, R., Field, D. E., & Fischer, C. (1986). Young children’s recall and reconstruction of audio and audiovisual narratives. Child Development, 57(4), 1014–1023. doi:10.2307/1130375
   PubMed Web of Science ®Google Scholar
• Glenberg, A. M., Gutierrez, T., Levin, J. R., Japuntich, S., & Kaschak, M. P. (2004). Activity and imaged activity can enhance young children’s reading ability. Journal of Educational Psychology, 96(3), 424–436. doi:10.1037/0022-0663.96.3.424
   Web of Science ®Google Scholar
• Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9(3), 558–565. doi:10.3758/BF03196313
   PubMed Web of Science ®Google Scholar
• Glenberg, A. M., & Robertson, D. A. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43, 379–401. doi:10.1006/jmla.2000.2714
   Web of Science ®Google Scholar
• Graesser, A. C., Singer, M., & Trabasso, T. (1994). Constructing inferences during narrative text comprehension. Psychological Review, 101(3), 371–395. doi:10.1037/0033-295X.101.3.371
   PubMed Web of Science ®Google Scholar
• Greenhoot, A. F., & Semb, P. A. (2008). Do illustrations enhance preschoolers’ memories for stories? Age-related change in the picture facilitation effect. Journal of Experimental Child Psychology, 99, 271–287. doi:10.1016/j.jecp.2007.06.005
   PubMed Web of Science ®Google Scholar
• Gunter, B., Furnham, A., & Griffiths, S. (2000). Children’s memory for news: A comparison of three presentation media. Media Psychology, 2(2), 93–118. doi:10.1207/S1532785XMEP0202_1
   Web of Science ®Google Scholar
• Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: A theory of cognitive interest in science learning. Journal of Educational Psychology, 90(3), 414–434. doi:10.1037/0022-0663.90.3.414
   Web of Science ®Google Scholar
• Hauf, J. (2016). Experimentelle Untersuchung der Entwicklung der kognitiven Textverarbeitung unter Berücksichtigung unterschiedlicher Darbietungsmodalitäten [Experimental investigation of the development of cognitive text processing with regard to different modalities of text presentations] (Doctoral Dissertation). Würzburg, Germany: Julius-Maximilians Universität.
   Google Scholar
• Hayes, D. S., Kelly, S. B., & Mandel, M. (1986). Media differences in children’s story synopses: Radio and television contrasted. Journal of Educational Psychology, 78(5), 341–346. doi:10.1037/0022-0663.78.5.341
   Web of Science ®Google Scholar
• Hidi, S., & Baird, W. (1986). Interestingness - a neglected variable in discourse processing. Cognitive Science, 10, 179–194.
   Web of Science ®Google Scholar
• Höffler, T. N., & Leutner, D. (2007). Instructional animation versus static pictures: A meta-analysis. Learning and Instruction, 17, 722–738. doi:10.1016/j.learninstruc.2007.09.013
   Web of Science ®Google Scholar
• Kaschak, M. P., Zwaan, R. A., Aveyard, M., & Yaxley, R. H. (2006). Perception of auditory motion affects language processing. Cognitive Science, 30, 733–744. doi:10.1207/s15516709cog0000_54
   PubMed Web of Science ®Google Scholar
• Kintsch, W. (1988). The role of knowledge in discourse comprehension: A construction-integration model. Psychological Review, 95(2), 163–182. doi:10.1037/0033-295X.95.2.163
   PubMed Web of Science ®Google Scholar
• Kintsch, W. (1998). Comprehension. A Paradigm for Cognition. Cambridge, United Kingdom: Cambridge University Press.
   Google Scholar
• Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32(1), 1–19. doi:10.1207/s15326985ep3201_1
   Web of Science ®Google Scholar
• McDaniel, M. A., Waddill, P. J., Finstad, K., & Bourg, T. (2000). The effects of text-based interest on attention and recall. Journal of Educational Psychology, 92(3), 492–502. doi:10.1037//0022-0663.92.3.492
   Web of Science ®Google Scholar
• Medienpädagogischer Forschungsverbund Südwest. (2017). KIM-Studie 2016. Kindheit, Internet, Medien [KIM Study 2016. Childhood, interet, media]. Retrieved from https://www.mpfs.de/fileadmin/files/Studien/KIM/2016/KIM_2016_Web-PDF.pdf
   Google Scholar
• Meteyard, L., Bahrami, B., & Vigliocco, G. (2007). Motion detection and motion verbs. Language affects low-level visual perception. Psychological Science, 18(11), 1007–1013. doi:10.1111/j.1467-9280.2007.02016.x
   PubMed Web of Science ®Google Scholar
• Nieding, G. (2006). Wie verstehen kinder texte? die entwicklung kognitiver repräsentationen [How do children understand text? the development of cognitive representation]. Lengerich: Pabst.
   Google Scholar
• Nieding, G., & Ohler, P. (1999). Der einfluss von protagonisten-zielstrukturen auf räumliche mentale modelle beim narrativen textverstehen von kindern. Sprache & Kognition, 18, 146–158. doi: 10.1024//0253-4533.18.34.146
   Google Scholar
• Nyhout, A., & O’Neill, D. K. (2013). Constructing spatial representations from narratives and non-narrative descriptions: Evidence from 7-year-olds. In M. A. Finlayson, B. Fisseni, B. Löwe, & J. C. Meister (Eds.), Workshop on computational models of narrative (pp. 158–165). Wadern, Germany: Leibniz-Zentrum für Informatik. doi:10.4230/OASIcs.CMN.2013.158
   Google Scholar
• Peirce, J. (2007). PsychoPy - Psychophysics software in Python. Journal of Neuroscience Methods, 162, 8–13. doi:10.1016/j.jneumeth.2006.11.017
   PubMed Web of Science ®Google Scholar
• Pezdek, K., Lehrer, A., & Simon, S. (1984). The relationship between reading and cognitive processing of television and radio. Child Development, 55(6), 2072–2082. doi:10.2307/1129780
   Web of Science ®Google Scholar
• Pike, M. M., Barnes, M. A., & Barron, R. W. (2010). The role of illustrations in children’s inferential comprehension. Journal of Experimental Child Psychology, 105, 243–255. doi:10.1016/j.jecp.2009.10.006
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F., Hauk, O., Nikulin, V. V., & Ilmoniemi, R. J. (2005). Functional links between motor and language systems. European Journal of Neuroscience, 21, 793–797. doi:10.1111/j.1460-9568.2005.03900.x
   PubMed Web of Science ®Google Scholar
• Ricci, C. M., & Beal, C. R. (2002). The effect of interactive media on children’s story memory. Journal of Educational Psychology, 94(1), 138–144. doi:10.1037//0022-0663.94.1.138
   Web of Science ®Google Scholar
• Richter, T., & Zwaan, R. A. (2009). Processing of color words activates color representations. Cognition, 111, 383–389. doi:10.1016/j.cognition.2009.02.011
   PubMed Web of Science ®Google Scholar
• Rideout, V. (2015). The common sense census: Media use by tweens and teens. San Francisco, CA: Common Sense.
   Google Scholar
• Rubman, C. N., & Waters, H. S. (2000). A, B, Seeing: The role of constructive processes in children’s comprehension monitoring. Journal of Educational Psychology, 92(3), 503–514. doi:10.1037//0022-0663.92.3.503
   Web of Science ®Google Scholar
• Schmalhofer, F., & Glavanov, D. (1986). Three components of understanding a programmer’s manual: Verbatim, propositional and situational representations. Journal of Memory and Language, 25, 279–294. doi:10.1016/0749-596X(86)90002-1
   Web of Science ®Google Scholar
• Schnotz, W. (2014). Integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 72–103). New York, NY: Cambridge University Press.
   Google Scholar
• Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and Instruction, 13, 141–156. doi:10.1016/S0959-4752(02)00017-8
   Web of Science ®Google Scholar
• Stanfield, R. A., & Zwaan, R. A. (2001). The effect of implied orientation derived from verbal context on picture recognition. Psychological Science, 12(2), 153–156. doi:10.1111/1467-9280.00326
   PubMed Web of Science ®Google Scholar
• Stanislaw, H., & Todorov, N. (1999). Calculation of signal detection theory measures. Behavior Research Methods, Instruments & Computers, 31(1), 137–149. doi:10.3758/BF03207704
   PubMedGoogle Scholar
• Taylor, L. J., & Zwaan, R. A. (2009). Action and cognition: The case of language. Language and Cognition, 1(1), 45–58. doi:10.1515/LANGCOG.2009.003
   Google Scholar
• Van Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York, NY: Academic Press.
   Google Scholar
• Wannagat, W., Waizenegger, G., Hauf, J., & Nieding, G. (2018). Mental representations of the text surface, the text base, and the situation model in auditory and audiovisual texts in 7-, 9-, and 11-year-olds. Discourse Processes, 55(3), 290–304. doi: 10.1080/0163853X.2016.1237246
   Web of Science ®Google Scholar
• Wannagat, W., Waizenegger, G., & Nieding, G. (2017). Multilevel mental representations of written, auditory, and audiovisual text in children and adults. Cognitive Processes, 18, 491–504. doi: 10.1007/s10339-017-0820-y
   PubMed Web of Science ®Google Scholar
• Wiley, J. (2019). Picture this! Effects of photographs, diagrams, animations, and sketching on learning and beliefs about learning from a geoscience text. Applied Cognitive Psychology, 33, 9–19. doi:10.1002/acp.3495
   Web of Science ®Google Scholar
• Zwaan, R. A. (1999). Embodied cognition, perceptual symbols, and situation models. Discourse Processes, 28(1), 81–88. doi:10.1080/01638539909545070
   Web of Science ®Google Scholar
• Zwaan, R. A. (2014). Embodiment and language comprehension: Reframing the discussion. Trends in Cognitive Sciences, 18(5), 229–234. doi:10.1016/j.tics.2014.02.008
   PubMed Web of Science ®Google Scholar
• Zwaan, R. A., & Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123(2), 162–185. doi:10.1037/0033-2909.123.2.162
   PubMed Web of Science ®Google Scholar
• Zwaan, R. A., Stanfield, R. A., & Yaxley, R. H. (2002). Language comprehenders mentally represent the shapes of objects. Psychological Science, 13(2), 168–171. doi:10.1111/1467-9280.00430
   PubMed Web of Science ®Google Scholar
• Zwaan, R. A., & Taylor, L. J. (2006). Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology: General, 135(1), 1–11. doi:10.1037/0096-3445.135.1.1
   PubMed Web of Science ®Google Scholar
• Zwaan, R. A., Taylor, L. J., & de Boer, M. (2010). Motor resonance as a function of narrative time: Further tests of the linguistic focus hypothesis. Brain & Language, 112, 143–149. doi:10.1016/j.bandl.2008.11.004
   PubMed Web of Science ®Google Scholar