Towards a multimodally oriented theory of translation: A cognitive framework for the translation of illustrated technical texts

References

• Anderson, John R. 1995. Cognitive Psychology and Its Implications. New York: W. H. Freeman.
   Google Scholar
• Boeriis, Morten, and Jana Holsanova. 2012. “Tracking Visual Segmentation: Connecting Semiotic and Cognitive Perspectives.” Visual Communication 11 (3): 259–281. doi:10.1177/1470357212446408.
   Web of Science ®Google Scholar
• Byrne, Jody. 2012. Scientific and Technical Translation Explained. Manchester: St Jerome.
   Google Scholar
• Connors, Sean P. 2013. “Weaving Multimodal Meaning in a Graphic Novel Reading Group.” Visual Communication 12 (1): 27–53. doi:10.1177/1470357212462812.
   Web of Science ®Google Scholar
• Englund Dimitrova, Birgitta. 2010. “Translation Process.” In Handbook of Translation Studies, Vol. 1, edited by Yves Gambier and Luc van Doorslaer, 406–411. Amsterdam: John Benjamins.
   Google Scholar
• Eysenck, Michael W., and Mark T. Keane. 2005. Cognitive Psychology. Hove: Psychology Press.
   Google Scholar
• Foulsham, Tom, and Geoffrey Underwood. 2008. “What Can Saliency Models Predict about Eye Movements? Spatial and Sequential Aspects of Fixations during Encoding and Recognition.” Journal of Vision 8 (2): 1–17. doi:10.1167/8.2.6.
   PubMed Web of Science ®Google Scholar
• Franco Aixelá, Javier. 2004. “The Study of Technical and Scientific Translation: An Examination of its Historical Development.” Jostrans: The Journal of Specialised Translation 1, 29–49. http://www.jostrans.org/issue01/art_aixela.php
   Google Scholar
• Gibbons, Alison. 2012. Multimodality, Cognition, and Experimental Literature. New York: Routledge.
   Google Scholar
• Glenberg, Arthur M., and William E. Langston. 1992. “Comprehension of Illustrated Text: Pictures Help to Build Mental Models.” Journal of Memory and Language 31 (2): 129–151. doi: 10.1016/0749-596X(92)90008-L
   Web of Science ®Google Scholar
• Göpferich, Susanne, Arnt Lykke Jakobsen, and Inger M. Mees. 2009. Introduction to Behind the Mind: Methods, Models and Results in Translation Process Research, edited by Susanne Göpferich, Arnt Lykke Jakobsen, and Inger M. Mees, 1–9. Copenhagen: Samfundslitteratur.
   Google Scholar
• Halliday, Michael A. K. 1978. Language as a Social Semiotic: The Social Interpretation of Language and Meaning. London: Edward Arnold.
   Google Scholar
• Hegarty, Mary, and Marcel A. Just. 1989. “Understanding Machines from Text and Diagrams.” In Knowledge Acquisition from Text and Pictures, edited by Heinz Mandl and Joel R. Levin, 171–194. Amsterdam: Elsevier.
   Google Scholar
• Hegarty, Mary, and Marcel A. Just. 1993. “Constructing Mental Models of Machines from Text and Diagrams.” Journal of Memory and Language 32 (6): 717–742. doi: 10.1006/jmla.1993.1036
   Web of Science ®Google Scholar
• Henderson, John M., James R. Brockmole, Monica S. Castelhano, and Michael Mach. 2007. “Visual Saliency Does Not Account for Eye Movements During Visual Search.” In Eye Movements: A Window on Mind and Brain, edited by Roger P. G. van Gompel, Martin H. Fischer, Wayne S. Murray, and Robin L. Hill, 537–562. Amsterdam: Elsevier.
   Google Scholar
• Hiippala, Tuomo. 2012. “The Localisation of Advertising Print Media as a Multimodal Process.” In Multimodal Texts from Around the World: Cultural and Linguistic Insights, edited by Wendy L. Bowcher, 97–122. London: Palgrave.
   Google Scholar
• Hirvonen, Maija, and Liisa Tiittula. 2010. “A Method for Analysing Multimodal Research Material: Audio Description in Focus.” MikaEL, Electronic Proceedings of the KäTu Symposium on Translation and Interpreting Studies 4: 1–12. http://www.sktl.fi/@Bin/40698/Hirvonen%26Tiittula_MikaEL2010.pdf
   Google Scholar
• Horton, William. 2005. “Graphics: The Not Quite Universal Language.” In Usability and Internationalization of Information Technology, edited by Nuray Aykin, 157–187. Mahwah, NJ: Erlbaum.
   Google Scholar
• Hull, Glynda A., and Mark E. Nelson. 2005. “Locating the Semiotic Power of Multimodality.” Written Communication 22 (2): 224–261. doi: 10.1177/0741088304274170
   Web of Science ®Google Scholar
• Jakobsen, Arnt Lykke, and Kristian T. H. Jensen. 2008. “Eye Movement Behaviour across Four Different Types of Reading Task.” In Looking at Eyes: Tracking Studies of Reading and Translation Processing, edited by Susanne Göpferich, Arnt Lykke Jakobsen, and Inger Mees, 103–124. Copenhagen: Samfundslitteratur.
   Google Scholar
• Jensen, Kristian T. H. 2010. “Distribution of Attention Between Source Text and Target Text During Translation.” In Cognitive Explorations of Translation: Eyes, Keys, Taps, edited by Sharon O'Brien, 215–236. New York: Continuum International.
   Google Scholar
• Jewitt, Carey. 2009a. “Introduction: Handbook Rationale, Scope and Structure.” In The Routledge Handbook of Multimodal Analysis, edited by Carey Jewitt, 1–13. London: Routledge.
   Google Scholar
• Jewitt, Carey. 2009b. “An Introduction to Multimodality.” In The Routledge Handbook of Multimodal Analysis, edited by Carey Jewitt, 14–39. London: Routledge.
   Google Scholar
• Kaindl, Klaus. 2004. “Multimodality in the Translation of Humour in Comics.” In Perspectives on Multimodality, edited by Eija Ventola, Charles Cassidy, and Martin Kaltenbacher, 173–192. Amsterdam: John Benjamins.
   Google Scholar
• Kaindl, Klaus. 2013. “Multimodality and Translation.” In The Routledge Handbook of Translation Studies, edited by Carmen Millán and Francesca Bartrina, 257–269. London: Routledge.
   Google Scholar
• Kress, Gunther, and Theo van Leeuwen. 2001. Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Arnold.
   Google Scholar
• Kress, Gunther, and Theo van Leeuwen. 2006. Reading Images: The Grammar of Visual Design. 2nd ed. London: Routledge.
   Google Scholar
• Lauer, Claire. 2009. “Contending with Terms: ‘Multimodal’ and ‘Multimedia’ in the Academic and Public Spheres.” Computers and Composition 26 (4): 225–239. doi:10.1016/j.compcom.2009.09.001.
   Google Scholar
• Lautenbacher, Olli Philippe. 2012. “From Still Pictures to Moving Pictures: Eye Tracking Text and Image.” In Eye Tracking in Audiovisual Translation, edited by Elisa Perego, 135–155. Rome: Aracne.
   Google Scholar
• Lemke, Jay. 2002. “Travels in Hypermodality.” Visual Communication 1 (3): 299–325. doi:10.1177/147035720200100303.
   Google Scholar
• Mayer, Richard E. 1989. “Models for Understanding.” Review of Educational Research 59 (1): 43–64. doi: 10.3102/00346543059001043
   Web of Science ®Google Scholar
• Mayer, Richard E. 1993. “Illustrations That Instruct.” In Advances in Instructional Psychology, Vol. 4, edited by Robert Glaser, 253–284. Mahwah, NJ: Erlbaum.
   Google Scholar
• Mayer, Richard E. 2002. “Using Illustrations to Promote Constructivist Learning from Science Text.” In The Psychology of Science Text Comprehension, edited by José Otero, José A. Léon, and Arthur C. Graesser, 333–356. Mahwah, NJ: Erlbaum.
   Google Scholar
• Mayer, Richard E. 2005. “Cognitive Theory of Multimedia Learning.” In Cambridge Handbook of Multimedia Learning, edited by Richard E. Mayer, 31–48. New York: Cambridge University Press.
   Google Scholar
• Mayer, Richard E., and Joan K. Gallini. 1990. “When Is an Illustration Worth Ten Thousand Words?” Journal of Educational Psychology 82 (4): 715–726. doi: 10.1037/0022-0663.82.4.715
   Web of Science ®Google Scholar
• Mills, Mark, Andrew Hollingworth, Stefan Van der Stigchel, Lesa Hoffman, and Michael D. Dodd. 2011. “Examining the Influence of Task Set on Eye Movements and Fixations.” Journal of Vision 11 (8): 1–15. doi:10.1167/11.8.17.
   Web of Science ®Google Scholar
• Muñoz Martin, Ricardo. 2010. “On Paradigms and Cognitive Translatology.” In Translation and Cognition, edited by Gregory M. Shreve and Erik Angelone, 169–187. Amsterdam: John Benjamins.
   Google Scholar
• Nord, Christiane. 1991. Text Analysis in Translation: Theory, Methodology, and Didactic Application of a Model for Translation-Oriented Text Analysis. Translated from German by Christiane Nord and Penelope Sparrow. Amsterdam: Rodopi.
   Google Scholar
• O'Brien, Sharon. 2006. “Eye-Tracking and Translation Memory Matches.” Perspectives: Studies in Translatology 14 (3): 185–205.
   Web of Science ®Google Scholar
• O'Brien, Sharon. 2010. Introduction to Cognitive Explorations of Translation: Eyes, Keys, Taps, edited by Sharon O'Brien, 1–14. New York: Continuum International.
   Google Scholar
• O'Halloran, Kay L. 2008. “Systemic Functional-Multimodal Discourse Analysis (SF-MDA): Constructing Ideational Meaning Using Language and Visual Imagery.” Visual Communication 7 (4): 443–475. doi:10.1177/1470357208096210.
   Web of Science ®Google Scholar
• Oittinen, Riitta. 1990. “The Dialogic Relation between Text and Illustration: A Translatological View.” TEXTconTEXT 5: 40–52.
   Google Scholar
• Oittinen, Riitta. 2000. Translating for Children. New York: Garland.
   Google Scholar
• Oittinen, Riitta. 2008. “Audiences and Influences: Multisensory Translations of Picturebooks.” In Whose Story? Translating the Verbal and the Visual in Literature for Young Readers, edited by Maria González Davies and Riitta Oittinen, 5–18. Newcastle upon Tyne: Cambridge Scholars.
   Google Scholar
• O'Sullivan, Carol. 2013. “Multimodality as Challenge and Resource for Translation.” Jostrans: The Journal of Specialised Translation 20: 2–14. http://www.jostrans.org/issue20/art_osullivan.php
   Google Scholar
• Parkin, Alan J. 2014. Essential Cognitive Psychology. Hove: Psychology Press.
   Google Scholar
• Prieto Velasco, Juan Antonio. 2009. Traducción e imagen: la información visual en textos especializados. Granada: Ediciones Tragatanto.
   Google Scholar
• Prieto Velasco, Juan Antonio. 2012. “A Corpus-Based Approach to the Multimodal Analysis of Specialized Knowledge.” Language Resources and Evaluation 47 (2): 399–423. doi:10.1007/s10579-012-9204-1.
   Web of Science ®Google Scholar
• Reimann, Peter. 2003. “Multimedia Learning: Beyond Modality.” Learning and Instruction 13 (2): 245–252. doi: 10.1016/S0959-4752(02)00024-5
   Web of Science ®Google Scholar
• Remael, Aline, and Josélia Neves. 2007. “Introduction: A Tool for Social Integration? Audiovisual Translation from Different Angles.” Linguistica Antverpiensia 6: 11–22.
   Google Scholar
• Ruiz, Carmen, Natalia Paredes, Pedro Macizo, and Maria Teresa Bajo. 2008. “Activation of Lexical and Syntactic Target Language Properties in Translation.” Acta Psychologica 128: 490–500. doi:10.1016/j.actpsy.2007.08.004.
   PubMed Web of Science ®Google Scholar
• Sager, Juan C. 1994. Language Engineering and Translation: Consequences of Automation. Amsterdam: John Benjamins.
   Google Scholar
• Schnotz, Wolfgang. 2005. “An Integrated Model of Text and Picture Comprehension.” In Cambridge Handbook of Multimedia Learning, edited by Richard E. Mayer, 49–69. New York: Cambridge University Press.
   Google Scholar
• Schnotz, Wolfgang, and Maria Bannert. 2003. “Construction and Interference in Learning from Multiple Representation.” Learning and Instruction 13 (2): 141–156. doi:10.1016/S0959-4752(02)00017-8.
   Web of Science ®Google Scholar
• Schnotz, Wolfgang, and Christian Kürschner. 2008. “External and Internal Representations in the Acquisition and Use of Knowledge: Visualization Effects on Mental Model Construction.” Instructional Science 36 (3): 175–190. doi:10.1007/s11251-007-9029-2.
   Web of Science ®Google Scholar
• Schnotz, Wolfgang, and Richard Lowe. 2003. “Introduction: External and Internal Representations in Multimedia Learning.” Learning and Instruction 13 (2): 117–123. doi: 10.1016/S0959-4752(02)00015-4.
   Web of Science ®Google Scholar
• Schnotz, Wolfgang, Maria Bannert, and Tina Seufert. 2002. “Toward an Integrative View of Text and Picture Comprehension: Visualization Effects on the Construction of Mental Models.” In The Psychology of Science Text Comprehension, edited by José Otero, José A. Léon, and Arthur C. Graesser, 385–416. Mahwah, NJ: Erlbaum.
   Google Scholar
• Shreve, Gregory M., and Erik Angelone. 2010. “Translation and Cognition: Recent Developments.” In Translation and Cognition, edited by Gregory M. Shreve and Erik Angelone, 1–13. Amsterdam: John Benjamins.
   Google Scholar
• Sorden, Stephen D. 2013. “The Cognitive Theory of Multimedia Learning.” In The Handbook of Educational Theories, edited by Beverly J. Irby, Genevieve Brown, Rafael Lara-Alecio, and Shirley Jackson, 155–168. Charlotte, NC: Information Age.
   Google Scholar
• Tercedor, Maribel, Esperanza Alarcón-Navío, Juan A. Prieto-Velasco, and Clara I. López-Rodríguez. 2009. “Images as Part of Technical Translation Courses: Implications and Applications.” Jostrans: The Journal of Specialised Translation 11: 143–168. http://www.jostrans.org/issue11/art_tercedoretal.php
   Google Scholar
• Tercedor-Sánchez, María Isabel, and Francisco Abadía-Molina. 2005. “The Role of Images in the Translation of Technical and Scientific Texts.” Meta: Translators’ Journal 50 (4). doi:10.7202/019857ar.
   Google Scholar
• Youngs, Suzette, and Frank Serafini. 2013. “Discussing Picturebooks Across Perceptual, Structural and Ideological Perspectives.” Journal of Language and Literacy Education 9 (1): 189–200.
   Google Scholar