Using Eye Movements to Study the Reading of Subtitles in Video

References

• Bates, D., Kliegl, R., Vasishth, S., & Baayen, H. (2015). Parsimonious mixed models. Retrieved from https://arxiv.org/pdf/1506.04967.pdf
   Google Scholar
• Cutter, M. G., Drieghe, D., & Liversedge, S. P. (2017). Reading sentences of uniform word length: Evidence for the adaptation of the preferred saccade length during reading. Journal of Experimental Psychology: Human Perception and Performance, 43, 1895–1911.
   PubMed Web of Science ®Google Scholar
• Cutter, M. G., Drieghe, D., & Liversedge, S. P. (2018). Reading sentences of uniform word length – II: Very rapid adaptation of the preferred saccade length. Psychonomic Bulletin & Review, 25(4), 1435–1440. doi:10.3758/s13423-018-1473-2
   PubMed Web of Science ®Google Scholar
• d’Ydewalle, G., Van Rensbergen, J., & Pollet, J. (1987). Reading a message when the same message is available auditorily in another language: The case of subtitling. In J. K. O’Regan & A. Lévy-Schoen (Eds.), Eye movements: From physiology to cognition (pp. 313–321). Amsterdam, The Netherlands: Elsevier Science.
   Google Scholar
• Diao, Y., & Sweller, J. (2007). Redundancy in foreign language reading comprehension instruction: Concurrent written and spoken presentations. Learning and Instruction, 17(1), 78–88. doi:10.1016/j.learninstruc.2006.11.007
   Web of Science ®Google Scholar
• Díaz Cintas, J., & Remael, A. (2007). Audiovisual translation: Subtitling. Manchester, UK: St. Jerome.
   Google Scholar
• Drews, F. A., Yazdani, H., Godfrey, C. N., Cooper, J. M., & Strayer, D. L. (2009). Text messaging during simulated driving. Human Factors: The Journal of Human Factors and Ergonomics Society, 51(5), 762–770. doi:10.1177/0018720809353319
   PubMed Web of Science ®Google Scholar
• Engbert, R., Nuthmann, A., Richter, E., & Kliegl, R. (2005). SWIFT: A dynamical model of saccade generation during reading. Psychological Review, 112(4), 777–813. doi:10.1037/0033-295X.112.4.777
   PubMed Web of Science ®Google Scholar
• Feng, G. (2006). Eye movements as time-series random variables: A stochastic model of eye movement control in reading. Cognitive Systems Research, 7(1), 70–95. doi:10.1016/j.cogsys.2005.07.004
   Web of Science ®Google Scholar
• Fothergill, A., (Director). (2006). Planet Earth. Burbank, CA: BBC Video.
   Google Scholar
• Gernsbacher, M. A. (2015). Video captions benefit everyone. Policy Insights from the Behavioral and Brain Sciences, 2(1), 195–202. doi:10.1177/2372732215602130
   PubMedGoogle Scholar
• Graesser, A. C., McNamara, D. S., Cai, Z., Conley, M., Li, H., & Pennebaker, J. (2014). Coh-metrix measures text characteristics at multiple levels of language and discourse. The Elementary School Journal, 115(2), 210–228. doi:10.1086/678293
   Web of Science ®Google Scholar
• Horowitz, T. D., Klieger, S. B., Fencsik, D. E., Yang, K. K., Alvarez, G. A., & Wolfe, J. M. (2007). Tracking unique objects. Perception & Psychophysics, 69(2), 172–184. doi:10.3758/BF03193740
   PubMed Web of Science ®Google Scholar
• Kalyuga, S., & Sweller, J. (2005). The redundancy principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 247–262). New York: Cambridge University Press.
   Google Scholar
• Karamitroglou, F. (1998). A proposed set of subtitling standards in Europe. Translation Journal, 2(2). Retrieved from http://translationjournal.net/journal/04stndrd.htm
   Google Scholar
• Krejtz, I., Szarkowska, A., & Łogińska, M. (2016). Reading function and content words in subtitled videos. Journal of Deaf Studies and Deaf Education, 21(2), 222–232. doi:10.1093/deafed/env061
   PubMed Web of Science ®Google Scholar
• Kruger, J.-L. (2012). Making meaning in AVT: Eye tracking and viewer construction of narrative. Perspectives: Studies in Translatology, 20(1), 67–86. doi:10.1080/0907676X.2011.632688
   Web of Science ®Google Scholar
• Kruger, J.-L., & Doherty, S. (2016). Measuring cognitive load in the presence of educational video: Towards a multimodal methodology. Australasian Journal of Educational Technology, 32(6), 19–31. doi:10.14742/ajet.3084
   Web of Science ®Google Scholar
• Kruger, J.-L., & Steyn, F. (2014). Subtitles and eye tracking: Reading and performance. Reading Research Quarterly, 49(1), 105–120. doi:10.1002/rrq.59
   Web of Science ®Google Scholar
• Lin, L., Lee, J., & Robertson, T. (2011). Reading while watching video: The effect of video content on reading comprehension and media multitasking ability. Journal of Educational Computing Research, 45(2), 183–201. doi:10.2190/EC.45.2.d
   Web of Science ®Google Scholar
• Morrison, R. E. (1984). Manipulation of stimulus onset delay in reading: Evidence for parallel programming of saccades. Journal of Experimental Psychology: Human Perception and Performance, 10, 667–682.
   PubMed Web of Science ®Google Scholar
• Pavio, A. (1971). Imagery and verbal processes. New York, NY: Holt, Reinhardt, & Winston.
   Google Scholar
• Perego, E., Del Missier, F., & Stragá, M. (2018). Dubbing vs. subtitling: Complexity matters. Target, 30(1), 137–157. doi:10.1075/target.16083.per
   Web of Science ®Google Scholar
• Pollatsek, A., Bolozky, S., Well, A. D., & Rayner, K. (1981). Asymmetries in the perceptual span for Israeli readers. Brain and Language, 14(1), 174–180. doi:10.1016/0093-934X(81)90073-0
   PubMed Web of Science ®Google Scholar
• Pylyshyn, Z. (2004). Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities. Visual Cognition, 11(7), 801–822. doi:10.1080/13506280344000518
   Web of Science ®Google Scholar
• Pylyshyn, Z., & Storm, R. W. (1988). Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spatial Vision, 3(3), 179–197. doi:10.1163/156856888X00122
   PubMedGoogle Scholar
• Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422. doi:10.1037/0033-2909.124.3.372
   PubMed Web of Science ®Google Scholar
• Rayner, K., Ashby, J., Pollatsek, A., & Reichle, E. D. (2004). The effects of frequency and predictability on eye fixations in reading: Implications for the E-Z Reader model. Journal of Experimental Psychology: Human Perception and Performance, 30, 720–732.
   PubMed Web of Science ®Google Scholar
• Rayner, K., & Morrison, R. M. (1981). Eye movements and identifying words in parafoveal vision. Bulletin of the Psychonomic Society, 17(3), 135–138. doi:10.3758/BF03333690
   Google Scholar
• Rayner, K., Schotter, E. R., Masson, M. E. J., Potter, M. C., & Treiman, R. (2016). So much to read, so little time: How do we read, and can speed reading help? Psychological Science in the Public Interest, 32(1), 4–34. doi:10.1177/1529100615623267
   Web of Science ®Google Scholar
• Rayner, K., Sereno, S. C., Morris, R. K., Schmauder, A. R., & Clifton, C. (1989). Eye movements and on-line language comprehension processes. Language and Cognitive Processes, 4(3–4), 21–50. doi:10.1080/01690968908406362
   Google Scholar
• Rayner, K., Sereno, S. C., & Raney, G. E. (1996). Eye movement control in reading: A comparison of two types of models. Journal of Experimental Psychology: Human Perception and Performance, 22, 1188–1200.
   PubMed Web of Science ®Google Scholar
• Reichle, E. D. (2020). Computational models of reading: A handbook. Oxford: Oxford University Press. Manuscript in press.
   Google Scholar
• Reichle, E. D., Liversedge, S. P., Pollatsek, A., & Rayner, K. (2009). Encoding multiple words simultaneously in reading is implausible. Trends in Cognitive Sciences, 13(3), 115–119. doi:10.1016/j.tics.2008.12.002
   PubMed Web of Science ®Google Scholar
• Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K. (1998). Toward a model of eye-movement control in reading. Psychological Review, 105(1), 125–157. doi:10.1037/0033-295X.105.1.125
   PubMed Web of Science ®Google Scholar
• Reichle, E. D., & Schotter, E. R. (2020). A computational analysis of the constraints on parallel word identification. Proceedings of the 42nd Annual Conference of the Cognitive Science Society. Manuscript in press.
   Google Scholar
• Reingold, E. M., Reichle, E. D., Glaholt, M. G., & Sheridan, H. (2012). Direct lexical control of eye movements in reading: Evidence from survival analysis of fixation durations. Cognitive Psychology, 65(2), 177–206. doi:10.1016/j.cogpsych.2012.03.001
   PubMed Web of Science ®Google Scholar
• Robson, G. (2004). The closed captioning handbook. Amsterdam, The Netherlands: Elsevier.
   Google Scholar
• Romero-Fresco, P. (2009). More haste less speed: Edited versus verbatim respoken subtitles. Vigo International Journal of Applied Linguistics, 6, 109–133.
   Web of Science ®Google Scholar
• Szarkowska, A., & Bogucka, L. (2019). Six-second rule revisited: An eye-tracking study on the impact of speech rate and language proficiency on subtitle reading. Translation, Cognition & Behavior, 2(1), 103–126. doi:10.1075/tcb.00022.sza
   Google Scholar
• Szarkowska, A., & Gerber-Morón, O. (2018). Viewers can keep up with fast subtitles: Evidence from eye movements. PLoS One, 13(6), 1–30. doi:10.1371/journal.pone.0199331
   Web of Science ®Google Scholar
• Szarkowska, A., Krejtz, I., Pilipczuk, O., Dutka, Ł., & Kruger, J.-L. (2016). The effects of text editing and subtitle presentation rate on the comprehension and reading patterns of interlingual and intralingual subtitles among deaf, hard of hearing and hearing viewers. Across Languages and Cultures, 17(2), 183–204. doi:10.1556/084.2016.17.2.3
   Web of Science ®Google Scholar
• Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12(1), 97–136. doi:10.1016/0010-0285(80)90005-5
   PubMed Web of Science ®Google Scholar
• Ullman, S. (1984). Visual routines. Cognition, 18(1–3), 97–159. doi:10.1016/0010-0277(84)90023-4
   PubMed Web of Science ®Google Scholar
• Warren, T., White, S. J., & Reichle, E. D. (2009). Wrap up effects can be independent of interpretative processing: Evidence from eye movements. Cognition, 111(1), 132–137. doi:10.1016/j.cognition.2008.12.011
   PubMed Web of Science ®Google Scholar
• Wolfe, J. M. (1994). Guided Search 2.0: A revised model of visual search. Psychonomic Bulletin & Review, 1(2), 202–238. doi:10.3758/BF03200774
   PubMed Web of Science ®Google Scholar
• Yang, S.-N. (2006). An oculomotor-based model of eye movements in reading: The competition/activation model. Cognitive Systems Research, 7, 56–69.
   Web of Science ®Google Scholar
• Zelinsky, G. J. (2008). A theory of eye movements during target acquisition. Psychological Review, 113(4), 787–835. doi:10.1037/a0013118
   Web of Science ®Google Scholar