Linearisation during language production: evidence from scene meaning and saliency maps

References

• Biederman, I. (1981). On the semantics of a glance at a scene. In Perceptual organization (pp. 213–253). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Bock, J. K. (1986). Syntactic persistence in language production. Cognitive Psychology, 18(3), 355–387.
   Web of Science ®Google Scholar
• Bock, K. (1987). Exploring levels of processing in sentence production. In Natural language generation (pp. 351–363). Dordrecht: Springer.
   Google Scholar
• Bock, K., & Ferreira, V. (2014). Syntactically speaking. In The Oxford handbook of language production. Oxford: Oxford University Press.
   Google Scholar
• Bock, K., Irwin, D., & Davidson, D. J. (2004). Putting first things first. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, and action (pp. 224–250). New York, NY: Psychology Press.
   Google Scholar
• Bock, K., Irwin, D. E., Davidson, D. J., & Levelt, W. J. (2003). Minding the clock. Journal of Memory and Language, 48(4), 653–685.
   Web of Science ®Google Scholar
• Bock, K., & Loebell, H. (1990). Framing sentences. Cognition, 35, 1–39.
   PubMed Web of Science ®Google Scholar
• Brown-Schmidt, S., & Konopka, A. E. (2015). Processes of incremental message planning during conversation. Psychonomic Bulletin & Review, 22(3), 833–843.
   PubMed Web of Science ®Google Scholar
• Brown-Schmidt, S., & Tanenhaus, M. K. (2006). Watching the eyes when talking about size: An investigation of message formulation and utterance planning. Journal of Memory and Language, 54, 592–609.
   Web of Science ®Google Scholar
• Bunger, A., Papafragou, A., & Trueswell, J. C. (2013). Event structure influences language production: Evidence from structural priming in motion event description. Journal of Memory and Language, 69(3), 299–323.
   PubMed Web of Science ®Google Scholar
• Castelhano, M. S., & Henderson, J. M. (2007). Initial scene representations facilitate eye movement guidance in visual search. Journal of Experimental Psychology: Human Perception and Performance, 33(4), 753–763.
   PubMed Web of Science ®Google Scholar
• Castelhano, M. S., & Henderson, J. M. (2008). The influence of color on the perception of scene gist. Journal of Experimental Psychology: Human Perception and Performance, 34(3), 660–675.
   PubMed Web of Science ®Google Scholar
• Chang, F., Dell, G. S., Bock, K., & Griffin, Z. M. (2000). Structural priming as implicit learning: A comparison of models of sentence production. Journal of Psycholinguistic Research, 29(2), 217–230.
   PubMed Web of Science ®Google Scholar
• Chun, M. M. (2000). Contextual cueing of visual attention. Trends in Cognitive Sciences, 4, 170–178.
   PubMed Web of Science ®Google Scholar
• Cohn, N., Coderre, E., O’Donnell, E., Osterby, A., & Loschky, L. (2018, July 28). The cognitive systems of visual and multimodal narratives. The 40th Annual Cognitive Science Society Meeting, Monona Terrace Convention Center, Madison, WI.
   Google Scholar
• Elsner, M., Clarke, A., & Rohde, H. (2018). Visual complexity and its effects on referring expression generation. Cognitive Science, 42(4), 940–973.
   PubMedGoogle Scholar
• Ferreira, F., & Henderson, J. M. (1998). Linearization strategies during language production. Memory and Cognition, 26(1), 88–96.
   PubMed Web of Science ®Google Scholar
• Ferreira, F., & Swets, B. (2002). How incremental is language production? Evidence from the production of utterances requiring the computation of arithmetic sums. Journal of Memory and Language, 46(1), 57–84.
   Web of Science ®Google Scholar
• Fromkin, V. (1973). Speech errors as linguistic evidence. The Hague: Mouton.
   Google Scholar
• Garrett, M. F. (1988). Processes in language production. Linguistics: The Cambridge Survey, 3, 69–96.
   Google Scholar
• Gleitman, L. R., January, D., Nappa, R., & Trueswell, J. C. (2007). On the give and take between event apprehension and utterance formulation. Journal of Memory and Language, 57(4), 544–569.
   PubMed Web of Science ®Google Scholar
• Griffin, Z. M. (2004). Why look? Reasons for speech-related eye movements. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, and action (pp. 192–222). New York, NY: Psychology Press.
   Google Scholar
• Griffin, Z. M., & Bock, K. (2000). What the eyes say about speaking. Psychological Science, 11(4), 274–279.
   PubMed Web of Science ®Google Scholar
• Hafri, A., Papafragou, A., & Trueswell, J. C. (2013). Getting the gist of events: Recognition of two-participant actions from brief displays. Journal of Experimental Psychology: General, 142(3), 880–905.
   PubMed Web of Science ®Google Scholar
• Harel, J., Koch, C., & Perona, P. (2007). Graph-based visual saliency. In Advances in neural information processing systems (pp. 545–552). Cambridge, MA: MIT Press.
   Google Scholar
• Henderson, J. M. (2017). Gaze control as prediction. Trends in Cognitive Sciences, 21(1), 15–23.
   PubMed Web of Science ®Google Scholar
• Henderson, J. M., & Ferreira, F. (2004). Scene perception for psycholinguists. In J. M. Henderson, & F. Ferreira (Eds.), The interface of language, vision, and action (pp. 1–58). New York, NY: Psychology Press.
   Google Scholar
• Henderson, J. M., & Hayes, T. R. (2017). Meaning-based guidance of attention in scenes as revealed by meaning maps. Nature Human Behaviour, 1(10), 743–747.
   PubMed Web of Science ®Google Scholar
• Henderson, J. M., & Hayes, T. R. (2018). Meaning guides attention in real-world scene images: Evidence from eye movements and meaning maps. Journal of Vision, 18(6), 10–10.
   PubMed Web of Science ®Google Scholar
• Henderson, J. M., Hayes, T. R., Rehrig, G., & Ferreira, F. (2018). Meaning guides attention during real-world scene description. Scientific Reports, 8, 13504.
   PubMed Web of Science ®Google Scholar
• Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews Neuroscience, 2(3), 194–203.
   PubMed Web of Science ®Google Scholar
• Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11), 1254–1259.
   Web of Science ®Google Scholar
• Koehler, K., & Eckstein, M. P. (2017a). Beyond scene gist: Objects guide search more than scene background. Journal of Experimental Psychology: Human Perception and Performance, 43, 1–17.
   PubMed Web of Science ®Google Scholar
• Koehler, K., & Eckstein, M. P. (2017b). Temporal and peripheral extraction of contextual cues from scenes during visual search. Journal of Vision, 17(2), 1–32.
   Web of Science ®Google Scholar
• Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge, MA: MIT Press.
   Google Scholar
• Levelt, W. J. M., Page, R. B. L., & Longuet-Higgins, H. C. (1981). The speaker’s linearization problem. Philosophical Transactions of the Royal Society B: Biological Sciences, 295, 305–315.
   Web of Science ®Google Scholar
• MacDonald, M. C. (2013). How language production shapes language form and comprehension. Frontiers in Psychology, 4, 226.
   PubMed Web of Science ®Google Scholar
• Melinger, A., Branigan, H. P., & Pickering, M. J. (2014). Parallel processing in language production. Language, Cognition and Neuroscience, 29(6), 663–683.
   Web of Science ®Google Scholar
• Myachykov, A., Thompson, D., Scheepers, C., & Garrod, S. (2011). Visual attention and structural choice in sentence production across languages. Language and Linguistics Compass, 5(2), 95–107.
   Google Scholar
• Peacock, C. E., Hayes, T. R., & Henderson, J. M. (2018). Meaning guides attention during scene viewing, even when it is irrelevant. Attention, Perception, & Psychophysics, 81(1), 20–34.
   Web of Science ®Google Scholar
• Potter, M. C., Wyble, B., Hagmann, C. E., & McCourt, E. S. (2014). Detecting meaning in RSVP at 13 ms per picture. Attention, Perception, & Psychophysics, 76(2), 270–279.
   PubMed Web of Science ®Google Scholar
• Rehrig, G., Cheng, M., McMahan, B. C., & Shome, R. (in preparation). Why are the batteries in the microwave?: Use of semantic information under uncertainty in a search task. Manuscript in preparation.
   Google Scholar
• Shanon, B. (1984). Room descriptions. Discourse Processes, 7(3), 225–255.
   Web of Science ®Google Scholar
• Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113(4), 766–786.
   PubMed Web of Science ®Google Scholar
• van de Velde, M., & Meyer, A. S. (2014). Syntactic flexibility and planning scope: The effect of verb bias on advance planning during sentence recall. Frontiers in Psychology, 5, 1174.
   PubMed Web of Science ®Google Scholar
• Vogels, J., Krahmer, E., & Maes, A. (2013). Who is where referred to how, and why? The influence of visual saliency on referent accessibility in spoken language production. Language and Cognitive Processes, 28(9), 1323–1349.
   Web of Science ®Google Scholar
• Zwitserlood, P., Bölte, J., Hofmann, R., Meier, C. C., & Dobel, C. (2018). Seeing for speaking: Semantic and lexical information provided by briefly presented, naturalistic action scenes. PLOS ONE, 13(4), 1–22.
   Web of Science ®Google Scholar