Semantic effects on sensory-motor modality switching

References

• Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–660.
   PubMed Web of Science ®Google Scholar
• Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645. doi: 10.1146/annurev.psych.59.103006.093639
   PubMed Web of Science ®Google Scholar
• Boulenger, V., Roy, A. C., Paulignan, Y., Deprez, V., Jeannerod, M., & Nazir, T. A. (2006). Cross-talk between language processes and overt motor behavior in the first 200 msec of processing. Journal of Cognitive Neuroscience, 18, 1607–1615. doi: 10.1162/jocn.2006.18.10.1607
   PubMed Web of Science ®Google Scholar
• Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, 24, 355–363. doi: 10.1016/j.cogbrainres.2005.02.020
   PubMedGoogle Scholar
• Chao, L. L., Haxby, J. V., & Martin, A. (1999). Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nature Neuroscience, 2, 913–919. doi: 10.1038/13217
   PubMed Web of Science ®Google Scholar
• Chersi, F., Thill, S., Ziemke, T., & Borghi, A. M. (2010). Sentence processing: Linking language to motor chains. Frontiers in Neurorobotics, 4, 1–9. doi: 10.3389/fnbot.2010.00004
   PubMedGoogle Scholar
• Collins, J., Pecher, D., Zeelenberg, R., & Coulson, S. (2011). Modality switching in a property verification task: An ERP study of what happens when candles flicker after high heels click. Frontiers in Psychology, 2, 1–10. doi: 10.3389/fpsyg.2011.00010
   PubMed Web of Science ®Google Scholar
• Connell, L., & Lynott, D. (2012). When does perception facilitate or interfere with conceptual processing? The effect of attentional modulation. Frontiers in Psychology, 3, 1–4. doi: 10.3389/fpsyg.2012.00474
   PubMed Web of Science ®Google Scholar
• Connell, L., & Lynott, D. (2014). I see/hear what you mean: Semantic activation in visual word recognition depends on perceptual attention. Journal of Experimental Psychology: General, 143, 527–533. doi: 10.1037/a0034626
   PubMed Web of Science ®Google Scholar
• Connell, L., Lynott, D., & Dreyer, F. (2012). A functional role for modality-specific perceptual systems in conceptual representations. Plos One, 7, e33321. doi: 10.1371/journal.pone.0033321
   PubMed Web of Science ®Google Scholar
• De Vega, M., & Urrutia, M. (2011). Counterfactual sentences activate embodied meaning: An action–sentence compatibility effect study. Journal of Cognitive Psychology, 23, 962–973. doi: 10.1080/20445911.2011.590471
   Web of Science ®Google Scholar
• Dell, G. S., & O’Seaghdha, P. G. (1992). Stages of lexical access in language production. Cognition, 42, 287–314. doi: 10.1016/0010-0277(92)90046-K
   PubMed Web of Science ®Google Scholar
• Farah, M. J. (2000). The neural bases of mental imagery. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (2nd ed., pp. 965–974). Cambridge: MIT Press.
   Google Scholar
• Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: A review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology, 61, 825–850. doi: 10.1080/17470210701623605
   PubMed Web of Science ®Google Scholar
• Gallese, V., & Lakoff, G. (2005). The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22, 455–479. doi: 10.1080/02643290442000310
   PubMed Web of Science ®Google Scholar
• Hald, L. A., Marshall, J. A., Janssen, D. P., & Garnham, A. (2011). Switching modalities in a sentence verification task: ERP evidence for embodied language processing. Frontiers in Psychology, 2, 1–15. doi: 10.3389/fpsyg.2011.00045
   PubMed Web of Science ®Google Scholar
• Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301–307. doi: 10.1016/S0896-6273(03)00838-9
   PubMed Web of Science ®Google Scholar
• Hickok, G., Houde, J., & Rong, F. (2011). Sensorimotor integration in speech processing: Computational basis and neural organization. Neuron, 69, 407–422. doi: 10.1016/j.neuron.2011.01.019
   PubMed Web of Science ®Google Scholar
• Kaschak, M. P., Madden, C. J., Therriault, D. J., Yaxley, R. H., Aveyard, M., Blanchard, A. A., & Zwaan, R. A. (2005). Perception of motion affects language processing. Cognition, 94, B79–B89. doi: 10.1016/j.cognition.2004.06.005
   PubMed Web of Science ®Google Scholar
• Kent, R. D. (2000). Research on speech motor control and its disorders: A review and prospective. Journal of Communication Disorders, 33, 391–428. doi: 10.1016/S0021-9924(00)00023-X
   PubMed Web of Science ®Google Scholar
• Kiefer, M., & Pulvermüller, F. (2012). Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions. Cortex, 48, 805–825. doi: 10.1016/j.cortex.2011.04.006
   PubMed Web of Science ®Google Scholar
• Kiefer, M., Sim, E. J., Herrnberger, B., Grothe, J., & Hoenig, K. (2008). The sound of concepts: Four markers for a link between auditory and conceptual brain systems. The Journal of Neuroscience, 28, 12224–12230. doi: 10.1523/JNEUROSCI.3579-08.2008
   PubMed Web of Science ®Google Scholar
• Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., & Koch, I. (2010). Control and interference in task switching – A review. Psychological Bulletin, 136, 849–874. doi: 10.1037/a0019842
   PubMed Web of Science ®Google Scholar
• Kosslyn, S. M., & Thompson, W. L. (2000). Shared mechanisms in visual imagery and visual perception: Insights from cognitive science. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (2nd ed., pp. 975–985). Cambridge: MIT Press.
   Google Scholar
• Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge: MIT Press.
   Google Scholar
• Masson, M. E. (2015). Toward a deeper understanding of embodiment. Canadian Journal of Experimental Psychology, 69, 159–164. doi: 10.1037/cep0000055
   PubMed Web of Science ®Google Scholar
• Mirabella, G., Iaconelli, S., Spadacenta, S., Federico, P., & Gallese, V. (2012). Processing of hand-related verbs specifically affects the planning and execution of arm reaching movements. Plos One, 7, e35403. doi: 10.1371/journal.pone.0035403
   Google Scholar
• Morton, J. (1969). The interaction of information in word recognition. Psychological Review, 76, 165–178. doi: 10.1037/h0027366
   Web of Science ®Google Scholar
• Navon, D., & Miller, J. (1987). Role of outcome conflict in dual-task interference. Journal of Experimental Psychology: Human Perception and Performance, 13, 435–448.
   PubMed Web of Science ®Google Scholar
• Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2003). Verifying different-modality properties for concepts produces switching costs. Psychological Science, 14, 119–124. doi: 10.1111/1467-9280.t01-1-01429
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F. (2005). Opinion: Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576–582. doi: 10.1038/nrn1706
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F., Hauk, O., Nikulin, V. V., & Ilmoniemi, R. J. (2005). Functional links between motor and language systems. European Journal of Neuroscience, 21, 793–797. doi: 10.1111/j.1460-9568.2005.03900.x
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F., Mohr, B., & Schleichert, H. (1999). Semantic or lexico-syntactic factors: What determines word-class specific activity in the human brain? Neuroscience Letters, 275, 81–84. doi: 10.1016/S0304-3940(99)00724-7
   PubMed Web of Science ®Google Scholar
• Rueschemeyer, S. A., Lindemann, O., van Rooij, D., van Dam, W., & Bekkering, H. (2010). Effects of intentional motor actions on embodied language processing. Experimental Psychology, 57, 260–266. doi: 10.1027/1618-3169/a000031
   PubMed Web of Science ®Google Scholar
• Sato, M., Mengarelli, M., Riggio, L., Gallese, V., & Buccino, G. (2008). Task related modulation of the motor system during language processing. Brain and Language, 105, 83–90. doi: 10.1016/j.bandl.2007.10.001
   PubMed Web of Science ®Google Scholar
• Scerrati, E., Baroni, G., Borghi, A. M., Galatolo, R., Lugli, L., & Nicoletti, R. (2015). The modality-switch effect: Visually and aurally presented prime sentences activate our senses. Frontiers in Psychology, 6, 1668. doi: 10.3389/fpsyg.2015.01668
   PubMed Web of Science ®Google Scholar
• Schaeffner, S., Koch, I., & Philipp, A. M. (2015). The role of sensory-motor modality compatibility in language processing. Psychological Research, 80, 212–223. doi: 10.1007/s00426-015-0661-1
   PubMed Web of Science ®Google Scholar
• Scorolli, C., & Borghi, A. M. (2007). Sentence comprehension and action: Effector specific modulation of the motor system. Brain Research, 1130, 119–124. doi: 10.1016/j.brainres.2006.10.033
   PubMed Web of Science ®Google Scholar
• Shebani, Z., & Pulvermüller, F. (2013). Moving the hands and feet specifically impairs working memory for arm-and leg-related action words. Cortex, 49, 222–231. doi: 10.1016/j.cortex.2011.10.005
   PubMed Web of Science ®Google Scholar
• Stephan, D. N., & Koch, I. (2010). Central cross-talk in task switching: Evidence from manipulating input-output modality compatibility. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 1075–1081.
   PubMed Web of Science ®Google Scholar
• Stephan, D. N., & Koch, I. (2011). The role of input–output modality compatibility in task switching. Psychological Research, 75, 491–498. doi: 10.1007/s00426-011-0353-4
   PubMed Web of Science ®Google Scholar
• Stephan, D. N., & Koch, I. (2015a). Tactile stimuli increase effects of modality compatibility in task switching. Experimental Psychology, 62, 276–284. doi: 10.1027/1618-3169/a000291
   PubMed Web of Science ®Google Scholar
• Stephan, D. N., & Koch, I. (2015b). Modality-specific effects on crosstalk in task switching – evidence from modality compatibility. Psychological Research. doi:10.1007/s00426-015-0700-y
   Google Scholar
• Van Dantzig, S., Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2008). Perceptual processing affects conceptual processing. Cognitive Science: A Multidisciplinary Journal, 32, 579–590. doi: 10.1080/03640210802035365
   PubMed Web of Science ®Google Scholar
• Vermeulen, N., Chang, B., Mermillod, M., Pleyers, G., & Corneille, O. (2013). Memory for words representing modal concepts. Experimental Psychology, 60, 293–301. doi: 10.1027/1618-3169/a000199
   PubMed Web of Science ®Google Scholar
• Vermeulen, N., Corneille, O., & Niedenthal, P. M. (2008). Sensory load incurs conceptual processing costs. Cognition, 109, 287–294. doi: 10.1016/j.cognition.2008.09.004
   PubMed Web of Science ®Google Scholar
• Vermeulen, N., Mermillod, M., Godefroid, J., & Corneille, O. (2009). Unintended embodiment of concepts into percepts: Sensory activation boosts attention for same-modality concepts in the attentional blink paradigm. Cognition, 112, 467–472. doi: 10.1016/j.cognition.2009.06.003
   PubMed Web of Science ®Google Scholar