Taking action in hand: effects of gesture observation on action verb naming

References

• Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390–412. doi: 10.1016/j.jml.2007.12.005
   Web of Science ®Google Scholar
• Barry, C., Hirsh, K. W., Johnston, R. A., & Williams, C. L. (2001). Age of acquisition, word frequency, and the locus of repetition priming of picture naming. Journal of Memory and Language, 44(3), 350–375. doi: 10.1006/jmla.2000.2743
   Web of Science ®Google Scholar
• Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645.
   PubMed Web of Science ®Google Scholar
• Bastiaanse, Roelien, Wieling, Martijn, & Wolthuis, Nienke. (2016). The role of frequency in the retrieval of nouns and verbs in aphasia. Aphasiology, 30(11), 1221–1239. doi:10.1080/02687038.2015.1100709
   Web of Science ®Google Scholar
• Bates, E., Burani, C., D’Amico, S., & Barca, L. (2001). Word reading and picture naming in Italian. Memory & Cognition, 29(7), 986–999. doi: 10.3758/BF03195761
   PubMed Web of Science ®Google Scholar
• Bates, B., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. doi: 10.18637/jss.v067.i01
   Web of Science ®Google Scholar
• Beattie, G., & Shovelton, H. (1999). Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation. Semiotica, 123(1–2), 1–30. doi: 10.1515/semi.1999.123.1-2.1
   Web of Science ®Google Scholar
• Bernardis, P., & Carameli, N. (2009). Meaning in words, gestures and mental images. In N. Taatgen & H. van Rijn (Eds.), Proceedings of the 31th Annual Conference of the Cognitive Science Society (pp. 1692–1697). Cognitive Science Society.
   Google Scholar
• Bernardis, P., Salillas, E., & Caramelli, N. (2008). Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 25(7–8), 1114–1128. doi: 10.1080/02643290801921707
   PubMed Web of Science ®Google Scholar
• Box, G. E. P., & Cox, D. R. (1964). An analysis of transformations. Journal of the Royal Statistical Society, Series B (Methodological), 26(2), 211–252.
   Web of Science ®Google Scholar
• Church, R. B., Kelly, S., & Holcombe, D. (2014). Temporal synchrony between speech, action and gesture during language production. Language, Cognition and Neuroscience, 29(3), 345–354. doi: 10.1080/01690965.2013.857783
   Web of Science ®Google Scholar
• Coelho, Y., & Bartolo, A. (2012). Language and action in cognitive neuroscience. New York, NY: Psychology Press.
   Google Scholar
• Cohen-Maximov, T., Avirame, K., Flöel, A., & Lavidor, M. (2015). Modulation of gestural-verbal semantic integration by tDCS. Brain Stimulation, 8(3), 493–498. doi: 10.1016/j.brs.2014.12.001
   PubMed Web of Science ®Google Scholar
• Cortese, M. J., & Fugett, A. (2004). Imageability ratings for 3,000 monosyllabic words. Behavior Research Methods, Instruments, & Computers, 36(3), 384–387. doi: 10.3758/BF03195585
   PubMedGoogle Scholar
• Cubelli, R., Marchetti, C., Boscolo, G., & Della Sala, S. (2000). Cognition in action: Testing a model of limb apraxia. Brain and Cognition, 44(2), 144–165. doi: 10.1006/brcg.2000.1226
   PubMed Web of Science ®Google Scholar
• de Aguiar, V. (2015). Enhancement of verb retrieval: Neuromodulation, repetition priming, and aphasia rehabilitation ( PhD thesis). Trento: University of Trento, University of Groningen, Macquarie University.
   Google Scholar
• Dell, G. S., Schwartz, M. F., Martin, N., Saffran, E. M., & Gagnon, D. A. (1997). Lexical access in aphasic and nonaphasic speakers. Psychological Review, 104(4), 801–838. doi: 10.1037/0033-295X.104.4.801
   PubMed Web of Science ®Google Scholar
• de Rosario-Martinez, H. (2015). phia: Post-hoc interaction analysis. R package version 0.2-1.
   Google Scholar
• de Ruiter, J. (2000). The production of gesture and speech. In D. McNeill (Ed.), Language and gesture (pp. 284–311). Cambridge: Cambridge University Press.
   Google Scholar
• de Ruiter, Jan P., & de Beer, Carola. (2013). A critical evaluation of models of gesture and speech production for understanding gesture in aphasia. Aphasiology, 27(9), 1015–1030. doi:10.1080/02687038.2013.797067
   Web of Science ®Google Scholar
• de Zubicaray, G., Fraser, D., Ramajoo, K., & McMahon, K. (2017). Interference from related actions in spoken word production: Behavioural and fMRI evidence. Neuropsychologia, 96, 78–88. doi: 10.1016/j.neuropsychologia.2017.01.010
   PubMed Web of Science ®Google Scholar
• Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Frontiers in Psychology, 5, 781. doi: 10.3389/fpsyg.2014.00781
   PubMed Web of Science ®Google Scholar
• Druks, J., & Masterson, J. (2000). An object and action naming battery. Hove: Psychology Press.
   Google Scholar
• Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. Cambridge, MA: Belknap Press of Harvard University Press.
   Google Scholar
• Hostetter, A., & Alibali, M. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15(3), 495–514. doi: 10.3758/PBR.15.3.495
   PubMed Web of Science ®Google Scholar
• Howard, D., Nickels, L., Coltheart, M., & Cole-Virtue, J. (2006). Cumulative semantic inhibition in picture naming: Experimental and computational studies. Cognition, 100(3), 464–482. doi: 10.1016/j.cognition.2005.02.006
   PubMed Web of Science ®Google Scholar
• Jonides, J., & Mack, R. (1984). On the cost and benefit of cost and benefit. Psychological Bulletin, 96(1), 29–44. doi: 10.1037/0033-2909.96.1.29
   Web of Science ®Google Scholar
• Jonkers, R. (1998). Comprehension and production of verbs in aphasic speakers. Groningen: s.n.
   Google Scholar
• Jonkers, R., & Bastiaanse, R. (1996). The influence of instrumentality and transitivity on action naming in Broca's and anomic aphasia. Brain and Language, 53(1), 37–39.
   Google Scholar
• Jonkers, R., & Bastiaanse, R. (2007). Action naming in anomic aphasic speakers: Effects of instrumentality and name relation. Brain and Language, 102(3), 262–272. doi: 10.1016/j.bandl.2007.01.002
   PubMed Web of Science ®Google Scholar
• Kelly, S., Healey, M., Özyürek, A., & Holler, J. (2015). The processing of speech, gesture, and action during language comprehension. Psychonomic Bulletin & Review, 22(2), 517–523. doi: 10.3758/s13423-014-0681-7
   PubMed Web of Science ®Google Scholar
• Kelly, S. D., Özyürek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21(2), 260–267.
   PubMed Web of Science ®Google Scholar
• Kemmerer, D., Tranel, D., & Barrash, J. (2001). Patterns of dissociation in the processing of verb meanings in brain-damaged subjects. Language and Cognitive Processes, 16(1), 1–34. doi: 10.1080/01690960042000175
   Web of Science ®Google Scholar
• Kipper-Schuler, K. (2006). Verbnet: A broad-coverage, comprehensive verb lexicon ( PhD thesis). University of Pennsylvania, Philadelphia.
   Google Scholar
• Kiss, G. R., Armstrong, C., Milroy, R., & Piper, J. (1973). An associative thesaurus of English and its computer analysis. In A. J. Aitken, R. W. Bailey & N. Hamilton-Smith (Eds.), The computer and literary studies (pp. 153–165). Edinburgh: Edinburgh University Press.
   Google Scholar
• Kita, S. (2000). How representational gestures help speaking. In D. McNeill (Ed.), Language and gesture (pp. 162–185). Cambridge: Cambridge University Press.
   Google Scholar
• Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16–32. doi: 10.1016/S0749-596X(02)00505-3
   Web of Science ®Google Scholar
• Krauss, R., Chen, Y., & Gottesman, R. (2000). Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp. 261–283). New York: Cambridge University Press.
   Google Scholar
• Luzzatti, C., Raggi, R., Zonca, G., Pistarini, C., Contardi, A., & Pinna, G. D. (2002). Verb-noun double dissociation in aphasic lexical impairments: The role of word frequency and imageability. Brain and Language, 444(81), 432–444. doi: 10.1006/brln.2001.2536
   Web of Science ®Google Scholar
• Luzzatti, Claudio, Raggi, Rossella, Zonca, Giusy, Pistarini, Caterina, Contardi, Antonella, & Pinna, Gian-Domenico. (2002). Verb–noun double dissociation in aphasic lexical impairments: The role of word frequency and imageability. Brain and Language, 81(1-3), 432–444. doi:10.1006/brln.2001.2536
   PubMed Web of Science ®Google Scholar
• Marangolo, P., Bonifazi, S., Tomaiuolo, F., Craighero, L., Coccia, M., Altoe, G., … Cantagallo, A. (2010). Improving language without words: First evidence from aphasia. Neuropsychologia, 48(13), 3824–3833. doi: 10.1016/j.neuropsychologia.2010.09.025
   PubMed Web of Science ®Google Scholar
• Matuschek, H., Kliegl, R., Vasishth, S., Baayen, H., & Bates, D. (2017). Balancing type I error and power in linear mixed models. Journal of Memory and Language, 94, 305–315. doi: 10.1016/j.jml.2017.01.001
   Web of Science ®Google Scholar
• McNamara, T. P. (2005). Semantic priming: Perspectives from memory and word recognition. New York: Psychology Press.
   Google Scholar
• McNeill, D. (2000). Language and gesture. Cambridge: Cambridge University Press.
   Google Scholar
• McNeill, D., Cassell, J., & McCullough, K. E. (1994). Communicative effects of speech-mismatched gestures. Research on Language and Social Interaction, 27(3), 223–237. doi: 10.1207/s15327973rlsi2703_4
   Google Scholar
• McRae, K., de Sa, V. R., & Seidenberg, M. S. (1997). On the nature and scope of featural representations of word meaning. Journal of Experimental Psychology: General, 126(2), 99–130. doi: 10.1037/0096-3445.126.2.99
   PubMed Web of Science ®Google Scholar
• Morey, R. D., & Rouder, J. N. (2015). BayesFactor: Computation of Bayes factors for common designs. R package version 0.9.12-2. Retrieved from https://CRAN.R-project.org/package=BayesFactor
   Google Scholar
• Mounoud, P., Duscherer, K., Moy, G., & Perraudin, S. (2007). The influence of action perception on object recognition: A developmental study. Developmental Science, 10(6), 836–852. doi: 10.1111/j.1467-7687.2007.00624.x
   PubMed Web of Science ®Google Scholar
• Neely, J. (1991). Semantic priming: Effects in visual word recognition: A selective review of current findings and theories. In D. Besner & G. Humphreys (Eds.), Basic processes in reading: Visual and word recognition. Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Osborne, J. (2010). Improving your data transformations: Applying the Box-Cox transformation. Practical Assessment, Research & Evaluation, 15(12), 1–9.
   Google Scholar
• Osiurak, F., Jarry, C., Baltenneck, N., Boudin, B., & Le Gall, D. (2012). Make a gesture and I will tell you what you are miming. Pantomime recognition in healthy subjects. Cortex, 48(5), 584–592. doi: 10.1016/j.cortex.2011.01.007
   PubMed Web of Science ®Google Scholar
• Özçalişkan, Ş, Lucero, C., & Goldin-Meadow, S. (2016). Does language shape silent gesture? Cognition, 148, 10–18. doi: 10.1016/j.cognition.2015.12.001
   PubMed Web of Science ®Google Scholar
• Özyürek, A. (2014). Hearing and seeing meaning in speech and gesture: Insights from brain and behaviour. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 369(1651), 20130296. doi: 10.1098/rstb.2013.0296
   PubMed Web of Science ®Google Scholar
• Padden, C., Hwang, S. O., Lepic, R., & Seegers, S. (2015). Tools for language: Patterned iconicity in sign language nouns and verbs. Topics in Cognitive Science, 7(1), 81–94. doi: 10.1111/tops.12121
   PubMed Web of Science ®Google Scholar
• Pinheiro, J. C., & Bates, D. M. (2000). Mixed effects models in S and S-PLUS. New York: Springer.
   Google Scholar
• Plaut, D. C. (1995). Semantic and associative priming in a distributed attractor network. Proceedings of the 17th Annual Conference of the Cognitive Science Society (pp. 37–42). Pittsburgh, PA, Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Raymer, A. M., & Ochipa, C. (1997). Conceptual praxis. In L. Gonzalez Rothi & K. M. Heilman (Eds.), Apraxia: The neuropsychology of action (pp. 51–60). Hove: Psychology Press.
   Google Scholar
• Roelofs, A. (2006). Context effects of pictures and words in naming objects, reading words, and generating simple phrases. The Quarterly Journal of Experimental Psychology, 59(10), 1764–1784. doi: 10.1080/17470210500416052
   Web of Science ®Google Scholar
• Rose, M. L. (2006). The utility of arm and hand gestures in the treatment of aphasia. International Journal of Speech-Language Pathology, 8(2), 92–109. doi: 10.1080/14417040600657948
   Google Scholar
• Rothi, L. J., Ochipa, C., & Heilman, K. M. (1997). A cognitive neuropsychological model of limb praxis and apraxia. In L. J. Rothi, & K. M. Heilman (Eds.), Apraxia: The neuropsychology of action (pp. 29–49). Hove: Psychology Press.
   Google Scholar
• RStudio Team. (2016). RStudio: Integrated Development for R. RStudio, Inc., Boston, MA.
   Google Scholar
• Rumiati, R. I., & Humphreys, G. W. (1998). Recognition by action: Dissociating visual and semantic routes to action in normal observers. Journal of Experimental Psychology: Human Perception and Performance, 24(2), 631–647. doi: 10.1037/0096-1523.24.2.631
   PubMed Web of Science ®Google Scholar
• Schnur, T., Costa, A., & Caramazza, A. (2002). Verb production and the semantic interference effect. Journal of Cognitive Science, 3, 1–26.
   Google Scholar
• So, W. C., Yi-Feng, A. L., Yap, D. F., Kheng, E., & Yap, J. M. (2013). Iconic gestures prime words: Comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 4(779), doi: 10.3389/fpsyg.2013.00779
   PubMedGoogle Scholar
• Szekely, A., Jacobsen, T., D’Amico, S., Devescovi, A., Andonova, E., Herron, D., … Bates, E. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory and Language, 51(2), 247–250. doi: 10.1016/j.jml.2004.03.002
   PubMed Web of Science ®Google Scholar
• Thompson, C. K., Lange, K. L., Schneider, S. L., & Shapiro, L. P. (1997). Agrammatic and non-brain-damaged subjects’ verb and verb argument structure production. Aphasiology, 11(4–5), 473–490. doi: 10.1080/02687039708248485
   Web of Science ®Google Scholar
• Tree, J., & Hirsh, K. (2003). Sometimes faster, sometimes slower: Associative and competitor priming in picture naming with young and elderly participants. Journal of Neurolinguistics, 16(6), 489–514. doi: 10.1016/S0911-6044(02)00005-2
   Web of Science ®Google Scholar
• Van Heuven, W. J. B., Mandera, P., Keuleers, E., & Brysbaert, M. (2014). Subtlex-UK: A new and improved word frequency database for British English. The Quarterly Journal of Experimental Psychology, 67(6), 1176–1190. doi: 10.1080/17470218.2013.850521
   PubMed Web of Science ®Google Scholar
• van Nispen, Karin, van de Sandt-Koenderman, W. Mieke. E., & Krahmer, Emiel. (2017). Production and comprehension of pantomimes used to depict objects. Frontiers in Psychology, 8. doi: 10.3389/fpsyg.2017.01095
   PubMed Web of Science ®Google Scholar
• Venables, W. N., & Ripley, B. D. (2002). Modern applied statistics with S (4th ed). New York: Springer.
   Google Scholar
• Vigliocco, G., Vinson, D. P., Lewis, W., & Garrett, M. F. (2004). Representing the meanings of object and action words: The featural and unitary semantic space hypothesis. Cognitive Psychology, 48(4), 422–488. doi: 10.1016/j.cogpsych.2003.09.001
   PubMed Web of Science ®Google Scholar
• Vigliocco, G., Vinson, D. P., & Siri, S. (2005). Semantic similarity and grammatical class in naming actions. Cognition, 94(3), B91–B100. doi: 10.1016/j.cognition.2004.06.004
   PubMed Web of Science ®Google Scholar
• Wheeldon, L., & Monsell, S. (1992). The locus of repetition priming of spoken word production. The Quarterly Journal of Experimental Psychology, 44(4), 723–761. doi: 10.1080/14640749208401307
   Web of Science ®Google Scholar
• Wheeldon, L. R., & Monsell, S. (1994). Inhibition of spoken word production by priming a semantic competitor. Journal of Memory and Language, 33(3), 332–356. doi: 10.1006/jmla.1994.1016
   Web of Science ®Google Scholar
• Wilson, M. (1988). MRC psycholinguistic database: Machine-usable dictionary, version 2.00. Behavior Research Methods, Instruments, & Computers, 20(1), 6–10. doi: 10.3758/BF03202594
   Google Scholar
• Wu, Y., & Coulson, S. (2007). Iconic gestures prime related concepts: An ERP study. Psychonomic Bulletin & Review, 14(1), 57–63. doi: 10.3758/BF03194028
   PubMed Web of Science ®Google Scholar
• Yap, D. F., So, W. C., Yap, J. M., Tan, Y. Q., & Teoh, R. L. (2011). Iconic gestures prime words. Cognitive Science, 35(1), 171–183. doi: 10.1111/j.1551-6709.2010.01141.x
   PubMed Web of Science ®Google Scholar
• Zuur, A. F., Ieno, E. I., Walker, N. J., Saveliev, A. A., & Smith, G. M. (2009). Mixed effects models and extensions in ecology with R. New York: Springer.
   Google Scholar