1,126
Views
25
CrossRef citations to date
0
Altmetric
REGULAR ARTICLES

Prominence in speech and gesture favour second language novel word learning

, &
Pages 992-1004 | Received 22 Apr 2016, Accepted 23 Dec 2017, Published online: 11 Feb 2018

References

  • Austin, E. E., & Sweller, N. (2014). Presentation and production: The role of gesture in spatial communication. Journal of Experimental Child Psychology, 122, 92–103. doi: 10.1016/j.jecp.2013.12.008
  • Baddeley, A. (1990). Human memory: Theory and practice. East Sussex: Lawrence Erlbaum.
  • Baddeley, A. D. (2000). The episodic buffer: A new component of working memory?. Trends in Cognitive Sciences, 4(11), 417–423. doi: 10.1016/S1364-6613(00)01538-2
  • Baills, F., Suárez-González, N., González-Fuente, S., & Prieto, P. (submitted). Observing and producing pitch gestures facilitates the learning of mandarin Chinese tones and words. Studies in Second Language Acquisition.
  • Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59(1), 617–645. doi: 10.1146/annurev.psych.59.103006.093639
  • Barsalou, L. W., Simmons, W. K., Barbey, A. K., & Wilson, C. D. (2003). Grounding conceptual knowledge in modality-specific systems. Trends in Cognitive Sciences, 7(2), 84–91. doi: 10.1016/S1364-6613(02)00029-3
  • Bernardis, P., & Gentilucci, M. (2006). Speech and gesture share the same communication system. Neuropsychologia, 44(2), 178–190. doi: 10.1016/j.neuropsychologia.2005.05.007
  • Biau, E., & Soto-Faraco, S. (2013). Beat gestures modulate auditory integration in speech perception. Brain and Language, 124(2), 143–152. doi: 10.1016/j.bandl.2012.10.008
  • Biau, E, & Soto-Faraco, S. (2015). Synchronization by the hand: the sight of gestures modulates low-frequency activity in brain responses to continuous speech. Frontiers in Human Neuroscience, 9, 1–6. doi: 10.3389/fnhum.2015.00527
  • Billmyer, K., & Varghese, M. (2000). Investigating instrument-based pragmatic variability: Effects of enhancing discourse completion tests. Applied Linguistics, 21(4), 517–552. doi: 10.1093/applin/21.4.517
  • Blum-Kulka, S., House, J., & Kasper, G. (1989). Investigating cross-cultural pragmatics: An introductory overview. In S. Blum-Kulka, J. House, & G. Kasper (Eds.), Cross-cultural pragmatics: Requests and apologies (pp. 1–34). Norwood, NJ: Ablex.
  • Bock, J. K., & Mazzella, J. R. (1983). Intonational marking of given and new information: Some consequences for comprehension. Memory & Cognition, 11(1), 64–76. doi: 10.3758/BF03197663
  • Dimitrova, D. V., Chu, M., Wang, L., Ozyurek, A., & Hagoort, P. (2016). Beat that word: How listeners integrate beat gesture and focus in multimodal speech discourse. Journal of Cognitive Neuroscience, 28(9), 1255–1269. doi: 10.1162/jocn_a_00963
  • Dohen, M. (2009). Speech through the ear, the eye, the mouth and the hand. In A. Esposito, A. Hussain, & M. Marinaro (Eds.), Multimodal signals: Cognitive and algorithmic issues (pp. 24–39). Berlin/Heidelberg: Springer.
  • Ekman, P. (1979). About brows: Emotional and conversational signals. In M. von Cranach, K. Forra, W. Lepinies, & D. Ploog (Eds.), Human ethology: Claims and limits of a new discipline: Contribution to the colloquium (pp. 169–248). Cambridge: Cambridge University Press.
  • Esteve-Gibert, N., & Prieto, P. (2013). Prosodic structure shapes the temporal realization of intonation and manual gesture movements. Journal of Speech Language and Hearing Research, 56(850), 850–865. doi: 10.1044/1092-4388(2012/12-0049)
  • Félix-Brasdefer, J. C. (2010). Data collection methods in speech act performance: DCTs, role plays, and verbal reports. In A. Martínez-Flor & E. Usó-Juan (Eds.), Speech act performance: Theoretical, empirical, and methodological issues (pp. 41–56). Amsterdam & Philadelphia, PA: John Benjamins.
  • Feyereisen, P. (2006). How could gesture facilitate lexical access? Advances in Speech Language Pathology, 8, 128–133. doi: 10.1080/14417040600667293
  • Fraundorf, S. H., Watson, D. G., & Benjamin, A. S. (2010). Recognition memory reveals just how contrastive accenting really is. Journal of Memory and Language, 63(3), 367–386. doi: 10.1016/j.jml.2010.06.004
  • Gass, S. M. (2013). Second language acquisition: An introductory course (with Behney J., & Plonsky, L.). London: Routledge.
  • Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin and Review, 9, 558–565. doi: 10.3758/BF03196313
  • Gluhareva, D., & Prieto, P. (2017). Training with rhythmic beat gestures favors L2 pronunciation in discourse-demanding situations. Language Teaching Research, 21(5), 609–631. doi: 10.1177/1362168816651463
  • Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. Cambridge, MA: Harvard University Press.
  • Hirata, Y., Kelly, S., Huang, J., & Manansala, M. (2014). Effect of hand gestures on auditory learning of second-language vowel length contrasts. Journal of Speech Language and Hearing Research, 57, 2090–2101. doi: 10.1044/2014_JSLHR-S-14-0049
  • Holle, H., Obermeier, C., Schmidt-Kassow, M., Friederici, A. D., Ward, J., & Gunter, T. C. (2012). Gesture facilitates the syntactic analysis of speech. Frontiers in Psychology, 3, 74. doi: 10.3389/fpsyg.2012.00074
  • Hu, F.-T., Ginns, P., & Bobis, J. (2015). Getting the point: Tracing worked examples enhances learning. Learning and Instruction, 35, 85–93. doi: 10.1016/j.learninstruc.2014.10.002
  • Hubbard, A. L., Wilson, S. M., Callan, D. E., & Dapretto, M. (2009). Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human Brain Mapping, 30(3), 1028–1037. doi: 10.1002/hbm.20565
  • Igualada, A., Esteve-Gibert, N., & Prieto, P. (2017). Beat gestures improve word recall in 3- to 5-year-old children. Journal of Experimental Child Psychology, 156, 99–112. doi: 10.1016/j.jecp.2016.11.017
  • Jannedy, S., & Mendoza-Denton, N. (2005). Structuring information through gesture and intonation. Interdisciplinary Studies on Information Structure, 3, 199–244.
  • Kelly, S. D., McDevitt, T., & Esch, M. (2009). Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language and Cognitive Processes, 24(2), 313–334. doi: 10.1080/01690960802365567
  • Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. In M. Key (Ed.), The relationship of verbal and nonverbal communication (pp. 207–227). The Hague: Mouton.
  • Kendon, A. (2004). Gesture. Visible action as utterance. Cambridge: Cambridge University Press.
  • Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396–414. doi: 10.1016/j.jml.2007.06.005
  • Kushch, O., & Prieto, P. (2016). The effects of pitch accentuation and beat gestures on information recall in contrastive discourse. Proceedings of Speech Prosody, Boston, USA, May 31-June 3.
  • Levinson, S. C., & Holler, J. (2014). The origin of human multi-modal communication. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), 20130302. doi: 10.1098/rstb.2013.0302
  • Llanes-Coromina, J., Vilà-Giménez, I., Kushch, O., & Prieto, P. (under revision). Beat gestures help preschoolers recall and comprehend discourse information. Journal of Experimental Child Psychology.
  • Macedonia, M., Müller, K., & Friederici, A. D. (2011). The impact of iconic gestures on foreign language word learning and its neural substrate. Human Brain Mapping, 32, 982–998. doi: 10.1002/hbm.21084
  • Masumoto, K, Yamaguchi, M, Sutani, K, Tsuneto, S, Fujita, A, & Tonoike, M. (2006). Reactivation of physical motor information in the memory of action events. Brain Research, 1101(1), 102–109. http://dx.doi.org/10.1016/j.brainres.2006.05.033
  • McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
  • McNeill, D. (2005). Gesture and thought. Chicago: University of Chicago Press.
  • Morett, L. M., & Chang, L.-Y. (2014). Emphasising sound and meaning: pitch gestures enhance Mandarin lexical tone acquisition. Language, Cognition and Neuroscience, 98(3), 773–794.
  • Nation, I. S. P. (1990). Teaching and learning vocabulary. New York: Newbury House.
  • Niedenthal, P. M., Barsalou, L. W., Winkielman, P., Krauth-Gruber, S., & Ric, F. (2005). Embodiment in attitudes, social perception, and emotion. Personality and Social Psychology Review, 9, 184–211. doi: 10.1207/s15327957pspr0903_1
  • Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart & Winston.
  • Poggi, I. (2007). Mind, hands, face and body. A goal and belief view of multimodal communication. Berlin: Weidler.
  • Prieto, P., Puglesi, C., Borràs-Comes, J., Arroyo, E., & Blat, J. (2015). Exploring the contribution of prosody and gesture to the perception of focus using an animated agent. Journal of Phonetics, 49, 41–54. doi: 10.1016/j.wocn.2014.10.005
  • Prieto, P., & Roseano, P. (2010). Transcription of intonation of the Spanish language. München: Lincom.
  • Pulvermuller, F., Hauk, O., Nikulin, V. V., & Ilmoniemi, R. J. (2005). Functional links between motor and language systems. European Journal of Neuroscience, 21, 793–797. doi: 10.1111/j.1460-9568.2005.03900.x
  • Quak, M., London, R. E., & Talsma, D. (2015). A multisensory perspective of working memory. Frontiers in Human Neuroscience, 9, 197. doi: 10.3389/fnhum.2015.00197
  • Quinn-Allen, L. Q. (1995). The effects of emblematic gestures on the development and access of mental representations of French expressions. The Modern Language Journal, 79, 521–529. doi: 10.1111/j.1540-4781.1995.tb05454.x
  • Richards, J. C. (1976). The role of vocabulary teaching. TESOL Quarterly, 10(1), 77–89. doi: 10.2307/3585941
  • Shattuck-Hufnagel, S., Ren, A., Mathew, M., Yen, I., & Demuth, K. (2016). Non-referential gestures in adult and child speech: Are they prosodic? Proceedings of Speech Prosody 2016. Boston, USA, May 31-June 3, 2016, 836–839.
  • Smotrova, T., & Lantolf, J. P. (2013). The function of gesture in lexically focused L2 instructional conversations. Modern Language Journal, 97, 397–416. doi: 10.1111/j.1540-4781.2013.12008.x
  • So, W. C., Sim Chen-Hui, C., & Low Wei-Shan, J. (2012). Mnemonic effect of iconic gesture and beat gesture in adults and children: Is meaning in gesture important for memory recall? Language and Cognitive Processes, 27, 665–681. doi: 10.1080/01690965.2011.573220
  • Stefan, K., Cohen, L. G., Duque, J., Mazzocchio, R., Celnik, P., Sawaki, L., … Classen, J. (2005). Formation of a motor memory by action observation. Journal of Neuroscience, 25(41), 9339–9346. doi: 10.1523/JNEUROSCI.2282-05.2005
  • Swerts, M., & Krahmer, E. (2008). Facial expression and prosodic prominence: Effects of modality and facial area. Journal of Phonetics, 36(2), 219–238. doi: 10.1016/j.wocn.2007.05.001
  • Tellier, M. (2008). The effect of gestures on second language memorisation by young children. Gesture, 8(2), 219–235. doi: 10.1075/gest.8.2.06tel
  • Wagner, P., Malisz, Z., & Kopp, S. (2014). Gesture and speech in interaction: An overview. Speech Communication, 57, 209–232. doi: 10.1016/j.specom.2013.09.008
  • Wang, L., & Chu, M. (2013). The role of beat gesture and pitch accent in semantic processing: An ERP study. Neuropsychologia, 51(13), 2847–2855. doi: 10.1016/j.neuropsychologia.2013.09.027
  • Yasinnik, Y., Renwick, M., & Shattuck-Hufnagel, S. (2004). The timing of speech-accompanying gestures with respect to prosody,” Proceedings of the International Conference: From Sound to Sense: +50 Years of Discoveries in Speech Communication, MIT, Cambridge, 10–13 June, C97–C102.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.