When actions speak too much louder than words: Hand gestures disrupt word learning when phonetic demands are high

References

• Baddeley , A. D. , Gathercole , S. E. and Papagno , C. 1998 . The phonological loop as a language learning device . Psychological Review , 105 : 158 – 173 .
   PubMed Web of Science ®Google Scholar
• Bernardis , P. and Gentilucci , M. 2006 . Speech and gesture share the same communication system . Neuropsychologia , 44 : 178 – 190 .
   PubMed Web of Science ®Google Scholar
• Clark , H. H. 1996 . Using language , Cambridge , , UK : Cambridge University Press .
   Google Scholar
• Goldin-Meadow , S. 2003 . Hearing gesture: How our hands help us think , Cambridge , MA : Belknap Press of Harvard University Press .
   Google Scholar
• Green , K. P. , Kuhl , P. K. , Meltzoff , A. N. and Stevens , E. B. 1991 . Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect . Perception and Psychophysics , 50 ( 6 ) : 524 – 536 .
   Web of Science ®Google Scholar
• Harada , T. 2006 . The acquisition of single and geminate stops by English-speaking children in a Japanese immersion program . Studies in Second Language Acquisition , 28 ( 4 ) : 601 – 632 .
   Web of Science ®Google Scholar
• Hardison , D. M. 2003 . Acquisition of second-language speech: Effects of visual cues, context, and talker variability . Applied Psycholinguistics , 24 ( 4 ) : 495 – 522 .
   Web of Science ®Google Scholar
• Hayes , R. L. 2001 . The perception of novel phoneme contrasts in a second language: A developmental study of native speakers of English learning Japanese singleton and geminate consonant contrasts . Coyote Papers: Language in Cognitive Science , 12 : 17 – 27 .
   Google Scholar
• Hayes-Harb , R. 2005 . Optimal L2 speech perception: Native speakers of English and Japanese consonant length contrasts . Journal of Language and Linguistics , 4 ( 1 ) : 1 – 29 .
   Google Scholar
• Hayes-Harb , R. 2007 . Lexical and statistical evidence in the acquisition of second language phonemes . Second Language Research , 23 : 65 – 94 .
   Web of Science ®Google Scholar
• Hazen , V. , Sennema , A. , Iba , M. and Faulkner , A. 2005 . Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of English . Speech Communication , 47 : 360 – 378 .
   Web of Science ®Google Scholar
• Hirata , Y. 2004 . Training native English speakers to perceive Japanese length contrasts in word versus sentence contexts . The Journal of the Acoustical Society of America , 116 ( 4 ) : 2384 – 2394 .
   Web of Science ®Google Scholar
• Hirata , Y. and Kelly , S. D. 2010 . The effects of lips and hands on auditory learning of second language speech sounds . Journal of Speech, Language and Hearing Research , 53 : 298 – 310 .
   PubMed Web of Science ®Google Scholar
• Hostetter , A. B. and Alibali , M. W. 2008 . Visible embodiment: Gestures as simulated action . Psychonomic Bulletin and Review , 15 : 495 – 514 .
   PubMed Web of Science ®Google Scholar
• Hubbard , A. L. , Wilson , S. M. , Callan , D. E. and Dapretto , M. 2008 . Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception . Human Brain Mapping , 30 : 1028 – 1037 .
   Web of Science ®Google Scholar
• Kelly , S. D. , Manning , S. and Rodak , S. 2008 . Gesture gives a hand to language and learning: Perspectives from cognitive neuroscience, developmental psychology and education . Language and Linguistics Compass , 2 : 1 – 20 .
   PubMedGoogle Scholar
• Kelly , S. D. , McDevitt , T. and Esch , M. 2009 . Neural correlates of learning Japanese words with and without iconic gestures . Language and Cognitive Processes , 24 : 313 – 324 .
   Web of Science ®Google Scholar
• Kelly , S. D. , Özyürek , A. and Maris , E. 2010 . Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension . Psychological Science , 21 : 260 – 267 .
   PubMed Web of Science ®Google Scholar
• Kendon , A. 2004 . Gesture: Visible action as utterance , Cambridge , , UK : Cambridge University Press .
   Google Scholar
• Kita , S. and Özyürek , A. 2003 . What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking . Journal of Memory and Language , 48 : 16 – 32 .
   Web of Science ®Google Scholar
• Krahmer , E. and Swerts , M. 2007 . The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception . Journal of Memory and Language , 57 : 396 – 414 .
   Web of Science ®Google Scholar
• Massaro , D. W. and Cohen , M. M. 1983 . Evaluation and integration of visual and auditory information in speech perception . Journal of Experimental Psychology: Human Perception and Performance , 9 ( 5 ) : 753 – 771 .
   Web of Science ®Google Scholar
• Massaro , D. W. and Jesse , A. 2007 . “ Audiovisual speech perception and word Recognition ” . In The Oxford handbook of psycholinguistics , Edited by: Gaskell , M. G. 19 – 35 . Oxford : Oxford University Press .
   Google Scholar
• McGurk , H. and MacDonald , J. 1976 . Hearing lips and seeing voices . Nature , 264 : 746 – 748 .
   PubMed Web of Science ®Google Scholar
• McNeill , D. 1992 . Hand and mind: What gestures reveal about thought , Chicago : The University of Chicago Press .
   Google Scholar
• McNeill , D. 2005 . Gesture and thought , Chicago : University of Chicago Press .
   Google Scholar
• Papagno , C. , Valentine , T. and Baddeley , A. D. 1991 . Phonological short-term memory and foreign language vocabulary learning . Journal of Memory and Language , 30 : 331 – 347 .
   Web of Science ®Google Scholar
• Papagno , C. and Vallar , G. 1992 . Phonological short-term memory and the learning of novel words: The effect of phonological similarity and item length . Quarterly Journal of Experimental Psychology , 44 : 47 – 67 .
   Web of Science ®Google Scholar
• Skipper , J. I. , Goldin-Meadow , S. , Nusbaum , H. C. and Small , S. L. 2009 . Gestures orchestrate brain networks for language understanding . Current Biology , 19 : 661 – 667 .
   PubMed Web of Science ®Google Scholar
• Skipper , J. I. , van Wassenhove , V. , Nusbaum , H. C. and Small , S. L. 2007 . Hearing lips and seeing voices: How cortical areas supporting speech production mediate audiovisual speech perception . Cerebral Cortex , 17 : 2387 – 2399 .
   PubMed Web of Science ®Google Scholar
• Stager , C. L. and Werker , J. F. 1997 . Infants listen for more phonetic detail in speech perception than in word-learning tasks . Nature , 388 : 381 – 382 .
   PubMed Web of Science ®Google Scholar
• Sueyoshi , A. and Hardison , D. M. 2005 . The role of gestures and facial cues in second language listening comprehension . Language Learning , 55 : 661 – 699 .
   Web of Science ®Google Scholar