111
Views
0
CrossRef citations to date
0
Altmetric
REGULAR ARTICLES

Do bilingual adults gesture when they are disfluent?: Understanding gesture-speech interaction across first and second languages

, , &
Pages 571-583 | Received 21 May 2023, Accepted 16 Apr 2024, Published online: 02 May 2024

References

  • Adams, T .W. (1998). Gesture in foreigner talk. University of Pennsylvania.
  • Akbuğa, E., & Göksun, T. (2023). EXPRESS: The role of spatial words in the spatialization of time. Quarterly Journal of Experimental Psychology, 77(2), 383–392. https://doi.org/10.1177/17470218231169972
  • Akhavan, N., Göksun, T., & Nozari, N. (2016). Disfluency production in speech and gesture. In A. Papafragou, D. Grodner, D. Mirman, & J. C. Trueswell (Eds.), Proceedings of the 38th annual conference of the cognitive science society (pp. 716–721). Cognitive Science Society.
  • Akhavan, N., Göksun, T., & Nozari, N. (2018). Integrity and function of gestures in aphasia. Aphasiology, 32(11), 1310–1335. https://doi.org/10.1080/02687038.2017.1396573
  • Aktan-Erciyes, A., Akbuğa, E., Kızıldere, E., & Göksun, T. (2023). Motion event representation in L1-Turkish versus L2-English speech and gesture: Relations to eye movements for event components. International Journal of Bilingualism, 27(1), 61–86. https://doi.org/10.1177/13670069221076838
  • Arslan, B., Aktan-Erciyes, A., & Göksun, T. (2023). Multimodal language in bilingual and monolingual children: Gesture production and speech disfluency. Bilingualism: Language and Cognition 26(5), 971–983. https://doi.org/10.1017/S1366728923000196
  • Arslan, B., & Göksun, T. (2021). Ageing, working memory, and mental imagery: Understanding gestural communication in younger and older adults. Quarterly Journal of Experimental Psychology, 74(1), 29–44. https://doi.org/10.1177/1747021820944696
  • Arslan, B., & Göksun, T. (2022). Aging, gesture production, and disfluency in speech: A comparison of younger and older adults. Cognitive Science, 46(2), e13098. https://doi.org/10.1111/cogs.13098
  • Avcı, C., Arslan, B., & Göksun, T. (2022). Gesture and speech disfluency in narrative context: Disfluency rates in spontaneous, restricted, and encouraged gesture conditions. In J. Culbertson, A. Perfors, H. Rabagliati, & V. Ramenzoni (Eds.), Proceedings of the 44th annual conference of the cognitive science society (pp. 1912–1917). Cognitive Science Society. https://escholarship.org/uc/item/6xg8p5rd
  • Badre, D., & Wagner, A. D. (2007). Left ventrolateral prefrontal cortex and the cognitive control of memory. Neuropsychologia, 45(13), 2883–2901. https://doi.org/10.1016/j.neuropsychologia.2007.06.015
  • Bergmann, C., Sprenger, S. A., & Schmid, M. S. (2015). The impact of language co-activation on L1 and L2 speech fluency. Acta Psychologica, 161, 25–35. https://doi.org/10.1016/j.actpsy.2015.07.015
  • Bock, K. (1996). Language production: Methods and methodologies. Psychonomic Bulletin & Review, 3(4), 395–421. https://doi.org/10.3758/BF03214545
  • Bortfeld, H., Leon, S. D., Bloom, J. E., Schober, M. F., & Brennan, S. E. (2001). Disfluency rates in conversation: Effects of age, relationship, topic, role, and gender. Language and Speech, 44(2), 123–147. https://doi.org/10.1177/00238309010440020101
  • Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108(3), 624–652. https://doi.org/10.1037/0033-295X.108.3.624
  • Braver, T. S., Gray, J. R., & Burgess, G. C. (2007). Explaining the many varieties of working memory variation: Dual mechanisms of cognitive control. Variation in Working Memory, 75, 76–106. https://doi.org/10.1093/acprof:oso/9780195168648.003.0004
  • Brennan, S. E., & Schober, M. F. (2001). How listeners compensate for disfluencies in spontaneous speech. Journal of Memory and Language, 44(2), 274–296. https://doi.org/10.1006/jmla.2000.2753
  • Brennan, S. E., & Williams, M. (1995). The feeling of another’s knowing: Prosody and filled pauses as cues to listeners about the metacognitive states of speakers. Journal of Memory and Language, 34(3), 383–398. https://doi.org/10.1006/jmla.1995.1017
  • Capirci, O., Contaldo, A., Caselli, M. C., & Volterra, V. (2005). From action to language through gesture: A longitudinal perspective. Gesture, 5(1-2), 155–177.
  • Cocks, N., Dipper, L., Pritchard, M., & Morgan, G. (2013). The impact of impaired semantic knowledge on spontaneous iconic gesture production. Aphasiology, 27(9), 1050–1069. https://doi.org/10.1080/02687038.2013.770816
  • Corley, M., & Stewart, O. W. (2008). Hesitation disfluencies in spontaneous speech: The meaning of um. Language and Linguistics Compass, 2(4), 589–602. https://doi.org/10.1111/j.1749-818X.2008.00068.x
  • Costa, A., Sebastián-Gallés, N., Miozzo, M., & Caramazza, A. (1999). The gender congruity effect: Evidence from Spanish and Catalan. Language & Cognitive Processes, 14(4), 381–391. https://doi.org/10.1080/016909699386275
  • Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149
  • Felker, E. R., Klockmann, H. E., & De Jong, N. H. (2019). How conceptualizing influences fluency in first and second language speech production. Applied Psycholinguistics, 40(1), 111–136. https://doi.org/10.1017/S0142716418000474
  • Fraundorf, S. H., & Watson, D. G. (2014). Alice’s adventures in um-derland: Psycholinguistic sources of variation in disfluency production. Language, Cognition and Neuroscience, 29(9), 1083–1096. https://doi.org/10.1080/01690965.2013.832785
  • Göksun, T., Lehet, M., Malykhina, K., & Chatterjee, A. (2013). Naming and gesturing spatial relations: Evidence from focal brain-injured individuals. Neuropsychologia, 51(8), 1518–1527. https://doi.org/10.1016/j.neuropsychologia.2013.05.006
  • Göksun, T., Lehet, M., Malykhina, K., & Chatterjee, A. (2015). Spontaneous gesture and spatial language: Evidence from focal brain-injury. Brain and Language, 150, 1–13. https://doi.org/10.1016/j.bandl.2015.07.012
  • Gollan, T. H., Montoya, R. I., Fennema-Notestine, C., & Morris, S. K. (2005). Bilingualism affects picture naming but not picture classification. Memory & Cognition, 33(7), 1220–1234. https://doi.org/10.3758/BF03193224
  • Graziano, M., & Gullberg, M. (2018). When speech stops, gesture stops: Evidence from developmental and crosslinguistic comparisons. Frontiers in Psychology, 9, 879. https://doi.org/10.3389/fpsyg.2018.00879
  • Gregersen, T., Olivares-Cuhat, G., & Storm, J. (2009). An examination of L1 and L2 gesture use: What role does proficiency play? The Modern Language Journal, 93(2), 195–208. https://doi.org/10.1111/j.1540-4781.2009.00856.x
  • Gullberg, M. (1998). Gesture as a communication strategy in second language discourse: A study of learners of French and Swedish. Lund University Press.
  • Gullberg, M. (2008). A helping hand? Gestures, L2 learners, and grammar. In S. G. McCafferty & G. Stam (Eds.), Gesture: Second language acquisition and classroom research (pp. 185–210). Routledge.
  • Gullberg, M. (2011). Multilingual multimodality: Communicative difficulties and their solution in second-language use. In J. Streeck, C. Goodwin, & C. LeBaron (Eds.), Embodied interaction: Language and body in the material world (pp. 137–151). Cambridge University Press.
  • Gullberg, M. (2013). Bilingualism and gesture. In T. K. Bhatia & W. C. Ritchie (Eds.), The handbook of bilingualism and multilingualism (pp. 417–437). Wiley-Blackwell.
  • Hadar, U., Dar, R., & Teitelman, A. (2001). Gesture during speech in first and second language: Implications for lexical retrieval. Gesture, 1(2), 151–165. https://doi.org/10.1075/gest.1.2.04had
  • Hermans, D., Bongaerts, T., de Bot, K., & Schreuder, R. (1998). Producing words in a foreign language: Can speakers prevent interference from their first language? Bilingualism: Language and Cognition, 1(3), 213–229. https://doi.org/10.1017/S1366728998000364
  • Kelly, S. D., Özyürek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21(2), 260–267. https://doi.org/10.1177/0956797609357327
  • Kita, S., Alibali, M. W., & Chu, M. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological Review, 124(3), 245–266. https://doi.org/10.1037/rev0000059
  • Kita, S., & Davies, T. S. (2009). Competing conceptual representations trigger co-speech representational gestures. Language and Cognitive Processes, 24(5), 761–775. https://doi.org/10.1080/01690960802327971
  • Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16–32. https://doi.org/10.1016/S0749-596X(02)00505-3
  • Kısa, Y. D., Goldin-Meadow, S., & Casasanto, D. (2022). Do gestures really facilitate speech production? Journal of Experimental Psychology: General, 151(6), 1252–1271. https://doi.org/10.1037/xge0001135
  • Kosmala, L., & Crible, L. (2022). The dual status of filled pauses: Evidence from genre, proficiency and co-occurrence. Language and Speech, 65(1), 216–239. https://doi.org/10.1177/00238309211010862
  • Krauss, R. M. (1998). Why do we gesture when we speak? Current Directions in Psychological Science, 7(2), 54–54. https://doi.org/10.1111/1467-8721.ep13175642
  • Lausberg, H., & Sloetjes, H. (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, 41(3), 841–849. https://doi.org/10.3758/BRM.41.3.841
  • Maclay, H., & Osgood, C. E. (1959). Hesitation phenomena in spontaneous English speech. Word, 15(1), 19–44. https://doi.org/10.1080/00437956.1959.11659682
  • Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007). The language experience and proficiency questionnaire (LEAP–Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50(4), 940–967. https://doi.org/10.1044/1092-4388(2007/067)
  • McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.
  • McNeill, D. (2019). Gesture and thought. University of Chicago Press.
  • Melinger, A., & Kita, S. (2007). Conceptualisation load triggers gesture production. Language and Cognitive Processes, 22(4), 473–500. https://doi.org/10.1080/01690960600696916
  • Morsella, E., & Krauss, R. M. (2004). The role of gestures in spatial working memory and speech. The American Journal of Psychology, 117(3), 411. https://doi.org/10.2307/4149008
  • Nicoladis, E. (2007). The effect of bilingualism on the use of manual gestures. Applied Psycholinguistics, 28(3), 441–454. https://doi.org/10.1017/S0142716407070245
  • Nicoladis, E., Pika, S., & Marentette, P. (2009). Do French–English bilingual children gesture more than monolingual children? Journal of Psycholinguistic Research, 38(6), 573–585. https://doi.org/10.1007/s10936-009-9121-7
  • Nozari, N., Dell, G. S., & Schwartz, M. F. (2011). Is comprehension necessary for error detection? A conflict-based account of monitoring in speech production. Cognitive Psychology, 63(1), 1–33. https://doi.org/10.1016/j.cogpsych.2011.05.001
  • Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics, 24(4), 492–518. https://doi.org/10.1093/applin/24.4.492
  • Oviatt, S. (1995). Predicting spoken disfluencies during human-computer interaction. Computer Speech and Language, 9(1), 19–35. https://doi.org/10.1006/csla.1995.0002
  • Özder, L. E., Özer, D., & Göksun, T. (2022). Gesture use in L1-Turkish and L2-English: Evidence from emotional narrative retellings. Quarterly Journal of Experimental Psychology, 76(8), 1797–1816. https://doi.org/10.1177/17470218221126685
  • Özer, D., & Göksun, T. (2020). Gesture use and processing: A review on individual differences in cognitive resources. Frontiers in Psychology, 11, 573555. https://doi.org/10.3389/fpsyg.2020.573555
  • Özyurek, A., & Kita, S. (1999). Expressing manner and path in English and Turkish: Differences in speech, gesture, and conceptualization. In M. Hahn & S. C. Stoness (Eds.), Proceedings of the twenty-first annual conference of the cognitive science society (pp. 507–512). Erlbaum.
  • Özyürek, A., Kita, S., Allen, S., Brown, A., Furman, R., & Ishizuka, T. (2008). Development of cross-linguistic variation in speech and gesture: Motion events in English and Turkish. Developmental Psychology, 44(4), 1040–1054. https://doi.org/10.1037/0012-1649.44.4.1040
  • Pika, S., Nicoladis, E., & Marentette, P. F. (2006). A cross-cultural study on the use of gestures: Evidence for cross-linguistic transfer? Bilingualism: Language and Cognition, 9(3), 319–327. https://doi.org/10.1017/S1366728906002665
  • Ping, R., & Goldin-Meadow, S. (2010). Gesturing saves cognitive resources when talking about nonpresent objects. Cognitive Science, 34(4), 602–619. https://doi.org/10.1111/j.1551-6709.2010.01102.x
  • Rauscher, F. H., Krauss, R. M., & Chen, Y. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 7(4), 226–231. https://doi.org/10.1111/j.1467-9280.1996.tb00364.x
  • Sabourin, L., & Stowe, L. A. (2008). Second language processing: When are first and second languages processed similarly? Second Language Research, 24(3), 397–430. https://doi.org/10.1177/0267658308090186
  • Schwartz, B. L. (2006). Tip-of-the-tongue states as metacognition. Metacognition and Learning, 1(2), 149–158. https://doi.org/10.1007/s11409-006-9583-z
  • Seyfeddinipur, M. (2006). Disfluency: Interrupting speech and gesture [Doctoral dissertation]. Radboud University. https://repository.ubn.ru.nl/bitstream/handle/2066/41397/41397.pdf?sequence=1
  • Seyfeddinipur, M., & Kita, S. (2001, August 29–31). Gesture as an indicator of early error detection in self-monitoring of speech. ISCA tutorial and research workshop (ITRW) on disfluency in spontaneous speech, Edinburgh, Scotland, UK.
  • So, W. C. (2010). Cross-cultural transfer in gesture frequency in Chinese–English bilinguals. Language and Cognitive Processes, 25(10), 1335–1353. https://doi.org/10.1080/01690961003694268
  • Syndicate, U. C. L. E. (2001). Quick placement test. Oxford University Press.
  • Vilà-Giménez, I., & Prieto, P. (2020). Encouraging kids to beat: Children's beat gesture production boosts their narrative performance. Developmental Science, 23(6), e12967. https://doi.org/10.1111/desc.12967
  • Zhao, J. (2006). The communicative functions of gestures in L2 speech. Journal of Second Language Acquisition and Teaching, 13, 1–17.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.