1,193
Views
15
CrossRef citations to date
0
Altmetric
Regular Articles

Visual-spatial and verbal abilities differentially affect processing of gestural vs. spoken expressions

&
Pages 896-914 | Received 04 Mar 2019, Accepted 29 Nov 2019, Published online: 18 Dec 2019
 

ABSTRACT

Listeners are sensitive to speakers’ co-speech iconic gestures. Concurrent visual and verbal information compete for attentional resources during multimodal comprehension. The current study examined the role of individual differences in visual-spatial vs. verbal abilities on individuals’ differential sensitivity to gestural vs. spoken expressions. Turkish-speaking adults (N = 83) were tested on their sensitivity to concurrent gesture vs. speech in an online task (Kelly, S. D., Özyürek, A., & Maris, E. (2010a). Two sides of the same coin. Psychological Science, 21(2), 260–267) and were administered spatial and verbal working memory measures. Participants were slower and less accurate when gesture and speech were incongruent to one another compared to the baseline condition, in which they expressed congruent information. People with higher spatial working memory capacity were more efficient in processing gestures whereas people with higher verbal working memory capacity were more sensitive to spoken expressions. These suggest that not all people are equally sensitive to co-speech gestures and some people may benefit more from gestures during comprehension.

Acknowledgements

We would like to thank Spencer Kelly for sharing the stimuli with us and Merve Tansan for assistance with data collection. We are grateful to the helpful feedback we received from Aslı Özyürek, Aylin Küntay, and Sami Gülgöz as well as the graduate students at Language & Cognition Lab and Language and Communication Development Lab at Koç University, particularly Aslı Aktan-Erciyes, Cansu Oranç, Berna Uzundağ, and Junko Kanero.

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This work was supported by Türkiye Bilimler Akademisi (Turkish Academy of Sciences) Outstanding Young Scientist Award 2018 given to Tilbe Göksun.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 53.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 444.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.