The role of co-speech gestures in retrieval and prediction during naturalistic multimodal narrative processing

References

• Alday, P. M., Schlesewsky, M., & Bornkessel-Schlesewsky, I. (2017). Electrophysiology reveals the neural dynamics of naturalistic auditory language processing: Event- related potentials reflect continuous model updates. ENeuro, 4), https://doi.org/10.1523/ENEURO.0311-16.2017
   PubMed Web of Science ®Google Scholar
• Alibali, M. W., & Kita, S. (2010). Gesture highlights perceptually present information for speakers. Gesture, 10(1), 3–28. https://doi.org/10.1075/gest.10.1.02ali
   Web of Science ®Google Scholar
• Andric, M., Solodkin, A., Buccino, G., Goldin-meadow, S., Rizzolatti, G., & Small, S. L. (2013). Brain function overlaps when people observe emblems, speech, and grasping. Neuropsychologia, 51(8), 1619–1629. https://doi.org/10.1016/j.neuropsychologia.2013.03.022
   PubMed Web of Science ®Google Scholar
• Armeni, K., Willems, R. M., van den Bosch, A., & Schoffelen, J. M. (2019). Frequency-specific brain dynamics related to prediction during language comprehension. NeuroImage, 198, 283–295. https://doi.org/10.1016/j.neuroimage.2019.04.083
   PubMed Web of Science ®Google Scholar
• Bosker, H. R., & Peeters, D. (2021). Beat gestures influence which speech sounds you hear. Proceedings of the Royal Society B: Biological Sciences, 288(1943), https://doi.org/10.1098/rspb.2020.2419
   PubMed Web of Science ®Google Scholar
• Broderick, M. P., Anderson, A. J., Di Liberto, G. M., Crosse, M. J., & Lalor, E. C. (2018). Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech. Current Biology, 28(5), 803–809.e3. https://doi.org/10.1016/j.cub.2018.01.080
   PubMed Web of Science ®Google Scholar
• Castellanos, N. P., & Makarov, V. A. (2006). Recovering EEG brain signals: Artifact suppression with wavelet enhanced independent component analysis. Journal of Neuroscience Methods, 158(2), 300–312. https://doi.org/10.1016/j.jneumeth.2006.05.033
   PubMed Web of Science ®Google Scholar
• Cho, H. C., & Abe, S. (2013). Is two-tailed testing for directional research hypotheses tests legitimate? Journal of Business Research, 66(9), 1261–1266. https://doi.org/10.1016/j.jbusres.2012.02.023
   Web of Science ®Google Scholar
• Crosse, M. J., Liberto, G. M. D., Bednar, A., & Lalor, E. C. (2016). The multivariate temporal response function (mTRF) toolbox: A MATLAB toolbox for relating neural signals to continuous stimuli. Frontiers in Human Neuroscience, 10, 1–14. https://doi.org/10.3389/fnhum.2016.00604
   PubMed Web of Science ®Google Scholar
• Cuevas, P., Steines, M., He, Y., Nagels, A., Culham, J., & Straube, B. (2019). The facilitative effect of gestures on the neural processing of semantic complexity in a continuous narrative. NeuroImage, 195, 38–47. https://doi.org/10.1016/j.neuroimage.2019.03.054
   PubMed Web of Science ®Google Scholar
• Dambacher, M., Kliegl, R., Hofmann, M., & Jacobs, A. M. (2006). Frequency and predictability effects on event-related potentials during Reading. Brain Research, 1084(1), 89–103. https://doi.org/10.1016/j.brainres.2006.02.010
   PubMed Web of Science ®Google Scholar
• de Cheveigné, A. (2019). ZapLine: a simple and effective method to remove power line artifacts. NeuroImage, 1(1), 1–13. https://doi.org/10.1101/782029
   Google Scholar
• Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9–21. https://doi.org/10.1016/j.jneumeth.2003.10.009
   PubMed Web of Science ®Google Scholar
• Delorme, A., Sejnowski, T., & Makeig, S. (2007). Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis. NeuroImage, 34(4), 1443–1449. https://doi.org/10.1016/j.neuroimage.2006.11.004
   PubMed Web of Science ®Google Scholar
• Digutsch, J., & Kosinski, M. (2023). Overlap in meaning is a stronger predictor of semantic activation in GPT-3 than in humans. Scientific Reports, 13(1), 1–7. https://doi.org/10.1038/s41598-023-32248-6
   PubMed Web of Science ®Google Scholar
• Drijvers, L., & Özyürek, A. (2017). Visual context enhanced: The joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech, Language, and Hearing Research, 60(1), 212–222. https://doi.org/10.1044/2016_JSLHR-H-16-0101
   PubMed Web of Science ®Google Scholar
• Ehinger, B. V., & Dimigen, O. (2019). Unfold: An integrated toolbox for overlap correction, non-linear modeling, and regression-based EEG analysis. PeerJ, 2019(10), e7838–e7833. https://doi.org/10.7717/peerj.7838
   Google Scholar
• Fabbri-Destro, M., Avanzini, P., De Stefani, E., Innocenti, A., Campi, C., & Gentilucci, M. (2015). Interaction between words and symbolic gestures as revealed by N400. Brain Topography, 28(4), 591–605. https://doi.org/10.1007/s10548-014-0392-4
   PubMed Web of Science ®Google Scholar
• Frank, S. L., Otten, L. J., Galli, G., & Vigliocco, G. (2015). The ERP response to the amount of information conveyed by words in sentences. Brain and Language, 140, 1–11. https://doi.org/10.1016/j.bandl.2014.10.006
   PubMed Web of Science ®Google Scholar
• Frank, S. L., & Willems, R. M. (2017). Word predictability and semantic similarity show distinct patterns of brain activity during language comprehension. Language, Cognition and Neuroscience, 32(9), 1192–1203. https://doi.org/10.1080/23273798.2017.1323109
   Web of Science ®Google Scholar
• Gabard-Durnam, L. J., Leal, A. S. M., Wilkinson, C. L., & Levin, A. R. (2018). The harvard automated processing pipeline for electroencephalography (HAPPE): Standardized processing software for developmental and high-artifact data. Frontiers in Neuroscience, 12, 97. https://doi.org/10.3389/fnins.2018.00097
   PubMed Web of Science ®Google Scholar
• Goldhahn, D., Eckart, T., & Quasthoff, U. (2012). Building large monolingual dictionaries at the Leipzig corpora collection: From 100 to 200 languages. Proceedings of the 8th International Conference on Language Resources and Evaluation, LREC 2012, 759–765.
   Google Scholar
• Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., Jansen, A., Gazula, H., Choe, G., Rao, A., Kim, C., Casto, C., Fanda, L., Doyle, W., Friedman, D., … Hasson, U. (2022). Shared computational principles for language processing in humans and deep language models. Nature Neuroscience, 25(3), 369–380. https://doi.org/10.1038/s41593-022-01026-4
   PubMed Web of Science ®Google Scholar
• Goodkind, A., & Bicknell, K. (2018). Predictive power of word surprisal for reading times is a linear function of language model quality. Proceedings of the 8th Workshop on Cognitive Modeling and Computational Linguistics, 10–18. https://doi.org/10.18653/v1/W18-0102
   Google Scholar
• Gratton, C., Nelson, S. M., & Gordon, E. M. (2022). Brain-behavior correlations: Two paths toward reliability. Neuron, 110(9), 1446–1449. https://doi.org/10.1016/j.neuron.2022.04.018
   PubMed Web of Science ®Google Scholar
• Hadar, U., & Butterworth, B. (1997). Iconic gesture, imagery and word retrieval in speech. Semiotica, 115(1-2), 147–172. https://doi.org/10.1515/semi.1997.115.1-2.147
   Web of Science ®Google Scholar
• Hadar, U., Wenkert-Olenik, D., Krauss, R., & Soroker, N. (1998). Gesture and the processing of speech: Neuropsychological evidence. Brain and Language, 62(1), 107–126. https://doi.org/10.1006/brln.1997.1890
   PubMed Web of Science ®Google Scholar
• Hale, J. T. (2001). A probabilistic earley parser as a psycholinguistic model. Proceedings of the Second Meeting of the North American Chapter of the Association for Computational Linguistics on Language Technologies, 1–8. https://doi.org/10.3115/1073336.1073357.
   Google Scholar
• Halgren, E., Dhond, R. P., Christensen, N., Van Petten, C., Marinkovic, K., Lewine, J. D., & Dale, A. M. (2002). N400-like magnetoencephalography responses modulated by semantic context, word frequency, and lexical class in sentences. NeuroImage, 17(3), 1101–1116. https://doi.org/10.1006/nimg.2002.1268
   PubMed Web of Science ®Google Scholar
• Hamilton, L. S., & Huth, A. G. (2020). The revolution will not be controlled: natural stimuli in speech neuroscience. Language, Cognition and Neuroscience, 35(5), 573–582. https://doi.org/10.1080/23273798.2018.1499946
   PubMed Web of Science ®Google Scholar
• He, Y., Gebhardt, H., Steines, M., Sammer, G., Kircher, T., Nagels, A., & Straube, B. (2015). The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech. Neuropsychologia, 72, 27–42. https://doi.org/10.1016/j.neuropsychologia.2015.04.018
   PubMed Web of Science ®Google Scholar
• He, Y., Luell, S., Muralikrishnan, R., Straube, B., & Nagels, A. (2020). Gesture’s body orientation modulates the N400 for visual sentences primed by gestures. Human Brain Mapping, 41(17), 4901–4911. https://doi.org/10.1002/hbm.25166
   PubMed Web of Science ®Google Scholar
• Heilbron, M., Armeni, K., Schoffelen, J. M., Hagoort, P., & De Lange, F. P. (2022). A hierarchy of linguistic predictions during natural language comprehension. Proceedings of the National Academy of Sciences of the United States of America, 119(32), 1–12. https://doi.org/10.1073/pnas.2201968119
   Web of Science ®Google Scholar
• Hintz, F., Khoe, Y. H., Strauß, A., Psomakas, A., & Holler, J. (2022). Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension. PsyArXiv. https://doi.org/10.31234/osf.io/avudx.
   Google Scholar
• Holle, H., & Gunter, T. C. (2007). The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience, 19(7), 1175–1192. https://doi.org/10.1162/jocn.2007.19.7.1175
   PubMed Web of Science ®Google Scholar
• Holle, H., Obermeier, C., Schmidt-Kassow, M., Friederici, A. D., Ward, J., & Gunter, T. C. (2012). Gesture facilitates the syntactic analysis of speech. Frontiers in Psychology, 3, 1–12. https://doi.org/10.3389/fpsyg.2012.00074
   PubMed Web of Science ®Google Scholar
• Holler, J., & Levinson, S. C. (2019). Multimodal language processing in human communication. Trends in Cognitive Sciences, 23(8), 639–652. https://doi.org/10.1016/j.tics.2019.05.006
   PubMed Web of Science ®Google Scholar
• Huizeling, E., Arana, S., Hagoort, P., & Schoffelen, J. M. (2022). Lexical frequency and sentence context influence the brain’s response to single words. Neurobiology of Language, 3(1), 149–179. https://doi.org/10.1162/nol_a_00054
   Google Scholar
• Jouravlev, O., Zheng, D., Balewski, Z., Le Arnz Pongos, A., Levan, Z., Goldin-Meadow, S., & Fedorenko, E. (2019). Speech-accompanying gestures are not processed by the language-processing mechanisms. Neuropsychologia, 132, 107132. https://doi.org/10.1016/j.neuropsychologia.2019.107132
   PubMed Web of Science ®Google Scholar
• Kandana Arachchige, K. G., Simoes Loureiro, I., Blekic, W., Rossignol, M., & Lefebvre, L. (2021). The role of iconic gestures in speech comprehension: An overview of various methodologies. Frontiers in Psychology, 12, 1–15. https://doi.org/10.3389/fpsyg.2021.634074
   Web of Science ®Google Scholar
• Kandylaki, K. D., & Bornkessel-Schlesewsky, I. (2019). From story comprehension to the neurobiology of language. Language, Cognition and Neuroscience, 34(4), 405–410. https://doi.org/10.1080/23273798.2019.1584679
   Web of Science ®Google Scholar
• Kelly, S. D., Kravitz, C., & Hopkins, M. (2004). Neural correlates of bimodal speech and gesture comprehension. Brain and Language, 89(1), 253–260. https://doi.org/10.1016/S0093-934X(03)00335-3
   PubMed Web of Science ®Google Scholar
• Kelly, S. D., Özyürek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21(2), 260–267. https://doi.org/10.1177/0956797609357327
   PubMed Web of Science ®Google Scholar
• Kretzschmar, F., Schlesewsky, M., & Staub, A. (2015). Dissociating word frequency and predictability effects in Reading: Evidence from coregistration of eye movements and EEG. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(6), 1648–1662. https://doi.org/10.1037/xlm0000128
   PubMed Web of Science ®Google Scholar
• Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62(1), 621–647. https://doi.org/10.1146/annurev.psych.093008.131123
   PubMed Web of Science ®Google Scholar
• Kutas, M., & Hillyard, S. (1980). Reading senseless sentences: Brain potentials reflect semantic incongruity. Science, 207(4427), 203–205. https://doi.org/10.1126/science.7350657
   PubMed Web of Science ®Google Scholar
• Lanyon, L., & Rose, M. L. (2009). Do the hands have it? The facilitation effects of arm and hand gesture on word retrieval in aphasia. Aphasiology, 23(7-8), 809–822. https://doi.org/10.1080/02687030802642044
   Web of Science ®Google Scholar
• Lau, E. F., Phillips, C., & Poeppel, D. (2008). A cortical network for semantics: (De)constructing the N400. Nature Reviews Neuroscience, 9(12), 920–933. https://doi.org/10.1038/nrn2532
   PubMed Web of Science ®Google Scholar
• Levy, R. P. (2008). Expectation-based syntactic comprehension. Cognition, 106(3), 1126–1177. https://doi.org/10.1016/j.cognition.2007.05.006
   PubMed Web of Science ®Google Scholar
• Maess, B., Mamashli, F., Obleser, J., Helle, L., & Friederici, A. D. (2016). Prediction signatures in the brain: Semantic pre-activation during language comprehension. Frontiers in Human Neuroscience, 10, 1–11. https://doi.org/10.3389/fnhum.2016.00591
   PubMed Web of Science ®Google Scholar
• Mahowald, K., Ivanova, A. A., Blank, I. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2023). Dissociating language and thought in large language models: a cognitive perspective. ArXiv Preprint ArXiv:2301.06627.
   Google Scholar
• McNeill, D. (2008). Gesture and thought. Chicago University Press.
   Google Scholar
• Meyer, L., Sun, Y., & Martin, A. E. (2020). Synchronous, but not entrained: exogenous and endogenous cortical rhythms of speech and language processing. Language, Cognition and Neuroscience, 35(9), 1089–1099. https://doi.org/10.1080/23273798.2019.1693050
   Web of Science ®Google Scholar
• Michaelov, J. A., Bardolph, M. D., Van Petten, C. K., Bergen, B. K., & Coulson, S. (2023). Strong prediction: Language model surprisal explains multiple N400 effects. Neurobiology of Language, 1–29. https://doi.org/10.1162/nol_a_00105
   Google Scholar
• Mognon, A., Jovicich, J., Bruzzone, L., & Buiatti, M. (2011). ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. Psychophysiology, 48(2), 229–240. https://doi.org/10.1111/j.1469-8986.2010.01061.x
   PubMed Web of Science ®Google Scholar
• Monsalve, I. F., Frank, S. L., & Vigliocco, G. (2012). Lexical surprisal as a general predictor of Reading time. EACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings, 398–408.
   Google Scholar
• Morett, L. M., Landi, N., Irwin, J., & McPartland, J. C. (2020). N400 amplitude, latency, and variability reflect temporal integration of beat gesture and pitch accent during language processing. Brain Research, 1747, 147059. https://doi.org/10.1016/j.brainres.2020.147059
   PubMed Web of Science ®Google Scholar
• Nieuwland, M. S., Barr, D. J., Bartolozzi, F., Busch-Moreno, S., Darley, E., Donaldson, D. I., Ferguson, H. J., Fu, X., Heyselaar, E., Huettig, F., Husband, E. M., Ito, A., Kazanina, N., Kogan, V., Kohút, Z., Kulakova, E., Mézière, D., Politzer-Ahles, S., Rousselet, G., … Von Grebmer Zu Wolfsthurn, S. (2020). Dissociable effects of prediction and integration during language comprehension: Evidence from a largescale study using brain potentials. Philosophical Transactions of the Royal Society B: Biological Sciences, 375(1791), https://doi.org/10.1098/rstb.2018.0522
   PubMed Web of Science ®Google Scholar
• Özyürek, A. (2014). Hearing and seeing meaning in speech and gesture: Insights from brain and behaviour. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), 20130296. https://doi.org/10.1098/rstb.2013.0296
   PubMed Web of Science ®Google Scholar
• Özyürek, A., Willems, R. M., Kita, S., & Hagoort, P. (2007). On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience, 19(4), 605–616. https://doi.org/10.1162/jocn.2007.19.4.605
   PubMed Web of Science ®Google Scholar
• Park, H., Ince, R. A. A., Schyns, P. G., Thut, G., & Gross, J. (2018). Representational interactions during audiovisual speech entrainment: Redundancy in left posterior superior temporal gyrus and synergy in left motor cortex. PLoS Biology, 16(8), 1–26. https://doi.org/10.1371/journal.pbio.2006558
   Web of Science ®Google Scholar
• Payne, B. R., Lee, C. L., & Federmeier, K. D. (2015). Revisiting the incremental effects of context on word processing: Evidence from single-word event-related brain potentials. Psychophysiology, 52(11), 1456–1469. https://doi.org/10.1111/psyp.12515
   PubMed Web of Science ®Google Scholar
• Pion-Tonachini, L., Kreutz-Delgado, K., & Makeig, S. (2019). ICLabel: An automated electroencephalographic independent component classifier, dataset, and website. NeuroImage, 198, 181–197. https://doi.org/10.1016/j.neuroimage.2019.05.026
   PubMed Web of Science ®Google Scholar
• Pouw, W., Wit, J. D., Bögels, S., Rasenberg, M., Milivojevic, B., & Ozyurek, A. (2021). Semantically related gestures move alike: Towards a distributional semantics of gesture kinematics. International Conference on Human-Computer Interaction, 269–287.
   Google Scholar
• Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI Blog, 1(8), 1–12. http://arxiv.org/abs/2007.07582
   Google Scholar
• Rayner, K., & Duffy, S. A. (1986). Lexical complexity and fixation times in Reading: Effects of word frequency, verb complexity, and lexical ambiguity. Memory & Cognition, 14(3), 191–201. https://doi.org/10.3758/BF03197692
   PubMed Web of Science ®Google Scholar
• Ryu, S. H., & Lewis, R. L. (2021). Accounting for agreement phenomena in sentence comprehension with transformer language models: Effects of similarity-based interference on surprisal and attention. CMCL 2021 - Workshop on Cognitive Modeling and Computational Linguistics, Proceedings, 61–71. https://doi.org/10.18653/v1/2021.cmcl-1.6.
   Google Scholar
• Sassenhagen, J. (2019). How to analyse electrophysiological responses to naturalistic language with time-resolved multiple regression. Language, Cognition and Neuroscience, 34(4), 474–490. https://doi.org/10.1080/23273798.2018.1502458
   Web of Science ®Google Scholar
• Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021). The neural architecture of language: Integrative modeling converges on predictive processing. Proceedings of the National Academy of Sciences of the United States of America, 118(45), 1–12. https://doi.org/10.1073/pnas.2105646118
   Web of Science ®Google Scholar
• Stein, B. E., & Stanford, T. R. (2008). Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience, 9(4), 255–266. https://doi.org/10.1038/nrn2331
   PubMed Web of Science ®Google Scholar
• Straube, B., Green, A., Weis, S., & Kircher, T. (2012). A supramodal neural network for speech and gesture semantics: An fMRI study. PLoS One, 7(11), 1–10. https://doi.org/10.1371/journal.pone.0051207
   Web of Science ®Google Scholar
• Straube, B., He, Y., Steines, M., Gebhardt, H., Kircher, T., Sammer, G., & Nagels, A. (2013). Supramodal neural processing of abstract information conveyed by speech and gesture. Frontiers in Behavioral Neuroscience, 7, 1–14. https://doi.org/10.3389/fnbeh.2013.00120
   PubMed Web of Science ®Google Scholar
• Sun, J., Wang, Z., & Tian, X. (2021). Manual gestures modulate early neural responses in loudness perception. Frontiers in Neuroscience, 15, 1–17. https://doi.org/10.3389/fnins.2021.634967
   Web of Science ®Google Scholar
• Szewczyk, J. M., & Schriefers, H. (2018). The N400 as an index of lexical preactivation and its implications for prediction in language comprehension. Language, Cognition and Neuroscience, 33(6), 665–686. https://doi.org/10.1080/23273798.2017.1401101
   Web of Science ®Google Scholar
• ter Bekke, M., Drijvers, L., & Holler, J. (2020). The predictive potential of hand gestures during conversation: An investigation of the timing of gestures in relation to speech. PsyArXiv. https://doi.org/10.31234/osf.io/b5zq7.
   Google Scholar
• Trujillo, J., Özyürek, A., Holler, J., & Drijvers, L. (2021). Speakers exhibit a multimodal Lombard effect in noise. Scientific Reports, 11(1), 1–12. https://doi.org/10.1038/s41598-021-95791-0
   PubMed Web of Science ®Google Scholar
• Van Petten, C., & Kutas, M. (1990). Interactions between sentence context and word frequencyinevent-related brainpotentials. Memory & Cognition, 18(4), 380–393. https://doi.org/10.3758/BF03197127
   PubMed Web of Science ®Google Scholar
• Wang, L., & Chu, M. (2013). The role of beat gesture and pitch accent in semantic processing: an ERP study. Neuropsychologia, 51(13), 2847–2855. https://doi.org/10.1016/j.neuropsychologia.2013.09.027
   PubMed Web of Science ®Google Scholar
• Weissbart, H., Kandylaki, K. D., & Reichenbach, T. (2019). Cortical tracking of surprisal during continuous speech comprehension. Journal of Cognitive Neuroscience, 32(1), 155–166. https://doi.org/10.1162/jocn_a_01467
   PubMed Web of Science ®Google Scholar
• Willems, R. M., Frank, S. L., Nijhof, A. D., Hagoort, P., & Van Den Bosch, A. (2016). Prediction during natural language comprehension. Cerebral Cortex, 26(6), 2506–2516. https://doi.org/10.1093/cercor/bhv075
   PubMed Web of Science ®Google Scholar
• Willems, R. M., Nastase, S. A., & Milivojevic, B. (2020). Narratives for neuroscience. Trends in Neurosciences, 43(5), 271–273. https://doi.org/10.1016/j.tins.2020.03.003
   PubMed Web of Science ®Google Scholar
• Willems, R. M., Özyürek, A., & Hagoort, P. (2007). When language meets action: The neural integration of gesture and speech. Cerebral Cortex, 17(10), 2322–2333. https://doi.org/10.1093/cercor/bhl141
   PubMed Web of Science ®Google Scholar
• Winkler, I., Haufe, S., & Tangermann, M. (2011). Automatic classification of artifactual ICA-components for artifact removal in EEG signals. Behavioral and Brain Functions, 7(1), 30. https://doi.org/10.1186/1744-9081-7-30
   PubMed Web of Science ®Google Scholar
• Wu, Y. C., & Coulson, S. (2005). Meaningful gestures: Electrophysiological indices of iconic gesture comprehension. Psychophysiology, 42(6), 654–667. https://doi.org/10.1111/j.1469-8986.2005.00356.x
   PubMed Web of Science ®Google Scholar
• Xu, J., Gannon, P. J., Emmorey, K., Smith, J. F., & Braun, A. R. (2009). Symbolic gestures and spoken language are processed by a common neural system. Proceedings of the National Academy of Sciences of the United States of America, 106(49), 20664–20669. https://doi.org/10.1073/pnas.0909197106
   PubMed Web of Science ®Google Scholar
• Yan, S., & Jaeger, T. F. (2020). (Early) context effects on event-related potentials over natural inputs. Language, Cognition and Neuroscience, 35(5), 658–679. https://doi.org/10.1080/23273798.2019.1597979
   PubMed Web of Science ®Google Scholar
• Zhang, S., Jixing, L., Yang, Y., & Hale, J. (2022). Decoding the silence: Neural bases of zero pronoun resolution in Chinese. Brain and Language, 224, 105050. https://doi.org/10.1016/j.bandl.2021.105050
   PubMed Web of Science ®Google Scholar
• Zhang, Y., Frassinelli, D., Tuomainen, J., Skipper, J. I., & Vigliocco, G. (2021). More than words: Word predictability, prosody, gesture and mouth movements in natural language comprehension. Proceedings of the Royal Society B: Biological Sciences, 288, 20210500. https://doi.org/10.1098/rspb.2021.0500
   PubMed Web of Science ®Google Scholar