References
- Amoruso, L., Couto, J., & Ibanez, A. (2011). Beyond extrastriate body area (EBA) and fusiform body area (FBA): Context integration in the meaning of actions. Frontiers in Human Neuroscience, 5(124). https://doi.org/https://doi.org/10.3389/fnhum.2011.00124
- Andric, M., & Small, S. (2012). Gesture’s neural language. Frontiers in Psychology, 3(99). https://doi.org/https://doi.org/10.3389/fpsyg.2012.00099
- Ardila, A., Bernal, B., & Rosselli, M. (2016). The role of Wernicke's area in language comprehension. Psychology & Neuroscience, 9(3), 340–343. https://doi.org/https://doi.org/10.1037/pne0000060
- Behrmann, M., Geng, J. J., & Shomstein, S. (2004). Parietal cortex and attention. Current Opinion in Neurobiology, 14(2), 212–217. https://doi.org/https://doi.org/10.1016/j.conb.2004.03.012
- Ben-Shabat, E., Matyas, T. A., Pell, G. S., Brodtmann, A., & Carey, L. M. (2015). The right supramarginal gyrus is important for proprioception in healthy and stroke-affected participants: A functional MRI study. Frontiers in Neurology, 6, 248–248. https://doi.org/https://doi.org/10.3389/fneur.2015.00248
- Bernard, J. A., B. Millman, Z., & Mittal, V. A. (2015). Beat and metaphoric gestures are differentially associated with regional cerebellar and cortical volumes. Human Brain Mapping, 36(10), 4016–4030. https://doi.org/https://doi.org/10.1002/hbm.22894
- Bernardis, P., & Gentilucci, M. (2006). Speech and gesture share the same communication system. Neuropsychologia, 44(2), 178–190. https://doi.org/https://doi.org/10.1016/j.neuropsychologia.2005.05.007
- Bernstein, L. E., & Liebenthal, E. (2014). Neural pathways for visual speech perception. Frontiers in Neuroscience, 8(386). https://doi.org/https://doi.org/10.3389/fnins.2014.00386
- Binder, J. R. (2015). The Wernicke area: Modern evidence and a reinterpretation. Neurology, 85(24), 2170–2175. https://doi.org/https://doi.org/10.1212/WNL.0000000000002219
- Binder, J. R., & Desai, R. H. (2011). The neurobiology of semantic memory. Trends in Cognitive Sciences, 15(11), 527–536. https://doi.org/https://doi.org/10.1016/j.tics.2011.10.001
- Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009). Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cerebral Cortex, 19(12), 2767–2796. https://doi.org/https://doi.org/10.1093/cercor/bhp055
- Brozzoli, C., Gentile, G., & Ehrsson, H. H. (2012). That's near my hand! parietal and premotor coding of hand-centered space contributes to localization and self-attribution of the hand. Journal of Neuroscience, 32(42), 14573–14582. https://doi.org/https://doi.org/10.1523/JNEUROSCI.2660-12.2012
- Buchsbaum, B. R., Hickok, G., & Humphries, G. (2001). Role of left posterior superior temporal gyrus in phonological processing for speech perception and production. Cognitive Science, 25(5), 663–678. https://doi.org/https://doi.org/10.1207/s15516709cog2505_2
- Calvert, G. A., & Campbell, R. (2003). Reading speech from still and moving faces: The neural substrates of visible speech. Journal of Cognitive Neuroscience, 15(1), 57–70. https://doi.org/https://doi.org/10.1162/089892903321107828
- Campbell, R. (2008). The processing of audiovisual speech: Empirical and neural bases. Philosophical Transactions of the Royal Society B: Biological Sciences, 363(1493), 1001–1010. https://doi.org/https://doi.org/10.1098/rstb.2007.2155
- Carlson, N. R. (2012). Physiology of behavior (11th ed.). Pearson.
- Celsis, P., Boulanouar, K., Doyon, B., Ranjeva, J. P., Berry, I., Nespoulous, J. L., & Chollet, F. (1999). Differential fMRI responses in the left posterior superior temporal gyrus and left supramarginal gyrus to habituation and change detection in syllables and tones. NeuroImage, 9(1), 135–144. https://doi.org/https://doi.org/10.1006/nimg.1998.0389
- Chang, E. F., Rieger, J. W., Johnson, K., Berger, M. S., Barbaro, N. M., & Knight, R. T. (2010). Categorical speech representation in human superior temporal gyrus. Nature Neuroscience, 13(11), 1428–1432. https://doi.org/https://doi.org/10.1038/nn.2641
- Chui, K. (2008). Complementary gestures and information types. Language and Linguistics, 9(1), 1–22.
- Chui, K. (2019). Language, gesture, and meaning. In C. Shei (Ed.), Routledge handbook of Chinese discourse analysis (pp. 244–261). Routledge.
- Chui, K., & Lai, H.-l. (2008). The NCCU Corpus of spoken Chinese: Mandarin, Hakka, and Southern Min. Taiwan Journal of Linguistics, 6(2), 119–144. https://doi.org/https://doi.org/10.6519/TJL.2008.6(2).5
- Chui, K., Lai, H.-l., & Chan, H.-C. (2017). Taiwan spoken Chinese corpus. In R. Sybesma (Ed.), Encyclopedia of Chinese language and linguistics (pp. 257–259). Brill.
- Chui, K., Lee, C.-Y., Yeh, K., & Chao, P.-C. (2018). Semantic processing of self-adaptors, emblems, and iconic gestures: An ERP study. Journal of Neurolinguistics, 47, 105–122. https://doi.org/https://doi.org/10.1016/j.jneuroling.2018.04.004
- Dennett, D. (1987). The intentional stance. MIT Press.
- DeWitt, I., & Rauschecker, J. P. (2013). Wernicke’s area revisited: Parallel streams and word processing. Brain and Language, 127(2), 181–191. https://doi.org/https://doi.org/10.1016/j.bandl.2013.09.014
- Dick, A. S., Goldin-Meadow, S., Hasson, U., Skipper, J. I., & Small, S. L. (2009). Co-speech gestures influence neural activity in brain regions associated with processing semantic information. Human Brain Mapping, 30(11), 3509–3526. https://doi.org/https://doi.org/10.1002/hbm.20774
- Dick, A. S., Mok, E. H., Beharelle, A. R., Goldin-Meadow, S., & Small, S. L. (2014). Frontal and temporal contributions to understanding the iconic co-speech gestures that accompany speech. Human Brain Mapping, 35(3), 900–917. https://doi.org/https://doi.org/10.1002/hbm.22222
- Ekman, P., & Friesen, W. V. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1), 49–98. https://doi.org/https://doi.org/10.1515/semi.1969.1.1.49
- Graves, W. W., Grabowski, T. J., Mehta, S., & Gupta, P. (2008). The left posterior superior temporal gyrus participates specifically in accessing lexical phonology. Journal of Cognitive Neuroscience, 20(9), 1698–1710. https://doi.org/https://doi.org/10.1162/jocn.2008.20113
- Green, A., Straube, B., Weis, S., Jansen, A., Willmes, K., Konrad, K., & Kircher, T. (2009). Neural integration of iconic and unrelated coverbal gestures: A functional MRI study. Human Brain Mapping, 30(10), 3309–3324. https://doi.org/https://doi.org/10.1002/hbm.20753
- Habets, B., Kita, S., Shao, Z., Özyurek, A., & Hagoort, P. (2011). The role of synchrony and ambiguity in speech-gesture integration during comprehension. Journal of Cognitive Neuroscience, 23(8), 1845–1854. https://doi.org/https://doi.org/10.1162/jocn.2010.21462
- He, Y., Gebhardt, H., Steines, M., Sammer, G., Kircher, T., Nagels, A., & Straube, B. (2015). The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech. Neuropsychologia, 72, 27–42. https://doi.org/https://doi.org/10.1016/j.neuropsychologia.2015.04.018
- Hirshorn, E. A., Li, Y., Ward, M. J., Richardson, R. M., Fiez, J. A., & Ghuman, A. S. (2016). Decoding and disrupting left midfusiform gyrus activity during word reading. Proceedings of the National Academy of Sciences, 113(29), 8162–8167. https://doi.org/https://doi.org/10.1073/pnas.1604126113
- Holle, H., Gunter, T. C., Rüschemeyer, S.-A., Hennenlotter, A., & Iacoboni, M. (2008). Neural correlates of the processing of co-speech gestures. NeuroImage, 39(4), 2010–2024. https://doi.org/https://doi.org/10.1016/j.neuroimage.2007.10.055
- Holle, H., Obleser, J., Rueschemeyer, S.-A., & Gunter, T. C. (2010). Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions. NeuroImage, 49(1), 875–884. https://doi.org/https://doi.org/10.1016/j.neuroimage.2009.08.058
- Kanwisher, N., & Yovel, G. (2006). The fusiform face area: A cortical region specialized for the perception of faces. Philosophical Transactions of the Royal Society B: Biological Sciences, 361(1476), 2109–2128. https://doi.org/https://doi.org/10.1098/rstb.2006.1934
- Kelly, S. D., Ward, S., Creigh, P., & Bartolotti, J. (2007). An intentional stance modulates the integration of gesture and speech during comprehension. Brain and Language, 101(3), 222–233. https://doi.org/https://doi.org/10.1016/j.bandl.2006.07.008
- Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge University Press.
- Kircher, T., Straube, B., Leube, D., Weis, S., Sachs, O., Willmes, K., Konrad, K., & Green, A. (2009). Neural interaction of speech and gesture: Differential activations of metaphoric co-verbal gestures. Neuropsychologia, 47(1), 169–179. https://doi.org/https://doi.org/10.1016/j.neuropsychologia.2008.08.009
- Koenigs, M., Barbey, A. K., Postle, B. R., & Grafman, J. (2009). Superior parietal cortex is critical for the manipulation of information in working memory. Journal of Neuroscience, 29(47), 14980–14986. https://doi.org/https://doi.org/10.1523/JNEUROSCI.3706-09.2009
- Kutas, M., & Federmeier, K. D. (2000). Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences, 4(12), 463–470. https://doi.org/https://doi.org/10.1016/S1364-6613(00)01560-6
- Leff, A. P., Schofield, T. M., Crinion, J. T., Seghier, M. L., Grogan, A., Green, D. W., & Price, C. J. (2009). The left superior temporal gyrus is a shared substrate for auditory short-term memory and speech comprehension: Evidence from 210 patients with stroke. Brain, 132(12), 3401–3410. https://doi.org/https://doi.org/10.1093/brain/awp273
- Lindenberg, R., Uhlig, M., Scherfeld, D., Schlaug, G., & Seitz, R. J. (2012). Communication with emblematic gestures: Shared and distinct neural correlates of expression and reception. Human Brain Mapping, 33(4), 812–823. https://doi.org/https://doi.org/10.1002/hbm.21258
- Lotze, M., Heymans, U., Birbaumer, N., Veit, R., Erb, M., Flor, H., & Halsband, U. (2006). Differential cerebral activation during observation of expressive gestures and motor acts. Neuropsychologia, 44(10), 1787–1795. https://doi.org/https://doi.org/10.1016/j.neuropsychologia.2006.03.016
- Lui, F., Buccino, G., Duzzi, D., Benuzzi, F., Crisi, G., Baraldi, P., Nichelli, P., Porro, C. A., & Rizzolatti, G. (2008). Neural substrates for observing and imagining non-object-directed actions. Social Neuroscience, 3(3/4), 261–275. https://doi.org/https://doi.org/10.1080/17470910701458551
- Marstaller, L., & Burianová, H. (2015). A common functional neural network for overt production of speech and gesture. Neuroscience, 284, 29–41. https://doi.org/https://doi.org/10.1016/j.neuroscience.2014.09.067
- McCarthy, G., Puce, A., Gore, J. C., & Allison, T. (1997). Face-specific processing in the human fusiform gyrus. Journal of Cognitive Neuroscience, 9(5), 605–610. https://doi.org/https://doi.org/10.1162/jocn.1997.9.5.605
- McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.
- McNeill, D. (2005). Gesture and thought. University of Chicago Press.
- Montgomery, K. J., Isenberg, N., & Haxby, J. V. (2007). Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Social Cognitive & Affective Neuroscience, 2(2), 114–122. https://doi.org/https://doi.org/10.1093/scan/nsm004
- Nichols, T., Brett, M., Andersson, J., Wager, T., & Poline, J.-B. (2005). Valid conjunction inference with the minimum statistic. NeuroImage, 25(3), 653–660. https://doi.org/https://doi.org/10.1016/j.neuroimage.2004.12.005
- Obermeier, C., & Gunter, T. C. (2015). Multisensory integration: The case of a time window of gesture-speech integration. Journal of Cognitive Neuroscience, 27(2), 292–307. https://doi.org/https://doi.org/10.1162/jocn_a_00688
- Obermeier, C., Holle, H., & Gunter, T. C. (2011). What iconic gesture fragments reveal about gesture-speech integration: When synchrony is lost, memory can help. Journal of Cognitive Neuroscience, 23(7), 1648–1663. https://doi.org/https://doi.org/10.1162/jocn.2010.21498
- Okada, K., Venezia, J. H., Matchin, W., Saberi, K., & Hickok, G. (2013). An fMRI study of audiovisual speech perception reveals multisensory interaction in auditory cortex. PLoSONE, 8(6), e68959. https://doi.org/https://doi.org/10.1371/journal.pone.0068959
- Ozker, M., Schepers, I. M., Magnotti, J. F., Yoshor, D., & Beauchamp, M. S. (2017). A double dissociation between anterior and posterior superior temporal gyrus for processing audiovisual speech demonstrated by electrocorticography. Journal of Cognitive Neuroscience, 29(6). 1044–1060. https://doi.org/https://doi.org/10.1162/jocn_a_01110
- Özyürek, A. (2014). Hearing and seeing meaning in speech and gesture: Insights from brain and behaviour. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), 20130296. https://doi.org/https://doi.org/10.1098/rstb.2013.0296
- Peelen, M. V., & Downing, P. E. (2005). Selectivity for the human body in the fusiform gyrus. Journal of Neurophysiology, 93(1), 603–608. https://doi.org/https://doi.org/10.1152/jn.00513.2004
- Schwarzlose, R. F., Baker, C. I., & Kanwisher, N. (2005). Separate face and body selectivity on the fusiform gyrus. Journal of Neuroscience, 25(47), 11055–11059. https://doi.org/https://doi.org/10.1523/JNEUROSCI.2621-05.2005
- Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007). Speech-associated gestures, Broca’s area, and the human mirror system. Brain and Language, 101(3), 260–277. https://doi.org/https://doi.org/10.1016/j.bandl.2007.02.008
- Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2009). Gestures orchestrate brain networks for language understanding. Current Biology, 19(8), 661–667. https://doi.org/https://doi.org/10.1016/j.cub.2009.02.051
- Stephan, K. E., Marshall, J. C., Friston, K. J., Rowe, J. B., Ritzl, A., Zilles, K., & Fink, G. R. (2003). Lateralized cognitive processes and lateralized task control in the human brain. Science, 301(5631), 384–386. https://doi.org/https://doi.org/10.1126/science.1086025
- Straube, B., Green, A., Bromberger, B., & Kircher, T. (2011). The differentiation of iconic and metaphoric gestures: Common and unique integration processes. Human Brain Mapping, 32(4), 520–533. https://doi.org/https://doi.org/10.1002/hbm.21041
- Straube, B., Green, A., Weis, S., & Kircher, T. (2012). A supramodal neural network for speech and gesture semantics: An fMRI study. PLOS ONE, 7(11), e51207. https://doi.org/https://doi.org/10.1371/journal.pone.0051207
- Taylor, J. C., Wiggett, A. J., & Downing, P. E. (2007). Functional MRI analysis of body and body part representations in the extrastriate and fusiform body areas. Journal of Neurophysiology, 98(3), 1626–1633. https://doi.org/https://doi.org/10.1152/jn.00012.2007
- Villarreal, M., Fridman, E. A., Amengual, A., Falasco, G., Gerscovich, E. R., Ulloa, E. R., & Leiguarda, R. C. (2008). The neural substrate of gesture recognition. Neuropsychologia, 46(9), 2371–2382. https://doi.org/https://doi.org/10.1016/j.neuropsychologia.2008.03.004
- Wang, J., Yang, Y., Fan, L., Xu, J., Li, C., Liu, Y., Fox, P. T., Eickhoff, S. B., Yu, C., & Jiang, T. (2015). Convergent functional architecture of the superior parietal lobule unraveled with multimodal neuroimaging approaches. Human Brain Mapping, 36(1), 238–257. https://doi.org/https://doi.org/10.1002/hbm.22626
- Weiner, K. S., & Zilles, K. (2016). The anatomical and functional specialization of the fusiform gyrus. Neuropsychologia, 83, 48–62. https://doi.org/https://doi.org/10.1016/j.neuropsychologia.2015.06.033
- Weisberg, J., Hubbard, A. L., & Emmorey, K. (2017). Multimodal integration of spontaneously produced representational co-speech gestures: An fMRI study. Language, Cognition and Neuroscience, 32(2), 158–174. https://doi.org/https://doi.org/10.1080/23273798.2016.1245426
- Willems, R. M., Özyürek, A., & Hagoort, P. (2007). When language meets action: The neural integration of gesture and speech. Cerebral Cortex, 17(10), 2322–2333. https://doi.org/https://doi.org/10.1093/cercor/bhl141
- Willems, R. M., Özyürek, A., & Hagoort, P. (2009). Differential roles for left inferior frontal and superior temporal cortex in multimodal integration of action and language. NeuroImage, 47(4), 1992–2004. https://doi.org/https://doi.org/10.1016/j.neuroimage.2009.05.066
- Wise, R. J. S., Scott, S. K., Blank, S. C., Mummery, C. J., Murphy, K., & Warburton, E. A. (2001). Separate neural subsystems within ‘wernicke's area’. Brain, 124(1), 83–95. https://doi.org/https://doi.org/10.1093/brain/124.1.83
- Wolpert, D. M., Miall, R. C., & Kawato, M. (1998). Internal models in the cerebellum. Trends in Cognitive Sciences, 2(9), 338–347. https://doi.org/https://doi.org/10.1016/S1364-6613(98)01221-2
- Wu, Y., Wang, J., Zhang, Y., Zheng, D., Zhang, J., Rong, M., Wu, H., Wang, Y., Zhou, K., & Jiang, T. (2016). The Neuroanatomical basis for posterior superior parietal lobule control lateralization of visuospatial attention. Frontiers in Neuroanatomy, 10, 32. https://doi.org/https://doi.org/10.3389/fnana.2016.00032
- Xu, J., Gannon, P. J., Emmorey, K., Smith, J. F., & Braun, A. R. (2009). Symbolic gestures and spoken language are processed by a common neural system. Proceedings of the National Academy of Sciences, 106(49), 20664–20669. https://doi.org/https://doi.org/10.1073/pnas.0909197106
- Yang, J., Andric, M., & Mathew, M. M. (2015). The neural basis of hand gesture comprehension: A meta-analysis of functional magnetic resonance imaging studies. Neuroscience & Biobehavioral Reviews, 57, 88–104. https://doi.org/https://doi.org/10.1016/j.neubiorev.2015.08.006