Multisensory integration processes underlying speech perception as revealed by the McGurk illusion

References

• Alink, A., Schwiedrzik, C. M., Kohler, A., Singer, W., & Muckli, L. (2010). Stimulus predictability reduces responses in primary visual cortex. The Journal of Neuroscience, 30(8), 2960–2966. doi:10.1523/JNEUROSCI.3730-10.2010
   PubMed Web of Science ®Google Scholar
• Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 15(9), 839–843. doi:10.1016/j.cub.2005.03.046
   PubMed Web of Science ®Google Scholar
• Alsius, A., Navarra, J., & Soto-Faraco, S. (2007). Attention to touch weakens audiovisual speech integration. Experimental Brain Research, 183(3), 399–404. doi:10.1007/s00221-007-1110-1
   PubMed Web of Science ®Google Scholar
• Altieri, N. (2014). Multisensory integration, learning, and the predictive coding hypothesis. Frontiers in Psychology, 5. doi:10.3389/fpsyg.2014.00257
   Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.
   Google Scholar
• Andersen, T. S., Tiippana, K., Laarni, J., Kojo, I., & Sams, M. (2009). The role of visual spatial attention in audiovisual speech perception. Speech Communication, 51(2), 184–193. doi:10.1016/j.specom.2008.07.004
   Web of Science ®Google Scholar
• Arbib, M. A. (2005). From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics. Behavioral and Brain Sciences, 28(02), 105–124.
   PubMed Web of Science ®Google Scholar
• Bastien-Toniazzo, M., Stroumza, A., & Cavé, C. (2010). Audio-visual perception and integration in developmental dyslexia: An exploratory study using the McGurk effect. Current psychology letters. Behaviour, Brain & Cognition, 25(3), 2–15.
   Google Scholar
• Baum, S. H., Martin, R. C., Hamilton, A. C., & Beauchamp, M. S. (2012). Multisensory speech perception without the left superior temporal sulcus. NeuroImage, 62(3), 1825–1832. doi:10.1016/j.neuroimage.2012.05.034
   PubMed Web of Science ®Google Scholar
• Beauchamp, M. S., Nath, A. R., & Pasalar, S. (2010). fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. The Journal of Neuroscience, 30(7), 2414–2417. doi:10.1523/JNEUROSCI.4865-09.2010
   PubMed Web of Science ®Google Scholar
• Besle, J., Fort, A., Delpuech, C., & Giard, M. H. (2004). Bimodal speech: Early suppressive visual effects in human auditory cortex. European Journal of Neuroscience, 20(8), 2225–2234. doi:10.1111/j.1460-9568.2004.03670.x
   PubMed Web of Science ®Google Scholar
• Bolognini, N., Rossetti, A., Maravita, A., & Miniussi, C. (2011). Seeing touch in the somatosensory cortex: A TMS study of the visual perception of touch. Human Brain Mapping, 32(12), 2104–2114. doi:10.1002/hbm.21172
   PubMed Web of Science ®Google Scholar
• Bovo, R., Ciorba, A., Prosser, S., & Martini, A. (2009). The McGurk phenomenon in Italian listeners. Acta Otorhinolaryngologica Italica, 29(4), 203–208.
   PubMed Web of Science ®Google Scholar
• Brancazio, L., Miller, J. L., & Paré, M. A. (2003). Visual influences on the internal structure of phonetic categories. Perception & Psychophysics, 65(4), 591–601. doi:10.3758/BF03194585
   PubMed Web of Science ®Google Scholar
• Bristow, D., Dehaene-Lambertz, G., Mattout, J., Soares, C., Gliga, T., Baillet, S., & Mangin, J. F. (2008). Hearing faces: How the infant brain matches the face it sees with the speech it hears. Journal of Cognitive Neuroscience, 21(5), 905–921. doi:10.1162/jocn.2009.21076
   Web of Science ®Google Scholar
• Burgmeier, R., Desai, R. U., Farner, K. C., Tiano, B., Lacey, R., Volpe, N. J., & Mets, M. B. (2015). The effect of amblyopia on visual-auditory speech perception: Why mothers may say “Look At Me When I’m Talking To You”. JAMA Ophthalmology, 133(1), 11–16. doi:10.1001/jamaophthalmol.2014.3307
   PubMed Web of Science ®Google Scholar
• Burnham, D. (1998). Harry McGurk and the McGurk effect. In AVSP’98 International Conference on Auditory-Visual Speech Processing.
   Google Scholar
• Burnham, D., & Dodd, B. (2004). Auditory–visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect. Developmental Psychobiology, 45(4), 204–220. doi:10.1002/dev.20032
   PubMed Web of Science ®Google Scholar
• Bushara, K. O., Grafman, J., & Hallett, M. (2001). Neural correlates of auditory-visual stimulus onset asynchrony detection. The Journal of Neuroscience, 21(1), 300–304.
   PubMed Web of Science ®Google Scholar
• Chen, Y., & Hazan, V. (2009). Developmental factor and the nonnative speaker effect in auditory-visual speech perception. Journal of the Acoustical Society of America, 126, 858–865. doi:10.1121/1.3158823
   PubMed Web of Science ®Google Scholar
• Cienkowski, K. M., & Carney, A. E. (2002). Auditory-visual speech perception and aging. Ear and Hearing, 23(5), 439–449. doi:10.3389/fpsyg.2014.00323
   PubMed Web of Science ®Google Scholar
• Clark, G. (2003). Cochlear implants in children: Safety as well as speech and language. International Congress Series, 1254, 7–25. doi:10.1016/j.ijporl.2003.08.006
   Google Scholar
• Colin, C., Radeau, M., & Deltenre, P. (2005). Top-down and bottom-up modulation of audiovisual integration in speech. European Journal of Cognitive Psychology, 17(4), 541–560. doi:10.1080/09541440440000168
   Web of Science ®Google Scholar
• Colin, C., Radeau, M., Soquet, A., Demolin, D., Colin, F., & Deltenre, P. (2002). Mismatch negativity evoked by the McGurk–MacDonald effect: A phonetic representation within short-term memory. Clinical Neurophysiology, 113(4), 495–506. doi:10.1016/S1388-2457(02)00024-X
   PubMed Web of Science ®Google Scholar
• Costa, T. L., Costa, M. F., Magalhães, A., Rêgo, G. G., Nagy, B. V., Boggio, P. S., & Ventura, D. F. (2015). The role of early stages of cortical visual processing in size and distance judgment: A transcranial direct current stimulation study. Neuroscience Letters, 588, 78–82. doi:10.1016/j.neulet.2014.12.055
   PubMed Web of Science ®Google Scholar
• Deas, L., Wilcox, L. M., Kazimi, A., & Allison, R. S. (2013). Audio-visual integration in stereoscopic 3D. Proceedings of the ACM Symposium on Applied Perception – SAP, 13, 83. doi:10.1145/2492494.2492506
   Google Scholar
• Erickson, L. C., Zielinski, B. A., Zielinski, J. E., Liu, G., Turkeltaub, P. E., Leaver, A. M., & Rauschecker, J. P. (2014). Distinct cortical locations for integration of audiovisual speech and the McGurk effect. Frontiers in Psychology, 5. doi:10.3389/fpsyg.2014.00534
   PubMed Web of Science ®Google Scholar
• Fingelkurts, A. A., Fingelkurts, A. A., Krause, C. M., Möttönen, R., & Sams, M. (2003). Cortical operational synchrony during audio–visual speech integration. Brain and Language, 85(2), 297–312. doi:10.1016/S0093-934X(03)00059-2
   PubMed Web of Science ®Google Scholar
• Fixmer, E., & Hawkins, S. (1998). The influence of quality of information on the McGurk effect. In: AVSP’98 international conference on auditory-visual speech processing.
   Google Scholar
• Fowler, C. A., & Dekle, D. J. (1991). Listening with eye and hand: Cross-modal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance, 17(3), 816. doi:10.1037/0096-1523.17.3.816
   PubMed Web of Science ®Google Scholar
• Fujisaki, W., Shimojo, S., Kashino, M., & Nishida, S. Y. (2004). Recalibration of audiovisual simultaneity. Nature Neuroscience, 7(7), 773–778. doi:10.1038/nn1268
   PubMed Web of Science ®Google Scholar
• de Gelder, B., Vroomen, J., Annen, L., Masthof, E., & Hodiamont, P. (2003). Audio-visual integration in Schizophrenia. Schizophrenia Research, 59(2), 211–218. doi:10.1016/S0920-9964(01)00344-9
   PubMed Web of Science ®Google Scholar
• de Gelder, B. D., Parnas, J., Bovet, P., Vroomen, J., Popelier, T. J. H., & Innocenti, G. M. (1997). Impaired integration of audition and vision in schizophrenics. Experimental Brain Research, 117, S23.
   Google Scholar
• Gentilucci, M., & Cattaneo, L. (2005). Automatic audiovisual integration in speech perception. Experimental Brain Research, 167(1), 66–75. doi:10.1007/s00221-005-0008-z
   PubMed Web of Science ®Google Scholar
• Gentilucci, M., & Corballis, M. C. (2006). From manual gesture to speech: A gradual transition. Neuroscience & Biobehavioral Reviews, 30(7), 949–960. doi:10.1016/j.neubiorev.2006.02.004
   PubMed Web of Science ®Google Scholar
• Gibson, J. (1979). The ecological approach to visual perception.
   Google Scholar
• Gibson, J. J. (1966). The senses considered as perceptual systems. Journal of the British Society for Phenomenology. doi:10.1080/00071773.1971.11006191
   Google Scholar
• Green, K. P., & Gerdeman, A. (1995). Cross-Modal discrepancies in coarticulation and the integration of speech information: The McGurk effect with mismatched vowels. Journal of Experiment Psychology: Human Perception and Performance, 21(6), 1409–1426. doi:10.1037/0096-1523.21.6.1409
   PubMed Web of Science ®Google Scholar
• Green, K. P., & Kuhl, P. K. (1991). Integral processing of visual place and auditory voicing information during phonetic perception. Journal of Experimental Psychology. Human Perception and Performance, 17(1), 278–288. doi:10.1037/0096-1523.17.1.278
   PubMed Web of Science ®Google Scholar
• Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50(6), 524–536. doi: 10.3758/BF03207536
   PubMed Web of Science ®Google Scholar
• Gurler, D., Doyle, N., Walker, E., Magnotti, J., & Beauchamp, M. (2015). A link between individual differences in multisensory speech perception and eye movements. Attention, Perception, & Psychophysics, 1–9. doi:10.3758/s13414-014-0821-1
   Web of Science ®Google Scholar
• Hardison, D. M. (1999). Bimodal speech perception by native and nonnative speakers of English: Factors influencing the McGurk effect. Language Learning, 49(1), 213–283. doi:10.1111/0023-8333.49.s1.7
   Web of Science ®Google Scholar
• Hazan, V., & Li, E. (2008). The effect of auditory and visual degradation on audiovisual perception of native and non-native speakers. Interspeech, 1191–1194. doi:10.1016/j.specom.2010.05.003
   Google Scholar
• Heinrichs, R. W., & Zakzanis, K. K. (1998). Neurocognitive deficit in schizophrenia: A quantitative review of the evidence. Neuropsychology, 12(3), 426–445. doi:10.1037/0894-4105.12.3.426
   PubMed Web of Science ®Google Scholar
• Jones, J. A., & Callan, D. E. (2003). Brain activity during audiovisual speech perception: An fMRI study of the McGurk effect. Neuroreport, 14(8), 1129–1133. doi: 10.1097/00001756-200306110-00006
   PubMed Web of Science ®Google Scholar
• Keane, B. P., Rosenthal, O., Chun, N. H., & Shams, L. (2010). Audiovisual integration in high functioning adults with autism. Research in Autism Spectrum Disorders, 4(2), 276–289. doi:10.1016/j.rasd.2009.09.015
   Web of Science ®Google Scholar
• Keil, J., Müller, N., Ihssen, N., & Weisz, N. (2012). On the variability of the McGurk effect: Audiovisual integration depends on prestimulus brain states. Cerebral Cortex, 22(1), 221–231. doi:10.1093/cercor/bhr125
   PubMed Web of Science ®Google Scholar
• Kilian-Hütten, N., Vroomen, J., & Formisano, E. (2011). Brain activation during audiovisual exposure anticipates future perception of ambiguous speech. Neuroimage, 57(4), 1601–1607. doi:10.1016/j.neuroimage.2011.05.043
   PubMed Web of Science ®Google Scholar
• Kislyuk, D. S., Möttönen, R., & Sams, M. (2008). Visual processing affects the neural basis of auditory discrimination. Journal of Cognitive Neuroscience, 20(12), 2175–2184. doi:10.1162/jocn.2008.20152
   PubMed Web of Science ®Google Scholar
• Knill, D. C., & Pouget, A. (2004). The Bayesian brain: The role of uncertainty in neural coding and computation. Trends in Neurosciences, 27(12), 712–719. doi:10.1016/j.tins.2004.10.007
   PubMed Web of Science ®Google Scholar
• Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21(1), 1–36. doi:10.1016/0010-0277(85)90021-6
   PubMed Web of Science ®Google Scholar
• Luck, S. J. (2005). An introduction to the event-related potential technique (p. 388). Cambridge, MA: MIT press.
   Google Scholar
• Mallick, D. B., Magnotti, J. F., & Beauchamp, M. S. (2015). Variability and stability in the McGurk effect: Contributions of participants, stimuli, time, and response type. Psychonomic Bulletin & Review, 1–9. doi:10.3758/s13423-015-0817-4
   PubMed Web of Science ®Google Scholar
• Marques, L. M., Lapenta, O. M., Merabet, L. B., Bolognini, N., & Boggio, P. S. (2014). Tuning and disrupting the brain-modulating the McGurk illusion with electrical stimulation. Frontiers in Human Neuroscience, 8. doi:10.3389/fnhum.2014.00533
   PubMed Web of Science ®Google Scholar
• Massaro, D. W. (1984). Children’s perception of visual and auditory speech. Child Development, 1777–1788. doi:10.2307/1129925
   PubMed Web of Science ®Google Scholar
• Massaro, D. W. (1987). Psychophysics versus specialized processes in speech perception: An alternative perspective. The Psychophysics of Speech Perception, 39, 46–65. doi:10.1007/978-94-009-3629-4_3
   Google Scholar
• Massaro, D. W., & Chen, T. H. (2008). The motor theory of speech perception revisited. Psychonomic Bulletin & Review, 15(2), 453–457. doi:10.3758/PBR.15.2.453
   PubMed Web of Science ®Google Scholar
• Massaro, D. W., & Cohen, M. M. (1993). Perceiving asynchronous bimodal speech in consonant-vowel and vowel syllables. Speech Communication, 13(1), 127–134. doi:10.1016/0167-6393(93)90064-R
   Web of Science ®Google Scholar
• Massaro, D. W., & Cohen, M. M. (2000). Tests of auditory–visual integration efficiency within the framework of the fuzzy logical model of perception. The Journal of the Acoustical Society of America, 108(2), 784–789. doi:10.1121/1.429611
   PubMed Web of Science ®Google Scholar
• Massaro, D. W., Cohen, M. M., Gesi, A., & Heredia, R. (1993). Bimodal speech perception: An examination across languages. Journal of Phonetics, 21, 445–478.
   Web of Science ®Google Scholar
• Massaro, D. W., Thompson, L. A., Barron, B., & Laren, E. (1986). Developmental changes in visual and auditory contributions to speech perception. Journal of Experimental Child Psychology, 41(1), 93–113. doi:10.1016/0022-0965(86)90053-6
   PubMed Web of Science ®Google Scholar
• McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.
   Google Scholar
• Mongillo, E. A., Irwin, J. R., Whalen, D. H., Klaiman, C., Carter, A. S., & Schultz, R. T. (2008). Audiovisual processing in children with and without autism spectrum disorders. Journal of Autism and Developmental Disorders, 38(7), 1349–1358. doi:10.1007/s10803-007-0521-y
   PubMed Web of Science ®Google Scholar
• Munhall, K. G., Gribble, P., Sacco, L., & Ward, M. (1996). Temporal constraints on the McGurk effect. Perception & Psychophysics, 58(3), 351–362. doi: 10.3758/BF03206811
   PubMed Web of Science ®Google Scholar
• Narinesingh, C., Wan, M., Goltz, H. C., Chandrakumar, M., & Wong, A. M. (2014). Audiovisual perception in adults with amblyopia: A study using the McGurk effect. Investigative Ophthalmology & Visual Science, 55(5), 3158–3164. doi: 10.1167/iovs.14-14140
   PubMed Web of Science ®Google Scholar
• Nath, A. R., & Beauchamp, M. S. (2012). A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimage, 59(1), 781–787. doi:10.1016/j.neuroimage.2011.07.024
   PubMed Web of Science ®Google Scholar
• Nicholls, M. E., Searle, D. A., & Bradshaw, J. L. (2004). Read my lips asymmetries in the visual expression and perception of speech revealed through the McGurk effect. Psychological Science, 15(2), 138–141. doi:10.1111/j.0963-7214.2004.01502011.x
   PubMed Web of Science ®Google Scholar
• Norrix, L. W., Plante, E., & Vance, R. (2006). Auditory–visual speech integration by adults with and without language-learning disabilities. Journal of Communication Disorders, 39(1), 22–36. doi:10.1016/j.jcomdis.2005.05.003
   PubMed Web of Science ®Google Scholar
• Norrix, L. W., Plante, E., Vance, R., & Boliek, C. A. (2007). Auditory-visual integration for speech by children with and without specific language impairment. Journal of Speech, Language, and Hearing Research, 50(6), 1639–1651. doi:10.1044/1092-4388(2007/111)
   PubMed Web of Science ®Google Scholar
• Olasagasti, I., Bouton, S., & Giraud, A. L. (2015). Prediction across sensory modalities: A neurocomputational model of the McGurk effect. Cortex, 68, 61–75. doi:10.1016/j.cortex.2015.04.008
   PubMed Web of Science ®Google Scholar
• Paré, M., Richler, R. C., ten Hove, M., & Munhall, K. G. (2003). Gaze behavior in audiovisual speech perception: The influence of ocular fixations on the McGurk effect. Perception & Psychophysics, 65(4), 553–567. doi:10.3758/BF03194582
   PubMed Web of Science ®Google Scholar
• Pearl, D., Yodashkin-Porat, D., Katz, N., Valevski, A., Aizenberg, D., Sigler, M., … Kikinzon, L. (2009). Differences in audiovisual integration, as measured by McGurk phenomenon, among adult and adolescent patients with schizophrenia and age-matched healthy control groups. Comprehensive Psychiatry, 50(2), 186–192. doi:10.1016/j.comppsych.2008.06.004
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F., Shtyrov, Y., & Ilmoniemi, R. (2005). Brain signatures of meaning access in action word recognition. Journal of Cognitive Neuroscience, 17(6), 884–892. doi:10.1162/0898929054021111
   PubMed Web of Science ®Google Scholar
• Rizzolatti, C. (2005). The mirror neuron system and imitation. Perspectives on Imitation: Mechanisms of Imitation and Imitation in Animals, 1, 55. doi:10.1146/annurev.neuro.27.070203.144230
   Google Scholar
• Roberts, M., & Summerfield, Q. (1981). Audiovisual presentation demonstrates that selective adaptation in speech perception is purely auditory. Perception & Psychophysics, 30(4), 309–314. doi: 10.3758/BF03206144
   PubMed Web of Science ®Google Scholar
• Rosenblum, L. D., & Saldaña, H. M. (1992). Discrimination tests of visually influenced syllables. Perception & Psychophysics, 52(4), 461–473. doi: 10.3758/BF03206706
   PubMed Web of Science ®Google Scholar
• Rosenblum, L. D., Schmuckler, M. A., & Johnson, J. A. (1997). The McGurk effect in infants. Perception & Psychophysics, 59(3), 347–357. doi: 10.3758/BF03211902
   PubMed Web of Science ®Google Scholar
• Ross, L. A., Saint-Amour, D., Leavitt, V. M. Molholm, S., Javitt, D. C., & Foxe, J. J. (2007). Impaired multisensory processing in Schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophrenia Research, 97(1), 173–183. doi:10.1016/j.schres.2007.08.008
   PubMed Web of Science ®Google Scholar
• Rouger, J., Fraysse, B., Deguine, O., & Barone, P. (2008). McGurk effects in cochlear-implanted deaf subjects. Brain Research, 1188, 87–99. doi:10.1016/j.brainres.2007.10.049
   PubMed Web of Science ®Google Scholar
• Saalasti, S., Tiippana, K., Kätsyri, J., & Sams, M. (2011). The effect of visual spatial attention on audiovisual speech perception in adults with Asperger syndrome. Experimental Brain Research, 213(2–3), 283–290. doi:10.1007/s00221-011-2751-7
   PubMed Web of Science ®Google Scholar
• Saint-Amour, D., De Sanctis, P., Molholm, S., Ritter, W., & Foxe, J. J. (2007). Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia, 45(3), 587–597. doi:10.1016/j.neuropsychologia.2006.03.036
   PubMed Web of Science ®Google Scholar
• Sams, M., Aulanko, R., Hämäläinen, M., Hari, R., Lounasmaa, O. V., Lu, S. T., & Simola, J. (1991). Seeing speech: Visual information from lip movements modifies activity in the human auditory cortex. Neuroscience Letters, 127(1), 141–145. doi:10.1016/0304-3940(91)90914-F
   PubMed Web of Science ®Google Scholar
• Sams, M., Manninen, P., Surakka, V., Helin, P., & Kättö, R. (1998). McGurk effect in Finnish syllables, isolated words, and words in sentences: Effects of word meaning and sentence context. Speech Communication, 26(1), 75–87. doi:10.1016/S0167-6393(98)00051-x
   Web of Science ®Google Scholar
• Sams, M., Möttönen, R., & Sihvonen, T. (2005). Seeing and hearing others and oneself talk. Cognitive Brain Research, 23(2), 429–435. doi:10.1016/j.cogbrainres.2004.11.006
   PubMedGoogle Scholar
• Samuel, A. G. (2011). Speech perception. Annual Review of Psychology, 62, 49–72. doi:10.1146/annurev.psych.121208.131643
   PubMed Web of Science ®Google Scholar
• Schorr, E. A., Fox, N. A., van Wassenhove, V., & Knudsen, E. I. (2005). Auditory-visual fusion in speech perception in children with cochlear implants. Proceedings of the National Academy of Sciences of the United States of America, 102(51), 18748–18750. doi:10.1073/pnas.0508862102
   PubMed Web of Science ®Google Scholar
• Sekiyama, K. (1997). Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception & Psychophysics, 59(1), 73–80. doi:10.3758/BF03206849
   PubMed Web of Science ®Google Scholar
• Sekiyama, K., & Burnham, D. (2008). Impact of language on development of auditory-visual speech perception. Developmental Science, 11(2), 306–320. doi:10.1111/j.1467-7687.2008.00677.x
   PubMed Web of Science ®Google Scholar
• Sekiyama, K., Kanno, I., Miura, S., & Sugita, Y. (2003). Auditory-visual speech perception examined by fMRI and PET. Neuroscience Research, 47(3), 277–287. doi:10.1016/S0168-0102(03)00214-1
   PubMed Web of Science ®Google Scholar
• Sekiyama, K., & Tohkura, Y. I. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. The Journal of the Acoustical Society of America, 90(4), 1797–1805. doi: 10.1121/1.401660
   PubMed Web of Science ®Google Scholar
• Sekiyama, K., & Tohkura, Y. I. (1993). Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics, 4, 427–444.
   Google Scholar
• Shigeno, S. (2000). Influence of vowel context on the audio-visual speech perception of voiced stop consonants. Japanese Psychological Research, 42(3), 155–167. doi:10.1093/schbul/sbr052
   Web of Science ®Google Scholar
• Silverstein, S. M., & Keane, B. P. (2011). Perceptual organization impairment in schizophrenia and associated brain mechanisms: Review of research from 2005 to 2010. Schizophrenia Bulletin, 37(4), 690–699. doi:10.1093/schbul/sbr052
   PubMed Web of Science ®Google Scholar
• Skipper, J. I., van Wassenhove, V., Nusbaum, H. C., & Small, S. L. (2007). Hearing lips and seeing voices: How cortical areas supporting speech production mediate audiovisual speech perception. Cerebral Cortex, 17(10), 2387–2399. doi:10.1093/cercor/bhl147
   PubMed Web of Science ®Google Scholar
• Smith, E. G., & Bennetto, L. (2007). Audiovisual speech integration and lipreading in autism. Journal of Child Psychology and Psychiatry, 48, 813–821. doi:10.1111/j.1469-7610.2007.01766.x
   PubMed Web of Science ®Google Scholar
• Soto-Faraco, S., & Alsius, A. (2009). Desconstructing the McGurk-MacDonald illusion. Journal of Experimental Psychology: Human Perception and Performance, 35(2), 580–587. doi:10.1037/a0013483
   PubMed Web of Science ®Google Scholar
• Soto-Faraco, S., Navarra, J., & Alsius, A. (2004). Assessing automaticity in audiovisual speech integration: Evidence from the speeded classification task. Cognition, 92(3), B13–B23. doi:10.1016/j.cognition.2003.10.005
   Google Scholar
• Stevenson, R. A., Altieri, N. A., Kim, S., Pisoni, D. B., & James, T. W. (2010). Neural processing of asynchronous audiovisual speech perception. Neuroimage, 49(4), 3308–3318. doi:10.1016/j.neuroimage.2009.12.001
   PubMed Web of Science ®Google Scholar
• Stevenson, R. A., Zemtsov, R. K., & Wallace, M. T. (2012). Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions. Journal of Experimental Psychology. Human Perception and Performance, 38(6), 1517–1529. doi:10.1037/a0027339
   PubMed Web of Science ®Google Scholar
• Taylor, N., Isaac, C., & Milne, E. (2010). A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. Journal of Autism and Developmental Disorders, 40(11), 1403–1411. doi:10.1007/s10803-010-1000-4
   PubMed Web of Science ®Google Scholar
• Teinonen, T., Aslin, R. N., Alku, P., & Csibra, G. (2008). Visual speech contributes to phonetic learning in 6-month-old infants. Cognition, 108(3), 850–855. doi:10.1016/j.cognition.2008.05.009
   PubMed Web of Science ®Google Scholar
• Tiippana, K. (2014). What is the McGurk effect? Frontiers in Psychology, 5. doi:10.3389/fpsyg.2014.00725
   Web of Science ®Google Scholar
• Tiippana, K., Andersen, T. S., & Sams, M. (2004). Visual attention modulates audiovisual speech perception. European Journal of Cognitive Psychology, 16(3), 457–472. doi: 10.1080/09541440340000268
   Web of Science ®Google Scholar
• Tremblay, C., Champoux, F., Voss, P., Bacon, B. A., Lepore, F., & Théoret, H. (2007). Speech and non-speech audio-visual illusions: A developmental study. PLoS One, 2(8), e742. doi:10.1371/journal.pone.0000742
   PubMed Web of Science ®Google Scholar
• Van der Burg, E., Alais, D., & Cass, J. (2013). Rapid recalibration to audiovisual asynchrony. The Journal of Neuroscience, 33(37), 14633–14637. doi:10.1523/jneurosci.1182-13.2013
   PubMed Web of Science ®Google Scholar
• Van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America, 102(4), 1181–1186. doi:10.1073/pnas.0408949102
   PubMed Web of Science ®Google Scholar
• Van Wassenhove, V., Grant, K. W., & Poeppel, D. (2007). Temporal window of integration in auditory-visual speech perception. Neuropsychologia, 45, 598–607. doi:10.1016/j.neuropsychologia.2006.01.001
   PubMed Web of Science ®Google Scholar
• Vetter, P., Edwards, G., & Muckli, L. (2012). Transfer of predictive signals across saccades. Frontiers in Psychology, 3, 176. doi:10.3389/fpsyg.2012.00176
   PubMed Web of Science ®Google Scholar
• Vroomen, J., Keetels, M., De Gelder, B., & Bertelson, P. (2004). Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cognitive Brain Research, 22(1), 32–35. doi:10.1016/j.cogbrainres.2004.07.003
   PubMedGoogle Scholar
• van Wassenhove, V. (2013). Speech through ears and eyes: Interfacing the senses with the supramodal brain. Frontiers in Psychology, 4. doi:10.3389/fpsyg.2013.00388
   PubMed Web of Science ®Google Scholar
• Williams, J., Massaro, D., Peel, N., Bosseler, A., & Suddendorf, T. (2004). Visual-auditory integration during speech imitation in autism. Research in Developmental Disabilities, 25, 559–575. doi:10.1016/j.ridd.2004.01.008
   PubMed Web of Science ®Google Scholar
• Windmann, S. (2004). Effects of sentence context and expectation on the McGurk illusion. Journal of Memory and Language, 50(2), 212–230. doi:10.1016/j.jml.2003.10.001
   Web of Science ®Google Scholar
• Ziemann, U. (2011). Transcranial magnetic stimulation at the interface with other techniques a powerful tool for studying the human cortex. The Neuroscientist, 17(4), 368–381. doi:10.1177/1073858410390225
   PubMed Web of Science ®Google Scholar