Exploring the relationship between speech perception and production across phonological processes, language familiarity, and sensory modalities

References

• Arnold, P., & Hill, F. (2001). Bisensory augmentation: A speechreading advantage when speech is clearly audible and intact. British Journal of Psychology, 92, 339–355. doi: 10.1348/000712601162220
   Web of Science ®Google Scholar
• Besle, J., Bertrand, O., & Giard, M. H. (2009). Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex. Hearing Research, 258, 143–151. doi: 10.1016/j.heares.2009.06.016
   PubMed Web of Science ®Google Scholar
• Best, C. T. (1995). A direct realist view of cross-language speech perception. In W. Strange (Ed.), Speech perception and linguistic experience: Issues in cross-language research (pp. 171–204). Baltimore: York Press.
   Google Scholar
• Best, C. T., & Tyler, M. D. (2007). Nonnative and second-language speech perception: Commonalities and complementarities. In O.-S. Bohn & M. J. Munro (Eds.), Language experience in second language speech learning: In honor of James Emil Flege (pp. 13–34). Amsterdam: John Benjamins Publishing Company.
   Google Scholar
• Bever, T. G., & Poeppel, D. (2010). Analysis by synthesis: A (re-) emerging program of research for language and vision. Biolinguistics, 4, 174–200.
   Google Scholar
• Bonatti, L. L., Peña, M., Nespor, M., & Mehler, J. (2005). Linguistic constraints on statistical computations: The role of consonants and vowels in continuous speech processing. Psychological Science, 16, 451–459. doi: 10.1111/j.0956-7976.2005.01565.x
   PubMed Web of Science ®Google Scholar
• Bosch, L., Costa, A., & Sebastian-Galles, N. (2000). First and second language vowel perception in early bilinguals. European Journal of Cognitive Psychology, 12, 189–221. doi: 10.1080/09541446.2000.10590222
   Web of Science ®Google Scholar
• Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433–436. doi: 10.1163/156856897X00357
   PubMedGoogle Scholar
• Caramazza, A., Miceli, G., Villa, G., & Romani, C. (1987). The role of the graphemic buffer in spelling: Evidence from a case of acquired dysgraphia. Cognition, 26, 59–85. doi: 10.1016/0010-0277(87)90014-X
   PubMed Web of Science ®Google Scholar
• Courtney, M. G. R. (2013). Determining the number of factors to retain in EFA: Using the SPSS R-menu v2.0 to make more judicious estimations. Practical Assessment, Research & Evaluation, 18, 1–14.
   Google Scholar
• D’Ausilio, A., Pulvermüller, F., Salmas, P., Bufalari, I., Begliomini, C., & Fadiga, L. (2009). The motor somatotopy of speech perception. Current Biology, 19, 381–385. doi: 10.1016/j.cub.2009.01.017
   PubMed Web of Science ®Google Scholar
• Dell, G. S. (1986). A spreading-activation theory of retreival in sentence production. Psychological Review, 93, 283–321. doi: 10.1037/0033-295X.93.3.283
   PubMed Web of Science ®Google Scholar
• Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009
   PubMed Web of Science ®Google Scholar
• di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., & Rizzolatti, G. (1992). Understanding motor events: A neurophysiological study. Experimental Brain Research, 91, 176–180. doi: 10.1007/BF00230027
   PubMed Web of Science ®Google Scholar
• Díaz, B., Baus, C., Escera, C., Costa, A., & Sebastian-Galles, N. (2008). Brain potentials to native phoneme discrimination reveal the origin of individual differences in learning the sounds of a second language. Proceedings of the National Academy of Sciences, 105, 16083–16088. doi: 10.1073/pnas.0805022105
   PubMed Web of Science ®Google Scholar
• Díaz, B., Mitterer, H., Broersma, M., Escera, C., & Sebastian-Galles, N. (2016). Variability in L2 phonemic learning originates from speech-specific capabilities: An MMN study on late bilinguals. Bilingualism: Language and Cognition, 19, 955–970. doi: 10.1017/S1366728915000450
   Web of Science ®Google Scholar
• Díaz, B., Mitterer, H., Broersma, M., & Sebastian-Galles, N. (2012). Individual differences in late bilinguals’ L2 phonological processes: From acoustic-phonetic analysis to lexical access. Learning and Individual Differences, 22, 680–689. doi: 10.1016/j.lindif.2012.05.005
   Web of Science ®Google Scholar
• Dupoux, E., Peperkamp, S., & Sebastian-Galles, N. (2010). Limits on bilingualism revisited: Stress “deafness” in simultaneous French–spanish bilinguals. Cognition, 114, 266–275. doi: 10.1016/j.cognition.2009.10.001
   PubMed Web of Science ®Google Scholar
• Fadiga, L., Craighero, L., Buccino, G., & Rizzolatti, G. (2002). Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience, 15, 399–402. doi: 10.1046/j.0953-816x.2001.01874.x
   PubMed Web of Science ®Google Scholar
• Flege, J. E. (1995). Second language speech learning: Theory, findings, and problems. In W. Strange (Ed.), Speech perception and linguistic experience: Issues in cross-language research (pp. 233–277). Baltimore: York Press.
   Google Scholar
• Flege, J. E., MacKay, I. R., & Meador, D. (1999). Native Italian speakers’ perception and production of English vowels. The Journal of the Acoustical Society of America, 106, 2973–2987. doi: 10.1121/1.428116
   PubMed Web of Science ®Google Scholar
• Fowler, C. A. (1986). An event approach to the study of speech perception from a direct-realist perspective. Journal of Phonetics, 14, 3–28.
   Web of Science ®Google Scholar
• Friederici, A. D. (2011). The brain basis of language processing: From structure to function. Physiological Reviews, 91, 1357–1392. doi: 10.1152/physrev.00006.2011
   PubMed Web of Science ®Google Scholar
• Fromkin, V. A. (1971). The non-anomalous nature of anomalous utterances. Language, 47(1), 27–52. doi: 10.2307/412187
   Web of Science ®Google Scholar
• Gabay, Y., Schiff, R., & Vakil, E. (2012). Dissociation between the procedural learning of letter names and motor sequences in developmental dyslexia. Neuropsychologia, 50, 2435–2441. doi: 10.1016/j.neuropsychologia.2012.06.014
   PubMed Web of Science ®Google Scholar
• Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2002). Cognitive neuroscience: The biology of the mind. New York, NY: W. W. Norton & Company.
   Google Scholar
• Hedenius, M., Persson, J., Alm, P. A., Ullman, M. T., Howard, J. H., Howard, D. V., & Jennische, M. (2013). Impaired implicit sequence learning in children with developmental dyslexia. Research in Developmental Disabilities, 34, 3924–3935. doi: 10.1016/j.ridd.2013.08.014
   PubMed Web of Science ®Google Scholar
• Hickok, G., Houde, J., & Rong, F. (2011). Sensorimotor integration in speech processing: Computational basis and neural organization. Neuron, 69, 407–422. doi: 10.1016/j.neuron.2011.01.019
   PubMed Web of Science ®Google Scholar
• Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews Neuroscience, 8, 393–402. doi: 10.1038/nrn2113
   PubMed Web of Science ®Google Scholar
• Hillis, A. E., Rapp, B. C., & Caramazza, A. (1999). When a rose is a rose in speech but a tulip in writing. Cortex; a journal devoted to the study of the nervous system and behavior, 35, 337–356. doi: 10.1016/S0010-9452(08)70804-9
   PubMed Web of Science ®Google Scholar
• Ito, T., Tiede, M., & Ostry, D. J. (2009). Somatosensory function in speech perception. Proceedings of the National Academy of Sciences, 106, 1245–1248. doi: 10.1073/pnas.0810063106
   PubMed Web of Science ®Google Scholar
• Kartushina, N., & Frauenfelder, U. H. (2014). On the effects of L2 perception and of individual differences in L1 production on L2 pronunciation. Frontiers in Psychology, 5, 1–17. doi: 10.3389/fpsyg.2014.01246
   PubMed Web of Science ®Google Scholar
• Kelly, S. W., Griffiths, S., & Frith, U. (2002). Evidence for implicit sequence learning in dyslexia. Dyslexia, 8, 43–52. doi: 10.1002/dys.208
   PubMedGoogle Scholar
• Kittredge, A., & Dell, G. S. (2016). Learning to speak by listening: Transfer of phonotactics from perception to production. Journal of Memory and Language, 89, 8–22. doi: 10.1016/j.jml.2015.08.001
   PubMed Web of Science ®Google Scholar
• Klatt, D. H. (1979). Speech perception: A model of acoustic-phonetic analysis and lexical access. Journal of Phonetics, 7, 279–312.
   Web of Science ®Google Scholar
• Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge, MA: MIT Press.
   Google Scholar
• Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences, 22, 1–75.
   PubMed Web of Science ®Google Scholar
• Levy, E. S., & Law, F. F. (2010). Production of French vowels by American-English learners of French: Language experience, consonantal context, and the perception-production relationship. The Journal of the Acoustical Society of America, 128, 1290–1305. doi: 10.1121/1.3466879
   PubMed Web of Science ®Google Scholar
• Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1–36. doi: 10.1016/0010-0277(85)90021-6
   PubMed Web of Science ®Google Scholar
• Lotto, A., Hickok, G., & Holt, L. (2009). Reflections on mirror neurons and speech perception. Trends in Cognitive Sciences, 13, 110–114. doi: 10.1016/j.tics.2008.11.008
   PubMed Web of Science ®Google Scholar
• Marslen-Wilson, W. D., & Welsh, A. (1978). Processing interactions and lexical access during word recognition in continuous speech. Cognitive Psychology, 10, 29–63. doi: 10.1016/0010-0285(78)90018-X
   Web of Science ®Google Scholar
• McClelland, J. L., & Elman, J. L. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1–86. doi: 10.1016/0010-0285(86)90015-0
   PubMed Web of Science ®Google Scholar
• McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748. doi: 10.1038/264746a0
   PubMed Web of Science ®Google Scholar
• Miyawaki, K., Strange, W., Verbrugge, R., Liberman, A. M., Jenkins, J. J., & Fujimura, O. (1975). An effect of linguistic experience: The discrimination of [r] and [l] by native speakers of Japanese and english. Perception & Psychophysics, 18, 331–340. doi: 10.3758/BF03211209
   Web of Science ®Google Scholar
• Möttönen, R., & Watkins, K. E. (2009). Motor representations of articulators contribute to categorical perception of speech sounds. Journal of Neuroscience, 29, 9819–9825. doi: 10.1523/JNEUROSCI.6018-08.2009
   PubMed Web of Science ®Google Scholar
• Näätänen, R., Lehtokoski, A., Lennes, M., Cheour, M., Huotilainen, M., Iivonen, A., … Alho, K. (1997). Language-specific phoneme representations revealed by electric and magnetic brain responses. Nature, 385, 432–434. doi: 10.1038/385432a0
   PubMed Web of Science ®Google Scholar
• Näätänen, R., Paavilainen, P., Rinne, T., & Alho, K. (2007). The mismatch negativity (MMN) in basic research of central auditory processing: A review. Clinical Neurophysiology, 118, 2544–2590. doi: 10.1016/j.clinph.2007.04.026
   PubMed Web of Science ®Google Scholar
• Navarra, J., & Soto-Faraco, S. (2007). Hearing lips in a second language: Visual articulatory information enables the perception of second language sounds. Psychological Research, 71, 4–12. doi: 10.1007/s00426-005-0031-5
   PubMed Web of Science ®Google Scholar
• Nespor, M., Peña, M., & Mehler, J. (2003). On the different roles of vowels and consonants in speech processing and language acquisition. Lingue e Linguaggio, 2, 221–247.
   Google Scholar
• Norris, D. (1994). Shortlist: A connectionist model of continuous speech recognition. Cognition, 52, 189–234. doi: 10.1016/0010-0277(94)90043-4
   Web of Science ®Google Scholar
• Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9, 97–113. doi: 10.1016/0028-3932(71)90067-4
   PubMed Web of Science ®Google Scholar
• Pallier, C., Bosch, L., & Sebastian-Galles, N. (1997). A limit on behavioral plasticity in speech perception. Cognition, 64, B9–B17. doi: 10.1016/S0010-0277(97)00030-9
   PubMed Web of Science ®Google Scholar
• Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437–442. doi: 10.1163/156856897X00366
   PubMedGoogle Scholar
• Peperkamp, S., & Bouchon, C. (2011). The relation between perception and production in L2 phonological processing. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH (pp. 161–164).
   Google Scholar
• Pickering, M. J., & Garrod, S. (2013). An integrated theory of language production and comprehension. Behavioral and Brain Sciences, 36, 329–347. doi: 10.1017/S0140525X12001495
   PubMed Web of Science ®Google Scholar
• Price, C. J. (2012). A review and synthesis of the first 20years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage, 62, 816–847. doi: 10.1016/j.neuroimage.2012.04.062
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F., & Fadiga, L. (2010). Active perception: Sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience, 11, 351–360. doi: 10.1038/nrn2811
   PubMed Web of Science ®Google Scholar
• Pulvermüller, F., Huss, M., Kherif, F., Moscoso del Prado Martin, F., Hauk, O., & Shtyrov, Y. (2006). Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences, 103, 7865–7870. doi: 10.1073/pnas.0509989103
   PubMed Web of Science ®Google Scholar
• Rallo Fabra, L., & Romero, J. (2012). Native Catalan learners’ perception and production of English vowels. Journal of Phonetics, 40, 491–508. doi: 10.1016/j.wocn.2012.01.001
   Web of Science ®Google Scholar
• Ramus, F. (2003). Developmental dyslexia: Specific phonological deficit or general sensorimotor dysfunction? Current Opinion in Neurobiology, 13, 212–218. doi: 10.1016/S0959-4388(03)00035-7
   PubMed Web of Science ®Google Scholar
• Ramus, F., Pidgeon, E., & Frith, U. (2003). The relationship between motor control and phonology in dyslexic children. Journal of Children Psychology and Psychiatry, 44, 712–722. doi: 10.1111/1469-7610.00157
   PubMed Web of Science ®Google Scholar
• Rauschecker, J. P., & Scott, S. K. (2009). Maps and streams in the auditory cortex: Nonhuman primates illuminate human speech processing. Nature Neuroscience, 12, 718–724. doi: 10.1038/nn.2331
   PubMed Web of Science ®Google Scholar
• Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebral Cortex, 17, 1147–1153. doi: 10.1093/cercor/bhl024
   PubMed Web of Science ®Google Scholar
• Sánchez-García, C., Alsius, A., Enns, J. T., & Soto-Faraco, S. (2011). Cross-modal prediction in speech perception. PLoS ONE, 6, 1–8. doi: 10.1371/journal.pone.0025198
   Web of Science ®Google Scholar
• Sánchez-García, C., Enns, J. T., & Soto-Faraco, S. (2013). Cross-modal prediction in speech depends on prior linguistic experience. Experimental Brain Research, 225, 499–511. doi: 10.1007/s00221-012-3390-3
   PubMed Web of Science ®Google Scholar
• Schwartz, J. L., Basirat, A., Ménard, L., & Sato, M. (2012). The perception-for-action-control theory (PACT): A perceptuo-motor theory of speech perception. Journal of Neurolinguistics, 25, 336–354. doi: 10.1016/j.jneuroling.2009.12.004
   Web of Science ®Google Scholar
• Scott, S. K., McGettigan, C., & Eisner, F. (2009). A little more conversation, a little less action — candidate roles for the motor cortex in speech perception. Nature Reviews Neuroscience, 10, 295–302. doi: 10.1038/nrn2603
   PubMed Web of Science ®Google Scholar
• Sebastian-Galles, N., & Baus, C. (2005). On the relationship between perception and production in L2 categories. In A. Cutler (Ed.), Twenty-first century psycholinguistics: Four cornerstones (pp. 279–292). New York: Erlbaum.
   Google Scholar
• Sebastian-Galles, N., Echeverría, S., & Bosch, L. (2005). The influence of initial exposure on lexical representation: Comparing early and simultaneous bilinguals. Journal of Memory and Language, 52, 240–255. doi: 10.1016/j.jml.2004.11.001
   Web of Science ®Google Scholar
• Sebastian-Galles, N., & Soto-Faraco, S. (1999). Online processing of native and non-native phonemic contrasts in early bilinguals. Cognition, 72, 111–123. doi: 10.1016/S0010-0277(99)00024-4
   PubMed Web of Science ®Google Scholar
• Skipper, J. I., Devlin, J. T., & Lametti, D. R. (2017). The hearing ear is always found close to the speaking tongue: Review of the role of the motor system in speech perception. Brain and Language, 164, 77–105. doi: 10.1016/j.bandl.2016.10.004
   PubMed Web of Science ®Google Scholar
• Stekelenburg, J. J., & Vroomen, J. (2007). Neural correlates of multisensory integration of ecologically valid audiovisual events. Journal of Cognitive Neuroscience, 19, 1964–1973. doi: 10.1162/jocn.2007.19.12.1964
   PubMed Web of Science ®Google Scholar
• Strange, W., & Dittmann, S. (1984). Effects of discrimination training on the perception of /r-l/ by Japanese adults learning English. Perception & Psychophysics, 36, 131–145. doi: 10.3758/BF03202673
   PubMed Web of Science ®Google Scholar
• Sumby, W. H. (1954). Visual contribution to speech intelligibility in noise. The Journal of the Acoustical Society of America, 26, 212–215. doi: 10.1121/1.1907309
   Web of Science ®Google Scholar
• Ullman, M. T. (2004). Contributions of memory circuits to language: The declarative/procedural model. Cognition, 92, 231–270. doi: 10.1016/j.cognition.2003.10.008
   PubMed Web of Science ®Google Scholar
• van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech neurophysiological basis of multisensory integration. Proceedings of the National Academy of Sciences, 102, 1181–1186. doi: 10.1073/pnas.0408949102
   PubMed Web of Science ®Google Scholar
• Vicari, S., Finzi, A., Menghini, D., Marotta, L., Baldi, S., & Petrosini, L. (2005). Do children with developmental dyslexia have an implicit learning deficit? Journal of Neurology, Neurosurgery, and Psychiatry, 76, 1392–1397. doi: 10.1136/jnnp.2004.061093
   PubMed Web of Science ®Google Scholar
• Vroomen, J., & Stekelenburg, J. J. (2010). Visual anticipatory information modulates multisensory interactions of artificial audiovisual stimuli. Journal of Cognitive Neuroscience, 22, 1583–1596. doi: 10.1162/jocn.2009.21308
   PubMed Web of Science ®Google Scholar
• Wacongne, C., Changeux, J.-P., & Dehaene, S. (2012). A neuronal model of predictive coding accounting for the mismatch negativity. Journal of Neuroscience, 32, 3665–3678. doi: 10.1523/JNEUROSCI.5003-11.2012
   PubMed Web of Science ®Google Scholar
• Watkins, K. E., Strafella, A. P., & Paus, T. (2003). Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia, 41, 989–994. doi: 10.1016/S0028-3932(02)00316-0
   PubMed Web of Science ®Google Scholar
• Winkler, I., & Czigler, I. (2012). Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. International Journal of Psychophysiology, 83, 132–143. doi: 10.1016/j.ijpsycho.2011.10.001
   PubMed Web of Science ®Google Scholar