445
Views
0
CrossRef citations to date
0
Altmetric
REGULAR ARTICLES

Processing reduced speech in the L1 and L2: a combined eye-tracking and ERP study

, , &
Pages 527-551 | Received 07 Nov 2022, Accepted 15 Mar 2024, Published online: 24 Apr 2024

References

  • Adda-Decker, M., Boula de Mareüil, P., Adda, G., & Lamel, L. (2005). Investigating syllabic structures and their variation in spontaneous French. Speech Communication, 46(2), 119–139. https://doi.org/10.1016/j.specom.2005.03.006
  • Alday, P. M. (2019). How much baseline correction do we need in ERP research? Extended GLM model can replace baseline correction while lifting its limits. Psychophysiology, 56(12), e13451. https://doi.org/10.1111/psyp.13451
  • Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38(4), 419–439. https://doi.org/10.1006/jmla.1997.2558
  • Altmann, G., & Kamide, Y. (2004). Now you see it, now you don't: Mediating the mapping between language and the visual world. In F. Ferreira (Ed.), The integration of language, vision, and action: Eye movements and the visual world (pp. 347–386). Psychology Press.
  • Altmann, G., & Kamide, Y. (2007). The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. Journal of Memory and Language, 57(4), 502–518. https://doi.org/10.1016/j.jml.2006.12.004
  • Ardal, S., Donald, M. W., Meuter, R., Muldrew, S., & Luce, M. (1990). Brain responses to semantic incongruity in bilinguals. Brain and Language, 39(2), 187–205. https://doi.org/10.1016/0093-934X(90)90011-5
  • Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01
  • Boersma, P., & Weenink, D. (2019). Praat: Doing phonetics by computer. https://www.praat.org/
  • Brand, S., & Ernestus, M. (2018). Listeners' processing of a given reduced word pronunciation variant directly reflects their exposure to this variant: Evidence from native listeners and learners of French. Quarterly Journal of Experimental Psychology, 71(5), 1240–1259. https://doi.org/10.1080/17470218.2017.1313282
  • Brouwer, S., Mitterer, H., & Huettig, F. (2012). Speech reductions change the dynamics of competition during spoken word recognition. Language and Cognitive Processes, 27(4), 539–571. https://doi.org/10.1080/01690965.2011.555268
  • Brown, C., & Hagoort, P. (Eds.). (1999). The neurocognition of language. Oxford University Press.
  • Brysbaert, M. (2013). LEXTALE-FR: A fast, free, and efficient test to measure language proficiency in French. Psychologica Belgica, 53, 23–37. https://doi.org/10.5334/pb-53-1-23
  • Bürki, A., Ernestus, M., & Frauenfelder, U. H. (2010). Is there only one “fenêtre” in the production lexicon? On-line evidence on the nature of phonological representations of pronunciation variants for French schwa words Is there only one “fenêtre” in the production lexicon? On-line evidence on the nature of phonological representations of pronunciation variants for French schwa words. Journal of Memory and Language, 62, 421–437. https://doi.org/10.1016/j.jml.2010.01.002
  • Bürki, A., Fougeron, C., & Gendrot, C. (2007). On the categorical nature of the process involved in schwa elision in French. In Proceedings of Interspeech-2007 (pp. 1026–1029). International Speech Communication Association (ISCA).
  • Cohen, C., Carlson, M., & Dussias, P. E. (2023, February). Just to be safe: Listeners use redundant phonetic information to distinguish unsuffixed from suffixed nouns. PsyArXiv. psyarxiv.com/uy823
  • Council of Europe (2011). Common European framework of reference for languages: Learning, teaching, assessment. https://www.coe.int/t/dg4/linguistic/cadre1_en.asp
  • Crosse, M., Di Liberto, G., Bednar, A., & Lalor, E. (2016). The multivariate temporal response function (mTRF) toolbox: A MATLAB toolbox for relating neural signals to continuous stimuli. Frontiers in Human Neuroscience, 10, Article 604. https://doi.org/10.3389/fnhum.2016.00604
  • Crowley, K. E., & Colrain, I. M. (2004). A review of the evidence for P2 being an independent component process: Age, sleep and modality. Clinical Neurophysiology, 115(4), 732–744. https://doi.org/10.1016/j.clinph.2003.11.021
  • Cutler, A. (2012). Native listening: Language experience and the recognition of spoken words. MIT Press.
  • Dahan, D., Magnuson, J. S., & Tanenhaus, M. K. (2001). Time course of frequency effects in spoken-word recognition: Evidence from eye movements. Cognitive Psychology, 42(4), 317–367. https://dx.doi.org/10.1006/cogp.2001.0750
  • Dahan, D., Magnuson, J. S., Tanenhaus, M. K., & Hogan, E. M. (2001). Subcategorical mismatches and the time course of lexical access: Evidence for lexical competition. Language and Cognitive Processes, 16, 507–534. https://doi.org/10.1080/01690960143000074
  • Dahan, D., Tanenhaus, M., & Salverda, A. P. (2007). The influence of visual processing on phonetically driven saccades in the “visual world” paradigm. In R. van Gompel, M. Fischer, W. Murray, & R. Hill (Eds.), Eye movements: A window on mind and brain (pp. 471–486). Elsevier. https://doi.org/10.1016/B978-008044980-7/50023-9
  • de Cheveigné, A., & Arzounian, D. (2018). Robust detrending, rereferencing, outlier detection, and inpainting for multichannel data. NeuroImage, 172, 903–912. https://doi.org/10.1016/j.neuroimage.2018.01.035
  • Drijvers, L., Mulder, K., & Ernestus, M. (2016). Alpha and gamma band oscillations index differential processing of acoustically reduced and full forms. Brain and Language, 153–154, 27–37. https://doi.org/10.1016/j.bandl.2016.01.003
  • Erb, J., & Obleser, J. (2013). Upregulation of cognitive control networks in older adults' speech comprehension. Frontiers in Systems Neuroscience, 7, 116. https://doi.org/10.3389/fnsys.2013.00116.
  • Ernestus, M. (2000). Voice assimilation and segment reduction in casual Dutch. A corpus-based study of the phonology-phonetics interface [Unpublished doctoral dissertation]. Free University. (Print ISBNs 9789076864020, 9076864020).
  • Ernestus, M., Baayen, R., & Schreuder, R. (2002). The recognition of reduced word forms. Brain and Language, 81, 162–173. https://doi.org/10.1006/brln.2001.2514
  • Ernestus, M., Dikmans, M., & Giezenaar, G. (2017). Advanced second language learners experience difficulties processing reduced word pronunciation variants. Dutch Journal of Applied Linguistics, 6(1), 1–20. https://doi.org/10.1075/dujal
  • Ernestus, M., Kouwenhoven, H., & van Mulken, M. (2017). The direct and indirect effects of the phonotactic constraints in the listener's native language on the comprehension of reduced and unreduced word pronunciation variants in a foreign language. Journal of Phonetics, 62, 50–64. https://doi.org/10.1016/j.wocn.2017.02.003
  • Gouvea, A. C., Phillips, C., Kazanina, N., & Poeppel, D. (2010). The linguistic processes underlying the P600. Language and Cognitive Processes, 25(2), 149–188. https://doi.org/10.1080/01690960902965951
  • Hahne, A. (2001). What's different in second-language processing? Evidence from event-related brain potentials. Journal of Psycholinguistic Research, 30, 251–266. https://doi.org/10.1023/A:1010490917575
  • Hahne, A., & Friederici, A. D. (2001). Processing a second language: Late learners' comprehension mechanisms as revealed by event-related brain potentials. Bilingualism: Language and Cognition, 4(2), 123–141. https://doi.org/10.1017/S1366728901000232
  • Hanique, I., Schuppler, B., & Ernestus, M. (2010). Morphological and predictability effects on schwa reduction: The case of Dutch word-initial syllables. In Proceedings of Interspeech-2010 (pp. 933–936). International Speech Communication Association (ISCA).
  • Huettig, F., & G. T. M. Altmann (2005). Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm. Cognition, 96, 23–32. https://doi.org/10.1016/j.cognition.2004.10.003
  • Huettig, F., & McQueen, J. M. (2007). The tug of war between phonological, semantic and shape information in language-mediated visual search. Journal of Memory and Language, 57(4), 460–482. https://doi.org/10.1016/j.jml.2007.02.001
  • Huettig, F., Olivers, C. N., & Hartsuiker, R. J. (2011). Looking, language, and memory: Bridging research from the visual world and visual search paradigms. Acta Psychologica, 137(2), 138–150. https://doi.org/10.1016/j.actpsy.2010.07.013Visual search and visual world: Interactions among visual attention, language, and working memory.
  • Huettig, F., Rommers, J., & Meyer, A. S. (2011). Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica, 137(2), 151–171. https://doi.org/10.1016/j.actpsy.2010.11.003
  • Ito, A., Pickering, M. J., & Corley, M. (2018). Investigating the time-course of phonological prediction in native and non-native speakers of English: A visual world eye-tracking study. Journal of Memory and Language, 98, 1–11. https://doi.org/10.1016/j.jml.2017.09.002
  • Johnson, K. (2004). Massive reduction in conversational American English. In K. Yoneyama & K. Maekawa (Eds.), Spontaneous speech: Data and analysis. Proceedings of the 1st session of the 10th International Symposium (pp. 29–54). Tokyo: National International Institute for Japanese Language.
  • Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354. https://doi.org/10.1037/0033-295X.87.4.329
  • Kohler, K. J. (1990). Segmental reduction in connected speech in German: Phonological facts and phonetic explanations. In W. Hardcastle & A. Marchal (Eds.), Speech production, speech modelling (pp. 21–33). Kluwer Academic Publishers.
  • Kotz, S. A., Holcomb, P. J., & Osterhout, L. (2008). ERPs reveal comparable syntactic sentence processing in native and non-native readers of English. Acta Psychologica, 128(3), 514–527. https://doi.org/10.1016/j.actpsy.2007.10.003
  • Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62, 621–647. https://doi.org/10.1146/psych.2011.62.issue-1
  • Lahey, M., & Ernestus, M. (2014). Pronunciation variation in infant-directed speech: Phonetic reduction of two highly frequent words. Language Learning and Development, 10(4), 308–327. https://doi.org/10.1080/15475441.2013.860813
  • Lemhöfer, K., & Broersma, M. (2012). Introducing LexTALE: A quick and valid Lexical test for advanced learners of English. Behavior Research Methods, 44(2), 325–343. https://doi.org/10.3758/s13428-011-0146-0.
  • Lennes, M., Alaroty, N., & Vainio, M. (2001). Is the phonetic quality of unaccented words unpredictable? An example from spontaneous finnish. Journal of the International Phonetic Association, 31, 127–138. https://doi.org/10.1017/S0025100301001104
  • Makeig, S., Bell, A., Jung, T. P., & Sejnowski, T. (1996). Independent component analysis of electroencephalographic data. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in neural information processing systems (pp. 145–151). MIT Press.
  • Manor, B. R., & Gordon, E. (2003). Defining the temporal threshold for ocular fixation in free-viewing visuocognitive tasks. Journal of Neuroscience Methods, 128, 85–93. https://doi.org/10.1016/S0165-0270(03)00151-1
  • Matin, E., Shao, K., & Boff, K. (1993). Saccadic overhead: Information-processing time with and without saccades. Perception & Psychophysics, 53, 372–380. https://doi.org/10.3758/BF03206780
  • Miettinen, I., Tiitinen, H., Alku, P., & May, P. J. (2010). Sensitivity of the human auditory cortex to acoustic degradation of speech and non-speech sounds. BMC Neuroscience, 11, 1–13. https://doi.org/10.1186/1471-2202-11-24
  • Mirman, D. (2014). Growth curve analysis and visualization using R. CRC Press.
  • Mirman, D., Dixon, J. A., & Magnuson, J. S. (2008). Statistical and computational models of the visual world paradigm: Growth curves and individual differences. Journal of Memory and Language, 59(4), 475–494. https://doi.org/10.1016/j.jml.2007.11.006
  • Mirman, D., & Magnuson, J. S. (2009). Dynamics of activation of semantically similar concepts during spoken word recognition. Memory & Cognition, 37(7), 1026–1039. https://doi.org/10.3758/MC.37.7.1026
  • Moreno, E. M., & Kutas, M. (2005). Processing semantic anomalies in two languages: An electrophysiological exploration in both languages of Spanish–English bilinguals. Cognitive Brain Research, 22(2), 205–220. https://doi.org/10.1016/j.cogbrainres.2004.08.010
  • Moreno, E. M., Rodríguez-Fornells, A., & Laine, M. (2008). Event-related potentials (ERPs) in the study of bilingual language processing. Journal of Neurolinguistics, 21(6), 477–508. https://doi.org/10.1016/j.jneuroling.2008.01.003
  • Morgan-Short, K., & Tanner, D. (2013). Event-related potentials (ERPs). In J. Jegerski & B. VanPatten (Eds.), Research methods in second language psycholinguistics (pp. 127–152). Routledge.
  • Mulder, K., Brekelmans, G., & Ernestus, M. (2015). The processing of schwa reduced cognates and noncognates in non-native listeners of English. In Scottish consortium for ICPhS, M. Wolters, J. Livingstone, B. Beattie, R. Smith, & M. MacMahon (Eds.), Proceedings of the 18th International Congress of Phonetic Sciences (ICPhS 2015). Glasgow: University of Glasgow.
  • Mulder, K., ten Bosch, L., & Boves, L. (2018). Analyzing EEG signals in auditory speech comprehension using temporal response functions and generalized additive models. In Proceedings of Interspeech 2018 (pp. 1452–1456). International Speech Communication Association (ISCA).
  • Mulder, K., Wloch, L., Boves, L., ten Bosch, L., & Ernestus, M. (2022). Cognate status modulates the comprehension of isolated reduced forms. Language, Cognition and Neuroscience, 37(5), 576–614. https://doi.org/10.1080/23273798.2021.1995611.
  • New, B., Pallier, C., Brysbaert, M., & Ferrand, L. (2004). Lexique 2: A new French lexical database. Behavior Research Methods, Instruments, & Computers, 36(3), 516–524. https://doi.org/10.3758/BF03195598.
  • Nijveld, A., ten Bosch, L., & Ernestus, M. (2019). ERP signal analysis with temporal resolution using a time window bank. In Proceedings of Interspeech (pp. 1208–1212). International Speech Communication Association (ISCA).
  • Nouveau, D. (2012). Limites perceptives de l'e caduc chez des apprenants nééerlandophones. Revue Canadienne de Linguistique Appliquée, 15, 60–78.
  • Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J. (2011). FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Computational Intelligence and Neuroscience, 2011, 1–9. https://doi.org/10.1155/2011/156869.
  • Proverbio, A. M., Čok, B., & Zani, A. (2002). Electrophysiological measures of language processing in bilinguals. Journal of Cognitive Neuroscience, 14(7), 994–1017. https://doi.org/10.1162/089892902320474463
  • Rossion, B., & Pourtois, G. (2004). Revisiting Snodgrass and Vanderwart's object pictorial set: The role of surface detail in basic-level object recognition. Perception, 33, 217–236. https://doi.org/10.1068/p5117
  • Sanders, L. D., & Neville, H. J. (2003a). An ERP study of continuous speech processing: II. Segmentation, semantics, and syntax in nonnative speakers. Cognitive Brain Research, 15, 214–227. https://doi.org/10.1016/S0926-6410(02)00194-5
  • Sanders, L. D., & Neville, H. J. (2003b). An ERP study of continuous speech processing: I. Segmentation, semantics, and syntax in native speakers. Cognitive Brain Research, 15(3), 228–240. https://doi.org/10.1016/S0926-6410(02)00195-7
  • Sanders, L. D., Newport, E. L., & Neville, H. J. (2002). Segmenting nonsense: An event-related potential index of perceived onsets in continuous speech. Nature Neuroscience, 5(7), 700–703. https://doi.org/10.1038/nn873
  • Shook, A., & Marian, V. (2013). The bilingual language interaction network for comprehension of speech. Bilingualism: Language and Cognition, 16(2), 304–324. https://doi.org/10.1017/S1366728912000466
  • Snodgrass, J. G., & Vanderwart, M. (1980). A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology Human Learning and Memory, 6, 174–215. https://doi.org/10.1037/0278-7393.6.2.174
  • Song, J., & Iverson, P. (2018). Listening effort during speech perception enhances auditory and lexical processing for non-native listeners and accents. Cognition, 179, 163–170. https://doi.org/10.1016/j.cognition.2018.06.001
  • Stridfeldt, M. (2005). La perception du français oral par des apprenants suédois [Unpublished doctoral dissertation]. Umea Universitet.
  • ten Bosch, L., Boves, L., & Ernestus, M. (2022, May 23). DIANA, a process-oriented model of human auditory word recognition. Brain Science, 12(5), 681. https://doi.org/10.3390/brainsci12050681
  • Teruya, H., & Kapatsinski, V. (2019). Deciding to look: Revisiting the linking hypothesis for spoken word recognition in the visual world. Language, Cognition and Neuroscience, 34(7), 861–880. https://doi.org/10.1080/23273798.2019.1588338
  • Thothathiri, M., & Snedeker, J. (2008). Give and take: Syntactic priming during spoken language comprehension. Cognition, 108(1), 51–68. https://doi.org/10.1016/j.cognition.2007.12.012
  • van de Ven, M., Tucker, B. V., & Ernestus, M. (2011). Semantic context effects in the comprehension of reduced pronunciation variants. Memory & Cognition, 39(7), 1301–1316. https://doi.org/10.3758/s13421-011-0103-2
  • van Gompel, R., Fischer, M., Murray, W., & Hill, R. (Eds.). (2007). Eye movements: A window on mind and brain. Elsevier.
  • Weber, A., & Cutler, A. (2004). Lexical competition in non-native spoken-word recognition. Journal of Memory and Language, 50(1), 1–25. https://doi.org/10.1016/S0749-596X(03)00105-0
  • Weber-Fox, C. M., & Neville, H. J. (1996). Maturational constraints on functional specializations for language processing: ERP and behavioral evidence in bilingual speakers. Journal of Cognitive Neuroscience, 8(3), 231–256. https://doi.org/10.1162/jocn.1996.8.3.231
  • Winsler, K., Midgley, K. J., Grainger, J., & Holcomb, P. J. (2018). An electrophysiological megastudy of spoken word recognition. Language, Cognition and Neuroscience, 33(8), 1063–1082. https://doi.org/10.1080/23273798.2018.1455985.
  • Wong, S. W. L., Mok, P. P. K., Chung, K. K. H., Leung, V. W. H., Bishop, D. V. M., & Chow, B. W. Y. (2015). Perception of native English reduced forms in Chinese learners: Its role in listening comprehension and its phonological correlates. Tesol Quarterly, 51, 7–31. https://doi.org/10.1002/tesq.2017.51.issue-1