2,000
Views
0
CrossRef citations to date
0
Altmetric
REGULAR ARTICLE

Entrainment to speech prosody influences subsequent sentence comprehension

ORCID Icon &
Pages 263-276 | Received 29 Oct 2021, Accepted 19 Jul 2022, Published online: 11 Aug 2022

References

  • Aarts, A. A., Anderson, J. E., Anderson, C. J., Attridge, P. R., Attwood, A., Axt, J., Babel, M., Bahník, Š, Baranski, E., Barnett-Cowan, M., Bartmess, E., Beer, J., Bell, R., Bentley, H., Beyan, L., Binion, G., Borsboom, D., Bosch, A., Bosco, F. A., … Zuni, K. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716–aac4716. https://doi.org/10.1126/science.aac4716
  • Anwyl-Irvine, A. L., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. K. (2020). Gorilla in our midst: An online behavioral experiment builder. Behavior Research Methods, 52(1), 388–407. https://doi.org/10.3758/s13428-019-01237-x
  • Baddeley, A. D., Thomson, N., & Buchanan, M. (1975). Word length and the structure of short-term memory. Journal of Verbal Learning and Verbal Behavior, 14(6), 575–589. https://doi.org/10.1016/S0022-5371(75)80045-4
  • Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2011). Random effects structure in mixed-effects models: Keep it maximal. Journal of Memory and Language, 68(3), 255–278. https://doi.org/10.1016/j.jml.2012.11.001.
  • Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1) ), 1–48. https://doi.org/10.18637/jss.v067.i01.
  • Boersma, P., & van Heuven, V. (2001). Speak and unSpeak with Praat. Glot International, 5(9–10), 341–347.
  • Bosker, H. R. (2017). Accounting for rate-dependent category boundary shifts in speech perception. Attention, Perception, and Psychophysics, 79(1), 333–343. https://doi.org/10.3758/s13414-016-1206-4
  • Bourguignon, M., De Tiège, X., De Beeck, M. O., Ligot, N., Paquier, P., Van Bogaert, P., Goldman, S., Hari, R., & Jousmäki, V. (2013). The pace of prosodic phrasing couples the listener’s cortex to the reader’s voice. Human Brain Mapping, 34(2), 314–326. https://doi.org/10.1002/hbm.21442
  • Box, G. E. P, & Cox, D. R. (1964). An Analysis of Transformations. Journal of the Royal Statistical Society: Series B (Methodological), 26(2), 211–243. http://doi.org/10.1111/rssb.1964.26.issue-2
  • Branigan, H. P. (2007). Syntactic priming. Language and Linguistics Compass, 1(1–2), 1–16. https://doi.org/10.1111/j.1749-818x.2006.00001.x
  • Breen, M. (2014). Empirical investigations of the role of implicit prosody in sentence processing. Linguistics and Language Compass, 8(2), 37–50. https://doi.org/10.1111/lnc3.12061
  • Breen, M., Kaswer, L., Van Dyke, J. A., Krivokapić, J., & Landi, N. (2016). Imitated prosodic fluency predicts reading comprehension ability in good and poor high school readers. Frontiers in Psychology, 7(JUL), 1026. https://doi.org/10.3389/fpsyg.2016.01026
  • Brennan, S. E. (1996). Lexical entrainment in spontaneous dialog. Proceedings, 1996 International Symposium on Spoken Dialogue, ISSD-96, 41–44.
  • Breska, A., & Deouell, L. Y. (2017). Neural mechanisms of rhythm-based temporal prediction: Delta phase-locking reflects temporal predictability but not rhythmic entrainment. PLoS Biology, 15(2), 1–30. https://doi.org/10.1371/journal.pbio.2001665
  • Brown, M., Salverda, A. P., Dilley, L. C., & Tanenhaus, M. K. (2011). Expectations from preceding prosody influence segmentation in online sentence processing. Psychonomic Bulletin and Review, 18(6), 1189–1196. https://doi.org/10.3758/s13423-011-0167-9
  • Calderone, Daniel J, Lakatos, Peter, Butler, Pamela D., & Castellanos, F. Xavier. (2014). Entrainment of neural oscillations as a modifiable substrate of attention. Trends in Cognitive Sciences, 18(6), 300–309. http://doi.org/10.1016/j.tics.2014.02.005
  • Carlson, K., Clifton, C., & Frazier, L. (2001). Prosodic boundaries in adjunct attachment. Journal of Memory and Language, 45(1), 58–81. https://doi.org/10.1006/jmla.2000.2762
  • Clifton, C., Carlson, K., & Frazier, L. (2002). Informative prosodic boundaries. Language and Speech, 45(2), 87–114. https://doi.org/10.1177/00238309020450020101
  • Davidson, D.J, & Martin, A.E. (2013). Modeling accuracy as a function of response time with the generalized linear mixed effects model. Acta Psychologica, 144(1), 83–96. http://doi.org/10.1016/j.actpsy.2013.04.016
  • Dilley, L. C., & McAuley, J. D. (2008). Distal prosodic context affects word segmentation and lexical processing. Journal of Memory and Language, 59(3), 294–311. https://doi.org/10.1016/j.jml.2008.06.006
  • Dilley, L. C., & Pitt, M. A. (2010). Altering context speech rate can cause words to appear or disappear. Psychological Science, 21(11), 1664–1670. https://doi.org/10.1177/0956797610384743
  • Edlund, J. (2011). In search for the conversational homunculus: serving to understand spoken human face-to-face interaction. http://www.diva-portal.org/smash/record.jsf?pid=diva2:402997
  • Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146
  • Fodor, J. D. (2002). Psycholinguistics cannot escape prosody. In Proceedings of the 1st International Conference on Speech Prosody, April 2002, 83–88.
  • Frazier, L., Carlson, K., & Clifton, C. (2006). Prosodic phrasing is central to language comprehension. Trends in Cognitive Sciences, 10(6), 244–249. https://doi.org/10.1016/j.tics.2006.04.002
  • Ghitza, O. (2017). Acoustic-driven delta rhythms as prosodic markers. Language, Cognition and Neuroscience, 32(5), 545–561. https://doi.org/10.1080/23273798.2016.1232419
  • Grosjean, F. (1983). How long is the sentence? Prediction and prosody in the on-line processing of language. Linguistics, 21(3), 501–530. https://doi.org/10.1515/ling.1983.21.3.501.
  • Heister, J., Würzner, K. M., Bubenzer, J., Pohl, E., Hanneforth, T., Geyken, A., & Kliegl, R. (2011). dlexDB – Eine lexikalische datenbank für die psychologische und linguistische forschung. Psychologische Rundschau, 62(1), 10–20. https://doi.org/10.1026/0033-3042/a000029
  • Henke, L., & Meyer, L. (2020). Endogenous Oscillations Time-Constrain Linguistic Segmentation: Cycling the Garden Path. Cerebral Cortex (in press).
  • Henry, M. J., & Obleser, J. (2012). Frequency modulation entrains slow neural oscillations and optimizes human listening behavior. Proceedings of the National Academy of Sciences, 109(49), 20095–20100. https://doi.org/10.1073/pnas.1213390109
  • Herbst, S. K., Stefanics, G., & Obleser, J. (2022). Endogenous modulation of delta phase by expectation – A replication of stefanics et al., 2010. Cortex; A Journal Devoted to the Study of the Nervous System and Behavior, 149, 226–245. https://doi.org/10.1016/J.CORTEX.2022.02.001
  • Hickok, G., Farahbod, H., & Saberi, K. (2015). The rhythm of perception: Entrainment to acoustic rhythms induces subsequent perceptual oscillation. Psychological Science, 26(7), 1006–1013. https://doi.org/10.1177/0956797615576533.
  • Hoeks, J. C. J., Hendriks, P., Vonk, W., Brown, C. M., & Hagoort, P. (2006). Processing the noun phrase versus sentence coordination ambiguity: Thematic information does not completely eliminate processing difficulty. Quarterly Journal of Experimental Psychology, 59(9), 1581–1599. https://doi.org/10.1080/17470210500268982
  • Hoeks, J. C. J., Vonk, W., & Schriefers, H. (2002). Processing coordinated structures in context: The effect of topic-structure on ambiguity resolution. Journal of Memory and Language, 46(1), 99–119. https://doi.org/10.1006/jmla.2001.2800
  • Inbar, M., Grossman, E., & Landau, A. N. (2020). Sequences of intonation units form a 1 Hz rhythm. BioRxiv, 10(1), 1–23. https://doi.org/10.1101/765016
  • Klasmeyer, G.. (1997). Perceptual importance of selected voice quality parameters. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing – Proceedings, https://doi.org/10.1109/ICASSP.1997.598808.
  • Kösem, A., Bosker, H. R., Takashima, A., Meyer, A. S., Jensen, O., & Hagoort, P. (2018). Neural entrainment determines the words we hear. Current Biology, 28(18), 2867–2875. https://doi.org/10.1016/j.cub.2018.07.023
  • Kotz, S. A., Meyer, M., Alter, K., Besson, M., Von Cramon, D. Y., & Friederici, A. D. (2003). On the lateralization of emotional prosody: An event-related functional MR investigation. Brain and Language, 86(3), 366–376. https://doi.org/10.1016/S0093-934X(02)00532-1
  • Lakatos, Peter, Chen, Chi-Ming, O'Connell, Monica N, Mills, Aimee, & Schroeder, Charles E. (2007). Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron, 53(2), 279–292. http://doi.org/10.1016/j.neuron.2006.12.011
  • Lakatos, Peter, Gross, Joachim, & Thut, Gregor. (2019). A new unifying account of the roles of neuronal entrainment. Current Biology, 29(18), R890–R905. http://doi.org/10.1016/j.cub.2019.07.075
  • Lehnert-LeHouillier, H., Terrazas, S., & Sandoval, S. (2020). Prosodic entrainment in conversations of verbal children and teens on the autism spectrum. Frontiers in Psychology, 11, 2718. https://doi.org/10.3389/fpsyg.2020.582221
  • Levitan, R., Gravano, A., Willson, L., Be, S., Nŭ, S., Hirschberg, J., & Nenkova, A. (n.d.). Acoustic-prosodic entrainment and social behavior. Retrieved from June 14, 2022, from http://www.mturk.com
  • Levitan, R., & Hirschberg, J. (n.d.). Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions.
  • Luo, H., & Poeppel, D. (2007). Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron, 54(6), 1001–1010. https://doi.org/10.1016/j.neuron.2007.06.004.
  • Mai, G., Minett, J. W., & Wang, W. S. Y. (2016). Delta, theta, beta, and gamma brain oscillations index levels of auditory sentence processing. NeuroImage, 133, 516–528. https://doi.org/10.1016/j.neuroimage.2016.02.064
  • Martin, Andrea E, & McElree, Brian. (2018). Retrieval cues and syntactic ambiguity resolution: speed-accuracy tradeoff evidence. Language, Cognition and Neuroscience, 33(6), 769–783. http://doi.org/10.1080/23273798.2018.1427877
  • Meyer, L. (2018). The neural oscillations of speech processing and language comprehension: State of the art and emerging mechanisms. European Journal of Neuroscience, 48(7), 2609–2621. https://doi.org/10.1111/ejn.13748
  • Meyer, L., Sun, Y., & Martin, A. E. (2019). Synchronous, but not entrained: Exogenous and endogenous cortical rhythms of speech and language processing. Language, Cognition and Neuroscience, 0(0), 1–11. https://doi.org/10.1080/23273798.2019.1693050
  • Meyer, L., Sun, Y., & Martin, A. E. (2020). “Entraining” to speech, generating language? Language, Cognition and Neuroscience, 0(0), 1–11. https://doi.org/10.1080/23273798.2020.1827155
  • Meyer, M., Alter, K., Friederici, A. D., Lohmann, G., & Von Cramon, D. Y. (2002). FMRI reveals brain regions mediating slow prosodic modulations in spoken sentences. Human Brain Mapping, 17(2), 73–88. https://doi.org/10.1002/hbm.10042
  • New, B., Ferrand, L., Pallier, C., & Brysbaert, M. (2006). Reexamining the word length effect in visual word recognition: New evidence from the English lexicon project. Psychonomic Bulletin and Review, 13(1), 45–52. https://doi.org/10.3758/BF03193811
  • Oord, A. v. d., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016). WaveNet: A generative model for raw audio. http://arxiv.org/abs/1609.03499
  • Pannekamp, A., Toepel, U., Alter, K., Hahne, A., & Friederici, A. D. (2005). Prosody-driven sentence processing: An event-related brain potential study. Journal of Cognitive Neuroscience, 17(3), 407–421. https://doi.org/10.1162/0898929053279450
  • Pickering, M. J., & Ferreira, V. S. (2008). Structural priming: A critical review. Psychological Bulletin, 134(3), 427–459. https://doi.org/10.1037/0033-2909.134.3.427
  • Pöppel, E. (1997). A hierarchical model of temporal perception. Trends in Cognitive Sciences, 1(2), 56–61. https://doi.org/10.1016/S1364-6613(97)01008-5
  • R Core Team. (2019). R: A language and environment for statistical computing. Accessed 1st April 2019.
  • Reichel, U. D., Mády, K., & Cole, J. (2018). Prosodic entrainment in dialog acts. https://doi.org/10.48550/arxiv.1810.12646
  • Snedeker, J., & Casserly, E. (2010). Is it all relative? Effects of prosodic boundaries on the comprehension and production of attachment ambiguities. Language and Cognitive Processes, 25(7–9), 1234–1264. https://doi.org/10.1080/01690960903525499
  • Sonntag, G. P., & Portele, T. (1998). PURR – A method for prosody evaluation and investigation. Computer Speech and Language, 12(4), 437–451. https://doi.org/10.1006/csla.1998.0107
  • Stefanics, G., Hangya, B., Hernádi, I., Winkler, I., Lakatos, P., & Ulbert, I. (2010). Phase entrainment of human delta oscillations can mediate the effects of expectation on reaction speed. Journal of Neuroscience, 30(41), 13578–13585. https://doi.org/10.1523/JNEUROSCI.0703-10.2010
  • Stehwien, S., & Meyer, L. (2022). Short-term periodicity of prosodic phrasing. Speech Prosody. https://doi.org/10.31234/osf.io/c9sgb.
  • Steinhauer, K., & Friederici, A. D. (2001). Prosodic boundaries, comma rules, and brain responses: The closure positive shift in ERPs as a universal marker for prosodic phrasing in listeners and readers. Journal of Psycholinguistic Research, 30(3), 267–295. https://doi.org/10.1023/A:1010443001646
  • Teoh, E. S., Cappelloni, M. S., & Lalor, E. C. (2019). Prosodic pitch processing is represented in delta-band EEG and is dissociable from the cortical tracking of other acoustic and phonetic features. European Journal of Neuroscience, 50(11), 3831–3842. https://doi.org/10.1111/ejn.14510
  • Tukey, J. W.. (1977). Exploratory Data Analysis (Vol. 2, pp. 131–160). https://doi.org/10.1007/978-1-4419-7976-6.
  • Van Dyke, Julie A, & McElree, Brian. (2011). Cue-dependent interference in comprehension. Journal of Memory and Language, 65(3), 247–263. http://doi.org/10.1016/j.jml.2011.05.002
  • Vollrath, M., Kazenwadel, J., & Krüger, H.-P. P. (1992). A universal constant in temporal segmentation of human speech. Naturwissenschaften, 79(10), 479–480. https://doi.org/10.1007/bf01139205
  • Watson, D. G., & Gibson, E. A. F. (2004). The relationship between intonational phrasing and syntactic structure in language production. Language and Cognitive Processes, 19(6), 713–755. https://doi.org/10.1080/01690960444000070
  • Weidman, S., Breen, M., & Haydon, K. C. (2016). Prosodic speech entrainment in romantic relationships. Proceedings of the International Conference on Speech Prosody, https://doi.org/10.21437/speechprosody.2016-104.
  • White, P. A. (2017). The three-second “subjective present”: A critical review and a new proposal. Psychological Bulletin, 143(7), 735–756. https://doi.org/10.1037/bul0000104
  • Wilson, M., & Wilson, T. P. (2005). An oscillator model of the timing of turn-taking. Psychonomic Bulletin & Review, 12(6), 957–968. https://doi.org/10.3758/BF03206432
  • Young, S. R. (1984). RSVP: A task, reading aid, and research tool. Behavior Research Methods, Instruments, & Computers, 16(2), 121–124. https://doi.org/10.3758/BF03202369.