4,166
Views
11
CrossRef citations to date
0
Altmetric
Regular Articles

The neural correlates of word position and lexical predictability during sentence reading: evidence from fixation-related fMRI

, ORCID Icon, , ORCID Icon & ORCID Icon
Pages 613-624 | Received 28 Feb 2018, Accepted 22 Jan 2019, Published online: 10 Feb 2019

References

  • Ashby, J., Rayner, K., & Clifton, C. (2005). Eye movements of highly skilled and average readers: Differential effects of frequency and predictability. The Quarterly Journal of Experimental Psychology Section A, 58, 1065–1086. doi: 10.1080/02724980443000476
  • Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59, 390–412. doi: 10.1016/j.jml.2007.12.005
  • Badre, D., Poldrack, R. A., Paré-Blagoev, E. J., Insler, R. Z., & Wagner, A. D. (2005). Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron, 47, 907–918. doi: 10.1016/j.neuron.2005.07.023
  • Balogh, J., Zurif, E., Prather, P., Swinney, D., & Finkel, L. (1998). Gap-filling and end-of-sentence effects in real-time language processing: Implications for modeling sentence comprehension in aphasia. Brain and Language, 61, 169–182. doi: 10.1006/brln.1997.1917
  • Balota, D. A., Pollatsek, A., & Rayner, K. (1985). The interaction of contextual constraints and parafoveal visual information in reading. Cognitive Psychology, 17, 364–390. doi: 10.1016/0010-0285(85)90013-1
  • Baumgaertner, A., Weiller, C., & Büchel, C. (2002). Event-related fMRI reveals cortical sites involved in contextual sentence integration. Neuroimage, 16, 736–745. doi: 10.1006/nimg.2002.1134
  • Bavelier, D., Corina, D., Jezzard, P., Padmanabhan, S., Prinster, A., Braun, A., … Neville, H. (1997). Sentence reading: A functional MRI study at 4 tesla. Journal of Cognitive Neuroscience, 9, 664–686. doi: 10.1162/jocn.1997.9.5.664
  • Binder, J. R., & Desai, R. H. (2011). The neurobiology of semantic memory. Trends in Cognitive Sciences, 15, 527–536. doi: 10.1016/j.tics.2011.10.001
  • Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009). Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cerebral Cortex, 19, 2767–2796. doi: 10.1093/cercor/bhp055
  • Bottini, G., Corcoran, R., Sterzi, R., Paulesu, E., Schenone, P., Scarpa, P., … Frith, C. D. (1994). The role of the right hemisphere in the interpretation of figurative aspects of language A positron emission tomography activation study. Brain, 117, 1241–1253. doi: 10.1093/brain/117.6.1241
  • Carter, B. T., Foster, B., Muncy, N. M., & Luke, S. G. (2019). Linguistic networks associated with lexical, semantic and syntactic predictability in reading: A fixation-related fMRI study. Neuroimage, 189, 224–240. doi: 10.1016/j.neuroimage.2019.01.018
  • Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36, 181–204. doi: 10.1017/S0140525X12000477
  • Constable, R. T., Pugh, K. R., Berroya, E., Mencl, W. E., Westerveld, M., Ni, W., & Shankweiler, D. (2004). Sentence complexity and input modality effects in sentence comprehension: An fMRI study. Neuroimage, 22, 11–21. doi: 10.1016/j.neuroimage.2004.01.001
  • Dambacher, M., Kliegl, R., Hofmann, M., & Jacobs, A. M. (2006). Frequency and predictability effects on event-related potentials during reading. Brain Research, 1084, 89–103. doi: 10.1016/j.brainres.2006.02.010
  • Dien, J., Franklin, M. S., Michelson, C. A., Lemen, L. C., Adams, C. L., & Kiehl, K. A. (2008). fMRI characterization of the language formulation area. Brain Research, 1229, 179–192. doi: 10.1016/j.brainres.2008.06.107
  • Dikker, S., Rabagliati, H., Farmer, T. A., & Pylkkänen, L. (2010). Early occipital sensitivity to syntactic category is based on form typicality. Psychological Science, 21, 629–634. doi: 10.1177/0956797610367751
  • Dikker, S., Rabagliati, H., & Pylkkänen, L. (2009). Sensitivity to syntax in visual cortex. Cognition, 110, 293–321. doi: 10.1016/j.cognition.2008.09.008
  • Dimigen, O., Sommer, W., Hohlfeld, A., Jacobs, A. M., & Kliegl, R. (2011). Coregistration of eye movements and EEG in natural reading: Analyses and review. Journal of Experimental Psychology: General, 140, 552–572. doi: 10.1037/a0023885
  • Dronkers, N. F., Wilkins, D. P., Van Valin, R. D. Jr., Redfern, B. B., & Jaeger, J. J. (2004). Lesion analysis of the brain areas involved in language comprehension. Cognition, 92, 145–177. doi: 10.1016/j.cognition.2003.11.002
  • Fedorenko, E., Scott, T. L., Brunner, P., Coon, W. G., Pritchett, B., Schalk, G., & Kanwisher, N. (2016). Neural correlate of the construction of sentence meaning. Proceedings of the National Academy of Sciences, 113, E6256–E6262. doi: 10.1073/pnas.1612132113
  • Fitzsimmons, G., & Drieghe, D. (2013). How fast can predictability influence word skipping during reading? Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 1054–1063.
  • Friederici, A. D., Fiebach, C. J., Schlesewsky, M., Bornkessel, I. D., & von Cramon, D. Y. (2005). Processing linguistic complexity and grammaticality in the left frontal cortex. Cerebral Cortex, 16, 1709–1717. doi: 10.1093/cercor/bhj106
  • Friederici, A. D., Rüschemeyer, S. A., Hahne, A., & Fiebach, C. J. (2003). The role of left inferior frontal and superior temporal cortex in sentence comprehension: Localizing syntactic and semantic processes. Cerebral Cortex, 13, 170–177. doi: 10.1093/cercor/13.2.170
  • Friston, K. J. (2009). The free-energy principle: A rough guide to the brain? Trends in Cognitive Sciences, 13, 293–301. doi: 10.1016/j.tics.2009.04.005
  • Friston, K. J. (2010). The free-energy principle: A unified brain theory? Nature Reviews Neuroscience, 11, 127–138. doi: 10.1038/nrn2787
  • Friston, K. J., Glaser, D. E., Henson, R. N. A., Kiebel, S., Phillips, C., & Ashburner, J. (2002). Classical and Bayesian inference in neuroimaging: Applications. Neuroimage, 16, 484–512. doi: 10.1006/nimg.2002.1091
  • Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. (2004). Integration of word meaning and world knowledge in language comprehension. Science, 304, 438–441. doi: 10.1126/science.1095455
  • Hale, J. T. (2001). A probabilistic early parser as a psycholinguistic model. In Proceedings of the second meeting of the North American chapter of the association for computational linguistics (pp. 159–166). Pittsburgh, PA: Association for Computational Linguistics.
  • Haller, S., Klarhoefer, M., Schwarzbach, J., Radue, E. W., & Indefrey, P. (2007). Spatial and temporal analysis of fMRI data on word and sentence reading. European Journal of Neuroscience, 26, 2074–2084. doi: 10.1111/j.1460-9568.2007.05816.x
  • Hartwigsen, G., Henseler, I., Stockert, A., Wawrzyniak, M., Wendt, C., Klingbeil, J., … Saur, D. (2017). Integration demands modulate effective connectivity in a fronto-temporal network for contextual sentence integration. Neuroimage, 147, 812–824. doi: 10.1016/j.neuroimage.2016.08.026
  • Hawelka, S., Schuster, S., Gagl, B., & Hutzler, F. (2015). On forward inferences of fast and slow readers. An eye movement study. Scientific Reports, 5, 8432. doi: 10.1038/srep08432
  • Henderson, J. M., Choi, W., Lowder, M. W., & Ferreira, F. (2016). Language structure in the brain: A fixation-related fMRI study of syntactic surprisal in reading. Neuroimage, 132, 293–300. doi: 10.1016/j.neuroimage.2016.02.050
  • Henderson, J. M., Choi, W., Luke, S. G., & Desai, R. H. (2015). Neural correlates of fixation duration in natural reading: Evidence from fixation-related fMRI. Neuroimage, 119, 390–397. doi: 10.1016/j.neuroimage.2015.06.072
  • Henson, R. N. A. (2004). Analysis of fMRI time series: Linear time-invariant models, event-related fMRI and optimal experimental design. In R. S. J. Frackowiak, K. J. Friston, C. Frith, R. Dolan, C. J. Price, S. Zeki, A. T. Ashburner, & W. D. Penny (Eds.), Human brain function (2nd ed., pp. 793–822). London: Academic Press.
  • Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews Neuroscience, 8, 393–402. doi: 10.1038/nrn2113
  • Himmelstoss, N. A., Schuster, S., Hutzler, F., & Hawelka, S. (under review). Co-registration of eye movements and neuroimaging for studying contextual predictions in natural reading. Language, Cognition and Neuroscience.
  • Humphries, C., Binder, J. R., Medler, D. A., & Liebenthal, E. (2006). Syntactic and semantic modulation of neural activity during auditory sentence comprehension. Journal of Cognitive Neuroscience, 18, 665–679. doi: 10.1162/jocn.2006.18.4.665
  • Humphries, C., Binder, J. R., Medler, D. A., & Liebenthal, E. (2007). Time course of semantic processes during sentence comprehension: An fMRI study. Neuroimage, 36, 924–932. doi: 10.1016/j.neuroimage.2007.03.059
  • Hutzler, F., Braun, M., Võ, L.-H., Engl, V., Hofmann, M., Dambacher, M., … Jacobs, A. M. (2007). Welcome to the real world: Validating fixation-related brain potentials for ecologically valid settings. Brain Research, 1172, 124–129. doi: 10.1016/j.brainres.2007.07.025
  • Kennedy, A. (2003). The Dundee Corpus [CD-ROM]. Dundee: The University of Dundee, Psychology Department.
  • Kiehl, K. A., Laurens, K. R., & Liddle, P. F. (2002). Reading anomalous sentences: An event-related fMRI study of semantic processing. Neuroimage, 17, 842–850. doi: 10.1006/nimg.2002.1244
  • Kliegl, R., Grabner, E., Rolfs, M., & Engbert, R. (2004). Length, frequency, and predictability effects of words on eye movements in reading. European Journal of Cognitive Psychology, 16, 262–284. doi: 10.1080/09541440340000213
  • Kliegl, R., Nuthmann, A., & Engbert, R. (2006). Tracking the mind during reading: The influence of past, present, and future words on fixation durations. Journal of Experimental Psychology: General, 135, 12–35. doi: 10.1037/0096-3445.135.1.12
  • Kuperberg, G. R., Holcomb, P. J., Sitnikova, T., Greve, D., Dale, A. M., & Caplan, D. (2003). Distinct patterns of neural modulation during the processing of conceptual and syntactic anomalies. Journal of Cognitive Neuroscience, 15, 272–293. doi: 10.1162/089892903321208204
  • Kuperberg, G. R., McGuire, P. K., Bullmore, E. T., Brammer, M. J., Rabe-Hesketh, S., Wright, I. C., … David, A. S. (2000). Common and distinct neural substrates for pragmatic, semantic, and syntactic processing of spoken sentences: An fMRI study. Journal of Cognitive Neuroscience, 12, 321–341. doi: 10.1162/089892900562138
  • Kuperberg, G. R., Sitnikova, T., & Lakshmanan, B. M. (2008). Neuroanatomical distinctions within the semantic system during sentence comprehension: Evidence from functional magnetic resonance imaging. Neuroimage, 40, 367–388. doi: 10.1016/j.neuroimage.2007.10.009
  • Kuperman, V., Dambacher, M., Nuthmann, A., & Kliegl, R. (2010). The effect of word position on eye-movements in sentence and paragraph reading. Quarterly Journal of Experimental Psychology, 63, 1838–1857. doi: 10.1080/17470211003602412
  • Lau, E. F., Phillips, C., & Poeppel, D. (2008). A cortical network for semantics: (De)constructing the N400. Nature Reviews Neuroscience, 9, 920–933. doi: 10.1038/nrn2532
  • Levy, R. (2008). Expectation-based syntactic comprehension. Cognition, 106, 1126–1177. doi: 10.1016/j.cognition.2007.05.006
  • Luke, S. G., & Christianson, K. (2016). Limits on lexical prediction during reading. Cognitive Psychology, 88, 22–60. doi: 10.1016/j.cogpsych.2016.06.002
  • Luke, S. G., & Christianson, K. (2018). The Provo Corpus: A large eye-tracking corpus with predictability norms. Behavior Research Methods, 50, 826–833. doi: 10.3758/s13428-017-0908-4
  • Marslen-Wilson, W., & Tyler, L. K. (1975). Processing structure of sentence perception. Nature, 257, 784–786. doi: 10.1038/257784a0
  • Mazoyer, B. M., Tzourio, N., Frak, V., Syrota, A., Murayama, N., Levrier, O., … Mehler, J. (1993). The cortical representation of speech. Journal of Cognitive Neuroscience, 5, 467–479. doi: 10.1162/jocn.1993.5.4.467
  • Mumford, J. A., Poline, J. B., & Poldrack, R. A. (2015). Orthogonalization of regressors in FMRI models. PLoS One, 10, e0126255. doi: 10.1371/journal.pone.0126255
  • Newman, A. J., Pancheva, R., Ozawa, K., Neville, H. J., & Ullman, M. T. (2001). An event-related fMRI study of syntactic and semantic violations. Journal of Psycholinguistic Research, 30, 339–364. doi: 10.1023/A:1010499119393
  • Newman, S. D., Just, M. A., Keller, T. A., Roth, J., & Carpenter, P. A. (2003). Differential effects of syntactic and semantic processing on the subregions of Broca’s area. Cognitive Brain Research, 16, 297–307. doi: 10.1016/S0926-6410(02)00285-9
  • Ni, W., Constable, R. T., Mencl, W. E., Pugh, K. R., Fulbright, R. K., Shaywitz, S. E., … Shankweiler, D. (2000). An event-related neuroimaging study distinguishing form and content in sentence processing. Journal of Cognitive Neuroscience, 12, 120–133. doi: 10.1162/08989290051137648
  • Pallier, C., Devauchelle, A. D., & Dehaene, S. (2011). Cortical representation of the constituent structure of sentences. Proceedings of the National Academy of Sciences, 108, 2522–2527. doi: 10.1073/pnas.1018711108
  • Parker, A. J., Kirkby, J. A., & Slatter, T. J. (2017). Predictability effects during reading in the absence of parafoveal preview. Journal of Cognitive Psychology, 29, 902–911. doi: 10.1080/20445911.2017.1340303
  • Rao, R. P., & Ballard, D. H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2, 79–87. doi: 10.1038/4580
  • Rayner, K., Kambe, G., & Duffy, S. (2000). The effect of clause wrap-up on eye movements during reading. The Quarterly Journal of Experimental Psychology Section A, 53, 1061–1080. doi: 10.1080/713755934
  • Rayner, K., Sereno, S., Morris, R., Schmauder, A., & Clifton, C. (1989). Eye movements and on-line language comprehension processes. Language and Cognitive Processes, 4, SI21–SI49. doi: 10.1080/01690968908406362
  • R Core Team. (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from http://www.R-project.org/
  • Richlan, F., Gagl, B., Hawelka, S., Braun, M., Schurz, M., Kronbichler, M., & Hutzler, F. (2014). Fixation-related fMRI analysis in the domain of reading research: Using self-paced eye movements as markers for hemodynamic brain responses during visual letter string processing. Cerebral Cortex, 24, 2647–2656. doi: 10.1093/cercor/bht117
  • Schoffelen, J. M., Hultén, A., Lam, N., Marquand, A. F., Uddén, J., & Hagoort, P. (2017). Frequency-specific directed interactions in the human brain network for language. Proceedings of the National Academy of Sciences, 114, 8083–8088. doi: 10.1073/pnas.1703155114
  • Schuster, S., Hawelka, S., Hutzler, F., Kronbichler, M., & Richlan, F. (2016). Words in context: The effects of length, frequency, and predictability on brain responses during natural reading. Cerebral Cortex, 26, 3889–3904. doi: 10.1093/cercor/bhw184
  • Schuster, S., Hawelka, S., Richlan, F., Ludersdorfer, P., & Hutzler, F. (2015). Eyes on words: A fixation-related fMRI study of the left occipito-temporal cortex during self-paced silent reading of words and pseudowords. Scientific Reports, 5, 12686. doi: 10.1038/srep12686
  • Staub, A. (2011). The effect of lexical predictability on distributions of eye fixation durations. Psychonomic Bulletin and Review, 18, 371–376. doi: 10.3758/s13423-010-0046-9
  • Staub, A. (2015). The effect of lexical predictability on eye movements in reading: Critical review and theoretical interpretation. Language and Linguistics Compass, 9(8), 311–327. doi: 10.1111/lnc3.12151
  • Thompson-Schill, S. L., D’Esposito, M., Aguirre, G. K., & Farah, M. J. (1997). Role of left inferior prefrontal cortex in retrieval of semantic knowledge: A reevaluation. Proceedings of the National Academy of Sciences, 94, 14792–14797. doi: 10.1073/pnas.94.26.14792
  • Thompson-Schill, S. L., D’Esposito, M., & Kan, I. P. (1999). Effects of repetition and competition on activity in left prefrontal cortex during word generation. Neuron, 23, 513–522. doi: 10.1016/S0896-6273(00)80804-1
  • Turken, A. U., & Dronkers, N. F. (2011). The neural architecture of the language comprehension network: Converging evidence from lesion and connectivity analyses. Frontiers in System Neuroscience, 5, 1. doi: 10.3389/fnsys.2011.00001
  • Vandenberghe, R., Nobre, A. C., & Price, C. J. (2002). The response of the left temporal cortex to sentences. Journal of Cognitive Neuroscience, 14, 550–560. doi: 10.1162/08989290260045800
  • Van Petten, C. (1993). A comparison of lexical and sentence-level context effects in event-related potentials. Language and Cognitive Processes, 8, 485–531. doi: 10.1080/01690969308407586
  • Van Petten, C., & Kutas, M. (1990). Interactions between sentence context and word frequency in event-related brain potentials. Memory & Cognition, 18, 380–393. doi: 10.3758/BF03197127
  • Van Petten, C., & Kutas, M. (1991). Influences of semantic and syntactic context on open- and closed-class words. Memory & Cognition, 19, 95–112. doi: 10.3758/BF03198500
  • Wagner, A. D., Paré-Blagoev, E. J., Clark, J., & Poldrack, R. A. (2001). Recovering meaning: Left prefrontal cortex guides controlled semantic retrieval. Neuron, 31, 329–338. doi: 10.1016/S0896-6273(01)00359-2
  • Willems, R. M., Frank, S. L., Nijhof, A. D., Hagoort, P., & van den Bosch, A. (2016). Prediction during natural language comprehension. Cerebral Cortex, 26, 2506–2516. doi: 10.1093/cercor/bhv075
  • Xu, J., Kemeny, S., Park, G., Frattali, C., & Braun, A. (2005). Language in context: Emergent features of word, sentence, and narrative comprehension. Neuroimage, 25, 1002–1015. doi: 10.1016/j.neuroimage.2004.12.013
  • Xu, Y., Lin, Q., Han, Z., He, Y., & Bi, Y. (2016). Intrinsic functional network architecture of human semantic processing: Modules and hubs. Neuroimage, 132, 542–555. doi: 10.1016/j.neuroimage.2016.03.004
  • Yarkoni, T., Speer, N. K., Balota, D. A., McAvoy, M. P., & Zacks, J. M. (2008). Pictures of a thousand words: Investigating the neural mechanisms of reading with extremely rapid event-related fMRI. Neuroimage, 42, 973–987. doi: 10.1016/j.neuroimage.2008.04.258
  • Zhu, Z., Feng, G., Zhang, J. X., Li, G., Li, H., & Wang, S. (2013). The role of the left prefrontal cortex in sentence-level semantic integration. Neuroimage, 76, 325–331. doi: 10.1016/j.neuroimage.2013.02.060
  • Zhu, Z., Hagoort, P., Zhang, J. X., Feng, G., Chen, H. C., Bastiaansen, M., & Wang, S. (2012). The anterior left inferior frontal gyrus contributes to semantic unification. Neuroimage, 60, 2230–2237. doi: 10.1016/j.neuroimage.2012.02.036