384
Views
4
CrossRef citations to date
0
Altmetric
Original Articles

Validity of an eyetracking method for capturing auditory–visual cross-format semantic priming

ORCID Icon &
Pages 411-431 | Received 03 Aug 2018, Accepted 03 Jan 2019, Published online: 06 Feb 2019

References

  • Adobe Systems Inc. [Computer software]. (2017). Retrieved from http://supportdownloads.adobe.com/detail.jsp?ftpID=4237
  • Allopenna, P. D., Magnusan, J. S., & Tanenhaus, M. K. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38(4), 419–439.
  • Altmann, E. M. (2004). The preparation effect in task switching: Carryover of SOA. Memory and Cognition, 32(1), 153–163.
  • Altmann, E. M., & Gray, W. D. (2008). An integrated model of cognitive control in task switching. Psychological Review, 115(3), 602–639.
  • Altmann, G. T. M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73(3), 247–264.
  • Anderson, J. E., & Holcomb, P. J. (1995). Auditory and visual semantic priming using different stimulus onset asynchronicities: An event-related potential study. Psychophysiology, 32(2), 177–190.
  • Anderson, T. J., & MacAskill, M. R. (2013). Eye movements in patients with neurodegenerative disorders. Nature Reviews Neurology, 9(2), 74–85.
  • Andreou, C., Veith, K., Bozikas, V. P., Lincoln, T. M., & Moritz, S. (2014). Effects of dopaminergic modulation on automatic semantic priming: A double-blind study. Journal of Psychiatry & Neuroscience, 39(2), 110–117.
  • Angwin, A. J., Chenery, H. J., Copland, D. A., Murdoch, B. E., & Silburn, P. A. (2005). Summation of semantic priming and complex sentence comprehension in Parkinson’s disease. Cognitive Brain Research, 25(1), 78–89.
  • Arias-Trejo, N., & Plunkett, K. (2009). Lexical-semantic priming effects during infancy. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1536), 3633–3647.
  • Arias-Trejo, N., & Plunkett, K. (2013). What’s in a link: Associative and taxonomic priming effects in the infant lexicon. Cognition, 128(2), 214–227.
  • Balota, D. A. (1994). Visual word recognition: The journey from features to meaning. In M. A. Gernsbacher (Ed.), Handbook of Psycholinguistics (pp. 303–348). San Diego, CA: Academic Press.
  • Balota, D. A., & Duchek, J. M. (1988). Age-related differences in lexical access, spreading activation, simple pronunciation. Psychology and Aging, 3(1), 84–93.
  • Boyd, J. E., Patriciu, I., McKinnon, M. C., & Kiang, M. (2014). Test-retest reliability of N400 event-related brain potential measures in a word-pair semantic priming paradigm in patients with schizophrenia. Schizophrenia Research, 158(1–3), 195–203.
  • Branigan, H. P., Pickering, M. J., Liversedge, S. P., Stewart, A. J., & Urbach, T. P. (1995). Syntactic priming: Investigating the mental representation of language. Journal of Psycholinguistic Research, 24(6), 489–506.
  • Bushell, C. (1996). Dissociated identity and semantic priming in Broca’s aphasia: How controlled processing produces inhibitory semantic priming. Brain and Language, 55(2), 264–288.
  • Cabeza, R., & Nyberg, L. (2000). Imaging cognition II: An empirical review of 275 PET and fMRI studies. Journal of Cognitive Neuroscience, 12(1), 1–47.
  • Carroll, P., & Slowiaczek, M. L. (1986). Constraints on semantic priming in reading: A fixation time analysis. Memory and Cognition, 14(6), 509–522.
  • Carter, M. D., Hough, M. S., Stuart, A., & Rastatter, M. P. (2011). The effects of inter-stimulus interval and prime modality in a semantic priming task. Aphasiology, 25(6–7), 761–773.
  • Charness, G., Gneezy, U., & Kuhn, M. (2012). Experimental methods: Between-subject and within-subject design. Journal of Economic Behavior and Organization, 8(1), 1–8.
  • Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197.
  • Chen, Y.-C., & Spence, C. (2010). When hearing the bark helps to identify the dog: Semantically-congruent sounds modulate the identification of masked pictures. Cognition, 114(3), 389–404.
  • Chen, Y.-C., & Spence, C. (2011). Crossmodal semantic priming by naturalistic sounds and spoken words enhances visual sensitivity. Journal of Experimental Psychology: Human Perception and Performance, 37(5), 1554–1568.
  • Chetail, F., & Mathey, S. (2009). Syllabic priming in lexical decision and naming tasks. Canadian Journal of Experimental Psychology, 63(1), 40–48.
  • Choy, J. J., & Thompson, C. K. (2005). Online comprehension of anaphor and pronoun constructions in Broca’s aphasia: Evidence from eyetracking. Brain and Language, 95(1), 119–120.
  • Dahan, D., Magnuson, J. S., & Tanenhaus, M. K. (2001). Time course of frequency effects in spoken-word recognition: Evidence from eye movements. Cognitive Psychology, 42(4), 317–367.
  • De Graef, P., Christiaens, D., & d’Ydewalle, G. (1990). Perceptual effects of scene context on object identification. Psychological Research, 52(4), 317–329.
  • DeDe, G. (2012). Effects of word frequency and modality on sentence comprehension impairments in people with Aphasia. American Journal of Speech-Language Pathology/American Speech-Language-Hearing Association, 21(2), S103–S114.
  • DeGroot, A. M. (1984). Primed lexical decision: Combined effects of the proportion of related prime-target pairs and the stimulus-onset asynchrony of prime and target. Quarterly Journal of Experimental Psychology, 36(2), 253–280.
  • Del Toro, J. (2000). An examination of automatic versus strategic semantic priming effects in Broca’s aphasia. Aphasiology, 14(9), 925–947.
  • Den Heyer, K., Briand, K., & Dannenbring, G. (1983). Strategic factors in a lexical decision task: Evidence for automatic and attention-driven processes. Memory and Cognition, 11(4), 374–381.
  • Dickey, M. W., Choy, J. J., & Thompson, C. K. (2007). Real-time comprehension of wh- movement in aphasia: Evidence from eyetracking while listening. Brain and Language, 100(1), 1–22.
  • Eddy, M. D., & Holcomb, P. J. (2010). The temporal dynamics of masked repetition picture priming effects: Manipulations of stimulus-onset asynchrony (SOA) and prime duration. Brain Research, 1340, 24–39.
  • Empirisoft Corporation (2016). Directrt. Available from http://www.empirisoft.com/directrt.aspx
  • Empirisoft Corporation (2016). DirectRT. Retrieved from http://www.empirisoft.com/directrt.aspx
  • Farris-Trimble, A., & McMurray, B. (2013). Test-retest reliability of eye tracking in the visual world paradigm for the study of real-time spoken word recognition. Journal of Speech, Language, and Hearing Research, 56(4), 1328–1345.
  • Ferrand, L., Segui, J., & Grainger, J. (1996). Masked priming of word and picture naming: The role of syllabic units. Journal of Memory and Language, 35(5), 708–723.
  • Fischler, I. (1977). Semantic facilitation without association in a lexical decision task. Memory and Cognition, 5(3), 335–339.
  • Forster, K. I. (1981). Priming and the effects of the sentence and lexical contexts on naming time: Evidence for autonomous lexical processing. Quarterly Journal of Experimental Psychology, 33A, 465–495.
  • Forster, K. I. (2004). Category size effects revisited: Frequency and masked priming effects in semantic categorization. Brain and Language, 90(1–3), 276–286.
  • Frost, R., Kugler, T., Deutsch, A., & Forster, K. (2005). Orthographic structure versus morphological structure: Principles of lexical organization in a given language. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(6), 1293–1326.
  • GNU Image Manipulation Program [Computer Software] (2016). Retrieved from http://www.gimp.org/
  • Goldinger, S. D. (1996). Auditory lexical decision. Language and Cognitive Processes, 11(6), 559–567.
  • Gorden, W. P. (1983). Memory disorders in aphasia—I. Auditory immediate recall. Neuropsychologica, 21(4), 325–339.
  • Hagoort, P. (1993). Impairments of lexical-semantic processing in aphasia: Evidence from the processing of lexical ambiguities. Brain and Language, 45(2), 189–232.
  • Hagoort, P. (1997). Semantic priming in Broca’s aphasia at a short SOA: No support for an automatic access deficit. Brain and Language, 56(2), 287–300.
  • Hallowell, B. (1999). A new way of looking at linguistic comprehension. In W. Becker, H. Deubel, & T. Mergner (Eds.), Current occulomotor research: Physiological and psychological aspects (pp. 287–291). New York, NY: Plenum Press.
  • Hallowell, B. (2008). Strategic design of protocols to evaluate vision in research on aphasia and related disorders. Aphasiology, 22(6), 600–617.
  • Hallowell, B., & Chapey, R. (2008). Introduction to language intervention strategies in adult aphasia. In R. Chapey (Ed.), Language intervention strategies in aphasia and related communication disorders (5th ed., pp. 3–19). Philadelphia: Lippincott Williams & Wilkins.
  • Hallowell, B., Wertz, R. T., & Kruse, H. (2002). Using eye-movement responses to index auditory responses to index auditory comprehension. An adaptation of the revised token test. Aphasiology, 16(4–6), 587–594.
  • Henderson, J. M., & Ferreira, F. (2004). Scene perception for psycholinguistics. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision and action: Eye movements and the visual world (pp. 1–58). New York: Psychology Press.
  • Henderson, J. M., Weeks, P. A., & Hollingworth, A. (1999). The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology: Human Perception and Performance, 25(1), 210–228.
  • Heuer, S., & Hallowell, B. (2007). An evaluation of test images for multiple-choice comprehension assessment in aphasia. Aphasiology, 21(9), 883–900.
  • Heuer, S., & Hallowell, B. (2009). Visual attention in a multiple-choice task: Influences of image characteristics with and without presentation of a verbal stimulus. Aphasiology, 23(3), 351–363.
  • Heyman, T., Van Rensbergen, B., Storms, G., Hutchison, K. A., & De Deyne, S. (2015). The influence of working memory load on semantic priming. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(3), 911–920.
  • Howells, S. R., & Cardell, E. A. (2015). Semantic priming in anomic aphasia: A focused investigation using cross-modal methodology. Aphasiology, 29(6), 744–761.
  • Huettig, F., & Altmann, G. T. M. (2004). The online processing of ambiguous and unambiguous words in context: Evidence from head-mounted eye-tracking. In M. Carreiras & C. Clifton (Eds.), The on-line study of sentence comprehension: Eyetracking, ERP and beyond (pp. 187–207). New York, NY: Psychology Press.
  • Huettig, F., & Altmann, G. T. M. (2005). Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm. Cognition, 96(1), 23–32.
  • Huettig, F., & Altmann, G. T. M. (2011). Looking at anything that is green when hearing “frog”: How object surface colour and stored object colour knowledge influence language-mediated overt attention. The Quarterly Journal of Experimental Psychology, 64(1), 122–145.
  • Hutchison, K. A. (2007). Attentional control and the relatedness proportion effect in semantic priming. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33(4), 645–662.
  • Hutchison, K. A., Balota, D. A., Neely, J. H., Cortese, M. J., Cohen-Shikora, E. R., Tse, C.-S., … Buchanan, E. (2013). The semantic priming project. Behavior Research Methods, 45(4), 1099–1114.
  • Hyönä, J., & Niemi, P. (1990). Eye movements during repeated reading of a text. Acta Psychologica, 73(3), 259–280.
  • Ivanova, M. V., & Hallowell, B. (2012). Validity of an eye-tracking method to index working memory in people with and without aphasia. Aphasiology, 26(3–4), 556–578.
  • Ivanova, M. V., & Hallowell, B. (2013). A tutorial on aphasia test development in any language: Key substantive and psychometric considerations. Aphasiology, 27(8), 891–920.
  • Karsh, R., & Breitenbach, F. W. (1983). Looking at looking: The amorphous fixation measure. In R. Groner, C. Menz, D. F. Fisher, & R. Monty (Eds.), Eye-movements and psychological functions. International views (pp. 53–64). Hillsdale, NJ: Lawrence Erlbaum.
  • Kemper, S., & McDowd, J. (2006). Eye movements of young and older adults while reading with distraction. Psychology and Aging, 21(1), 32–39.
  • Kischka, U., Kammer, T., Maier, S., Weisbrod, M., Thimm, M., & Spitzer, M. (1996). Dopaminergic modulation of semantic network activation. Neuropsychologia, 34(11), 1107–1113.
  • Knoblich, G, Ohlsson, S, & Raney, G. E. (2001). An eye movement study of insight problem solving. Memory & Cognition, 29(7), 1000–1009.
  • LC Technologies. (2015). Eyegaze. Retrieved from http://www.eyegaze.com/
  • Leberton, K., Baron, J., & Eustache, F. (2001). Visual priming within and across symbolic format using a tachistoscopic picture identification task: A PET study. Journal of Cognitive Neuroscience, 13(5), 670–686.
  • Liu, H., Bates, E., Powell, T., & Wulfeck, B. (1997). Single-word shadowing and the study of lexical access. Applied Psycholinguistics, 18(2), 157–180.
  • Lively, S. E., Pisoni, D. B., & Goldinger, S. D. (1994). Spoken word recognition: Research and theory. In M. A. Gernbacher (Ed.), Handbook of psycholinguistics (pp. 265–301). San Diego, CA: Academic Press.
  • Lucas, M. (2000). Semantic priming without association: A meta-analytic review. Psychonomic Bulletin & Review, 7(4), 618–630.
  • Mack, J. E., Ji, W., & Thompson, C. K. (2013). Effects of verb meaning on lexical integration in agrammatic aphasia: Evidence from eyetracking. Journal of Neurolinguistics, 26(6), 619–636.
  • Manor, B., & Gordon, E. (2003). Defining the temporal threshold for ocular fixation in free-viewing visuocognitive tasks. Journal of Neuroscience Methods, 128(1–2), 85–93.
  • McNamara, T. P. (2005). Semantic priming perspectives from memory and word recognition. New York, NY: Psychology Press.
  • Mertus, J. A. (2000). The brown lab interactive speech system. Providence, RI: Brown University.
  • Meyer, A. M., Mack, J. E., & Thompson, C. K. (2012). Tracking passive sentence comprehension in agrammatic aphasia. Journal of Neurolinguistics, 25(1), 31–43.
  • Meyer, D. E. (2014). Semantic priming well established. Science, 345(6196), 523.
  • Meyer, D. E., & Schvaneveldt, R. W. (1971). Facilitation in recognizing pairs of words: Evidence of a dependence between retrieval operations. Journal of Experimental Psychology, 90(2), 227–234.
  • Meyer, D. E., Schvaneveldt, R. W., & Ruddy, M. G. (1975). Loci of contextual effects on visual word recognition. In P. M. A. Rabbit & S. Dornic (Eds.), Attention and performance V (pp. 99–118). New York, NY: Academic Press.
  • Milberg, W., Blumstein, S. E., & Dworetzky, B. (1988). Phonological processing and lexical access in aphasia. Brain and Language, 34(2), 279–293.
  • Milberg, W., Blumstein, S. E., Katz, D., Gershberg, F., & Brown, T. (1995). Semantic facilitation in aphasia: Effects of time and expectancy. Journal of Cognitive Neuroscience, 7(1), 33–50.
  • Mirman, D, & Magnuson, J. S. (2009). Dynamics of activation of semantically similar concepts during spoken word recognition. Memory & Cognition, 37(7), 1026–1039.
  • Mirman, D., Yee, E., Blumstein, S. E., & Magnuson, J. S. (2011). Theories of spoken word recognition deficits in Aphasia: Evidence from eyetracking and computational modeling. Brain and Language, 117(2), 53–68.
  • Murphy, K., & Hunt, H. (2013). The time course of semantic and associative priming effects is different in an attentional blink task. Cognitive Processing, 14(3), 283–292.
  • Murray, L. L. (1999). Review attention and aphasia: theory, research and clinical implications. Aphasiology, 13(20), 91-111.
  • Neely, J. H. (1977). Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited capacity attention. Journal of Experimental Psychology: General, 106(3), 226–254.
  • Neely, J. H. (1991). Semantic priming effects in visual word recognition: A selective review of current findings and theories. In D. Besner & G. W. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 265–335). Hillsdale, NJ: Erlbaum.
  • Odekar, A., Hallowell, B., Kruse, H., Moates, D., & Lee, C. (2009). Validity of eye-movement methods and indices for capturing semantic (associative) priming effects. Journal of Speech, Language, and Hearing Research, 52, 31–48.
  • Osterhout, L., Kim, A., & Kuperberg, G. R. (2012). The neurobiology of sentence comprehension. In M. Spivey, M. Joannisse, & K. McCrae (Eds.), The Cambridge handbook of psycholinguistics (pp. 365–389). Cambridge, MA: Cambridge University Press.
  • Osterhout, L, McLaughlin, J, Kim, A, Greenwald, R, & Inoue, K. (2004). Sentences in the brain: event-related potentials as real-time reflections of sentence comprehension and language learning. In (Eds.), The online study of sentence comprehension (pp. 271–308). New York, NY: Psychology Press.
  • Palermo, D. S., & Jenkins, J. J. (1964). Word association norms: Grade school through college. Minneapolis: University of Minnesota Press.
  • Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R., Jr., & Taylor, M. J. (2000). Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology, 37(2),127–152.
  • Pilotti, M., Bergman, E. T., Gallo, D. A., Sommers, M., & Roediger, H. L. (2000). Direct comparison of auditory implicit memory tests. Psychonomic Bulletin & Review, 7(2), 347–353.
  • Price, C. J., & Humphreys, G. W. (1989). The effects of surface detail on object categorization and naming. The Quarterly Journal of Experimental Psychology, 41(4), 797–827.
  • Ramat, R., Leigh, J., Zee, D., & Optican, L. (2007). What clinical disorders tell us about the neural control of saccadic eye movements. Brain, 130(1), 10–35.
  • Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology, 62(8), 1457–1506.
  • Rodriguez-Fornells, A, Münte, T. F, & Clahsen, H. (2002). Morphological priming in spanish verb forms: an erp repetition priming study. Journal Of Cognitive Neuroscience, 14(3), 443–454.
  • Rossell, S. L., Price, C. J., & Nobre, A. C. (2003). The anatomy and time course of semantic priming investigated by fMRI and ERPs. Neuropsychologia, 41(5), 550–564.
  • Rossion, B., & Pourtois, G. (2004). Revisiting Snodgrass and Vanderwart’s object pictorial set: The role of surface detail in basic-level object recognition. Perception, 33(2), 217–236.
  • Schad, D. J., Risse, S., Slattery, T., & Rayner, K. (2014). Word frequency in fast priming: Evidence for immediate cognitive control of eye movements during reading. Visual Cognition, 22(3), 390–414.
  • Schvaneveldt, R. W., Meyer, D. E., & Becker, C. A. (1976). Lexical ambiguity, semantic context, and visual word recognition. Journal of Experimental Psychology: Human Perception and Performance, 2(2), 243–256.
  • Shapiro, L., Swinney, D., & Borsky, S. (1998). Online examination of language performance in normal and neurologically impaired adults. American Journal of Speech-Language Pathology, 7, 49–60.
  • Silkes, J. P., & Rogers, M. A. (2012). Masked priming effects in aphasia: Evidence of altered automatic spreading activation. Journal of Speech, Language, and Hearing Research, 55(6), 1613–1625.
  • Siyambalapitiya, S., Chenery, H. J., & Copland, D. A. (2013). Lexical-semantic representation in bilingual aphasia: Findings from semantic priming and cognate repetition priming. Aphasiology, 27(11), 1302–1321.
  • Snodgrass, J. G., & Vanderwart, M. (1980). A standardized set of 260 pictures: Norms for name agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory, 6(2), 174–215.
  • Soni, M., Lambon Ralph, M. A., & Woollams, A. M. (2012). Repetition priming of picture naming in semantic aphasia: The impact of intervening items. Aphasiology, 26(1), 44–63.
  • Stevenage, S. V., Hale, S., Morgan, Y., & Neil, G. J. (2014). Recognition by association: Within- and cross-modality associative priming with faces and voices. British Journal of Psychology, 105(1), 1–16.
  • Tabossi, P. (1996). Cross-modal semantic priming. Language and Cognitive Processes, 11(6), 569–576.
  • Tanaka, J. W., & Presnell, L. M. (1999). Color diagnosticity in object recognition. Perception & Psychophysics, 61(6), 1140–1153.
  • Tanenhaus, M. K., Magnusan, J. S., Dahan, D., & Chambers, C. (2000). Eye movements and lexical access in spoken-language comprehension: Evaluating a linking hypothesis between fixations and linguistic processing. Journal of Psycholinguistic Research, 29(6), 557–580.
  • Therriault, D. J., Yaxley, R. H., & Zwaan, R. A. (2009). The role of color diagnosticity in object recognition and representation. Cognitive Processing, 10(4), 335–342.
  • Thiessen, A., Beukelman, D., Ullman, C., & Longenecker, M. (2014). Measurement of the visual attention patterns of people with Aphasia: A preliminary investigation of two types of human engagement in photographic images. Augmentative and Alternative Communication, 30(2), 120–129.
  • Uttal, W. R. (2001). Life and mind: Philosophical issues in biology and psychology. The new phrenology: The limits of localizing cognitive processes in the brain. Cambridge, MA, US: The MIT Press.
  • van der Laan, L. N., Papies, E. K., Hooge, I. T. C., & Smeets, P. A. M. (2017). Goal-directed visual attention drives health goal priming: An eye-tracking experiment. Health Psychology, 36(1), 82–90.
  • Yap, M. J., Hutchison, K. A., & Tan, L. C. (2017). Individual differences in semantic priming performance: Insights from the semantic priming project. In M. N. Jones (Ed.), Big data in cognitive science: From methods to insights (pp. 1–42). New York, NY: Psychology Press.
  • Yee, E, Blumstein, S. E, & Sedivy, J. C. (2008). Lexical-semantic activation in broca's and wernicke's aphasia: evidence from eye movements. Journal Of Cognitive Neuroscience, 20(4), 592–612.
  • Yee, E., Overton, E., & Thompson-Schill, S. (2009). Looking for meaning: Eye movements are sensitive to overlapping semantic features, not association. Psychometric Bulletin and Review, 16(5), 869–874.
  • Yee, E., & Sedivy, J. C. (2006). Eye movements to pictures reveal transient semantic activation during spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(1), 1–14.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.