N400 Brain Responses to Spoken Phrases Paired with Photographs of Scenes: Implications for Visual Scene Displays in AAC Systems

References

• Barrett, S. E., & Rugg, M. D. (1990). Event-related potentials and the semantic matching of pictures. Brain and Cognition, 14, 201–212.
   PubMed Web of Science ®Google Scholar
• Bates, E. (1979). The emergence of symbols: Cognition and communication in infancy. New York: Academic Press.
   Google Scholar
• Bentin, S. (1987). Event-related brain potentials, semantic processes, and expectancy factors in word recognition. Brain and Language, 31, 308–327.
   PubMed Web of Science ®Google Scholar
• Bentin, S., McCarthy, G., & Wood, C. C. (1985). Event-related potentials, lexical decision and semantic priming. Electroencephalography and Clinical Neurophysiology, 60, 343–355.
   PubMedGoogle Scholar
• Besson, M., & Macar, F. (1987). An event-related potential analysis of incongruity in music and other non-linguistic contexts. Psychophysiology, 24, 14–25.
   PubMed Web of Science ®Google Scholar
• Beteleva, T. G., & Farber, D. A. (2002). Role of the frontal cortical areas in the analysis of visual stimuli at conscious and unconscious levels. Human Physiology, 28, 511–519.
   Google Scholar
• Beukelman, D., & Mirenda, P. (2013). Augmentative and alternative communication: Supporting children and adults with complex communication needs (4th ed.). Baltimore, MD: Paul H Brookes Publishing Co.
   Google Scholar
• Blackstone, S. (2005). What are visual scene displays? Augmentative Communication News, 1; see: http://www.imakenews.com/aac-rerc/e_article000344804.cfm?x = b11,0,w
   Google Scholar
• Brady. N. C., Anderson, C. J., Hahn, L. J., Obermeier, S. M., & Kapa, L. L. (2014). Eye tracking as a measure of receptive vocabulary in children with autism spectrum disorders. Augmentative and Alternative Communication, 30, 147–159.
   PubMed Web of Science ®Google Scholar
• Bruner, J. S., Goodnow, J. J., & Austin, G. A. (1956). A study of thinking. New York: Wiley.
   Google Scholar
• Coch, D., Maron, L., Wolf, M., & Holcomb, P. J. (2002). Word and picture processing in children: An event-related potential study. Developmental Neuropsychology, 22, 373–406.
   PubMed Web of Science ®Google Scholar
• Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.
   Google Scholar
• Deacon, T. W. (1997). The symbolic species: The co-evolution of language and the brain. New York: W. W. Norton.
   Google Scholar
• Demiral, S. B., Malcolm, G. L., & Henderson, J. M. (2012). ERP correlates of spatially incongruent object identification during scene viewing: Contextual expectancy versus simultaneous processing. Neuropsychologia, 50, 1271–1285.
   PubMed Web of Science ®Google Scholar
• Dien, J., Michelson, C. A., & Franklin, M. S (2010). Separating the visual sentence N400 effect from the P400 sequential expectancy effect: Cognitive and neuroanatomical implications. Brain Research, 1355, 126–140.
   PubMed Web of Science ®Google Scholar
• Drager, K. D., Light, J. C., Carlson, R., D’Silva, K., Larsson, B., Pitkin, L., & Stopper, G. (2004). Learning of dynamic display AAC technologies by typically developing 3-year-olds: Effect of different layouts and menu approaches. Journal of Speech, Language, and Hearing Research, 47, 1133–1148.
   PubMed Web of Science ®Google Scholar
• Drager, K. D., Light, J. C., Speltz, J. C., Fallon, K. A., & Jeffries, L. Z. (2003). The performance of typically developing 2 1/2-year-olds on dynamic display AAC technologies with different system layouts and language organizations. Journal of Speech, Language, and Hearing Research, 42, 298–312.
   Google Scholar
• Du, X., Hitchman, G., Zhang, Q., & Qiu, J. (2014). An ERP study of expectation violation in a social comparison context. Journal of Psychophysiology, 28, 73–81.
   Web of Science ®Google Scholar
• Dube, W. V., & Wilkinson, K. M. (2014). The potential role of “stimulus overselectivity” in AAC: Information from eye-tracking and behavioral studies of attention. Augmentative and Alternative Communication, 30, 72–85.
   Web of Science ®Google Scholar
• Fishman, I., Yam, A., Bellugi, U., Lincoln, A., & Mills, D. (2010). Contrasting patterns of language-associated brain activity in autism and Williams syndrome. Social Cognitive and Affective Neuroscience, 6, 630–638.
   PubMed Web of Science ®Google Scholar
• Friedrich, M., & Friederici, A. D. (2004). N400-like semantic incongruity effect in 19-month-olds: Processing known words in picture contexts. Journal of Cognitive Neuroscience, 16, 1465–1477.
   PubMed Web of Science ®Google Scholar
• Frishkoff, G. A., Perfetti, C. A., & Collins-Thompson, K. (2010). Lexical quality in the brain: ERP evidence for robust word learning from context. Developmental Neuropsychology, 35, 376–403.
   PubMed Web of Science ®Google Scholar
• Ganis, G., & Kutas, M. (2003). An electrophysiological study of scene effects on object identification. Cognitive Brain Research, 16, 123–144.
   PubMedGoogle Scholar
• Hagoort, P. (2003). Interplay between syntax and semantics during sentence comprehension: ERP effects of combining syntactic and semantic violations. Journal of Cognitive Neuroscience, 15, 883–899.
   PubMed Web of Science ®Google Scholar
• Hamm, J. P., Johnson, B. W., & Kirk, I. J. (2002). Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts. Clinical Neurophysiology, 113, 1339–1350.
   PubMed Web of Science ®Google Scholar
• Holcomb, P. J. (1988). Automatic and attentional processing – an event-related brain potential analysis of semantic priming. Brain and Language, 35, 66–85.
   PubMed Web of Science ®Google Scholar
• Holcomb, P. J. (1993). Semantic priming and stimulus degradation: Implications for the role of the N400 in language processing. Psychophysiology, 30, 47–61.
   PubMed Web of Science ®Google Scholar
• Holcomb, P. J., & Neville, H.J. (1990). Auditory and visual semantic priming in lexical decision: A comparison using event-related brain potentials. Language and Cognitive Processes, 5, 281–312.
   Web of Science ®Google Scholar
• HydroCel Geodesic Sensor Net & Net Station [Apparatus and software]. (2011). Eugene, OR: EGI.
   Google Scholar
• Kroll, J. F., & Potter, M. C. (1984). Recognizing words, pictures and concepts: A comparison of lexical, object and reality decisions. Journal of Verbal Learning and Verbal Behavior, 23, 39–66.
   Google Scholar
• Kutas, M., & Hillyard, S. A. (1980). Event-related brain potentials to semantically inappropriate and surprisingly large words. Biological Psychology, 11, 99–116.
   PubMed Web of Science ®Google Scholar
• Kutas, M., & Hillyard, S. A. (1983). Event-related brain potentials to grammatical errors and semantic anomalies. Memory & Cognition, 11, 539–550.
   PubMed Web of Science ®Google Scholar
• Kutas, M., Lindamood, T. E., & Hillyard, S. A. (1984). Word expectancy and event-related brain potentials during sentence processing. In S. Kornblum & J. Requin (Eds.), Preparatory states and processes (pp. 217–237). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Kutas, M., Van Petten, C., & Besson, M. (1988). Event-related asymmetries during reading of sentences. Electroencephalography and Clinical Neurophysiology, 69, 218–233.
   PubMedGoogle Scholar
• Kutas, M., & Van Petten, C. (1994). Psycholinguistics electrified: Event-related potential investigations. In M.A. Gernsbacher (Ed.), Handbook of neuropsychology (pp. 83–143). Cambridge, MA: Academic Press.
   Google Scholar
• Light, J., & Drager, K. (2007). AAC technologies for young children with complex communication needs: State of the science and future research directions. Augmentative and Alternative Communication, 23, 204–216.
   PubMed Web of Science ®Google Scholar
• Light, J., & McNaughton, D. (2014). From basic to applied research to improve outcomes for individuals who require augmentative and alternative communication: Potential contributions of eye tracking research methods. Augmentative and Alternative Communication, 30, 99–105.
   PubMed Web of Science ®Google Scholar
• Luck, S. (2005). An introduction to the event-related potential technique (2nd edn). Cambridge, MA: MIT Press.
   Google Scholar
• McPherson, W. B., & Holcomb, P. J. (1999). An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology, 36, 53–65.
   PubMed Web of Science ®Google Scholar
• Mecklinger, A., Kramer, A. F., & Strayer, D. L. (1992). Event related potentials and EEG components in a semantic memory search task. Psychophysiology, 29, 104–119.
   Google Scholar
• Molfese, D.L., Morris, R. D., & Romski, M. A. (1990). Semantic discrimination in nonspeaking youngsters with moderate or severe retardation: Electrophysiological correlates. Brain and Language, 38, 61–74.
   PubMed Web of Science ®Google Scholar
• Nigam, A., Hoffman, J. E., & Simons, R. F. (1992). N400 to semantically anomalous pictures and words. Journal of Cognitive Neuroscience, 4, 15–22.
   PubMed Web of Science ®Google Scholar
• Nobre, A.C., & McCarthy, G. (1994). Language-related ERPS: Scalp distributions and modulation by word type and semantic priming. Journal of Cognitive Neuroscience, 6, 233–255.
   PubMed Web of Science ®Google Scholar
• Osterhout, L., & Holcomb, P. J. (1995). Event related potentials and language comprehension. In M. D. Rugg & M. G. Coles (Eds.), Electrophysiology of mind: Event-related brain potentials and cognition (pp. 171–215). New York, NY: Oxford University Press.
   Google Scholar
• Pierce, C. S. (1960). Collected papers of Charles Sanders Peirce (Vols. 1–8). Edited by C. Hartshorne, P. Weiss, & A. Birks. Cambridge, MA: Harvard University Press.
   Google Scholar
• Perfetti, C. A., Wlotko, E. W., & Hart, L. A. (2005). Word learning and individual differences in word learning reflected in event-related potentials. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 1281–1292.
   PubMed Web of Science ®Google Scholar
• Romski, M. A., & Sevcik, R. A. (1996). Breaking the speech barrier: Language development through augmented means. Baltimore, MD: Brookes
   Google Scholar
• Rugg, M. D. (1984). Event-related potentials and the phonological processing of words and non-words. Neuropsychologia, 22, 435–443.
   PubMed Web of Science ®Google Scholar
• Rugg, M. D. (1990). Event-related brain potentials dissociate repetition effects of high and low frequency words. Memory and Cognition, 18, 367–379.
   PubMed Web of Science ®Google Scholar
• Rugg, M. D., & Nagy, M. E. (1987). Lexical contribution to nonword-repetition effects: Evidence from event-related potentials. Memory & Cognition, 15, 473–481.
   PubMed Web of Science ®Google Scholar
• Savage-Rumbaugh, E. S. (1986). Ape language: From conditioned response to symbol. New York: Columbia University Press.
   Google Scholar
• Seidl, R., Hauser, E., Bernert, G., Marx, M., Freilinger, M., & Lubec, G. (1997). Auditory evoked potentials in young patients with Down syndrome: Event-related potentials (P3) and histaminergic system. Cognitive Brain Research, 5, 301–309.
   PubMedGoogle Scholar
• Skinner, B. F. (1957). Verbal behavior. Englewood Cliffs, NJ: Prentice-Hall.
   Google Scholar
• Thiessen, A., Beukelman, D., Ullman, C., & Longenecker, M. (2014). Measurement of the visual attention patterns of people with aphasia: A preliminary investigation of two types of human engagement in photographic images. Augmentative and Alternative Communication, 30, 120–129.
   PubMed Web of Science ®Google Scholar
• Vygotsky, L. (1934/1986). Thought and language. Cambridge, MA: MIT Press.
   Google Scholar
• Wilkinson, K. M., & Light, J. (2014). Preliminary study of gaze toward humans in photographs by individuals with autism, Down syndrome, or other intellectual disability: Implications for design of visual scene displays. Augmentative and Alternative Communication, 30, 130–146.
   PubMed Web of Science ®Google Scholar
• Wilkinson, K. M., Light, J., & Drager, K. (2012). Considerations for the composition of visual scene displays: Potential contributions of information from visual and cognitive sciences. Augmentative and Alternative Communication, 28, 137–147.
   PubMed Web of Science ®Google Scholar
• Wilkinson, K. M., & McIlvane, W. J. (2001). Methods for studying symbolic behavior and category formation: Contributions of stimulus equivalence research. Developmental Review, 21, 355–374.
   Web of Science ®Google Scholar
• Wilkinson, K. M., & Mitchell, T. (2014). Eye-tracking research for answering well-formed questions about augmentative and alternative communication assessment and intervention. Augmentative and Alternative Communication, 30, 106–119.
   PubMed Web of Science ®Google Scholar
• Wittgenstein, L. (1958). Philosophical investigations (3rd ed.). New York: Macmillan.
   Google Scholar