More than words (and faces): evidence for a Stroop effect of prosody in emotion word processing

References

• Belin, P., Fecteau, S., & Bédard, C. (2004). Thinking the voice: Neural correlates of voice perception. Trends in Cognitive Sciences, 8, 129–135. doi: 10.1016/j.tics.2004.01.008
   PubMed Web of Science ®Google Scholar
• Bower, G. H. (1987). Commentary on mood and memory. Behaviour Research and Therapy, 25, 443–455. doi: 10.1016/0005-7967(87)90052-0
   PubMed Web of Science ®Google Scholar
• Brosch, T., Grandjean, D., Sander, D., & Scherer, K. R. (2009). Cross-modal emotional attention: Emotional voices modulate early stages of visual processing. Journal of Cognitive Neuroscience, 21, 1670–1679. doi: 10.1162/jocn.2009.21110
   PubMed Web of Science ®Google Scholar
• Campanella, S., & Belin, P. (2007). Integrating face and voice in person perception. Trends in Cognitive Sciences, 11, 535–543. doi: 10.1016/j.tics.2007.10.001
   PubMed Web of Science ®Google Scholar
• Cutler, A. (1974). On saying what you mean without meaning what you say. In M. W. LaGaly, R. A. Fox, & A. Bruck (Eds.), Papers from the tenth regional meeting, Chicago Linguistic Society (pp. 117–127). Chicago: Chicago Linguistic Society.
   Google Scholar
• De Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14, 289–311. doi: 10.1080/026999300378824
   Web of Science ®Google Scholar
• Eimer, M., Holmes, A., & McGlone, F. P. (2003). The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions. Cognitive, Affective, & Behavioral Neuroscience, 3(2), 97–110. doi: 10.3758/CABN.3.2.97
   PubMed Web of Science ®Google Scholar
• Fagel, S. (2006). Emotional McGurk effect. Proceedings of the international conference on speech prosody, Dresden, 1.
   Google Scholar
• Filippi, P., Gingras, B., & Fitch, W. T. (2014). Pitch enhancement facilitates word learning across visual contexts. Frontiers in Psychology, 5, 1–8. doi: 10.3389/fpsyg.2014.01468
   PubMed Web of Science ®Google Scholar
• Fischer, A. H., & Roseman, I. J. (2007). Beat them or ban them: The characteristics and social functions of anger and contempt. Journal of Personality and Social Psychology, 93, 103–115. doi: 10.1037/0022-3514.93.1.103
   PubMed Web of Science ®Google Scholar
• Fitch, W. T. (2010). The evolution of language. Cambridge: Cambridge University Press.
   Google Scholar
• Ganong, W. F. (1980). Phonetic categorization in auditory word perception. Journal of Experimental Psychology: Human Perception and Performance, 1, 100–125.
   Google Scholar
• Grandjean, D., Baenziger, T., & Scherer, K. R. (2006). Intonation as an interference between language and affect. Progress in Brain Research, 156, 1–13.
   Web of Science ®Google Scholar
• Grimshaw, G. M. (1998). Integration and interference in the cerebral hemispheres: Relations with hemispheric specialization. Brain and Cognition, 36, 108–127. doi: 10.1006/brcg.1997.0949
   PubMed Web of Science ®Google Scholar
• Ho, H. T., Schröger, E., & Kotz, S. A. (2015). Selective attention modulates early human evoked potentials during emotional face–voice processing. Journal of Cognitive Neuroscience, 27, 798–818. doi: 10.1162/jocn_a_00734
   PubMed Web of Science ®Google Scholar
• Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65–70.
   Web of Science ®Google Scholar
• Ishii, K., Reyes, J. A., & Kitayama, S. (2003). Spontaneous attention to word content versus emotional tone differences among three cultures. Psychological Science, 14, 39–46. doi: 10.1111/1467-9280.01416
   PubMed Web of Science ®Google Scholar
• Johnson, E. K., & Jusczyk, P. W. (2001). Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language, 44, 548–567. doi: 10.1006/jmla.2000.2755
   Web of Science ®Google Scholar
• Johnson-Laird, P. N., & Oatley, K. (1989). The language of emotions: An analysis of a semantic field. Cognition and Emotion, 3(2), 81–123. doi: 10.1080/02699938908408075
   Google Scholar
• Kitayama, S., & Ishii, K. (2002). Word and voice: Spontaneous attention to emotional utterances in two languages. Cognition & Emotion, 16, 29–59. doi: 10.1080/0269993943000121
   Web of Science ®Google Scholar
• van Kleef, G. A., De Dreu, C. K. W., & Manstead, A. S. R. (2004). The interpersonal effects of anger and happiness in negotiations. Journal of Personality and Social Psychology, 86, 57–76. doi: 10.1037/0022-3514.86.1.57
   PubMed Web of Science ®Google Scholar
• Kotz, S. A., Meyer, M., & Paulmann, S. (2006). Lateralization of emotional prosody in the brain: An overview and synopsis on the impact of study design. Progress in Brain Research, 156, 285–294. doi: 10.1016/S0079-6123(06)56015-7
   PubMed Web of Science ®Google Scholar
• Liu, P., Rigoulot, S., & Pell, M. D. (2015). Culture modulates the brain response to human expressions of emotion: Electrophysiological evidence. Neuropsychologia, 67, 1–13. doi: 10.1016/j.neuropsychologia.2014.11.034
   PubMed Web of Science ®Google Scholar
• MacLeod, C. M., & MacDonald, P. A. (2000). Interdimensional interference in the Stroop effect: Uncovering the cognitive and neural anatomy of attention. Trends in Cognitive Sciences, 4, 383–391. doi: 10.1016/S1364-6613(00)01530-8
   PubMed Web of Science ®Google Scholar
• Marslen-Wilson, W. D. (1987). Functional parallelism in spoken word-recognition. Cognition, 25, 71–102. doi: 10.1016/0010-0277(87)90005-9
   PubMed Web of Science ®Google Scholar
• Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychonomic Bulletin & Review, 3, 215–221. doi: 10.3758/BF03212421
   PubMed Web of Science ®Google Scholar
• McClelland, J. L., & Elman, J. L. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1–86. doi: 10.1016/0010-0285(86)90015-0
   PubMed Web of Science ®Google Scholar
• McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748. doi: 10.1038/264746a0
   PubMed Web of Science ®Google Scholar
• Mitchell, R. L. C. (2006). How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico-semantic cues. European Journal of Neuroscience, 24, 3611–3618. doi: 10.1111/j.1460-9568.2006.05231.x
   PubMed Web of Science ®Google Scholar
• Mithen, S. J. (2005). The singing Neanderthals: The origins of music, language, mind, and body. London: Weidenfeld & Nicholson.
   Google Scholar
• Morton, E. S. (1977). On the occurrence and significance of motivation-structural rules in some bird and mammal sounds. American Naturalist, 111(981), 855–869. doi: 10.1086/283219
   Web of Science ®Google Scholar
• Morton, J. (1969). Interaction of information in word recognition. Psychological Review, 76, 165–178. doi: 10.1037/h0027366
   Web of Science ®Google Scholar
• Nygaard, L. C., Herold, D. S., & Namy, L. L. (2009). The semantics of prosody: Acoustic and perceptual evidence of prosodic correlates to word meaning. Cognitive Science, 33, 127–146. doi: 10.1111/j.1551-6709.2008.01007.x
   PubMed Web of Science ®Google Scholar
• Nygaard, L. C., & Lunders, E. R. (2002). Resolution of lexical ambiguity by emotional tone of voice. Memory & Cognition, 30, 583–593. doi: 10.3758/BF03194959
   PubMed Web of Science ®Google Scholar
• Nygaard, L. C., & Queen, J. S. (2008). Communicating emotion: Linking affective prosody and word meaning. Journal of Experimental Psychology: Human Perception and Performance, 34, 1017–1030.
   PubMed Web of Science ®Google Scholar
• Paulmann, S., & Kotz, S. A. (2008). An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo- and lexical-sentence context. Brain and Language, 105, 59–69. doi: 10.1016/j.bandl.2007.11.005
   PubMed Web of Science ®Google Scholar
• Paulmann, S., & Pell, M. D. (2011). Is there an advantage for recognizing multi-modal emotional stimuli? Motivation and Emotion, 35(2), 192–201. doi: 10.1007/s11031-011-9206-0
   Web of Science ®Google Scholar
• Paulmann, S., Titone, D., & Pell, M. D. (2012). How emotional prosody guides your way: evidence from eye movements. Speech Communication, 54, 92–107. doi: 10.1016/j.specom.2011.07.004
   Web of Science ®Google Scholar
• Peirce, J. W. (2007). PsychoPy – Psychophysics software in Python, 162, 8–13.
   Google Scholar
• Pell, M. D. (2002). Evaluation of nonverbal emotion in face and voice: Some preliminary findings on a new battery of tests. Brain and Cognition, 48, 499–514.
   PubMed Web of Science ®Google Scholar
• Pell, M. D. (2005). Nonverbal emotion priming: Evidence from the facial affect decision task. Journal of Nonverbal Behavior, 29, 45–73. doi: 10.1007/s10919-004-0889-8
   Web of Science ®Google Scholar
• Pell, M. D., Jaywant, A., Monetta, L., & Kotz, S. A. (2011). Emotional speech processing: Disentangling the effects of prosody and semantic cues. Cognition & Emotion, 25, 834–853. doi: 10.1080/02699931.2010.516915
   PubMed Web of Science ®Google Scholar
• Plant, R. R., & Turner, G. (2009). Millisecond precision psychological research in a world of commodity computers: New hardware, new problems? Behavior Research Methods, 41(3), 598–614. doi: 10.3758/BRM.41.3.598
   PubMed Web of Science ®Google Scholar
• Rigoulot, S., & Pell, M. D. (2012). Seeing emotion with your ears: Emotional prosody implicitly guides visual attention to faces. PLoS One, 7, e30740. doi: 10.1371/journal.pone.0030740
   Google Scholar
• Schirmer, A. (2010). Mark my words: Tone of voice changes affective word representations in memory. PloS One, 5, e9080. doi: 10.1371/journal.pone.0009080
   Web of Science ®Google Scholar
• Schirmer, A., & Kotz, S. A. (2003). ERP evidence for a sex-specific Stroop effect in emotional speech. Journal of Cognitive Neuroscience, 15, 1135–1148. doi: 10.1162/089892903322598102
   PubMed Web of Science ®Google Scholar
• Schirmer, A., & Kotz, S. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10, 24–30. doi: 10.1016/j.tics.2005.11.009
   PubMed Web of Science ®Google Scholar
• Schirmer, A., Kotz, S. A., & Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research, 14, 228–233. doi: 10.1016/S0926-6410(02)00108-8
   PubMedGoogle Scholar
• Schwartz, R., & Pell, M. D. (2012). Emotional speech processing at the intersection of prosody and semantics. PloS One, 7, e47279. doi: 10.1371/journal.pone.0047279
   PubMed Web of Science ®Google Scholar
• Scott, G. G., O’Donnell, P. J., Leuthold, H., & Sereno, S. C. (2009). Early emotion word processing: Evidence from event-related potentials. Biological psychology, 80(1), 95–104. doi: 10.1016/j.biopsycho.2008.03.010
   PubMed Web of Science ®Google Scholar
• Soderstrom, M., Seidl, A., Nelson, D., & Jusczyk, P. W. (2003). The prosodic bootstrapping of phrases: Evidence from prelinguistic infants. Journal of Memory and Language, 49, 249–267. doi: 10.1016/S0749-596X(03)00024-X
   Web of Science ®Google Scholar
• Stenberg, G., Wiking, S., & Dahl, M. (1998). Judging words at face value: Interference in a word processing task reveals automatic processing of affective facial expressions. Cognition & Emotion, 12, 755–782. doi: 10.1080/026999398379420
   Web of Science ®Google Scholar
• Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643–662. doi: 10.1037/h0054651
   Google Scholar
• Wildgruber, D., Ackermann, H., Kreifelts, B., & Ethofer, T. (2006). Cerebral processing of linguistic and emotional prosody: fMRI studies. Progress in Brain Research, 156, 249–268. doi: 10.1016/S0079-6123(06)56013-3
   PubMed Web of Science ®Google Scholar
• Wilson, D., & Wharton, T. (2006). Relevance and prosody. Journal of Pragmatics, 38, 1559–1579. doi: 10.1016/j.pragma.2005.04.012
   Web of Science ®Google Scholar
• Wurm, L. H., & Douglas, A. V. (1996). Dimensions of speech perception: Semantic associations in the affective lexicon. Cognition & Emotion, 10, 409–424. doi: 10.1080/026999396380204
   Web of Science ®Google Scholar
• Wurm, L. H., Labouvie-Vief, G., Aycock, J., Rebucal, K. A., & Koch, H. E. (2004). Performance in auditory and visual emotional stroop tasks: A comparison of older and younger adults. Psychology and Aging, 19, 523–535. doi: 10.1037/0882-7974.19.3.523
   PubMed Web of Science ®Google Scholar