Speakers' emotional facial expressions modulate subsequent multi-modal language processing: ERP evidence

References

• Aldunate, N., López, V., & Bosman, C. A. (2018). Early influence of affective context on emotion perception: EPN or early-N400? Frontiers in Neuroscience, 12, 708. https://doi.org/10.3389/fnins.2018.00708
   PubMed Web of Science ®Google Scholar
• Barrett, L. F. (2006). Solving the emotion paradox: Categorization and the experience of emotion. Personality and Social Psychology Review, 10(1), 20–46. https://doi.org/10.1207/s15327957pspr1001_2
   PubMed Web of Science ®Google Scholar
• Barrett, L. F. (2009). Variety is the spice of life: A psychological construction approach to understanding variability in emotion. Cognition and Emotion, 23(7), 1284–1306. https://doi.org/10.1080/02699930902985894
   PubMed Web of Science ®Google Scholar
• Barrett, L. F., Lindquist, K. A., & Gendron, M. (2007). Language as context for the perception of emotion. Trends in Cognitive Sciences, 11(8), 327–332. https://doi.org/10.1016/j.tics.2007.06.003
   PubMed Web of Science ®Google Scholar
• Bates, D., Kliegl, R., Vasishth, S., & Baayen, H. (2015). Parsimonious mixed models. arXiv Preprint arXiv:1506.04967 .
   Google Scholar
• Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01.
   Web of Science ®Google Scholar
• Bayer, M., & Schacht, A. (2014). Event-related brain responses to emotional words, pictures, and faces–a cross-domain comparison. Frontiers in Psychology, 5, 1106. https://doi.org/10.3389/fpsyg.2014.01106
   PubMed Web of Science ®Google Scholar
• Bayer, M., Sommer, W., & Schacht, A. (2012). Font size matters – emotion and attention in cortical responses to written words. PloS One, 7(5), Article e36042. https://doi.org/10.1371/journal.pone.0036042
   PubMed Web of Science ®Google Scholar
• Brain Products GmbH, Gilching, Germany (n.d.a). BrainVision (Version 0) [Computer software].
   Google Scholar
• Brain Products GmbH, Gilching Germany (n.d.b). BrainVision analyzer 2 (Version 0) [Computer software].
   Google Scholar
• Calvo, M. G., & Beltran, D. (2013). Recognition advantage of happy faces: Tracing the neurocognitive processes. Neuropsychologia, 51(11), 2051–2061. https://doi.org/10.1016/j.neuropsychologia.2013.07.010
   PubMed Web of Science ®Google Scholar
• Carminati, M. N., & Knoeferle, P. (2013). Effects of speaker emotional facial expression and listener age on incremental sentence processing. PloS One, 8(9), Article e72559. https://doi.org/10.1371/journal.pone.0072559
   PubMed Web of Science ®Google Scholar
• Carretie, L., Mercado, F., Tapia, M., & Hinojosa, J. A. (2001). Emotion, attention, and the ‘negativity bias,’ studied through event-related potentials. International Journal of Psychophysiology, 41(1), 75–85. https://doi.org/10.1016/S0167-8760(00)00195-1
   PubMed Web of Science ®Google Scholar
• Citron, F. M., Weekes, B. S., & Ferstl, E. C. (2013). Effects of valence and arousal on written word recognition: Time course and ERP correlates. Neuroscience Letters, 533, 90–95. https://doi.org/10.1016/j.neulet.2012.10.054
   PubMed Web of Science ®Google Scholar
• Cuthbert, B. N., Schupp, H. T., Bradley, M. M., Birbaumer, N., & Lang, P. J. (2000). Brain potentials in affective picture processing: Covariation with autonomic arousal and affective report. Biological Psychology, 52(2), 95–111. https://doi.org/10.1016/S0301-0511(99)00044-7
   PubMed Web of Science ®Google Scholar
• DeCot, B. (2011). The role of speaker facial expression in processing emotional sentences [Unpublished MA thesis]. University of Bielefeld.
   Google Scholar
• Eimer, M., & Holmes, A. (2007). Event-related brain potential correlates of emotional face processing. Neuropsychologia, 45(1), 15–31. https://doi.org/10.1016/j.neuropsychologia.2006.04.022
   PubMed Web of Science ®Google Scholar
• Foroni, F., & Semin, G. R. (2011). When does mimicry affect evaluative judgment? Emotion (Washington, D.C.), 11(3), 687–690. https://doi.org/10.1037/a0023163
   PubMed Web of Science ®Google Scholar
• Fox, J., & Weisberg, S. (2019). An R companion to applied regression (3rd ed.). Sage. https://socialsciences.mcmaster.ca/jfox/Books/Companion/.
   Google Scholar
• Grass, A., Bayer, M., & Schacht, A. (2016). Electrophysiological correlates of emotional content and volume level in spoken word processing. Frontiers in Human Neuroscience, 10, 326. https://doi.org/10.3389/fnhum.2016.00326
   PubMed Web of Science ®Google Scholar
• Hajcak, G., Weinberg, A., MacNamara, A., & Foti, D. (2012). The Oxford handbook of event-related potential components (pp. 441–472). Oxford University Press.
   Google Scholar
• Herbert, C., Ethofer, T., Fallgatter, A. J., Walla, P., & Northoff, G. (2018). The janus face of language: Where are the emotions in words and where are the words in emotions? Frontiers in Psychology, 9, 650. https://doi.org/10.3389/fpsyg.2018.00650
   PubMed Web of Science ®Google Scholar
• Hernandez-Gutierrez, D., Munoz, F., Sanchez-Garcia, J., Sommer, W., Abdel Rahman, R., Casado, P., Jimenez-Ortega, L., Espuny, J., Fondevila, S., & Martin-Loeches, M. (2021). Situating language in a minimal social context: How seeing a picture of the speaker's face affects language comprehension. Social Cognitive and Affective Neuroscience, 16(5), 502–511. https://doi.org/10.1093/scan/nsab009
   PubMed Web of Science ®Google Scholar
• Hietanen, J. K., & Astikainen, P. (2013). N170 response to facial expressions is modulated by the affective congruency between the emotional expression and preceding affective picture. Biological Psychology, 92(2), 114–124. https://doi.org/10.1016/j.biopsycho.2012.10.005
   PubMed Web of Science ®Google Scholar
• I/II, C. (1991–2021). Corpus search, management and analysis system. http://www.ids-mannheim.de/cosmas2/.
   Google Scholar
• Just, M. A., & Carpenter, P. A. (1992). A capacity theory of comprehension: Individual differences in working memory. Psychological Review, 99(1), 122–149. https://doi.org/10.1037/0033-295X.99.1.122
   PubMed Web of Science ®Google Scholar
• Kanske, P., & Kotz, S. A. (2007). Concreteness in emotional words: ERP evidence from a hemifield study. Brain Research, 1148, 138–148. https://doi.org/10.1016/j.brainres.2007.02.044
   PubMed Web of Science ®Google Scholar
• Kauschke, C., Bahn, D., Vesker, M., & Schwarzer, G. (2019). The role of emotional valence for the processing of facial and verbal stimuli – positivity or negativity bias? Frontiers in Psychology, 10, 1654. https://doi.org/10.3389/fpsyg.2019.01654
   PubMed Web of Science ®Google Scholar
• Kissler, J., & Bromberek-Dyzman, K. (2021). Mood induction differently affects early neural correlates of evaluative word processing in L1 and L2. Frontiers in Psychology, 11, 3809. https://doi.org/10.3389/fpsyg.2020.588902
   Web of Science ®Google Scholar
• Kissler, J., Herbert, C., Winkler, I., & Junghofer, M. (2009). Emotion and attention in visual word processing – An ERP study. Biological Psychology, 80(1), 75–83. https://doi.org/10.1016/j.biopsycho.2008.03.004
   PubMed Web of Science ®Google Scholar
• Kissler, J., & Koessler, S. (2011). Emotionally positive stimuli facilitate lexical decisions – An ERP study. Biological Psychology, 86(3), 254–264. https://doi.org/10.1016/j.biopsycho.2010.12.006
   PubMed Web of Science ®Google Scholar
• Knoeferle, P., & Crocker, M. W. (2006). The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science, 30(3), 481–529. https://doi.org/10.1207/s15516709cog0000_65
   PubMed Web of Science ®Google Scholar
• Kotz, S. A., & Paulmann, S. (2007). When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Research, 1151, 107–118. https://doi.org/10.1016/j.brainres.2007.03.015
   PubMed Web of Science ®Google Scholar
• Kret, M., & De Gelder, B. (2012). A review on sex differences in processing emotional signals. Neuropsychologia, 50(7), 1211–1221. https://doi.org/10.1016/j.neuropsychologia.2011.12.022
   PubMed Web of Science ®Google Scholar
• Krombholz, A., Schaefer, F., & Boucsein, W. (2007). Modification of N170 by different emotional expression of schematic faces. Biological Psychology, 76(3), 156–162. https://doi.org/10.1016/j.biopsycho.2007.07.004
   PubMed Web of Science ®Google Scholar
• Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62(1), 621–647. https://doi.org/10.1146/psych.2011.62.issue-1
   PubMed Web of Science ®Google Scholar
• Kutas, M., & Hillyard, S. A. (1984). Brain potentials during reading reflect word expectancy and semantic association. Nature, 307(5947), 161–163. https://doi.org/10.1038/307161a0
   PubMed Web of Science ®Google Scholar
• Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13.
   Web of Science ®Google Scholar
• Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. University of florida, gainesville (Tech Rep A-8).
   Google Scholar
• Leppänen, J. M., & Hietanen, J. K. (2004). Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research, 69(1), 22–29. https://doi.org/10.1007/s00426-003-0157-2
   PubMed Web of Science ®Google Scholar
• Li, X., Hagoort, P., & Yang, Y. (2008). Event-related potential evidence on the influence of accentuation in spoken discourse comprehension in chinese. Journal of Cognitive Neuroscience, 20(5), 906–915. https://doi.org/10.1162/jocn.2008.20512
   PubMed Web of Science ®Google Scholar
• Lindquist, K. A. (2017). The role of language in emotion: Existing evidence and future directions. Current Opinion in Psychology, 17, 135–139. https://doi.org/10.1016/j.copsyc.2017.07.006
   PubMed Web of Science ®Google Scholar
• Liu, B., Xin, S., Jin, Z., Hu, Y., & Li, Y. (2010). Emotional facilitation effect in the picture–word interference task: An ERP study. Brain and Cognition, 72(2), 289–299. https://doi.org/10.1016/j.bandc.2009.09.013
   PubMed Web of Science ®Google Scholar
• Liu, X., Liao, Y., Zhou, L., Sun, G., Li, M., & Zhao, L. (2013). Mapping the time course of the positive classification advantage: An ERP study. Cognitive, Affective, & Behavioral Neuroscience, 13(3), 491–500. https://doi.org/10.3758/s13415-013-0158-6
   PubMed Web of Science ®Google Scholar
• Luke, S. G. (2017). Evaluating significance in linear mixed-effects models in r. Behavior Research Methods, 49(4), 1494–1502. https://doi.org/10.3758/s13428-016-0809-y
   PubMed Web of Science ®Google Scholar
• Maier, M. A., Berner, M. P., & Pekrun, R. (2003). Directonality of affective priming: Effects of trait anxiety and activation level. Experimental Psychology, 50(2), 116–123. https://doi.org/10.1026//1618-3169.50.2.116
   PubMed Web of Science ®Google Scholar
• McRae, K., Ochsner, K. N., Mauss, I. B., Gabrieli, J. J., & Gross, J. J. (2008). Gender differences in emotion regulation: An fMRI study of cognitive reappraisal. Group Processes & Intergroup Relations, 11(2), 143–162. https://doi.org/10.1177/1368430207088035
   PubMed Web of Science ®Google Scholar
• Mittermeier, V., Leicht, G., Karch, S., Hegerl, U., Müller, H.-J., Pogarell, O., & Mulert, C. (2011). Attention to emotion: Auditory-evoked potentials in an emotional choice reaction task and personality traits as assessed by the NEO FFI. European Archives of Psychiatry and Clinical Neuroscience, 261(2), 111–120. https://doi.org/10.1007/s00406-010-0127-9
   PubMed Web of Science ®Google Scholar
• Münster, K., & Knoeferle, P. (2018). Extending situated language comprehension (accounts) with speaker and comprehender characteristics: Toward socially situated interpretation. Frontiers in Psychology, 8, 2267. https://doi.org/10.3389/fpsyg.2017.02267
   PubMed Web of Science ®Google Scholar
• Neurobehavioral Systems, Inc., Berkeley, CA (n.d.). Presentation (Version 16.5) [Computer software]. https://www.neurobs.com.
   Google Scholar
• Nieuwland, M. S., & Van Berkum, J. J. (2006). Individual differences and contextual bias in pronoun resolution: Evidence from ERPs. Brain Research, 1118(1), 155–167. https://doi.org/10.1016/j.brainres.2006.08.022
   PubMedGoogle Scholar
• Olofsson, J. K., Nordin, S., Sequeira, H., & Polich, J. (2008). Affective picture processing: An integrative review of ERP findings. Biological Psychology, 77(3), 247–265. https://doi.org/10.1016/j.biopsycho.2007.11.006
   PubMed Web of Science ®Google Scholar
• Paulmann, S., & Pell, M. D. (2010). Contextual influences of emotional speech prosody on face processing: How much is enough? Cognitive, Affective, & Behavioral Neuroscience, 10(2), 230–242. https://doi.org/10.3758/CABN.10.2.230
   PubMed Web of Science ®Google Scholar
• Rellecke, J., Sommer, W., & Schacht, A. (2012). Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials. Biological Psychology, 90(1), 23–32. https://doi.org/10.1016/j.biopsycho.2012.02.002
   PubMed Web of Science ®Google Scholar
• Rohr, L., & Rahman, R. A. (2015). Affective responses to emotional words are boosted in communicative situations. NeuroImage, 109, 273–282. https://doi.org/10.1016/j.neuroimage.2015.01.031
   PubMed Web of Science ®Google Scholar
• Schacht, A., & Sommer, W. (2009). Emotions in word and face processing: Early and late cortical responses. Brain and Cognition, 69(3), 538–550. https://doi.org/10.1016/j.bandc.2008.11.005
   PubMed Web of Science ®Google Scholar
• Schindler, S., & Bublatzky, F. (2020). Attention and emotion: An integrative review of emotional face processing as a function of attention. Cortex, 130, 362–386. https://doi.org/10.1016/j.cortex.2020.06.010
   PubMed Web of Science ®Google Scholar
• Schindler, S., & Kissler, J. (2018). Language-based social feedback processing with randomized “senders”: An ERP study. Social Neuroscience, 13(2), 202–213. https://doi.org/10.1080/17470919.2017.1285249
   PubMed Web of Science ®Google Scholar
• Schirmer, A., Kotz, S. A., & Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research, 14(2), 228–233. https://doi.org/10.1016/S0926-6410(02)00108-8
   PubMedGoogle Scholar
• Schupp, H. T., Cuthbert, B. N., Bradley, M. M., Cacioppo, J. T., Ito, T., & Lang, P. J. (2000). Affective picture processing: The late positive potential is modulated by motivational relevance. Psychophysiology, 37(2), 257–261. https://doi.org/10.1111/psyp.2000.37.issue-2
   PubMed Web of Science ®Google Scholar
• Schupp, H. T., Öhman, A., Junghöfer, M., Weike, A. I., Stockburger, J., & Hamm, A. O. (2004). The facilitated processing of threatening faces: An ERP analysis. Emotion (Washington, D.C.), 4(2), 189–200. https://doi.org/10.1037/1528-3542.4.2.189
   PubMed Web of Science ®Google Scholar
• Spruyt, A., Hermans, D., De Houwer, J., Vandromme, H., & Eelen, P. (2007). On the nature of the affective priming effect: Effects of stimulus onset asynchrony and congruency proportion in naming and evaluative categorization. Memory & Cognition, 35(1), 95–106. https://doi.org/10.3758/BF03195946
   PubMed Web of Science ®Google Scholar
• Stevens, J. S., & Hamann, S. (2012). Sex differences in brain activation to emotional stimuli: A meta-analysis of neuroimaging studies. Neuropsychologia, 50(7), 1578–1593. https://doi.org/10.1016/j.neuropsychologia.2012.03.011
   PubMed Web of Science ®Google Scholar
• Thompson, A. E., & Voyer, D. (2014). Sex differences in the ability to recognise non-verbal displays of emotion: A meta-analysis. Cognition and Emotion, 28(7), 1164–1195. https://doi.org/10.1080/02699931.2013.875889
   PubMed Web of Science ®Google Scholar
• Tugade, M. M., & Fredrickson, B. L. (2004). Resilient individuals use positive emotions to bounce back from negative emotional experiences. Journal of Personality and Social Psychology, 86(2), 320–333. https://doi.org/10.1037/0022-3514.86.2.320
   PubMed Web of Science ®Google Scholar
• Wang, L., Bastiaansen, M., Yang, Y., & Hagoort, P. (2011). The influence of information structure on the depth of semantic processing: How focus and pitch accent determine the size of the N400 effect. Neuropsychologia, 49(5), 813–820. https://doi.org/10.1016/j.neuropsychologia.2010.12.035
   PubMed Web of Science ®Google Scholar
• Weinberg, A., & Hajcak, G. (2010). Beyond good and evil: The time-course of neural activity elicited by specific picture content. Emotion (Washington, D.C.), 10(6), 767–782. https://doi.org/10.1037/a0020242
   PubMed Web of Science ®Google Scholar
• Wieser, M. J., & Brosch, T. (2012). Faces in context: A review and systematization of contextual influences on affective face processing. Frontiers in Psychology, 3, 471. https://doi.org/10.3389/fpsyg.2012.00471
   PubMed Web of Science ®Google Scholar