Processing emotions from faces and words measured by event-related brain potentials

References

• Adolphs, R., Damasio, H., Tranel, D., & Damasio, A. R. (1996). Cortical systems for the recognition of emotion in facial expressions. The Journal of Neuroscience, 16(23), 7678–7687. https://doi.org/10.1523/JNEUROSCI.16-23-07678.1996
   PubMed Web of Science ®Google Scholar
• Batty, M., & Taylor, M. J. (2003). Early processing of the six basic facial emotional expressions. Cognitive Brain Research, 17(3), 613–620. https://doi.org/10.1016/S0926-6410(03)00174-5
   PubMedGoogle Scholar
• Bayer, M., & Schacht, A. (2014). Event-related brain responses to emotional words, pictures, and faces: A cross-domain comparison. Frontiers in Psychology, 5, 1106. https://doi.org/10.3389/fpsyg.2014.01106
   PubMed Web of Science ®Google Scholar
• Beall, P. M., & Herbert, A. M. (2008). The face wins: stronger automatic processing of affect in facial expressions than words in a modified stroop task. Cognition and Emotion, 22(8), 1613–1642. https://doi.org/10.1080/02699930801940370
   Web of Science ®Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
   Web of Science ®Google Scholar
• Bistricky, S. L., Atchley, R. A., Ingram, R., & O'Hare, A. (2014). Biased processing of sad faces: An ERP marker candidate for depression susceptibility. Cognition and Emotion, 28(3), 470–492. https://doi.org/10.1080/02699931.2013.837815
   PubMed Web of Science ®Google Scholar
• Brainerd, C. J. (2018). The emotional-ambiguity hypothesis: a large-scale test. Psychological Science, 29(10), 1706–1715. https://doi.org/10.1177/0956797618780353
   PubMed Web of Science ®Google Scholar
• Carretié, L., Mercado, F., Tapia, M., & Hinojosa, J. A. (2001). Emotion, attention, and the 'negativity bias', studied through event-related potentials. International Journal of Psychophysiology, 41(1), 75–85. https://doi.org/10.1016/S0167-8760(00)00195-1
   PubMed Web of Science ®Google Scholar
• Causeur, D., Sheu, C.-F., Chu, M.-C., & Rufini, F. (2019). ERP: Significance analysis of event-related potentials data.
   Google Scholar
• Citron, F. M. (2012). Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies. Brain and Language, 122(3), 211–226. https://doi.org/10.1016/j.bandl.2011.12.007
   PubMed Web of Science ®Google Scholar
• Codispoti, M., Bradley, M. M., & Lang, P. J. (2001). Affective reactions to briefly presented pictures. Psychophysiology, 38(3), 474–478. https://doi.org/10.1111/psyp.2001.38.issue-3
   PubMed Web of Science ®Google Scholar
• Cowen, A. S., & Keltner, D. (2021). Semantic space theory: A computational approach to emotion. Trends in Cognitive Sciences, 25(2), 124–136. https://doi.org/10.1016/j.tics.2020.11.004
   PubMed Web of Science ®Google Scholar
• Ellsworth, P. C. (2013). Appraisal theory: old and new questions. Emotion Review, 5(2), 125–131. https://doi.org/10.1177/1754073912463617
   Web of Science ®Google Scholar
• Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149
   PubMed Web of Science ®Google Scholar
• Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007). The world of emotions is not two-dimensional. Psychological Science, 18(12), 1050–1057. https://doi.org/10.1111/j.1467-9280.2007.02024.x
   PubMed Web of Science ®Google Scholar
• Frühholz, S., Jellinghaus, A., & Herrmann, M. (2011). Time course of implicit processing and explicit processing of emotional faces and emotional words. Biological Psychology, 87(2), 265–274. https://doi.org/10.1016/j.biopsycho.2011.03.008
   PubMed Web of Science ®Google Scholar
• Gillioz, C., Fontaine, J. R. J., Soriano, C., & Scherer, K. R. (2016). Mapping emotion terms into affective space: further evidence for a four-dimensional structure. Swiss Journal of Psychology, 75(3), 141–148. https://doi.org/10.1024/1421-0185/a000180
   Web of Science ®Google Scholar
• Gratton, G., Coles, M. G., & Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55(4), 468–484. https://doi.org/10.1016/0013-4694(83)90135-9
   PubMedGoogle Scholar
• Hahn, P., Castillo, S., & Cunningham, D. W. (2019). Fitting the style: The semantic space for emotions on stylized faces. In CASA '19: Proceedings of the 32nd International Conference on Computer Animation and Social Agents (pp. 21–24). ACM.
   Google Scholar
• Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4(6), 223–233. https://doi.org/10.1016/S1364-6613(00)01482-0
   PubMed Web of Science ®Google Scholar
• Helwig, N. E. (2018). eegkit: Toolkit for electroencephalography data.
   Google Scholar
• Herbert, C., Junghofer, M., & Kissler, J. (2008). Event related potentials to emotional adjectives during reading. Psychophysiology, 45(3), 487–498. https://doi.org/10.1111/j.1469-8986.2007.00638.x
   PubMed Web of Science ®Google Scholar
• Herbert, C., Sfaerlea, A., & Blumenthal, T. (2013). Your emotion or mine: Labeling feelings alters emotional face perception -- an ERP study on automatic and intentional affect labeling. Frontiers in Human Neuroscience, 7, 378. https://doi.org/10.3389/fnhum.2013.00378
   PubMed Web of Science ®Google Scholar
• Hinojosa, J. A., Moreno, E. M., & Ferré, P. (2020). Affective neurolinguistics: Towards a framework for reconciling language and emotion. Language, Cognition and Neuroscience, 35(7), 813–839. https://doi.org/10.1080/23273798.2019.1620957
   Web of Science ®Google Scholar
• Homan, R. W., Herman, J., & Purdy, P. (1987). Cerebral location of international 10-20 system electrode placement. Electroencephalography and Clinical Neurophysiology, 66(4), 376–382. https://doi.org/10.1016/0013-4694(87)90206-9
   PubMedGoogle Scholar
• Kawasaki, H., Adolphs, R., Kaufman, O., Damasio, H., Damasio, A. R., Granner, M., Bakken, H., Hori, T., & Howard, M. A. (2001). Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex. Nature Neuroscience, 4(1), 15–16. https://doi.org/10.1038/82850
   PubMed Web of Science ®Google Scholar
• Kazak, A. E. (2018). Editorial: journal article reporting standards. American Psychologist, 73(1), 1–2. https://doi.org/10.1037/amp0000263
   PubMed Web of Science ®Google Scholar
• Kim, H., Somerville, L. H., Johnstone, T., Polis, S., Alexander, A. L., Shin, L. M., & Whalen, P. J. (2004). Contextual modulation of amygdala responsivity to surprised faces. Journal of Cognitive Neuroscience, 16(10), 1730–1745. https://doi.org/10.1162/0898929042947865
   PubMed Web of Science ®Google Scholar
• Kissler, J., Assadollahi, R., & Herbert, C. (2006). Emotional and semantic networks in visual word processing: Insights from ERP studies. In Progress in Brain Research (Vol. 156, pp. 147–183). Elsevier.
   Google Scholar
• Kissler, J., Herbert, C., Peyk, P., & Junghofer, M. (2007). Buzzwords: early cortical responses to emotional words during reading. Psychological Science, 18(6), 475–480. https://doi.org/10.1111/j.1467-9280.2007.01924.x
   PubMed Web of Science ®Google Scholar
• Kissler, J., Herbert, C., Winkler, I., & Junghofer, M. (2009). Emotion and attention in visual word processing – an ERP study. Biological Psychology, 80(1), 75–83. https://doi.org/10.1016/j.biopsycho.2008.03.004
   PubMed Web of Science ®Google Scholar
• Kreegipuu, K., Kuldkepp, N., Sibolt, O., Toom, M., Allik, J., & Näätänen, R. (2013). vMMN for schematic faces: Automatic detection of change in emotional expression. Frontiers in Human Neuroscience, 7, 714. https://doi.org/10.3389/fnhum.2013.00714
   PubMed Web of Science ®Google Scholar
• Kuldkepp, N., Kreegipuu, K., Raidvee, A., Näätänen, R., & Allik, J. (2013). Unattended and attended visual change detection of motion as indexed by event-related potentials and its behavioral correlates. Frontiers in Human Neuroscience, 7, 476. https://doi.org/10.3389/fnhum.2013.00476
   PubMed Web of Science ®Google Scholar
• Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62( 1), 621–647. https://doi.org/10.1146/psych.2011.62.issue-1
   PubMed Web of Science ®Google Scholar
• Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13
   Web of Science ®Google Scholar
• Lange, J., Heerdink, M. W., & van Kleef, G. A. (2022). Reading emotions, reading people: Emotion perception and inferences drawn from perceived emotions. Current Opinion in Psychology, 43(1), 85–90. https://doi.org/10.1016/j.copsyc.2021.06.008
   PubMedGoogle Scholar
• Lenth, V. R. (2021). Emmeans: Estimated marginal means, aka least-squares means. R package version 1.6.1, pages. https://CRAN.R–project.org/package=emmeans
   Google Scholar
• Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012). The brain basis of emotion: A meta-analytic review. The Behavioral and Brain Sciences, 35(3), 121–143. https://doi.org/10.1017/S0140525X11000446
   PubMed Web of Science ®Google Scholar
• Matsumoto, D., & Ekman, P. (1988). Japanese and Caucasian facial expressions of emotion (JACFEE). San Francisco, CA: Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University.
   Google Scholar
• Mill, A., Allik, J., Realo, A., & Valk, R. (2009). Age-related differences in emotion recognition ability: A cross-sectional study. Emotion, 9(5), 619–630. https://doi.org/10.1037/a0016562
   PubMed Web of Science ®Google Scholar
• Moors, A. (2010). Automatic constructive appraisal as a candidate cause of emotion. Emotion Review, 2(2), 139–156. https://doi.org/10.1177/1754073909351755
   Web of Science ®Google Scholar
• Niedenthal, P. M. (2007). Embodying emotion. Science, 316(5827), 1002–1005. https://doi.org/10.1126/science.1136930
   PubMed Web of Science ®Google Scholar
• Ochsner, K. N., & Gross, J. J. (2005). The cognitive control of emotion. Trends in Cognitive Sciences, 9(5), 242–249. https://doi.org/10.1016/j.tics.2005.03.010
   PubMed Web of Science ®Google Scholar
• Olofsson, J. K., Nordin, S., Sequeira, H., & Polich, J. (2008). Affective picture processing: An integrative review of ERP findings. Biological Psychology, 77(3), 247–265. https://doi.org/10.1016/j.biopsycho.2007.11.006
   PubMed Web of Science ®Google Scholar
• Öner, S. (2018). Neural substrates of cognitive emotion regulation: A brief review. Psychiatry and Clinical Psychopharmacology, 28(1), 91–96. https://doi.org/10.1080/24750573.2017.1407563
   Web of Science ®Google Scholar
• Palermo, R., O'Connor, K. B., Davis, J. M., Irons, J., & McKone, E. (2013). New tests to measure individual differences in matching and labelling facial expressions of emotion, and their association with ability to recognise vocal emotions and facial identity. PLOS ONE, 8(6), e68126. Publisher: Public Library of Science. https://doi.org/10.1371/journal.pone.0068126
   PubMed Web of Science ®Google Scholar
• Pessoa, L. (2008). On the relationship between emotion and cognition. Nature Reviews Neuroscience, 9(2), 148–158. https://doi.org/10.1038/nrn2317
   PubMed Web of Science ®Google Scholar
• Petro, N. M., Tong, T. T., Henley, D. J., & Neta, M. (2018). Individual differences in valence bias: fMRI evidence of the initial negativity hypothesis. Social Cognitive and Affective Neuroscience, 13(7), 687–698. https://doi.org/10.1093/scan/nsy049
   PubMed Web of Science ®Google Scholar
• Pochedly, J. T., Widen, S. C., & Russell, J. A. (2012). What emotion does the 'facial expression of disgust' express?. Emotion, 12(6), 1315–1319. https://doi.org/10.1037/a0027998
   PubMed Web of Science ®Google Scholar
• Ponz, A., Montant, M., Liegeois-Chauvel, C., Silva, C., Braun, M., Jacobs, A. M., & Ziegler, J. C. (2014). Emotion processing in words: A test of the neural re-use hypothesis using surface and intracranial EEG. Social Cognitive and Affective Neuroscience, 9(5), 619–627. https://doi.org/10.1093/scan/nst034
   PubMed Web of Science ®Google Scholar
• Rellecke, J., Palazova, M., Sommer, W., & Schacht, A. (2011). On the automaticity of emotion processing in words and faces: Event-related brain potentials evidence from a superficial task. Brain and Cognition, 77(1), 23–32. https://doi.org/10.1016/j.bandc.2011.07.001
   PubMed Web of Science ®Google Scholar
• Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
   Web of Science ®Google Scholar
• Russell, J. A., & Bullock, M. (1985). Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. Journal of Personality and Social Psychology, 48(5), 1290–1298. https://doi.org/10.1037/0022-3514.48.5.1290
   Web of Science ®Google Scholar
• Russell, J. A., Lewicka, M., & Niit, T. (1989). A cross-cultural study of a circumplex model of affect. Journal of Personality and Social Psychology, 57(5), 848–856. https://doi.org/10.1037/0022-3514.57.5.848
   Web of Science ®Google Scholar
• Schacht, A., & Sommer, W. (2009). Emotions in word and face processing: Early and late cortical responses. Brain and Cognition, 69(3), 538–550. https://doi.org/10.1016/j.bandc.2008.11.005
   PubMed Web of Science ®Google Scholar
• Scherer, K. R. (1999). Appraisal theory. In T. Dalgleish & M. J. Power (Eds.), Handbook of cognition and emotion (pp. 637–663). John Wiley & Sons Ltd.
   Google Scholar
• Scherer, K. R., & Fontaine, J. R. J. (2019). The semantic structure of emotion words across languages is consistent with componential appraisal models of emotion. Cognition and Emotion, 33(4), 673–682. https://doi.org/10.1080/02699931.2018.1481369
   PubMed Web of Science ®Google Scholar
• Scherer, K. R., Schorr, A., & Johnstone, T (2001). Appraisal processes in emotion: Theory, methods, research, Series in affective science, Oxford, New York: Oxford University Press.
   Google Scholar
• Schupp, H. T., Öhman, A., Junghöfer, M., Weike, A. I., Stockburger, J., & Hamm, A. O. (2004). The facilitated processing of threatening faces: An ERP analysis. Emotion, 4(2), 189–200. https://doi.org/10.1037/1528-3542.4.2.189
   PubMed Web of Science ®Google Scholar
• Soriano, C. M., Fontaine, J. R. J., & Scherer, K. R. (2015). Surprise in the GRID. Review of Cognitive Linguistics. Published Under the Auspices of the Spanish Cognitive Linguistics Association, 13(2), 436–460. https://doi.org/10.1075/rcl
   Web of Science ®Google Scholar
• Tempel, K., Kuchinke, L., Urton, K., Schlochtermeier, L. H., Kappelhoff, H., & Jacobs, A. M. (2013). Effects of positive pictograms and words: An emotional word superiority effect?. Journal of Neurolinguistics, 26(6), 637–648. https://doi.org/10.1016/j.jneuroling.2013.05.002
   Web of Science ®Google Scholar
• Thiruchselvam, R., Blechert, J., Sheppes, G., Rydstrom, A., & Gross, J. J. (2011). The temporal dynamics of emotion regulation: An EEG study of distraction and reappraisal. Biological Psychology, 87(1), 84–92. https://doi.org/10.1016/j.biopsycho.2011.02.009
   PubMed Web of Science ®Google Scholar
• Uusberg, A., Uibo, H., Kreegipuu, K., & Allik, J. (2013). EEG alpha and cortical inhibition in affective attention. International Journal of Psychophysiology, 89(1), 26–36. https://doi.org/10.1016/j.ijpsycho.2013.04.020
   PubMed Web of Science ®Google Scholar
• van Berkum, J. J. A. (2019). Language comprehension and emotion: Where are the interfaces, and who cares? In G. I. de Zubicaray & N. O. Schiller, (Eds.), The Oxford Handbook of Neurolinguistics (pp. 1–34). Oxford University Press, Oxford.
   Google Scholar
• Vrticka, P., Lordier, L., Bediou, B., & Sander, D. (2014). Human amygdala response to dynamic facial expressions of positive and negative surprise. Emotion, 14(1), 161–169. https://doi.org/10.1037/a0034619
   PubMed Web of Science ®Google Scholar
• Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., Kuhn, M., Pedersen, T., Miller, E., Bache, S., Müller, K., Ooms, J., Robinson, D., Seidel, D., Spinu, V., …Yutani, H. (2019). Welcome to the tidyverse. Journal of Open Source Software, 4(43), 1686. https://doi.org/10.21105/joss
   Google Scholar
• Widen, S. C., & Russell, J. A. (2013). Children's recognition of disgust in others. Psychological Bulletin, 139(2), 271–299. https://doi.org/10.1037/a0031640
   PubMed Web of Science ®Google Scholar
• Zajonc, R. B. (1980). Feeling and thinking: Preferences need no inferences. American Psychologist, 35(2), 151–175. https://doi.org/10.1037/0003-066X.35.2.151
   Web of Science ®Google Scholar
• Zhang, J., Wu, C., Meng, Y., & Yuan, Z. (2017). Different neural correlates of emotion-label words and emotion-laden words: An ERP study. Frontiers in Human Neuroscience, 11, 455. https://doi.org/10.3389/fnhum.2017.00455
   PubMed Web of Science ®Google Scholar