The value of a real face: Differences between affective faces and emojis in neural processing and their social influence on decision-making

References

• Baker, T. E., & Holroyd, C. B. (2011). Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200. Biological Psychology, 87(1), 25–34.
   Google Scholar
• Batty, M., & Taylor, M. J. (2003). Early processing of the six basic facial emotional expressions. Brain Research: Cognitive Brain Research, 17(3), 613–620.
   Google Scholar
• Billeke, P., & Aboitiz, F. (2013). Social cognition in schizophrenia: From social stimuli processing to social engagement. Frontiers in Psychiatry, 4, 4.
   Google Scholar
• Blau, V. C., Maurer, U., Tottenham, N., & McCandliss, B. D. (2007). The face-specific N170 component is modulated by emotional facial expression. Behavioral and Brain Functions, 3(1), 1.
   Google Scholar
• Bombari, D., Schmid, P. C., Schmid Mast, M., Birri, S., Mast, F. W., & Lobmaier, J. S. (2013). Emotion recognition: The role of featural and configural face information. Quarterly Journal of Experimental Psychology, 66(12), 2426–2442.
   Google Scholar
• Brown, W. M., Palameta, B., & Moore, C. (2003). Are there nonverbal cues to commitment? An exploratory study using the zero-acquaintance video presentation paradigm. Evolutionary Psychology, 1(1), 42–69.
   Google Scholar
• Burle, B., Roger, C., Allain, S., Vidal, F., & Hasbroucq, T. (2008). Error negativity does not reflect conflict: A reappraisal of conflict monitoring and anterior cingulate cortex activity. Journal of Cognitive Neuroscience, 20(9), 1637–1655.
   Google Scholar
• Chaumon, M., Bishop, D. V., & Busch, N. A. (2015). A practical guide to the selection of independent components of the electroencephalogram for artifact correction. Journal of Neuroscience Methods, 250, 47–63.
   Google Scholar
• Churches, O., Nicholls, M., Thiessen, M., Kohler, M., & Keage, H. (2014). Emoticons in mind: An event-related potential study. Social Neuroscience, 9(2), 196–202.
   Google Scholar
• Courchesne, E., Hillyard, S. A., & Courchesne, R. Y. (1977). P3 waves to the discrimination of targets in homogeneous and heterogeneous stimulus sequences. Psychophysiology, 14(6), 590–597.
   Google Scholar
• Csukly, G., Polgar, P., Tombor, L., Rethelyi, J., & Keri, S. (2011). Are patients with schizophrenia rational maximizers? Evidence from an ultimatum game study. Psychiatry Research, 187(1–2), 11–17.
   Google Scholar
• Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9–21.
   Google Scholar
• Delorme, A., Sejnowski, T., & Makeig, S. (2007). Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis. Neuroimage, 34(4), 1443–1449.
   Google Scholar
• Derks, D., Bos, A. E., & von Grumbkow, J. (2008). Emoticons in computer-mediated communication: Social motives and social context. CyberPsychology & Behavior, 11(1), 99–101.
   Google Scholar
• Duncan-Johnson, C. C., & Donchin, E. (1977). On quantifying surprise: The variation of event-related potentials with subjective probability. Psychophysiology, 14(5), 456–467.
   Google Scholar
• Eckel, C. C., & Wilson, R. K. (2003). The human face of game theory: Trust and reciprocity in sequential games. In E. Ostrom & J. Walker (Eds.), A Vol. in the Russell Sage Foundation series on trust. Trust and reciprocity: Interdisciplinary lessons from experimental research (pp. 245–274). New York, NY, US: Russell Sage Foundation.
   Google Scholar
• Eckel, C. C., & Grossman, P. J. (2001). Chivalry and solidarity in ultimatum games. Economic Inquiry, 39(2), 171–188.
   Google Scholar
• Eckel, C. C., & Wilson, R. K. (1998). Reciprocal fairness and social signalling: Experiments with limited reputations. Paper presented at the American Economic Association Meeting, New York, NY.
   Google Scholar
• Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191.
   Google Scholar
• Fehr, E., & Gachter, S. (2002). Altruistic punishment in humans. Nature, 415(6868), 137–140.
   Google Scholar
• Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity. Human Brain Mapping, 32(12), 2207–2216.
   Google Scholar
• Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295(5563), 2279–2282.
   Google Scholar
• Godin, S. (1993). The smiley dictionary: Cool things to do with your keyboard. Berkeley, CA: Peachpit.
   Google Scholar
• Güth, W., Schmittberger, R., & Schwarze, B. (1982). An experimental analysis of ultimatum bargaining. Journal of Economic Behavior & Organization, 3(4), 367–388.
   Google Scholar
• Hewig, J., Kretschmer, N., Trippe, R. H., Hecht, H., Coles, M. G., Holroyd, C. B., & Miltner, W. H. (2010). Hypersensitivity to reward in problem gamblers. Biological Psychiatry, 67(8), 781–783.
   Google Scholar
• Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4), 679–709.
   Google Scholar
• Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. Neuroreport, 14(18), 2481–2484.
   Google Scholar
• Holroyd, C. B., Pakzad-Vaezi, K. L., & Krigolson, O. E. (2008). The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology, 45(5), 688–697.
   Google Scholar
• Itier, R. J., Alain, C., Sedore, K., & McIntosh, A. R. (2007). Early face processing specificity: It’s in the eyes! Journal of Cognitive Neuroscience, 19(11), 1815–1826.
   Google Scholar
• Johnson, R. (1988). The amplitude of the P300 component of the event-related potential: Review and synthesis. Advances in Psychophysiology, 3, 69–137.
   Google Scholar
• Kim, K. W., Lee, S. W., Choi, J., Kim, T. M., & Jeong, B. (2016). Neural correlates of text‐based emoticons: A preliminary fMRI study. Brain and Behavior, 6(8), e00500.
   Google Scholar
• Kubota, J. T., Li, J., Bar-David, E., Banaji, M. R., & Phelps, E. A. (2013). The price of racial bias: Intergroup negotiations in the ultimatum game. Psychological Science, 24(12), 2498–2504.
   Google Scholar
• Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., Hawk, S. T., & van Knippenberg, A. (2010). Presentation and validation of the radboud faces database. Cognition & Emotion, 24(8), 1377–1388.
   Google Scholar
• Levine, D. K. (1998). Modeling altruism and spitefulness in experiments. Review of Economic Dynamics, 1(3), 593–622.
   Google Scholar
• Ma, Q., Hu, Y., Jiang, S., & Meng, L. (2015). The undermining effect of facial attractiveness on brain responses to fairness in the Ultimatum Game: An ERP study. Frontiers in Neuroscience, 9, 77.
   Google Scholar
• Meaux, E., & Vuilleumier, P. (2016). Facing mixed emotions: Analytic and holistic perception of facial emotion expressions engages separate brain networks. Neuroimage, 141, 154–173.
   Google Scholar
• Mehu, M., Grammer, K., & Dunbar, R. I. M. (2007). Smiles when sharing. Evolution and Human Behavior, 28(6), 415–422.
   Google Scholar
• Miltner, W. H., Braun, C. H., & Coles, M. G. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a “generic” neural system for error detection. Journal of Cognitive Neuroscience, 9(6), 788–798.
   Google Scholar
• Mognon, A., Jovicich, J., Bruzzone, L., & Buiatti, M. (2011). ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. Psychophysiology, 48(2), 229–240.
   Google Scholar
• Mussel, P., Göritz, A. S., & Hewig, J. (2013). The value of a smile: Facial expression affects ultimatum-game responses. Judgment & Decision Making, 8(3), 381–385.
   Google Scholar
• Mussel, P., Hewig, J., & Weiß, M. (2018). The reward‐like nature of social cues that indicate successful altruistic punishment. Psychophysiology, 55, e13093.
   Google Scholar
• Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005). Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychological Bulletin, 131(4), 510–532.
   Google Scholar
• Osinsky, R., Mussel, P., & Hewig, J. (2012). Feedback-related potentials are sensitive to sequential order of decision outcomes in a gambling task. Psychophysiology, 49(12), 1579–1589.
   Google Scholar
• Peirce, J. W. (2008). Generating stimuli for neuroscience using PsychoPy. Frontiers in Neuroinformatics, 2, 10.
   Google Scholar
• Polich, J. (2007). Updating P300: An integrative theory of P3a and P3b. Clinical Neurophysiology, 118(10), 2128–2148.
   Google Scholar
• Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006). When things are better or worse than expected: The medial frontal cortex and the allocation of processing resources. Journal of Cognitive Neuroscience, 18(7), 1112–1119.
   Google Scholar
• Proudfit, G. H. (2015). The reward positivity: From basic research on reward to a biomarker for depression. Psychophysiology, 52(4), 449–459.
   Google Scholar
• Reed, L. I., Zeglen, K. N., & Schmidt, K. L. (2012). Facial expressions as honest signals of cooperative intent in a one-shot anonymous Prisoner’s Dilemma game. Evolution and Human Behavior, 33(3), 200–209.
   Google Scholar
• Sakaki, M., Niki, K., & Mather, M. (2012). Beyond arousal and valence: The importance of the biological versus social relevance of emotional stimuli. Cognitive, Affective & Behavioral Neuroscience, 12(1), 115–139.
   Google Scholar
• Solnick, S. J., & Schweitzer, M. E. (1999). The influence of physical attractiveness and gender on ultimatum game decisions. Organizational Behavior and Human Decision Processes, 79(3), 199–215.
   Google Scholar
• Summerfield, C., & Egner, T. (2009). Expectation (and attention) in visual cognition. Trends in Cognitive Sciences, 13(9), 403–409.
   Google Scholar
• Tanaka, J. W., Kaiser, M. D., Butler, S., & Le Grand, R. (2012). Mixed emotions: Holistic and analytic perception of facial expressions. Cognition & Emotion, 26(6), 961–977.
   Google Scholar
• Von Neumann, J., & Morgenstern, O. (1953). Theory of games and economic behavior. Princeton: Princeton University Press.
   Google Scholar
• Weiß, M., Gutzeit, J., Rodrigues, J., Mussel, P., & Hewig, J. (2019). Do emojis influence social interactions? Neural and behavioral responses to affective emojis in bargaining situations. Psychophysiology, 56, e13321.
   Google Scholar
• Winkler, I., Haufe, S., & Tangermann, M. (2011). Automatic classification of artifactual ICA-components for artifact removal in EEG signals. Behavioral and Brain Functions, 7(1), 30.
   Google Scholar
• Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex, 15(5), 535–544.
   Google Scholar
• Yeung, N., & Sanfey, A. G. (2004). Independent coding of reward magnitude and valence in the human brain. Journal of Neuroscience, 24(28), 6258–6264.
   Google Scholar
• Yuasa, M., Saito, K., & Mukawa, N. (2011). Brain activity when reading sentences and emoticons: An fMRI study of verbal and nonverbal communication. Electronics and Communications in Japan, 94(5), 17–24.
   Google Scholar