Looking beyond the static face in emotion recognition: The informative case of interest

References

• Aviezer, H., Hassin, R. R., Ryan, J., Grady, C., Susskind, J., Anderson, A., … Bentin, S. (2008). Angry, disgusted, or afraid? Studies on the malleability of emotion perception: Research article. Psychological Science, 19(7), 724–732. doi: 10.1111/j.1467-9280.2008.02148.x
   PubMed Web of Science ®Google Scholar
• Aviezer, H., Trope, Y., & Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225–1229. doi: 10.1126/science.1224313
   PubMed Web of Science ®Google Scholar
• Banse, R., & Scherer, K. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636. doi: 10.1037/0022-3514.70.3.614
   PubMed Web of Science ®Google Scholar
• Bänziger, T., Grandjean, D., & Scherer, K. R. (2009). Emotion recognition from expressions in face, voice, and body: The multimodal emotion recognition test (MERT). Emotion (Washington, D.C.), 9(5), 691–704. http://doi.org/10.1037/a0017088
   PubMed Web of Science ®Google Scholar
• Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012). Introducing the geneva multimodal expression corpus for experimental research on emotion perception. Emotion, 12(5), 1161–1179. doi: 10.1037/a0025827
   PubMed Web of Science ®Google Scholar
• Bänziger, T., & Scherer, K. R. (2010). Introducing the Geneva multimodal emotion portrayal (GEMEP) corpus . In T. Bänziger, K. Scherer, & E. Roesch (Eds.), Blueprint for affective computing: A sourcebook (pp. 271–294). Oxford, England: Oxford University Press.
   Google Scholar
• Campos, B., Shiota, M. N., Keltner, D., Gonzaga, G. C., & Goetz, J. L. (2013). What is shared, what is different? Core relational themes and expressive displays of eight positive emotions. Cognition & Emotion, 27(1), 37–52. doi: 10.1080/02699931.2012.683852
   PubMed Web of Science ®Google Scholar
• Camras, L., Meng, Z., Ujiie, T., Dharamsi, S., Miyake, K., Oster, H., … Campos, J. (2002). Observing emotion in infants: Facial expression, body behaviour, and rater judgements of responses to an expectancy-violating event. Emotion, 2, 179–193. doi: 10.1037/1528-3542.2.2.179
   PubMed Web of Science ®Google Scholar
• Clément, F., & Dukes, D. (2013). The role of interest in the transmission of social values. Frontiers in Psychology, 4, 349. doi: 10.3389/fpsyg.2013.00349
   PubMed Web of Science ®Google Scholar
• Conty, L., & Grèzes, J. (2012). Look at me, I'll remember you: The perception of self-relevant social cues enhances memory and right hippocampal activity. Human Brain Mapping, 33(10), 2428–2440. doi: 10.1002/hbm.21366
   PubMed Web of Science ®Google Scholar
• Dael, N., Mortillaro, M., & Scherer, K. R. (2012). Emotion expression in body action and posture. Emotion, 12(5), 1085–1101. doi: 10.1037/a0025737
   PubMed Web of Science ®Google Scholar
• de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14(3), 289–311. doi: 10.1080/026999300378824
   Web of Science ®Google Scholar
• Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48, 384–392. doi: 10.1037/0003-066X.48.4.384
   PubMed Web of Science ®Google Scholar
• Ekman, P., & Cordaro, D. (2011). What is meant by calling emotions basic. Emotion Review, 3(4), 364–370. doi: 10.1177/1754073911410740
   Web of Science ®Google Scholar
• Ekman, P., & Friesen, W. V. (1978). Facial action coding system. Palo Alto, CA: Consulting Psychologists Press.
   Google Scholar
• Frijda, N. H. (1986). The emotions. Cambridge, Paris: Cambridge University Press and the Editions de la Maison des Sciences de l'Homme.
   Google Scholar
• Frijda, N. H., Kuipers, P., & Ter Schure, E. (1989). Relations among emotion, appraisal, and emotional action readiness. Journal of Personality and Social Psychology, 57(2), 212–228. doi: 10.1037/0022-3514.57.2.212
   Web of Science ®Google Scholar
• Gogate, L. J., Bahrick, L. E., & Watson, J. D. (2000). A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures. Child Development, 71(4), 878–894. doi: 10.1111/1467-8624.00197
   PubMed Web of Science ®Google Scholar
• Gonzaga, G. C., Turner, R. A., Keltner, D., Campos, B., & Altemus, M. (2006). Romantic love and sexual desire in close relationships.. Emotion, 6, 163–179. doi: 10.1037/1528-3542.6.2.163
   PubMed Web of Science ®Google Scholar
• Hawk, S. T., Fischer, A. H., & Van Kleef, G. a. (2012). Face the noise: Embodied responses to nonverbal vocalizations of discrete emotions. Journal of Personality and Social Psychology, 102(4), 796–814. doi: 10.1037/a0026234
   PubMed Web of Science ®Google Scholar
• Izard, C. E. (1971). The face of emotion. New York: Appleton-Century-Crofts.
   Google Scholar
• Izard, C. E. (1979). The maximally discriminative facial movement coding system (Max). Newark, DE: Instructional Resources Center, University of Delaware.
   Google Scholar
• Izard, C. E. (1980). The emergence of emotions and the development of consciousness in infancy. In J. M. Davidson & R. J. Davidson (Eds.), The psychobiology of consciousness in infancy (pp. 193–215). New York: Plenum Press.
   Google Scholar
• Izard, C. E. (1994). Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin, 115(2), 288–299. doi: 10.1037/0033-2909.115.2.288
   PubMed Web of Science ®Google Scholar
• Keltner, D. (1995). Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement and shame. Journal of Personality and Social Psychology, 68, 441–454. doi: 10.1037/0022-3514.68.3.441
   Web of Science ®Google Scholar
• Krumhuber, G., Kappas, A., & Manstead, A. S. R. (2013). Effects of dynamic aspects of facial expressions: A review. Emotion Review, 5(1), 41–46. doi: 10.1177/1754073912451349
   Web of Science ®Google Scholar
• Kudoh, T., & Matsumoto, D. (1985). Cross-cultural examination of the semantic dimensions of body postures. Journal of Personality and Social Psychology, 48(6), 1440–1446. doi: 10.1037/0022-3514.48.6.1440
   PubMed Web of Science ®Google Scholar
• Langsdorf, P., Izard, C. E., Rayias, M., & Hembree, E. A. (1983). Interest expression, visual fixation, and heart rate changes in 2-and 8-month-old infants. Developmental Psychology, 19(3), 375–386. doi: 10.1037/0012-1649.19.3.375
   Web of Science ®Google Scholar
• Martinez, L., Falvello, V. B., Aviezer, H., & Todorov, A. (2015). Contributions of facial expressions and body language to the rapid perception of dynamic emotions. Cognition & Emotion, 9931(May), 1–14.
   Google Scholar
• Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychonomic Bulletin & Review, 3(2), 215–221. doi: 10.3758/BF03212421
   PubMed Web of Science ®Google Scholar
• Matias, R., Cohn, J. F., & Ross, S. (1989). A comparison of two systems that code infant affective expression. Developmental Psychology, 25(4), 483–489. doi: 10.1037/0012-1649.25.4.483
   Web of Science ®Google Scholar
• McHugh, J. E., Kearney, G., Rice, H., & Newell, F. N. (2012). The sound of the crowd: Auditory information modulates the perceived emotion of a crowd based on bodily expressions. Emotion (Washington, D.C.), 12(1), 120–131. doi: 10.1037/a0024785
   PubMed Web of Science ®Google Scholar
• Mondloch, C. J. (2012). Sad or fearful? The influence of body posture on adults’ and children’s perception of facial displays of emotion. Journal of Experimental Child Psychology, 111(2), 180–196. doi: 10.1016/j.jecp.2011.08.003
   PubMed Web of Science ®Google Scholar
• Mondloch, C. J., Horner, M., & Mian, J. (2013). Wide eyes and drooping arms: Adult-like congruency effects emerge early in the development of sensitivity to emotional faces and body postures. Journal of Experimental Child Psychology, 114(2), 203–216. doi: 10.1016/j.jecp.2012.06.003
   PubMed Web of Science ®Google Scholar
• Mortillaro, M., Mehu, M., & Scherer, K. R. (2011). Subtly different positive emotions can be distinguished by their facial expressions. Social Psychological and Personality Science, 2(3), 262–271. doi: 10.1177/1948550610389080
   Web of Science ®Google Scholar
• Mortillaro, M., Mehu, M., & Scherer, K. R. (2013). The evolutionary origin of multimodal synchronization and emotional expression. In E. Altenmüller, S. Schmidt, & E. Zimmermann (Eds.), Evolution of emotional communication: From sounds in nonhuman mammals to speech and music in man (pp. 3–25). New York: Oxford University Press.
   Google Scholar
• Nelson, N. L., & Russell, J. A. (2011). Preschoolers’ use of dynamic facial, bodily, and vocal cues to emotion. Journal of Experimental Child Psychology, 110(1), 52–61. doi: 10.1016/j.jecp.2011.03.014
   PubMed Web of Science ®Google Scholar
• Nelson, N. L., & Russell, J. A. (2014). Dynamic facial expressions allow differentiation of displays intended to convey positive and hubristic pride. Emotion, 14, 857–864. doi: 10.1037/a0036789
   PubMed Web of Science ®Google Scholar
• Noordewier, M. K., & Breugelmans, S. M. (2013). On the valence of surprise. Cognition & Emotion, 27(7), 1326–1334. doi: 10.1080/02699931.2013.777660
   PubMed Web of Science ®Google Scholar
• Paulmann, S., & Pell, M. D. (2011). Is there an advantage for recognizing multi-modal emotional stimuli? Motivation and Emotion, 35(2), 192–201. doi: 10.1007/s11031-011-9206-0
   Web of Science ®Google Scholar
• Reeve, J. (1993). The face of interest. Motivation and Emotion, 17(4), 353–375. doi: 10.1007/BF00992325
   Web of Science ®Google Scholar
• Reeve, J., & Nix, G. (1997). Expressing intrinsic motivation through acts of exploration and facial displays of interest. Motivation and Emotion, 21(3), 237–250. doi: 10.1023/A:1024470213500
   Web of Science ®Google Scholar
• Roth, S., & Cohen, L. J. (1986). Approach, avoidance, and coping with stress. American Psychologist, 41(7), 813–819. doi: 10.1037/0003-066X.41.7.813
   PubMed Web of Science ®Google Scholar
• Scherer, K. R., & Ellgring, H. (2007). Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7(1), 158–171. doi: 10.1037/1528-3542.7.1.158
   PubMed Web of Science ®Google Scholar
• Scherer, K. R., Zentner, M. R., & Stern, D. (2004). Beyond surprise: The puzzle of infants’ expressive reactions to expectancy violation. Emotion, 4(4), 389–402. doi: 10.1037/1528-3542.4.4.389
   PubMed Web of Science ®Google Scholar
• Silvia, P. J. (2005). What is interesting? Exploring the appraisal structure of interest. Emotion, 5(1), 89–102. doi: 10.1037/1528-3542.5.1.89
   PubMed Web of Science ®Google Scholar
• Silvia, P. J. (2006). Exploring the psychology of interest. New York: Oxford University Press.
   Google Scholar
• Tomkins, S. S., & Mc Carter, R. (1964). What and where are the primary affects? Some evidence for a theory. Perceptual and Motor Skills, 18(1), 119–158. doi: 10.2466/pms.1964.18.1.119
   PubMed Web of Science ®Google Scholar
• Tracy, J. L., & Robins, R. W. (2004). Show your pride: Evidence for a discrete emotion expression. Psychological Science, 15(3), 194–197. doi: 10.1111/j.0956-7976.2004.01503008.x
   PubMed Web of Science ®Google Scholar
• Van den Stock, J., Righart, R., & de Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487–494. doi: 10.1037/1528-3542.7.3.487
   PubMed Web of Science ®Google Scholar
• Wallbott, H. G. (1998). Bodily expression of emotion. European Journal of Social Psychology, 28(6), 879–896. doi: 10.1002/(SICI)1099-0992(1998110)28:6<879::AID-EJSP901>3.0.CO;2-W
   Web of Science ®Google Scholar
• Wallbott, H. G., & Scherer, K. R. (1986). Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51(4), 690–699. doi: 10.1037/0022-3514.51.4.690
   Web of Science ®Google Scholar
• Watson, R., Latinus, M., Noguchi, T., Garrod, O., Crabbe, F., & Belin, P. (2014). Crossmodal adaptation in right posterior superior temporal sulcus during face–voice emotional integration. Journal of Neuroscience, 34(20), 6813–6821. doi: 10.1523/JNEUROSCI.4478-13.2014
   PubMed Web of Science ®Google Scholar
• Wenzler, S., Levine, S., van Dick, R., Oertel-Knöchel, V., & Aviezer, H. (2016). Beyond pleasure and pain: Facial expression ambiguity in adults and children during intense situations. Emotion, 16(6), 807–814. doi: 10.1037/emo0000185
   PubMed Web of Science ®Google Scholar
• Zieber, N., Kangas, A., Hock, A., & Bhatt, R. S. (2014). The development of intermodal emotion perception from bodies and voices. Journal of Experimental Child Psychology, 126, 68–79. doi: 10.1016/j.jecp.2014.03.005
   PubMed Web of Science ®Google Scholar