The perception of changing emotion expressions

Abstract

The utility of recognising emotion expressions for coordinating social interactions is well documented, but less is known about how continuously changing emotion displays are perceived. The nonlinear dynamic systems view of emotions suggests that mixed emotion expressions in the middle of displays of changing expressions may be decoded differently depending on the expression origin. Hysteresis is when an impression (e.g., disgust) persists well after changes in facial expressions that favour an alternative impression (e.g., anger). In expression changes based on photographs (Study 1) and avatar images (Studies 2a–c, 3), we found hystereses particularly in changes between emotions that are perceptually similar (e.g., anger–disgust). We also consistently found uncertainty (neither emotion contributing to the mixed expression was perceived), which was more prevalent in expression sequences than in static images. Uncertainty occurred particularly in changes between emotions that are perceptually dissimilar, such as changes between happiness and negative emotions. This suggests that the perceptual similarity of emotion expressions may determine the extent to which hysteresis and uncertainty occur. Both hysteresis and uncertainty effects support our premise that emotion decoding is state dependent, a characteristic of dynamic systems. We propose avenues to test possible underlying mechanisms.

Keywords:

• Emotion perception
• Emotion
• Expression
• Mixed emotions
• Dynamic systems
• Hysteresis

View correction statement:

Corrigendum

Acknowledgments

This work has been partially funded by an ERC Advanced Grant in the European Community's 7th Framework Programme under grant agreement No. 230331-PROPEREMO to Klaus Scherer.

We are grateful to Frank Jäkel for insightful comments on the scaling problem, and to Reni Atanassov for executing the data collection of Study 2b.