Perception of emotion in psychiatric disorders: On the possible role of task, dynamics, and multimodality

Abstract

Experimental evidence suggests an impairment in emotion perception in numerous psychiatric disorders. The results to date are primarily based on research using static displays of emotional facial expressions. However, our natural environment is dynamic and multimodal, comprising input from various communication channels such as facial expressions, emotional prosody, and emotional semantics, to name but a few. Thus, one critical open question is whether alterations in emotion perception in psychiatric populations are confirmed when testing patients in dynamic and multimodal naturalistic settings. Furthermore, the impact task demands may exert on results also needs to be reconsidered. Focusing on schizophrenia and depression, we review evidence on how emotions are perceived from faces and voices in these disorders and examine how experimental task demands, stimulus dynamics, and modality may affect study results.

Keywords:

• Emotion perception
• Multimodal
• Task effects
• Depression
• Schizophrenia

Acknowledgments

The authors would like to thank three anonymous reviewers for helpful comments on an earlier version of this manuscript. We also thank Rosie Wallis for carefully checking our English. We gratefully acknowledge the funding of the Canadian Institute of Health Research (CIHRMPO: 62867: Marc D. Pell and S.A.K.) and the German Science Foundation (DFG-FOR-499: S.A.K.).

Notes

*These authors contributed equally to the paper.