Perceiving verbal and vocal emotions in a second language

Abstract

Emotional inferences from speech require the integration of verbal and vocal emotional expressions. We asked whether this integration is comparable when listeners are exposed to their native language and when they listen to a language learned later in life. To this end, we presented native and non-native listeners with positive, neutral and negative words that were spoken with a happy, neutral or sad tone of voice. In two separate tasks, participants judged word valence and ignored tone of voice or judged emotional tone of voice and ignored word valence. While native listeners outperformed non-native listeners in the word valence task, performance was comparable in the voice task. More importantly, both native and non-native listeners responded faster and more accurately when verbal and vocal emotional expressions were congruent as compared to when they were incongruent. Given that the size of the latter effect did not differ as a function of language proficiency, one can conclude that the integration of verbal and vocal emotional expressions occurs as readily in one's second language as it does in one's native language.

Keywords:

• Emotion
• Prosody
• Bilingualism
• Speech

Acknowledgments

This research was supported by the NUS young investigator award (WBS R-581-000-066-101) conferred to Annett Schirmer. We would like to thank Peggy Ferroa for helping this project along by producing the required vocalisations.

Notes

¹An ANOVA with the reaction times adjusted for each word's phonological uniqueness point as the dependent variable revealed comparable results (Appendix 2).