Perceiving emotion from a talker: How face and voice work together

REFERENCES

• Banse , R. and Scherer , K. R. 1996 . Acoustic profiles in vocal emotion expression . Journal of Personality and Social Psychology , 70 : 614 – 636 .
   PubMed Web of Science ®Google Scholar
• Basilli , J. N. 1979 . Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face . Journal of Personality and Social Psychology , 37 : 2049 – 2056 .
   Web of Science ®Google Scholar
• Battocchi , A. , Pianesi , F. and Goren-Bar , D. 2005 . “ A first evaluation study of a database of kinetic facial expressions (DaFEx) ” . In Proceedings of ICMI '05 , Edited by: Lazzari , G. and Pianesi , F. 214 – 221 . New York , NY : ACM Press .
   Google Scholar
• Benoît , C. , Grice , M. and Hazan , V. 1996 . The SUS test: A method for the assessment of text-to-speech synthesis intelligibility using Semantically Unpredictable Sentences . Speech Communication , 18 : 381 – 392 .
   Web of Science ®Google Scholar
• Bird , K. D. , Hadzi-Pavlovic , D. , & Isaac , A. P. 2000 . PSY (Computer software) . Sydney , , Australia : School of Psychology, University of New South Wales .
   Google Scholar
• Collignon , O. , Girard , S. , Gosselin , F. , Roy , S. , Saint-Amour , D. , Lassonde , M. and Lepore , F. 2008 . Audio-visual integration of emotion expression . Brain Research , 1242 : 126 – 135 .
   PubMed Web of Science ®Google Scholar
• Collignon , O. , Girard , S. , Gosselin , F. , Saint-Amour , D. , Lepore , F. and Lassone , M. 2010 . Women process multisensory emotion expressions more efficiently than men . Neuropsychologia , 48 : 220 – 225 .
   PubMed Web of Science ®Google Scholar
• Constantini , E. , Pianesi , F. and Prete , M. 2005 . “ Recognising emotions in human and synthetic faces: The role of the upper and lower parts of the face ” . In Proceedings of Intelligent User Interfaces (IUI '05) , Edited by: Riedl , J. , Jameson , A. , Billsus , D. and Lau , T. 20 – 27 . New York , NY : ACM Press .
   Google Scholar
• Davis , C. and Kim , J. 2006 . Audio-visual speech perception off the top of the head . Cognition , 100 : B21 – B31 .
   Web of Science ®Google Scholar
• Deng , Z. , Bailenson , J. , Lewis , J. P. and Neumann , U. 2006 . Perceiving visual emotions with speech . Intelligent Virtual Agents: LNCS , 4133 : 107 – 120 .
   Web of Science ®Google Scholar
• Forster , K. I. and Forster , J. C. 2003 . DMDX: A Windows display program with millisecond accuracy . Behavioral Research Methods, Instruments and Computers , 35 : 116 – 124 .
   PubMedGoogle Scholar
• Fujimura , K. , & Sako , Y. 1999 . Shape signature by deformation . In B. Falcidieno , J. Rossignac , & V. Savchenko , Proceedings of international conference on Shape Modeling and Applications '99 , 279 , no. 1–4 ( 225 – 232 ). Washington , DC : IEEE Computer Society . doi: 10.1109/SMA.1999.749344
   Google Scholar
• Gaskell , M. G. and Marslen-Wilson , W. D. 1997 . Integrating form and meaning: A distributed model of speech perception . Language and Cognitive Processes , 12 : 613 – 656 .
   Web of Science ®Google Scholar
• Goffman , E. 1959 . The presentation of self in everyday life , Garden City , NY : Doubleday .
   Google Scholar
• Johnstone , T. and Scherer , K. R. 2000 . “ Vocal communication of emotion ” . In Handbook of emotion , 2nd ed. , Edited by: Lewis , M. and Haviland , J. 220 – 235 . New York , NY : Guilford Press .
   Google Scholar
• Juslin , P. N. and Laukka , P. 2003 . Communication of emotions in vocal expression and music performance: Different channels, same code? . Psychological Bulletin , 129 : 770 – 814 .
   PubMed Web of Science ®Google Scholar
• Kruskal , J. B. 1964 . Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis . Psychometrika , 29 : 1 – 27 .
   Web of Science ®Google Scholar
• Lee , A. 2010 . Virtualdub (1.9.11 (Build 32842)) [Computer software] . Available from http://www.virtualdub.org
   Google Scholar
• Massaro , D. W. and Egan , P. B. 1996 . Perceiving affect from the voice and the face . Psychonomic Bulletin and Review , 3 : 215 – 221 .
   PubMed Web of Science ®Google Scholar
• Nusseck , M. , Cunningham , D. W. , Wallraven , C. and Bülthoff , H. H. 2008 . The contribution of different facial regions to the recognition of conversational expressions . Journal of Vision , 8 : 1 – 23 .
   PubMed Web of Science ®Google Scholar
• Ross , E. D. , Prodan , C. I. and Monnot , M. 2007 . Human facial expressions are organized functionally across the upper-lower facial axis . The Neuroscientist , 13 : 433 – 446 .
   PubMed Web of Science ®Google Scholar
• Russell , J. A. and Bullock , M. E. 1985 . Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults . Journal of Personality and Social Psychology , 48 : 1290 – 1298 .
   Web of Science ®Google Scholar
• Sherer , K. R. 2003 . Vocal communication of emotion . Speech and Communication , 40 : 227 – 256 .
   Web of Science ®Google Scholar
• Smith , M. L. , Cottrell , G. W. , Gosselin , F. and Schyns , P. G. 2005 . Transmitting and decoding facial expressions . Psychological Science , 16 : 184 – 189 .
   PubMed Web of Science ®Google Scholar
• Takane , Y. and Shibayama , T. 1986 . “ Comparison of models for the stimulus recognition data ” . In Multidimensional data analysis , Edited by: de Leeuw , J. , Heiser , W. J. , Meulman , J. and Critchley , F. 119 – 138 . Leiden , , The Netherlands : DSWO Press .
   Google Scholar
• Tzanetakis , G. and Cook , P. 2002 . Musical genre classification of audio signals . IEEE Transactions on Speech and Audio Processing , 10 : 293 – 302 .
   Google Scholar
• Wallbott , H. G. and Scherer , K. R. 1986 . Cues and channels in emotion recognition . Journal of Personality and Social Psychology , 51 : 690 – 699 .
   Web of Science ®Google Scholar
• Wundt , W. 1911 . Grundzüge der physiologischen Psychologie, Vol. 3 , 6th ed. , Leipzig , , Germany : Engelmann .
   Google Scholar