Cross-modal integration of emotional face and voice in congruous and incongruous pairs: The P2 ERP effect

References

• Balconi , M. and Lucchiari , C. 2005 . “ Consciousness, emotion and face: An event-related potentials (ERP) study ” . In Consciousness and emotion: Agency, conscious choice, and selective perception , Edited by: Ellis , R. D. and Newton , N. 121 – 135 . Amsterdam and Philadelphia : John Benjamins Publishing Company .
   Google Scholar
• Balconi , M. and Lucchiari , C. 2006 . EEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis . Neuroscience Letters , 392 : 118 – 123 .
   PubMed Web of Science ®Google Scholar
• Balconi , M. and Lucchiari , C. 2008 . Consciousness and arousal effects on emotional face processing as revealed by brain oscillations: A gamma band analysis . International Journal of Psychophysiology , 67 : 41 – 46 .
   PubMed Web of Science ®Google Scholar
• Balconi , M. and Pozzoli , U. 2009 . Arousal effect on emotional face comprehension: Frequency band changes in different time intervals . Physiology and Behavior , 97 : 455 – 462 .
   PubMed Web of Science ®Google Scholar
• Callan , D. E. , Callan , A. M. , Kroos , C. and Vatikiotis-Bateson , E. 2001 . Multimodal contribution to speech perception revealed by independent component analysis: A single-sweep EEG case study . Cognitive Brain Research , 10 : 349 – 353 .
   PubMedGoogle Scholar
• Calvert , A. and Lewis , J. W. 2004 . “ Hemodynamic studies of audiovisual interactions ” . In The handbook of multisensory processes , Edited by: Calvert , G. , Spence , C. and Stein , B. E. 483 – 502 . Cambridge, MA : MIT Press .
   Google Scholar
• Calvert , G. A. 2001 . Crossmodal processing in the human brain: Insights from functional neuroimaging . Cerebral Cortex , 11 : 1110 – 1123 .
   PubMed Web of Science ®Google Scholar
• Calvert , G. A. , Campbell , M. and Brammer , R. J. 2000 . Evidence from functional magnetic resonance imaging in crossmodal binding in the human heteromodal cortex . Current Biology , 10 : 649 – 657 .
   PubMed Web of Science ®Google Scholar
• Campanella , S. and Belin , P. 2007 . Integrating face and voice in person perception . Trends in Cognitive Sciences , 11 : 635 – 643 .
   Google Scholar
• De Gelder , B. and Vroomen , J. 2000 . The perception of emotions by ear and by eye . Cognition and Emotion , 14 : 289 – 311 .
   Web of Science ®Google Scholar
• Ekman , P. and Friesen , W. V. 1976 . Pictures of facial affects , Palo Alto, CA : Consulting Psychologist Press .
   Google Scholar
• Giard , M. H. and Peronnet , F. 1999 . Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study . Journal of Cognitive Neuroscience , 11 : 473 – 490 .
   PubMed Web of Science ®Google Scholar
• Hadjikhani , N. and Roland , P. E. 1998 . Cross-modal transfer of information between the tactile and the visual representations in the human brain: A positron emission tomographic study . Journal of Neuroscience , 18 : 1072 – 1084 .
   PubMed Web of Science ®Google Scholar
• Jasper , H. H. 1958 . The ten-twenty electrode system of the International Federation . Electroencephalography and Clinical Neurophysiology , 10 : 371 – 375 .
   Google Scholar
• Kreifelts , B. , Ethofer , T. , Shiozawa , T. , Grodd , W. and Wildgruber , D. 2009 . Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice- and face-sensitive regions in the superior temporal sulcus . Neuropsychologia , 47 : 3059 – 3066 .
   PubMed Web of Science ®Google Scholar
• Lebib , R. , Papo , D. , de Bode , S. and Baudonnière , P.-M. 2003 . Evidence of a visual-to-auditory cross-modal sensory gating phenomenon as reflected by the human P50 event-related brain potential modulation . Neuroscience Letters , 341 : 185 – 188 .
   PubMedGoogle Scholar
• Marks , L. E. , Ben-Artzi , E. and Lakatos , S. 2003 . Cross-modal interactions in auditory and visual discrimination . International Journal of Psychophysiology , 50 : 125 – 145 .
   PubMedGoogle Scholar
• Pourtois , G. , Debatisse , D. , Despland , P.-A. and de Gelder , B. 2002 . Facial expressions modulate the time course of long latency auditory brain potentials . Cognitive Brain Research , 14 : 99 – 105 .
   PubMedGoogle Scholar
• Pourtois , G. , de Gelder , B. , Bol , A. and Crommelinck , M. 2005 . Perception of facial expressions and voices and of their combination in the human brain . Cortex , 41 : 49 – 59 .
   PubMed Web of Science ®Google Scholar
• Raij , T. , Uutela , K. and Hari , R. 2000 . Audiovisual integration of letters in the human brain . Neuron , 28 : 617 – 625 .
   PubMed Web of Science ®Google Scholar
• Rugg , M. D. and Coles , M. G. H. 1997 . Electrophysiology of mind: Event-related brain potentials and cognition , Oxford, , UK : Oxford University Press .
   Google Scholar
• Scherer , K. R. 1984 . “ On the nature and function of emotion: A component process approach ” . In Approaches to emotion , Edited by: Scherer , K. R. and Ekman , P. 293 – 317 . Hillsdale, NJ : Lawrence Erlbaum Associates, Inc .
   Google Scholar
• Schroeder , C. E. , Smiley , J. , Fu , K. J. , Mcginnis , T. , O'Connell , M. N. and Hackett , T. A. 2003 . Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing . International Journal of Psychophysiology , 50 : 5 – 17 .
   PubMedGoogle Scholar