Perceiving emotions from bodily expressions and multisensory integration of emotion cues in schizophrenia

REFERENCES

• APA . 2000 . Diagnostic and statistical manual of mental disorders (DSM-IV-TR) , Washington, DC : American Psychiatric Association .
   Google Scholar
• Argyle , M. 1988 . Bodily communication , London : Methuen .
   Google Scholar
• Banse , R. and Scherer , K. R. 1996 . Acoustic profiles in vocal emotion expression . Journal of Personality & Social Psychology , 70 ( 3 ) : 614 – 636 .
   PubMed Web of Science ®Google Scholar
• Bertelson , P. and de Gelder , B. 2004 . “ The psychology of multimodal perception ” . In Crossmodal space and crossmodal attention , Edited by: Spence , C. and Driver , J. 151 – 177 . Oxford, , UK : Oxford University Press .
   Google Scholar
• Bertrand , M. C. , Achim , A. M. , Harvey , P. O. , Sutton , H. , Malla , A. K. and Lepage , M. 2008 . Structural neural correlates of impairments in social cognition in first episode psychosis . Social Neuroscience , 3 ( 1 ) : 79 – 88 .
   PubMed Web of Science ®Google Scholar
• Borod , J. C. , Martin , C. C. , Alpert , M. , Brozgold , A. and Welkowitz , J. 1993 . Perception of facial emotion in schizophrenic and right brain-damaged patients . Journal of Nervous and Mental Disease , 181 ( 8 ) : 494 – 502 .
   PubMed Web of Science ®Google Scholar
• Borod , J. C. , Pick , L. H. , Hall , S. , Sliwinski , M. , Madigan , N. Obler , L. K. 2000 . Relationships among facial, prosodic, and lexical channels of emotional perceptual processing . Cognition and Emotion , 14 ( 2 ) : 193 – 211 .
   Web of Science ®Google Scholar
• Cutting , J. E. and Kozlowski , L. T. 1977 . Recognizing friends by their walk: Gait perception without familiarity cues . Bulletin of the Psychonomic Society , 9 : 353 – 356 .
   Web of Science ®Google Scholar
• de Gelder , B. 2006 . Towards the neurobiology of emotional body language . Nature Reviews Neuroscience , 7 ( 3 ) : 242 – 249 .
   PubMed Web of Science ®Google Scholar
• de Gelder , B. and Bertelson , P. 2003 . Multisensory integration, perception and ecological validity . Trends in Cognitive Sciences , 7 ( 10 ) : 460 – 467 .
   PubMed Web of Science ®Google Scholar
• de Gelder , B. , Bocker , K. B. , Tuomainen , J. , Hensen , M. and Vroomen , J. 1999 . The combined perception of emotion from voice and face: Early interaction revealed by human electric brain responses . Neuroscience Letters , 260 ( 2 ) : 133 – 136 .
   PubMed Web of Science ®Google Scholar
• de Gelder , B. , Snyder , J. , Greve , D. , Gerard , G. and Hadjikhani , N. 2004 . Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body . Proceedings of the National Academy of Sciences of the United States of America , 101 ( 47 ) : 16701 – 16706 .
   PubMed Web of Science ®Google Scholar
• de Gelder , B. and Van den Stock , J. 2011 . “ Real faces, real emotions: Perceiving facial expressions in naturalistic contexts of voices, bodies and scenes ” . In The Oxford handbook of face perception , Edited by: Calder , A. J. , Rhodes , G. , Johnson , M. H. and Haxby , J. V. 535 – 550 . New York, NY : Oxford University Press .
   Google Scholar
• de Gelder , B. , Van den Stock , J. , de Diego Balaguer , R. and Bachoud-Levi , A. C. 2008 . Huntington's disease impairs recognition of angry and instrumental body language . Neuropsychologia , 46 ( 1 ) : 369 – 373 .
   PubMed Web of Science ®Google Scholar
• de Gelder , B. , Van den Stock , J. , Meeren , H. K. , Sinke , C. B. , Kret , M. E. and Tamietto , M. 2010 . Standing up for the body. Recent progress in uncovering the networks involved in the perception of bodies and bodily expressions . Neuroscience and Biobehavioral Reviews , 34 ( 4 ) : 513 – 527 .
   PubMed Web of Science ®Google Scholar
• de Gelder , B. and Vroomen , J. 2000 . The perception of emotions by ear and by eye . Cognition and Emotion , 14 ( 3 ) : 289 – 311 .
   Web of Science ®Google Scholar
• de Gelder , B. , Vroomen , J. , de Jong , S. J. , Masthoff , E. D. , Trompenaars , F. J. and Hodiamont , P. 2005 . Multisensory integration of emotional faces and voices in schizophrenia . Schizophrenics Research , 72 ( 2–3 ) : 195 – 203 .
   PubMed Web of Science ®Google Scholar
• de Jong , J. J. , Hodiamont , P. P. , Van den Stock , J. and de Gelder , B. 2009 . Audiovisual emotion recognition in schizophrenia: Reduced integration of facial and vocal affect . Schizophrenia Research , 107 ( 2–3 ) : 286 – 293 .
   PubMed Web of Science ®Google Scholar
• Dolan , R. J. , Morris , J. S. and de Gelder , B. 2001 . Crossmodal binding of fear in voice and face . Proceedings of the National Academy of Sciences of the United States of America , 98 ( 17 ) : 10006 – 10010 .
   PubMed Web of Science ®Google Scholar
• Ekman , P. and Friesen , W. V. 1976 . Pictures of facial affect , Palo Alto, CA : Consulting Psychologists Press .
   Google Scholar
• Ethofer , T. , Anders , S. , Erb , M. , Droll , C. , Royen , L. Saur , R. 2006 . Impact of voice on emotional judgment of faces: An event-related fMRI study . Human Brain Mapping , 27 ( 9 ) : 707 – 714 .
   PubMed Web of Science ®Google Scholar
• Feinberg , T. E. , Rifkin , A. , Schaffer , C. and Walker , E. 1986 . Facial discrimination and emotional recognition in schizophrenia and affective disorders . Archives of General Psychiatry , 43 ( 3 ) : 276 – 279 .
   PubMed Web of Science ®Google Scholar
• Grèzes , J. , Pichon , S. and de Gelder , B. 2007 . Perceiving fear in dynamic body expressions . NeuroImage , 35 ( 2 ) : 959 – 967 .
   PubMed Web of Science ®Google Scholar
• Gur , R. E. , McGrath , C. , Chan , R. M. , Schroeder , L. , Turner , T. Turetsky , B. I. 2002 . An fMRI study of facial emotion processing in patients with schizophrenia . American Journal of Psychiatry , 159 ( 12 ) : 1992 – 1999 .
   PubMed Web of Science ®Google Scholar
• Hadjikhani , N. and de Gelder , B. 2003 . Seeing fearful body expressions activates the fusiform cortex and amygdala . Current Biology , 13 ( 24 ) : 2201 – 2205 .
   PubMed Web of Science ®Google Scholar
• Hadjikhani , N. , Joseph , R. M. , Manoach , D. S. , Naik , P. , Snyder , J. Dominick , K. 2009 . Body expressions of emotion do not trigger fear contagion in autism spectrum disorder . Social, Cognitive and Affective Neuroscience , 4 ( 1 ) : 70 – 78 .
   Google Scholar
• Heimberg , C. , Gur , R. E. , Erwin , R. J. , Shtasel , D. L. and Gur , R. C. 1992 . Facial emotion discrimination. III. Behavioral findings in schizophrenia . Psychiatry Research , 42 ( 3 ) : 253 – 265 .
   PubMed Web of Science ®Google Scholar
• Johnson-Frey , S. H. , Maloof , F. R. , Newman-Norlund , R. , Farrer , C. , Inati , S. and Grafton , S. T. 2003 . Actions or hand–object interactions? Human inferior frontal cortex and action observation . Neuron , 39 ( 6 ) : 1053 – 1058 .
   PubMed Web of Science ®Google Scholar
• Joshua , N. and Rossell , S. 2009 . Configural face processing in schizophrenia . Schizophrenia Research , 112 ( 1–3 ) : 99 – 103 .
   Google Scholar
• Kee , K. S. , Horan , W. P. , Wynn , J. K. , Mintz , J. and Green , M. F. 2006 . An analysis of categorical perception of facial emotion in schizophrenia . Schizophrenia Research , 87 ( 1–3 ) : 228 – 237 .
   PubMed Web of Science ®Google Scholar
• Kohler , C. G. , Turner , T. H. , Bilker , W. B. , Brensinger , C. M. , Siegel , S. J. Kanes , S. J. 2003 . Facial emotion recognition in schizophrenia: Intensity effects and error pattern . American Journal of Psychiatry , 160 ( 10 ) : 1768 – 1774 .
   PubMed Web of Science ®Google Scholar
• Mandal , M. K. , Pandey , R. and Prasad , A. B. 1998 . Facial expressions of emotions and schizophrenia: A review . Schizophrenia Bulletin , 24 ( 3 ) : 399 – 412 .
   PubMed Web of Science ®Google Scholar
• Massaro , D. W. and Egan , P. B. 1996 . Perceiving affect from the voice and the face . Psychonomic Bulletin and Review , 3 : 215 – 221 .
   PubMed Web of Science ®Google Scholar
• Michalopoulou , P. G. , Surguladze , S. , Morley , L. A. , Giampietro , V. P. , Murray , R. M. and Shergill , S. S. 2008 . Facial fear processing and psychotic symptoms in schizophrenia: Functional magnetic resonance imaging study . British Journal of Psychiatry , 192 ( 3 ) : 191 – 196 .
   PubMed Web of Science ®Google Scholar
• Peelen , M. V. and Downing , P. E. 2007 . The neural basis of visual body perception . Nature Reviews Neuroscience , 8 ( 8 ) : 636 – 648 .
   PubMed Web of Science ®Google Scholar
• Phillips , M. L. , Williams , L. , Senior , C. , Bullmore , E. T. , Brammer , M. J. Andrew , C. 1999 . A differential neural response to threatening and non-threatening negative facial expressions in paranoid and non-paranoid schizophrenics . Psychiatry Research , 92 ( 1 ) : 11 – 31 .
   PubMed Web of Science ®Google Scholar
• Pichon , S. , de Gelder , B. and Grèzes , J. 2008 . Emotional modulation of visual and motor areas by still and dynamic body expressions of anger . Social Neuroscience , 3 ( 3–4 ) : 199 – 212 .
   PubMed Web of Science ®Google Scholar
• Pinkham , A. E. , Hopfinger , J. B. , Pelphrey , K. A. , Piven , J. and Penn , D. L. 2008a . Neural bases for impaired social cognition in schizophrenia and autism spectrum disorders . Schizophrenia Research , 99 ( 1–3 ) : 164 – 175 .
   PubMed Web of Science ®Google Scholar
• Pinkham , A. E. , Hopfinger , J. B. , Ruparel , K. and Penn , D. L. 2008b . An investigation of the relationship between activation of a social cognitive neural network and social functioning . Schizophrenia Bulletin , 34 ( 4 ) : 688 – 697 .
   PubMed Web of Science ®Google Scholar
• Pomarol-Clotet , E. , Hynes , F. , Ashwin , C. , Bullmore , E. T. , McKenna , P. J. and Laws , K. R. 2010 . Facial emotion processing in schizophrenia: A non-specific neuropsychological deficit? . Psychological Medicine , 40 ( 6 ) : 911 – 919 .
   PubMed Web of Science ®Google Scholar
• Pourtois , G. , Debatisse , D. , Despland , P. A. and de Gelder , B. 2002 . Facial expressions modulate the time course of long latency auditory brain potentials . Cognitive Brain Research , 14 ( 1 ) : 99 – 105 .
   PubMedGoogle Scholar
• Ross , L. A. , Saint-Amour , D. , Leavitt , V. M. , Molholm , S. , Javitt , D. C. and Foxe , J. J. 2007 . Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions . Schizophrenia Research , 97 ( 1–3 ) : 173 – 183 .
   PubMed Web of Science ®Google Scholar
• Scherer , K. R. , Banse , R. , Wallbott , H. G. and Goldbeck , T. 1991 . Vocal cues in emotion encoding and decoding . Motivation and Emotion , 15 ( 2 ) : 123 – 148 .
   Web of Science ®Google Scholar
• Sprengelmeyer , R. , Young , A. W. , Schroeder , U. , Grossenbacher , P. G. , Federlein , J. Buttner , T. 1999 . Knowing no fear . Proceedings of the Royal Society. Series B: Biological Sciences , 266 ( 1437 ) : 2451 – 2456 .
   PubMed Web of Science ®Google Scholar
• Stekelenburg , J. J. and de Gelder , B. 2004 . The neural correlates of perceiving human bodies: An ERP study on the body-inversion effect . Neuroreport , 15 ( 5 ) : 777 – 780 .
   PubMed Web of Science ®Google Scholar
• Tamietto , M. , Geminiani , G. , Genero , R. and de Gelder , B. 2007 . Seeing fearful body language overcomes attentional deficits in patients with neglect . Journal of Cognitive Neuroscience , 19 ( 3 ) : 445 – 454 . doi: doi: 10.1162/jocn.2007.19.3.445
   PubMed Web of Science ®Google Scholar
• Van den Stock , J. , Grèzes , J. and de Gelder , B. 2008a . Human and animal sounds influence recognition of body language . Brain Research , 1242 : 185 – 190 .
   PubMed Web of Science ®Google Scholar
• Van den Stock , J. , Peretz , I. , Grèzes , J. and de Gelder , B. 2009 . Instrumental music influences recognition of emotional body language . Brain Topography , 21 ( 3–4 ) : 216 – 220 .
   PubMed Web of Science ®Google Scholar
• Van den Stock , J. , Righart , R. and de Gelder , B. 2007 . Body expressions influence recognition of emotions in the face and voice . Emotion , 7 ( 3 ) : 487 – 494 .
   PubMed Web of Science ®Google Scholar
• Van den Stock , J. , van de Riet , W. A. , Righart , R. and de Gelder , B. 2008b . Neural correlates of perceiving emotional faces and bodies in developmental prosopagnosia: An event-related fMRI-study . PLoS One , 3 ( 9 ) : e3195
   Google Scholar
• Vroomen , J. , Driver , J. and de Gelder , B. 2001 . Is cross-modal integration of emotional expressions independent of attentional resources? . Cognitive, Affective, & Behavioral Neuroscience , 1 ( 4 ) : 382 – 387 .
   PubMed Web of Science ®Google Scholar
• Wolwer , W. , Streit , M. , Polzer , U. and Gaebel , W. 1996 . Facial affect recognition in the course of schizophrenia . European Archives of Psychiatry and Clinical Neuroscience , 246 ( 3 ) : 165 – 170 .
   PubMed Web of Science ®Google Scholar