Event-related potentials reveal temporal staging of dynamic facial expression and gaze shift effects on attentional orienting

REFERENCES

• Adams , R. B. and Kleck , R. E. 2003 . Percieved gaze direction and the processing of facial displays of emotion . Psychological Science , 14 : 644 – 647 .
   PubMed Web of Science ®Google Scholar
• Adams , R. B. and Kleck , R. E. 2005 . Effects of direct and averted gaze on the perception of facially communicated emotion . Emotion , 5 : 3 – 11 .
   PubMed Web of Science ®Google Scholar
• Bayliss , A. P. , Frischen , A. , Fenske , M. J. and Tipper , S. P. 2007 . Affective evaluations of objects are influenced by observed gaze direction and emotional expression . Cognition , 104 : 644 – 653 .
   PubMed Web of Science ®Google Scholar
• Busse , L. and Woldorff , M.G. 2003 . The ERP omitted stimulus response to “no-stim” events and its implications for fast-rate event-related fMRI designs . NeuroImage , 18 : 856 – 864 .
   PubMed Web of Science ®Google Scholar
• Corkum , V. and Moore , C. 1994 . “ Development of joint visual attention in infants ” . In Joint attention: Its origin and role in development , Edited by: Moore , C. and Dunham , P. 61 – 85 . Hillside, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Davidson , R. J. 1998 . Affective style and affective disorders: Perspectives from affective neuroscience . Cognition & Emotion , 12 : 307 – 330 .
   Web of Science ®Google Scholar
• Deaner , R. O. and Platt , M. L. 2003 . Reflexive social attention in monkeys and humans . Current Biology , 13 : 1609 – 1613 .
   PubMed Web of Science ®Google Scholar
• Driver , J. , Davis , G. , Ricciardelli , P. , Kidd , P. , Maxwell , E. and Baron-Cohen , S. 1999 . Gaze perception triggers reflexive visuospatial orienting . Visual Cognition , 6 : 509 – 540 .
   Web of Science ®Google Scholar
• Eastwood , J. D. , Smilek , D. and Merikle , P. M. 2001 . Differential attentional guidance by unattended faces expressing positive and negative emotion . Perception & Psychophysics , 63 : 1004 – 1013 .
   PubMed Web of Science ®Google Scholar
• Eimer , M. and Holmes , A. 2002 . An ERP study on the time course of emotional face processing . NeuroReport , 13 : 427 – 431 .
   PubMed Web of Science ®Google Scholar
• Ekman , P. and Friesen , W. V. 1978 . The facial action coding system , Palo Alto, CA : Consulting Psychologists Press .
   Google Scholar
• Ekman , P. and Oster , H. 1979 . Facial expressions of emotion . Annual Review of Psychology , 30 : 527 – 554 .
   Web of Science ®Google Scholar
• Emery , N. J. , Lorincz , E. N. , Perrett , D. I. , Oram , M. W. and Baker , C. I. 1997 . Gaze following and joint attention in rhesus monkeys (Macaca mulatta) . Journal of Comparative Psychology , 111 : 286 – 293 .
   PubMed Web of Science ®Google Scholar
• Farroni , T. , Massaccesi , S. , Pividori , D. and Johnson , M. H. 2004 . Gaze following in newborns . Infancy , 5 : 39 – 60 .
   Web of Science ®Google Scholar
• Farroni , T. , Menon , E. , Rigato , S. and Johnson , M. H. 2007 . The perception of facial expressions in newborns . European Journal of Developmental Psychology , 4 : 2 – 13 .
   PubMed Web of Science ®Google Scholar
• Fichtenholtz , H. M. , Hopfinger , J. B. , Graham , R. , Detwiler , J. M. and LaBar , K. S. 2007 . Facial expressions and emotional targets produce separable ERP effects in a gaze directed attention study . Social, Cognitive, and Affective Neuroscience , 2 : 323 – 333 .
   PubMed Web of Science ®Google Scholar
• Field , T. M. , Woodson , R. W. , Greenberg , R. and Cohen , C. 1982 . Discrimination and imitation of facial expressions by neonates . Science , 218 : 179 – 181 .
   PubMed Web of Science ®Google Scholar
• Fox , E. , Lester , V. , Russo , R. , Bowles , R. J. , Pichler , A. and Dutton , K. 2000 . Facial expressions of emotion: Are angry faces detected more efficiently? . Cognition & Emotion , 14 : 61 – 92 .
   PubMed Web of Science ®Google Scholar
• Friesen , C. K. and Kingstone , A. 1998 . The eyes have it! Reflexive orienting is triggered by nonpredictive gaze . Psychonomic Bulletin & Review , 5 : 490 – 495 .
   Web of Science ®Google Scholar
• Friesen , C. K. and Kingstone , A. 2003a . Covert and overt orienting to gaze direction cues and the effects of fixation offset . Neuroreport , 14 : 489 – 493 .
   PubMed Web of Science ®Google Scholar
• Friesen , C. K. and Kingstone , A. 2003b . Abrupt onsets and gaze direction cues trigger independent reflexive attentional effects . Cognition , 87 : B1 – B10 .
   PubMed Web of Science ®Google Scholar
• Friesen , C. K. , Moore , C. and Kingstone , A. 2005 . Does gaze direction really trigger a reflexive shift of spatial attention? . Brain and Cognition , 57 : 66 – 69 .
   PubMed Web of Science ®Google Scholar
• Friesen , C. K. , Ristic , J. and Kingstone , A. 2004 . Attentional effects of counterproductive gaze and arrow cues . Journal of Experimental Psychology: Human Perception and Performance , 30 : 319 – 329 .
   PubMed Web of Science ®Google Scholar
• Ganel , T. , Goshen-Gottstein , Y. and Goodale , M. A. 2005 . Interactions between the processing of gaze direction and facial expression . Vision Research , 45 : 1191 – 1200 .
   PubMed Web of Science ®Google Scholar
• Graham , R. , Friesen , C. K. , Fichtenholtz , H. M. , & LaBar , K. S. in press . Modulation of reflexive orienting to gaze direction by facial expressions . Visual Cognition .
   Google Scholar
• Graham , R. and LaBar , K. S. 2007 . The Garner selective attention paradigm reveals dependencies between emotional expression and gaze direction in face perception . Emotion , 7 : 296 – 313 .
   PubMed Web of Science ®Google Scholar
• Heinze , H. J. , Mangun , G. R. , Burchert , W. , Hinrichs , H. , Sholz , M. Munte , T. F. 1994 . Combined spatial and temporal imaging of brain activity during selective attention in humans . Nature , 372 : 543 – 546 .
   PubMed Web of Science ®Google Scholar
• Hietanen , J. K. 1999 . Does your gaze direction and head orientation shift my visual attention? . NeuroReport , 10 : 3443 – 3447 .
   PubMed Web of Science ®Google Scholar
• Hietanen , J. K. and Leppanen , J. M. 2003 . Does facial expression affect attention orienting by gaze direction cues? . Journal of Experimental Psychology: Human Perception and Performance , 29 : 1228 – 1243 .
   PubMed Web of Science ®Google Scholar
• Holmes , A. , Richards , A. and Green , S. 2006 . Anxiety and sensitivity to eye gaze in emotional faces . Brain and Cognition , 60 : 282 – 294 .
   PubMed Web of Science ®Google Scholar
• Holmes , A. , Vuilleumier , P. and Eimer , M. 2003 . The processing of emotional facial expression is gated by spatial attention: Evidence from event-related brain potentials . Cognitive Brain Research , 16 : 174 – 184 .
   PubMedGoogle Scholar
• Hori , E. , Tazumi , T. , Umeno , K. , Kamachi , M. , Kobayashi , T. Ono , T. 2005 . Effects of facial expression on shared attention mechanisms . Physiology and Behavior , 84 : 397 – 405 .
   PubMed Web of Science ®Google Scholar
• Hugdahl , K. and Nordby , H. 1994 . Electrophysiological correlates to cued attentional shifts in the visual and auditory modalities . Behavioral and Neural Biology , 62 : 21 – 32 .
   PubMedGoogle Scholar
• Itakura , S. 1996 . An exploratory study of gaze monitoring in nonhuman primates . Japanese Psychological Research , 38 : 174 – 180 .
   Web of Science ®Google Scholar
• Jasper , H. H. 1958 . The ten-twenty electrode system of the International Federation . Electroencephalography and Clinical Neurophysiology , 20 : 371 – 375 .
   Google Scholar
• Johnson , M. H. and Vecera , S. P. 1993 . “ Cortical parcellation and the development of face processing ” . In Developmental neurocognition: Speech and face processing in the first year of life , Edited by: de Boysson-Bardies , B. , de Schonen , S. , Jusczyk , P. W. , McNeilage , P. and Morton , J. 135 – 148 . New York : Kluwer Academic/Plenum Publishers .
   Google Scholar
• Klinnert , M. D. , Campos , J. J. , Sorce , J. F. , Emde , R. N. , & Svejda , M. 1983 . The development of social referencing in infancy . In R. Plutchik & H. Kellerman Emotion: Theory, research, and experience: Vol. 2. Emotion in early development pp. 57 – 86 . New York : Academic Press .
   Google Scholar
• Klucharev , V. and Sams , M. 2004 . Interaction of gaze direction and facial expressions processing: ERP study . NeuroReport , 15 : 621 – 626 .
   PubMed Web of Science ®Google Scholar
• LaBar , K. S. , Crupain , M. J. , Voyvodic , J. B. and McCarthy , G. 2003 . Dynamic perception of facial affect and identity in the human brain . Cerebral Cortex , 13 : 1023 – 1033 .
   PubMed Web of Science ®Google Scholar
• Langton , S. R. H. and Bruce , V. 1999 . Reflexive visual orienting in response to the social attention of others . Visual Cognition , 6 : 541 – 567 .
   Web of Science ®Google Scholar
• Luck , S. J. 2005 . An introduction to the event-related potential technique , Cambridge, MA : MIT Press .
   Google Scholar
• Luck , S. J. , Woodman , G. F. and Vogel , E. K. 2000 . Event-related potential studies of attention . Trends in Cognitive Sciences , 4 : 432 – 440 .
   PubMed Web of Science ®Google Scholar
• Lundqvist , D. and Ohman , A. 2005 . Emotion regulates attention: The relation between facial configurations, facial emotion, and visual attention . Visual Cognition , 12 : 51 – 84 .
   Web of Science ®Google Scholar
• Mangun , G. R. and Hillyard , S. A. 1991 . Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming . Journal of Experimental Psychology: Human Perception and Performance , 17 : 1057 – 1074 .
   PubMed Web of Science ®Google Scholar
• Mangun , G. R. , Hopfinger , J. B. , Kussmaul , C. L. , Fletcher , E. and Heinze , H. J. 1997 . Covariations in ERP and PET measures of spatial selective attention in human extrastriate visual cortex . Human Brain Mapping , 5 : 273 – 279 .
   PubMed Web of Science ®Google Scholar
• Mathews , A. , Fox , E. , Yiend , J. and Calder , A. 2003 . The face of fear: Effects of eye gaze and emotion on visual attention . Visual Cognition , 10 : 823 – 835 .
   PubMed Web of Science ®Google Scholar
• Mogg , K. and Bradley , B. P. 1999 . Some methodological issues in assessing attentional biases for threatening faces in anxiety: A replication study using a modified version of the probe detection task . Behaviour Research and Therapy , 37 : 595 – 604 .
   PubMed Web of Science ®Google Scholar
• Mogg , K. , McNamara , J. , Powys , M. , Rawlinson , H. , Seiffer , A. and Bradley , B. P. 2000 . Selective attention to threat: A test of two cognitive models . Cognition and Emotion , 14 : 375 – 399 .
   Web of Science ®Google Scholar
• Nelson , C. A. and Horowitz , F. D. 1983 . The perception of facial expressions and stimulus notion by 2- and 5-month-old infants using holographic stimuli . Child Development , 54 : 868 – 877 .
   PubMedGoogle Scholar
• Ohman , A. , Flykt , A. and Esteves , F. 2001 . Emotion drives attention: Detecting the snake in the grass . Journal of Experimental Psychology: General , 130 : 466 – 478 .
   PubMed Web of Science ®Google Scholar
• Ohman , A. , Lundqvist , D. and Esteves , F. 2001 . The face in the crowd revisited: A threat advantage with schematic stimuli . Journal of Personality & Social Psychology , 80 : 381 – 396 .
   PubMed Web of Science ®Google Scholar
• Pecchinenda , A. , Pes , M. , Ferlazzo , F. and Zoccolotti , P. 2008 . The combined effect of gaze direction and facial expression on cueing spatial attention . Emotion , 8 : 628 – 634 .
   PubMed Web of Science ®Google Scholar
• Pourtois , G. , Grandjean , D. , Sander , D. and Vuilleumier , P. 2004 . Electrophysiological correlates of rapid spatial orienting towards fearful faces . Cerebral Cortex , 14 : 619 – 633 .
   PubMed Web of Science ®Google Scholar
• Pourtois , G. , Sander , D. , Andres , M. , Grandjean , D. , Reveret , L. Oliver , E. 2004 . Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals . European Journal of Neuroscience , 20 : 3507 – 3515 .
   PubMed Web of Science ®Google Scholar
• Putman , P. , Hermans , E. and van Honk , J. 2006 . Anxiety meets fear in perception of dynamic expressive gaze . Emotion , 6 : 94 – 102 .
   PubMed Web of Science ®Google Scholar
• Ristic , J. , Friesen , C. K. and Kingstone , A. 2002 . Are eyes special? It depends on how you look at it . Psychonomic Bulletin & Review , 9 : 507 – 513 .
   PubMed Web of Science ®Google Scholar
• Ristic , J. and Kingstone , A. 2005 . Taking control of reflexive attention . Cognition , 94 : B55 – B65 .
   PubMed Web of Science ®Google Scholar
• Robinson , M. D. and Compton , R. J. 2006 . The automaticity of affective reactions: Stimulus valence, arousal, and lateral spatial attention . Social Cognition , 24 : 469 – 495 .
   Google Scholar
• Schuller , A.-M. and Rossion , B. 2001 . Spatial attention triggered by eye gaze increases and speeds up early visual activity . NeuroReport , 12 : 1 – 7 .
   PubMed Web of Science ®Google Scholar
• Schuller , A.-M. and Rossion , B. 2004 . Perception of static eye gaze direction facilitates subsequent early visual processing . Clinical Neurophysiology , 115 : 1161 – 1168 .
   PubMed Web of Science ®Google Scholar
• Schuller , A.-M. and Rossion , B. 2005 . Spatial attention triggered by eye gaze enhances and speeds up visual processing in upper and lower fields beyond early striate visual processing . Clinical Neurophysiology , 116 : 2565 – 2576 .
   PubMed Web of Science ®Google Scholar
• Tipples , J. 2006 . Fear and fearfulness potentiate automatic orienting to eye gaze . Cognition and Emotion , 20 : 309 – 320 .
   Web of Science ®Google Scholar
• Tipples , J. , Atkinson , A. P. and Young , A. W. 2002 . The eyebrow frown: A salient social signal . Emotion , 2 : 288 – 296 .
   PubMed Web of Science ®Google Scholar
• Tipples , J. , Young , A. W. , Quinlan , P. , Broks , P. and Ellis , A. W. 2002 . Searching for threat . Quarterly Journal of Experimental Psychology A , 55 : 1007 – 1026 .
   PubMed Web of Science ®Google Scholar
• Tomasello , M. , Hare , B. , Lehmann , H. and Call , J. 2007 . Reliance on head versus eyes in the gaze following of great apes and human infants: The cooperative eye hypothesis . Journal of Human Evolution , 52 : 314 – 320 .
   PubMed Web of Science ®Google Scholar
• Tomonaga , M. 2007 . Is chimpanzee (Pan troglodytes) spatial attention reflexively triggered by the gaze cue? . Journal of Comparative Psychology , 121 : 156 – 170 .
   PubMedGoogle Scholar
• Whalen , P. J. , Shin , L. M. , McInerney , S. C. , Fischer , H. , Wright , C. I. and Rauch , S. L. 2001 . A functional MRI study of human amygdala responses to facial expressions of fear versus anger . Emotion , 1 : 70 – 83 .
   PubMed Web of Science ®Google Scholar
• Woldorff , M. G. , Hazlett , C. J. , Fichtenholtz , H. M. , Weissman , D. H. , Dale , A. M. and Song , A. W. 2004 . Functional parcellation of attentional control regions of the brain . Journal of Cognitive Neuroscience , 16 : 149 – 165 .
   PubMed Web of Science ®Google Scholar