Spatial statistics of gaze fixations during dynamic face processing

References

• Adolphs , R. , Gosselin , F. , Buchanan , T. W. , Tranel , D. , Schyns , P. and Damasio , A. R. 2005 . A mechanism for impaired fear recognition after amygdala damage . Nature , 433 : 68 – 72 .
   PubMed Web of Science ®Google Scholar
• Ambadar , Z. , Schooler , J. W. and Cohn , J. F. 2005 . Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions . Psychological Science , 16 : 403 – 410 .
   PubMed Web of Science ®Google Scholar
• Baron-Cohen , S. , Wheelwright , S. , Hill , J. , Raste , Y. and Plumb , I. 2001 . The “Reading the Mind in the Eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism . Journal of Child Psychology and Psychiatry , 42 : 241 – 251 .
   PubMed Web of Science ®Google Scholar
• Bassili , J. N. 1978 . Facial motion in the perception of faces and of emotional expression . Journal of Experimental Psychology , 4 : 373 – 379 .
   Google Scholar
• Bassili , J. N. 1979 . Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face . Journal of Personality and Social Psychology , 37 : 2049 – 2058 .
   PubMed Web of Science ®Google Scholar
• Benoît , C. , Guiard-Marigny , T. , Le Groff , B. , & Adjoudani , A. ( 1996 ). Which components of the face do humans and machines best speechread? In D. G. Stork & M. Hennecke ( Eds ), Speechreading by humans and machines: Models, systems & applications (pp. 315 – 328 ). Berlin : Springer-Verlag .
   Google Scholar
• Bruce , V. and Young , A. 1986 . Understanding face recognition . British Journal of Psychology , 77 : 305 – 327 .
   PubMed Web of Science ®Google Scholar
• Callan , D. E. , Jones , J. A. , Munhall , K. , Callan , A. M. , Kroos , C. and Vatikiotis-Bateson , E. 2003 . Neural processes underlying perceptual enhancement by visual speech gestures . Cognitive Neuroscience and Neuroreport , 14 : 2213 – 2218 .
   PubMed Web of Science ®Google Scholar
• Calvert , G. A. , Campbell , R. and Brammer , M. J. 2000 . Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex . Current Biology , 10 : 649 – 657 .
   PubMed Web of Science ®Google Scholar
• Cowley , S. J. 1998 . Of timing, turn-taking, and conversations . Journal of Psycholinguistic Research , 27 : 541 – 571 .
   Web of Science ®Google Scholar
• Davis , H. and Silverman , S. R. 1970 . Hearing and deafness , New York : Holt, Reinhart & Wilson .
   Google Scholar
• de Gelder , B. and Vroomen , J. 2000 . The perception of emotions by ear and by eye . Cognition and Emotion , 14 : 289 – 311 .
   Web of Science ®Google Scholar
• Dong , D. W. and Atick , J. J. 1995 . Statistics of natural time-varying images . Network: Computation in Neural Systems , 6 : 345 – 358 .
   Web of Science ®Google Scholar
• Ekman , P. (Ed.) ( 1982 ). Emotion in the human face (2nd ed.) . New York : Cambridge University Press .
   Google Scholar
• Ekman , P. 1994 . Strong evidence for universals in facial expressions: A reply to Russell's mistaken critique . Psychological Bulletin , 115 : 268 – 287 .
   PubMed Web of Science ®Google Scholar
• Emery , N. J. 2000 . The eyes have it: The neuroethology, function and evolution of social gaze . Neuroscience and Behavioural Reviews , 24 : 581 – 604 .
   PubMed Web of Science ®Google Scholar
• Erber , N. P. 1969 . Interaction of audition and vision in the recognition of oral speech stimuli . Journal of Speech and Hearing Research , 12 : 423 – 425 .
   PubMedGoogle Scholar
• Findlay , J. M. and Gilchrist , I. D. 2003 . Active vision: The psychology of looking and seeing , London : Oxford University Press .
   Google Scholar
• Grandjean , D. , Sander , D. , Pourtois , G. , Schwartz , S. , Seghier , M. L. Scherer , K. L. 2005 . The voices of wrath: Brain responses to angry prosody in meaningless speech . Nature Neuroscience , 8 : 145 – 146 .
   PubMed Web of Science ®Google Scholar
• Hawkins , S. 2003 . Roles and representations of systematic fine phonetic detail in speech understanding . Journal of Phonetics , 31 : 373 – 405 .
   Web of Science ®Google Scholar
• Henderson , J. M. 2003 . Human gaze control during real-world scene perception . Trends in Cognitive Sciences , 7 ( 11 ) : 498 – 504 .
   PubMed Web of Science ®Google Scholar
• Henderson , J. M. , Weeks , P. A. Jr and Hollingworth , A. 1999 . The effects of semantic consistency on eye movements during scene viewing . Journal of Experimental Psychology: Human Perception & Performance , 25 : 210 – 228 .
   Web of Science ®Google Scholar
• Hill , H. and Johnston , A. 2001 . Categorizing sex and identity from the biological motion of faces . Current Biology , 11 : 880 – 885 .
   PubMed Web of Science ®Google Scholar
• Horley , K. , Williams , L. M. , Gonsalvez , C. and Gordon , E. 2004 . Face to face: Visual scanpath evidence for abnormal processing of facial expressions in social phobia . Psychiatry Research , 127 : 43 – 53 .
   PubMed Web of Science ®Google Scholar
• Kittler , P. and Turkewitz , G. 1999 . The talking face: Effects of concurrent speech on hemispheric lateralization of face recognition . Developmental Neuropsychology , 16 : 253 – 271 .
   Web of Science ®Google Scholar
• Kleinke , C. L. 1986 . Gaze and eye contact: A research review . Psychological Bulletin , 100 : 78 – 100 .
   PubMed Web of Science ®Google Scholar
• Klin , A. , Jones , W. , Schultz , R. , Volkmar , F. R. and Cohen , D. 2002 . Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism . Archives of General Psychiatry , 59 : 809 – 816 .
   PubMed Web of Science ®Google Scholar
• Knappmeyer , B. , Thornton , I. M. and Bülthoff , H. H. 2003 . The use of facial motion and facial form during the processing of identity . Vision Research , 43 : 1921 – 1936 .
   PubMed Web of Science ®Google Scholar
• Krahmer , E. , Ruttkay , Z. , Swerts , M. , & Wesselink , W. ( 2002 ). Pitch, eyebrows and the perception of focus Proceedings of Speech Prosody 2002 , Aix en Province , France , pp. 443 – 446 .
   Google Scholar
• Lansing , C. R. and McConkie , G. W. 1999 . Attention to facial regions in segmental and prosodic visual speech perception tasks . Journal of Speech, Language, and Hearing Research , 42 : 526 – 539 .
   PubMed Web of Science ®Google Scholar
• Lansing , C. R. and McConkie , G. W. 2003 . Word identification and eye fixation locations in visual and visual-plus-auditory presentations of spoken sentences . Perception & Psychophysics , 65 : 536 – 552 .
   PubMed Web of Science ®Google Scholar
• MacDonald , J. , Andersen , S. and Bachmann , T. 2000 . Hearing by eye: How much spatial degradation can be tolerated? . Perception , 29 : 1155 – 1168 .
   PubMed Web of Science ®Google Scholar
• Mergl , R. , Mavrogiorgou , P. , Hegerl , U. and Juckel , G. 2005 . Kinematical analysis of emotionally induced facial expressions: A novel tool to investigate hypomimia in patients suffering from depression . Journal of Neurology, Neurosurgery & Psychiatry , 76 : 138 – 40 .
   PubMed Web of Science ®Google Scholar
• Munhall , K. G. , Kroos , C. , Jozan , G. and Vatikiotis-Bateson , E. 2004 . Spatial frequency requirements for audiovisual speech perception . Perception & Psychophysics , 66 : 574 – 583 .
   PubMedGoogle Scholar
• Oram , M. W. and Perrett , D. I. 1992 . Time course of neural responses discriminating different views of the face and head . Journal of Neurophysiology , 68 : 70 – 84 .
   PubMed Web of Science ®Google Scholar
• O'Neill , J. J. 1954 . Contributions of the visual components of oral symbols to speech comprehension . Journal of Speech and Hearing Disorders , 19 : 429 – 439 .
   PubMedGoogle Scholar
• O'Toole , A. J. , Roark , D. A. and Abdi , H. 2002 . Recognizing moving faces: A psychological and neural synthesis . Trends in Cognitive Sciences , 6 : 261 – 266 .
   PubMed Web of Science ®Google Scholar
• Paré , M. , Richler , R. C. , ten Hove , M. and Munhall , K. G. 2003 . Gaze behaviour in audiovisual speech perception: The influence of ocular fixations on the McGurk effect . Perception & Psychophysics , 65 : 533 – 567 .
   Google Scholar
• Parkhurst , D. J. and Niebur , E. 2003 . Scene content selected by active vision . Spatial Vision , 16 : 125 – 154 .
   PubMedGoogle Scholar
• Pisoni , D. B. 1997 . “ Some thoughts on “Normalization” in speech perception ” . In Talker variability in speech processing , Edited by: Johnson , K. and Mullennix , J. W. 9 – 32 . San Diego, CA : Academic Press .
   Google Scholar
• Posner , M. I. 1980 . Orienting of attention . Quarterly Journal of Experimental Psychology , 32 : 3 – 25 .
   PubMed Web of Science ®Google Scholar
• Puce , A. , Allison , T. , Bentin , S. , Gore , J. C. and McCarthy , G. 1998 . Temporal cortex activation in humans viewing eye and mouth movements . The Journal of Neuroscience , 18 : 2188 – 2199 .
   PubMed Web of Science ®Google Scholar
• Schyns , P. G. , Bonnar , L. and Gosselin , F. 2002 . Show me the features! Understanding recognition from the use of visual information . Psychological Science , 13 : 402 – 409 .
   PubMed Web of Science ®Google Scholar
• Sekiyama , K. , Kanno , I. , Miura , S. and Sugita , Y. 2003 . Auditory-visual speech perception examined by fMRI and PET . Neuroscience Research , 47 : 277 – 287 .
   PubMed Web of Science ®Google Scholar
• Smith , M. L. , Cottrell , G. W. , Gosselin , F. and Schyns , P. G. 2005 . Transmitting and decoding facial expressions . Psychological Science , 16 : 184 – 189 .
   PubMed Web of Science ®Google Scholar
• Sumby , W. H. and Pollack , I. 1954 . Visual contributions to speech intelligibility in noise . Journal of the Acoustical Society of America , 26 : 212 – 215 .
   Web of Science ®Google Scholar
• Thompson , L. A. , Malmberg , J. , Goodell , N. K. and Boring , R. L. 2004 . The distribution of attention across a talker's face . Discourse Processes , 38 : 145 – 168 .
   Web of Science ®Google Scholar
• Terzis , J. K. and Noah , E. M. 2002 . Mobius and Mobius-like patients: Etiology, diagnosis, and treatment options . Clinical Plastic Surgery , 29 : 497 – 514 .
   Google Scholar
• Vatikiotis-Bateson , E. , Eigsti , I. M. , Yano , S. and Munhall , K. G. 1998 . Eye movement of perceivers during audiovisual speech perception . Perception & Psychophysics , 60 : 926 – 940 .
   PubMed Web of Science ®Google Scholar
• Vatikiotis-Bateson , E. , Munhall , K. G. , Hirayama , M. , Kasahara , Y. , & Yehia , H. ( 1996 ) Physiology-based synthesis of audiovisual speech . In Proceedings of 4th Speech Production Seminar: Models and Data . Autrans , France .
   Google Scholar
• Vuilleumier , P. , Armony , J. L. , Driver , J. and Dolan , R. J. 2001 . Effects of attention and emotion on face processing in the human brain: An event-related fMRI study . Neuron , 30 : 829 – 841 .
   PubMed Web of Science ®Google Scholar
• Walker-Smith , G. J. , Gale , A. G. and Findlay , J. M. 1977 . Eye movement strategies involved in face perception . Perception , 6 : 313 – 326 .
   PubMed Web of Science ®Google Scholar
• Williams , L. M. , Loughland , C. M. , Green , M. J. , Harris , A. W. F. and Gordon , E. 2003 . Emotion perception in schizophrenia: And eye movement study comparing the effectiveness of risperidone vs. haloperidol . Psychiatry Research , 120 : 13 – 27 .
   PubMed Web of Science ®Google Scholar
• Wright , T. M. , Pelphrey , K. A. , Allison , T. , McKeown , M. J. and McCarthy , G. 2003 . Polysensory interactions along lateral temporal regions evoked by audiovisual speech . Cerebral Cortex , 13 : 1034 – 1043 .
   PubMed Web of Science ®Google Scholar
• Yarbus , A. L. 1967 . Eye movements and vision , New York : Plenum Press .
   Google Scholar
• Yehia , H. C. , Rubin , P. E. and Vatikiotis-Bateson , E. 1998 . Quantitative association of vocal-tract and facial behaviour . Speech Communication , 26 : 23 – 44 .
   Web of Science ®Google Scholar