Modelling search for people in 900 scenes: A combined source model of eye guidance

References

• Andrews , T. J. and Coppola , D. M. 1999 . Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments . Vision Research , 39 : 2947 – 2953 .
   PubMed Web of Science ®Google Scholar
• Araujo , C. , Kowler , E. and Pavel , M. 2001 . Eye movements during visual search: The cost of choosing the optimal path . Vision Research , 41 : 3613 – 3625 .
   PubMed Web of Science ®Google Scholar
• Bar , M. 2004 . Visual objects in context . Nature Reviews Neuroscience , 5 : 617 – 629 .
   PubMed Web of Science ®Google Scholar
• Biederman , I. , Mezzanotte , R. J. and Rabinowitz , J. C. 1982 . Scene perception: Detecting and judging objects undergoing relational violations . Cognitive Psychology , 14 : 143 – 177 .
   PubMed Web of Science ®Google Scholar
• Bosch , A. , Zisserman , A. and Muñoz , X. 2008 . Scene classification using a hybrid generative/discriminative approach . IEEE Transactions on Pattern Analysis and Machine Intelligence , 30 : 712 – 727 .
   PubMed Web of Science ®Google Scholar
• Brainard , D. H. 1997 . The Psychophysics Toolbox . Spatial Vision , 10 : 433 – 436 .
   PubMedGoogle Scholar
• Bravo , M. J. and Farid , H. 2006 . Object recognition in dense clutter . Perception & Psychophysics , 68 ( 6 ) : 911 – 918 .
   PubMed Web of Science ®Google Scholar
• Bruce , N. and Tsotsos , J. K. 2006 . Saliency based on information maximization . Advances in Neural Information Processing Systems , 18 : 155 – 162 .
   Google Scholar
• Buswell , G. T. 1935 . How people look at pictures , Oxford, , UK : Oxford University Press .
   Google Scholar
• Castelhano , M. S. and Henderson , J. M. 2007 . Initial scene representations facilitate eye movement guidance in visual search . Journal of Experimental Psychology: Human Perception and Performance , 33 : 753 – 763 .
   PubMed Web of Science ®Google Scholar
• Chaumon , M. , Drouet , V. and Tallon-Baudry , C. 2008 . Unconscious associative memory affects visual processing before 100 ms . Journal of Vision , 8 ( 3 ) : 1 – 10 .
   PubMed Web of Science ®Google Scholar
• Chun , M. M. 2003 . “ Scene perception and memory ” . In The psychology of learning and motivation: Advances in research and theory , Edited by: Irwin , D. E. and Ross , B. H. Vol. 42 , 79 – 108 . San Diego, CA : Academic Press .
   Google Scholar
• Dalal , N. and Triggs , B. 2005 . Histograms of oriented gradients for human detection . IEEE Conference on Computer Vision and Pattern Recognition , 2 : 886 – 893 .
   Google Scholar
• Dalal , N. , Triggs , B. and Schmid , C. 2006 . Human detection using oriented histograms of flow and appearance . European Conference on Computer Vision , 2 : 428 – 441 .
   Google Scholar
• De Graef , P. , Christiaens , D. and d'Ydewalle , G. 1990 . Perceptual effects of scene context on object identification . Psychological Research , 52 : 317 – 329 .
   PubMed Web of Science ®Google Scholar
• Droll , J. and Eckstein , M. 2008 . Expected object position of two hundred fifty observers predicts first fixations of seventy seven separate observers during search . Journal of Vision , 8 ( 6 ) : 320
   Google Scholar
• Eckstein , M. P. , Drescher , B. A. and Shimozaki , S. S. 2006 . Attentional cues in real scenes, saccadic targeting and Bayesian priors . Psychological Science , 17 : 973 – 980 .
   PubMed Web of Science ®Google Scholar
• Einhäuser , W. , Rutishauser , U. and Koch , C. 2008 . Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli . Journal of Vision , 8 ( 2 ) : 1 – 19 .
   Web of Science ®Google Scholar
• Elazary , L. and Itti , L. 2008 . Interesting objects are visually salient . Journal of Vision , 8 ( 3 ) : 1 – 15 .
   PubMed Web of Science ®Google Scholar
• Fei Fei , L. and Perona , P. 2005 . A Bayesian hierarchical model for learning natural scene categories . IEEE Proceedings in Computer Vision and Pattern Recognition , 2 : 524 – 531 .
   Google Scholar
• Foulsham , T. and Underwood , G. 2008 . What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition . Journal of Vision , 8 ( 2 ) : 1 – 17 .
   PubMed Web of Science ®Google Scholar
• Friedman , A. 1979 . Framing pictures: The role of knowledge in automatized encoding and memory of gist . Journal of Experimental Psychology: General , 108 : 316 – 355 .
   PubMed Web of Science ®Google Scholar
• Greene , M. R. and Oliva , A. 2009 . Recognition of natural scenes from global properties: Seeing the forest without representing the trees . Cognitive Psychology , 58 ( 2 ) : 137 – 179 .
   PubMed Web of Science ®Google Scholar
• Grossberg , S. and Huang , T.-R. 2009 . ARTSCENE: A neural system for natural scene classification . Journal of Vision , 9 : 1 – 19 .
   PubMed Web of Science ®Google Scholar
• Harel , J. , Koch , C. and Perona , P. 2006 . Graph-based visual saliency . Advances in Neural Information Processing Systems , 19 : 545 – 552 .
   Google Scholar
• Hayhoe , M. and Ballard , D. 2005 . Eye movements in natural behavior . Trends in Cognitive Sciences , 9 : 188 – 194 .
   PubMed Web of Science ®Google Scholar
• Hayhoe , M. , Shrivastava , A. , Mruczek , R. and Pelz , J. B. 2003 . Visual memory and motor planning in a natural task . Journal of Vision , 3 : 49 – 63 .
   PubMed Web of Science ®Google Scholar
• Henderson , J. M. , Brockmole , J. R. , Castelhano , M. S. and Mack , M. 2007 . “ Visual saliency does not account for eye movement during visual search in real-world scenes ” . In Eye movement research: Insights into mind and brain , Edited by: van Gompel , R. , Fischer , M. , Murray , W. and Hill , R. 537 – 562 . Oxford, , UK : Elsevier .
   Google Scholar
• Henderson , J. M. , Weeks , P. A. Jr and Hollingworth , A. 1999 . Effects of semantic consistency on eye movements during scene viewing . Journal of Experimental Psychology: Human Perception and Performance , 25 : 210 – 228 .
   Web of Science ®Google Scholar
• Hoiem , D. , Efros , A. A. and Hebert , M. 2006 . Putting objects in perspective . IEEE Conference on Computer Vision and Pattern Recognition , 2 : 2137 – 2144 .
   Google Scholar
• Itti , L. and Koch , C. 2000 . A saliency-based search mechanism for overt and covert shifts of visual attention . Vision Research , 40 : 1489 – 1506 .
   PubMed Web of Science ®Google Scholar
• Itti , L. , Koch , C. and Niebur , E. 1998 . A model of saliency-based visual attention for rapid scene analysis . IEEE Transactions in Pattern Analysis and Machine Vision , 20 ( 11 ) : 12 – 54 .
   Web of Science ®Google Scholar
• Joubert , O. , Rousselet , G. , Fize , D. and Fabre-Thorpe , M. 2007 . Processing scene context: Fast categorization and object interference . Vision Research , 47 : 3286 – 3297 .
   PubMed Web of Science ®Google Scholar
• Kanan , C. , Tong , M. H. , Zhang , L. , & Cottrell , G. W. 2009 . SUN: Top-down saliency using natural statistics . Visual Cognition , 17 6/7 , 979 – 1003 .
   PubMed Web of Science ®Google Scholar
• Koch , C. and Ullman , S. 1985 . Shifts in visual attention: Towards the underlying circuitry . Human Neurobiology , 4 : 219 – 227 .
   PubMedGoogle Scholar
• Kumar , S. and Hebert , M. 2005 . A hierarchical field framework for unified context-based classification . IEEE International Conference on Computer Vision , 2 : 1284 – 1291 .
   Google Scholar
• Land , M. F. and Lee , D. N. 1994 . Where we look when we steer . Nature , 369 : 742 – 744 .
   PubMed Web of Science ®Google Scholar
• Land , M. F. and McLeod , P. 2000 . From eye movements to actions: How batsmen hit the ball . Nature Neuroscience , 3 : 1340 – 1345 .
   PubMed Web of Science ®Google Scholar
• Lazebnik , S. , Schmidt , C. and Ponce , J. 2006 . Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories . IEEE Conference on Computer Vision and Pattern Recognition , 2 : 2169 – 2178 .
   Google Scholar
• Li , Z. 2002 . A saliency map in primary visual cortex . Trends in Cognitive Sciences , 6 ( 1 ) : 9 – 16 .
   PubMed Web of Science ®Google Scholar
• Loftus , G. R. and Mackworth , N. H. 1978 . Cognitive determinants of fixation location during picture viewing . Journal of Experimental Psychology: Human Perception and Performance , 4 : 565 – 572 .
   PubMed Web of Science ®Google Scholar
• Mannan , S. , Ruddock , K. H. and Wooding , D. S. 1995 . Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images . Spatial Vision , 9 : 363 – 386 .
   PubMedGoogle Scholar
• McCotter , M. , Gosselin , F. , Sowden , P. and Schyns , P. G. 2005 . The use of visual information in natural scenes . Visual Cognition , 12 : 938 – 953 .
   Web of Science ®Google Scholar
• Neider , M. B. and Zelinsky , G. J. 2006 . Scene context guides eye movements during visual search . Vision Research , 46 : 614 – 621 .
   PubMed Web of Science ®Google Scholar
• Oliva , A. and Torralba , A. 2001 . Modeling the shape of the scene: A holistic representation of the spatial envelope . International Journal of Computer Vision , 42 : 145 – 175 .
   Web of Science ®Google Scholar
• Oliva , A. and Torralba , A. 2006 . Building the gist of a scene: The role of global image features in recognition . Progress in Brain Research: Visual Perception , 155 : 23 – 36 .
   PubMed Web of Science ®Google Scholar
• Oliva , A. and Torralba , A. 2007 . The role of context in object recognition . Trends in Cognitive Sciences , 11 ( 12 ) : 520 – 527 .
   PubMed Web of Science ®Google Scholar
• Papageorgiou , C. and Poggio , T. 2000 . A trainable system for object detection . International Journal of Computer Vision , 38 ( 1 ) : 15 – 33 .
   Web of Science ®Google Scholar
• Parkhurst , D. J. , Law , K. and Niebur , E. 2002 . Modeling the role of salience in the allocation of overt visual attention . Vision Research , 42 : 107 – 123 .
   PubMed Web of Science ®Google Scholar
• Parkhurst , D. J. and Niebur , E. 2003 . Scene content selected by active vision . Spatial Vision , 16 ( 2 ) : 125 – 154 .
   PubMedGoogle Scholar
• Pelli , D. G. 1997 . The VideoToolbox software for visual psychophysics: Transforming numbers into movies . Spatial Vision , 10 : 437 – 442 .
   PubMedGoogle Scholar
• Peters , R. J. , Iyer , A. , Itti , L. and Koch , C. 2005 . Components of bottom-up gaze allocation in natural images . Vision Research , 45 : 2397 – 2416 .
   PubMed Web of Science ®Google Scholar
• Pomplun , M. 2006 . Saccadic selectivity in complex visual search displays . Vision Research , 46 : 1886 – 1900 .
   PubMed Web of Science ®Google Scholar
• Rabinovich , A. , Vedaldi , A. , Galleguillos , C. , Wiewiora , E. , & Belongie , S. 2007 . Objects in context . IEEE International Conference on Computer Vision , 1 – 8 .
   Google Scholar
• Rao , R. P. N. , Zelinsky , G. , Hayhoe , M. M. and Ballard , D. H. 2002 . Eye movements in iconic visual search . Vision Research , 42 : 1447 – 1463 .
   PubMed Web of Science ®Google Scholar
• Renninger , L. W. and Malik , J. 2004 . When is scene identification just texture recognition? . Vision Research , 44 : 2301 – 2311 .
   PubMed Web of Science ®Google Scholar
• Renninger , L. W. , Verghese , P. and Coughlan , J. 2007 . Where to look next? Eye movements reduce local uncertainty . Journal of Vision , 7 ( 3 ) : 1 – 17 .
   Web of Science ®Google Scholar
• Rodriguez-Sanchez , A. J. , Simine , E. and Tsotsos , J. K. 2007 . Attention and visual search . International Journal of Neural Systems , 17 ( 4 ) : 275 – 288 .
   PubMed Web of Science ®Google Scholar
• Rosenholtz , R. 1999 . A simple saliency model predicts a number of motion popout phenomena . Vision Research , 39 : 3157 – 3163 .
   PubMed Web of Science ®Google Scholar
• Rosenholtz , R. , Li , Y. and Nakano , L. 2007 . Measuring visual clutter . Journal of Vision , 7 ( 2 ) : 1 – 22 .
   PubMed Web of Science ®Google Scholar
• Rousselet , G. A. , Joubert , O. R. and Fabre-Thorpe , M. 2005 . How long to get to the “gist” of real-world natural scenes? . Visual Cognition , 12 : 852 – 877 .
   Web of Science ®Google Scholar
• Russell , B. , Torralba , A. , Murphy , K. and Freeman , W. T. 2008 . LabelMe: A database and web-based tool for image annotation . International Journal of Computer Vision , 77 : 157 – 173 .
   Web of Science ®Google Scholar
• Schyns , P. G. and Oliva , A. 1994 . From blobs to boundary edges: Evidence for time- and spatial-scale-dependent scene recognition . Psychological Science , 5 : 195 – 200 .
   Web of Science ®Google Scholar
• Serre , T. , Wolf , L. , Bileschi , S. , Riesenhuber , M. and Poggio , T. 2007 . Object recognition with cortex-like mechanisms . IEEE Transactions on Pattern Analysis and Machine Intelligence , 29 ( 3 ) : 411 – 426 .
   PubMed Web of Science ®Google Scholar
• Stirk , J. A. and Underwood , G. 2007 . Low-level visual saliency does not predict change detection in natural scenes . Journal of Vision , 7 ( 10 ) : 1 – 10 .
   PubMed Web of Science ®Google Scholar
• Tatler , B. W. 2007 . The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions . Journal of Vision , 7 ( 14 ) : 1 – 17 .
   PubMed Web of Science ®Google Scholar
• Tatler , B. W. , Baddeley , R. J. and Gilchrist , I. D. 2005 . Visual correlates of fixation selection: Effects of scale and time . Vision Research , 45 ( 5 ) : 643 – 659 .
   PubMed Web of Science ®Google Scholar
• Tatler , B. W. , Baddeley , R. J. and Vincent , B. T. 2006 . The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task . Vision Research , 46 ( 12 ) : 1857 – 1862 .
   PubMed Web of Science ®Google Scholar
• Tatler , B. W. , & Vincent , B. T. 2009 . The prominence of behavioural biases in eye guidance . Visual Cognition , 17 6/7 , 1029 – 1054 .
   Web of Science ®Google Scholar
• Torralba , A. 2003a . Contextual priming for object detection . International Journal of Computer Vision , 53 ( 2 ) : 169 – 191 .
   Web of Science ®Google Scholar
• Torralba , A. 2003b . Modeling global scene factors in attention . Journal of Optical Society of America , 20A ( 7 ) : 1407 – 1418 .
   Google Scholar
• Torralba , A. , Fergus , R. and Freeman , W. T. 2008 . 80 million tiny images: A large dataset for non-parametric object and scene recognition . IEEE Transactions on Pattern Analysis and Machine Intelligence , 30 : 1958 – 1970 .
   PubMed Web of Science ®Google Scholar
• Torralba , A. , Murphy , K. P. and Freeman , W. T. 2005 . Contextual models for object detection using boosted random fields . Advances in Neural Information Processing Systems , 17 : 1401 – 1408 .
   Google Scholar
• Torralba , A. , Murphy , K. P. and Freeman , W. T. 2007 . Sharing visual features for multiclass and multiview object detection . IEEE Transactions on Pattern Analysis and Machine Intelligence , 29 ( 5 ) : 854 – 869 .
   PubMed Web of Science ®Google Scholar
• Torralba , A. and Oliva , A. 2002 . Depth estimation from image structure . IEEE Pattern Analysis and Machine Intelligence , 24 : 1226 – 1238 .
   Web of Science ®Google Scholar
• Torralba , A. and Oliva , A. 2003 . Statistics of Natural Images Categories . Network: Computation in Neural Systems , 14 : 391 – 412 .
   PubMed Web of Science ®Google Scholar
• Torralba , A. , Oliva , A. , Castelhano , M. and Henderson , J. M. 2006 . Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search . Psychological Review , 113 : 766 – 786 .
   PubMed Web of Science ®Google Scholar
• Treisman , A. and Gelade , G. 1980 . A feature integration theory of attention . Cognitive Psychology , 12 : 97 – 136 .
   PubMed Web of Science ®Google Scholar
• Tsotsos , J. K. , Culhane , S. M. , Wai , W. Y. K. , Lai , Y. H. , Davis , N. and Nuflo , F. 1995 . Modeling visual-attention via selective tuning . Artificial Intelligence , 78 : 507 – 545 .
   Web of Science ®Google Scholar
• Ullman , S. , Vidal-Naquet , M. and Sali , E. 2002 . Visual features of intermediate complexity and their use in classification . Nature Neuroscience , 5 : 682 – 687 .
   PubMed Web of Science ®Google Scholar
• Van Zoest , W. , Donk , M. and Theeuwes , J. 2004 . The role of stimulus-driven and goal-driven control in saccadic visual selection . Journal of Experimental Psychology: Human Perception and Performance , 30 : 746 – 759 .
   PubMed Web of Science ®Google Scholar
• Vogel , J. and Schiele , B. 2007 . Semantic scene modeling and retrieval for content-based image retrieval . International Journal of Computer Vision , 72 ( 2 ) : 133 – 157 .
   Web of Science ®Google Scholar
• Wolfe , J. M. 1994 . Guided Search 2.0: A revised model of visual search . Psychonomic Bulletin and Review , 1 : 202 – 228 .
   PubMed Web of Science ®Google Scholar
• Wolfe , J. M. 2007 . “ Guided Search 4.0: Current progress with a model of visual search ” . In Integrated models of cognitive systems , Edited by: Gray , W. 99 – 119 . New York : Oxford Press .
   Google Scholar
• Wolfe , J. M. , Cave , K. R. and Franzel , S. L. 1989 . Guided Search: An alternative to the feature integration model for visual search . Journal of Experimental Psychology: Human Perception and Performance , 15 : 419 – 343 .
   PubMed Web of Science ®Google Scholar
• Wolfe , J. M. and Horowitz , T. S. 2004 . What attributes guide the deployment of visual attention and how do they do it? . Nature Reviews Neuroscience , 5 ( 6 ) : 495 – 501 .
   PubMed Web of Science ®Google Scholar
• Yarbus , A. 1967 . Eye movements and vision , New York : Plenum Press .
   Google Scholar
• Zelinsky , G. J. 2008 . A theory of eye movements during target acquisition . Psychological Review , 115 : 787 – 835 .
   PubMed Web of Science ®Google Scholar
• Zelinsky G. J. , & Schmidt , J. 2009 . An effect of referential scene constraint on search implies scene segmentation . Visual Cognition , 17 6/7 , 1004 – 1028 .
   Web of Science ®Google Scholar