Eye movement prediction and variability on natural video data sets

REFERENCES

• Barth , E. , Caelli , T. and Zetzsche , C. 1993 . Image encoding, labeling, and reconstruction from differential geometry . CVGIP: Graphical Models and Image Processing , 55 ( 6 ) : 428 – 446 .
   Google Scholar
• Barth , E. , Dorr , M. , Böhme , M. , Gegenfurtner , K. R. , & Martinetz , T. 2006 . Guiding the mind's eye: Improving communication and vision by external control of the scanpath . In B. E. Rogowitz , T. N. Pappas , & S. J. Daly , Human vision and electronic imaging XI 6057 , 116 – 123 . Bellingham , WA : Society of Photo-Optical Instrumentation Engineers
   Google Scholar
• Barth , E. , Dorr , M. , Vig , E. , Pomarjanschi , L. and Mota , C. 2010 . Efficient coding and multiple motions . Vision Research , 50 ( 22 ) : 2190 – 2199 .
   PubMed Web of Science ®Google Scholar
• Bruce , N. and Tsotsos , J. K. 2009 . Saliency, attention, and visual search: An information theoretic approach . Journal of Vision , 9 ( 3 ) : 1 – 24 .
   PubMed Web of Science ®Google Scholar
• Chang , C. C. , & Lin , C. J. 2001 . LIBSVM: A library for support vector machines [Software] . Retrieved from http://www.csie.ntu.edu.tw/cjlin/libsvm
   Google Scholar
• Dorr , M. , Martinetz , T. , Gegenfurtner , K. and Barth , E. 2010 . Variability of eye movements when viewing dynamic natural scenes . Journal of Vision , 10 ( 10 ) : 1 – 17 .
   Web of Science ®Google Scholar
• Drewes , J. , Trommershäuser , J. and Gegenfurtner , K. R. 2011 . Parallel visual search and rapid animal detection in natural scenes . Journal of Vision , 11 ( 2 ) : 1 – 21 .
   Web of Science ®Google Scholar
• Einhäuser , W. , Rutishauser , U. and Koch , C. 2008 . Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli . Journal of Vision , 8 ( 2 ) : 1 – 19 .
   Web of Science ®Google Scholar
• Einhäuser , W. , Spain , M. and Perona , P. 2008 . Objects predict fixations better than early saliency . Journal of Vision , 8 ( 14 ) : 11 – 26 .
   Web of Science ®Google Scholar
• Everingham , M. , van Gool , L. , Williams , C. K. I. , Winn , J. and Zisserman , A. 2010 . The Pascal Visual Object Classes (VOC) challenge . International Journal of Computer Vision , 88 ( 2 ) : 303 – 338 .
   Web of Science ®Google Scholar
• Field , D. J. 1987 . Relations between the statistics of natural images and the response profiles of cortical cells . Journal of the Optical Society of America , 4A : 2379 – 2394 .
   Google Scholar
• Foulsham , T. , & Kingstone , A. forthcoming . Modeling the influence of central and peripheral information on saccade biases in gaze-contingent scene viewing . Visual Cognition .
   Google Scholar
• Gao , D. and Vasconcelos , N. 2009 . Decision-theoretic saliency: Computational principles, biological plausibility, and implications for neurophysiology and psychophysics . Neural Computation , 21 ( 1 ) : 239 – 271 .
   PubMed Web of Science ®Google Scholar
• Guo , C. and Zhang , L. 2010 . A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression . IEEE Transactions on Image Processing , 19 ( 1 ) : 185 – 198 .
   PubMed Web of Science ®Google Scholar
• Hasson , U. , Landesman , O. , Knappmeyer , B. , Vallines , I. , Rubin , N. and Heeger , D. J. 2008 . Neurocinematics: The neuroscience of film . Projections , 2 ( 1 ) : 1 – 26 .
   Google Scholar
• Itti , L. 2004 . Automatic foveation for video compression using a neurobiological model of visual attention . IEEE Transactions on Image Processing , 13 ( 10 ) : 1304 – 1318 .
   PubMed Web of Science ®Google Scholar
• Itti , L. 2005 . Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes . Visual Cognition , 12 ( 6 ) : 1093 – 1123 .
   Web of Science ®Google Scholar
• Itti , L. , & Baldi , P. 2006 . Bayesian surprise attracts human attention . In Advances in neural information processing systems , 19 (NIPS 2005) 547 – 554 . Cambridge , MA : MIT Press .
   Google Scholar
• Itti , L. , Koch , C. and Niebur , E. 1998 . A model of saliency-based visual attention for rapid scene analysis . IEEE Transactions on Pattern Analysis and Machine Intelligence , 20 ( 11 ) : 1254 – 1259 .
   Web of Science ®Google Scholar
• Jähne , B. 1999 . Local structure . In B. Jähne & H. Haußecker , Handbook of computer vision and applications 2 , 209 – 238 . San Diego , CA : Academic Press .
   Google Scholar
• Judd , T. , Ehinger , K. , Durand , F. , & Torralba , A. 2009 . Learning to predict where humans look . In Proceedings of IEEE international conference on Computer Vision (ICCV) 2106 2113 . Los Alamitos , CA : IEEE Computer Society .
   Google Scholar
• Kienzle , W. , Franz , M. O. , Schölkopf , B. and Wichmann , F. A. 2009 . Center-surround patterns emerge as optimal predictors for human saccade targets . Journal of Vision , 9 ( 5 ) : 1 – 15 .
   PubMed Web of Science ®Google Scholar
• Kienzle , W. , Schölkopf , B. , Wichmann , F. A. , & Franz , M. O. 2007 . How to find interesting locations in video: A spatiotemporal interest point detector learned from human eye movements . In Proceedings of the 29th annual symposium of the German Association for Pattern Recognition (DAGM 2007) 405 – 414 . Berlin , , Germany : Springer Verlag .
   Google Scholar
• Kirchner , H. and Thorpe , S. 2005 . Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited . Vision Research , 46 : 1762 – 1776 .
   PubMed Web of Science ®Google Scholar
• Koch , C. and Ullman , S. 1985 . Shifts in selective visual attention: Towards the underlying neural circuitry . Human Neurobiology , 4 ( 4 ) : 219 – 227 .
   PubMedGoogle Scholar
• Land , M. and McLeod , P. 2000 . From eye movements to actions: How batsmen hit the ball . Nature Neuroscience , 3 ( 12 ) : 1340 – 1345 .
   PubMed Web of Science ®Google Scholar
• Land , M. F. and Hayhoe , M. 2001 . In what ways do eye movements contribute to everyday activities? . Vision Research , 41 : 3559 – 3565 .
   PubMed Web of Science ®Google Scholar
• Land , M. F. , Mennie , N. and Rusted , J. 1999 . The roles of vision and eye movements in the control of activities of daily living . Perception , 28 ( 11 ) : 1311 – 1328 .
   PubMed Web of Science ®Google Scholar
• Laptev , I. , Marszalek , M. , Schmid , C. , & Rozenfeld , B. 2008 . Learning realistic human actions from movies . In IEEE conference on Computer Vision and Pattern Recognition 1 – 8 . Los Alamitos , CA : IEEE Computer Society
   Google Scholar
• Le Meur , O. , Le Callet , P. , Barba , D. and Thoreau , D. 2006 . A coherent computational approach to model bottom-up visual attention . IEEE Transactions on Pattern Analysis and Machine Intelligence , 28 ( 5 ) : 802 – 817 .
   PubMed Web of Science ®Google Scholar
• Li , Z. , Qin , S. and Itti , L. 2011 . Visual attention guided bit allocation in video compression . Image and Vision Computing , 29 : 1 – 14 .
   Web of Science ®Google Scholar
• Mahadevan , V. and Vasconcelos , N. 2010 . Spatiotemporal saliency in dynamic scenes . IEEE Transactions on Pattern Analysis and Machine Intelligence , 32 : 171 – 177 .
   PubMed Web of Science ®Google Scholar
• Mital , P. K. , Smith , T. J. , Hill , R. and Henderson , J. M. 2011 . Clustering of gaze during dynamic scene viewing is predicted by motion . Cognitive Computation , 3 ( 1 ) : 5 – 24 .
   Web of Science ®Google Scholar
• Mota , C. , & Barth , E. 2000 . On the uniqueness of curvature features . In G. Baratoff & H. Neumann , Dynamische Perzeption 9 , 175 – 178 . Köln , , Germany : Infix Verlag .
   Google Scholar
• Nuthmann , A. , & Henderson , J. forthcoming . Using CRISP to model global characteristics of fixation durations in scene viewing and reading with a common mechanism . Visual Cognition .
   Web of Science ®Google Scholar
• Nyström , M. and Holmqvist , K. 2010 . Effect of compressed off-line foveated video on viewing behavior and subjective quality . ACM Transactions on Multimedia Computing, Communications, and Applications , 6 ( 1 ) : 1 – 14 .
   Web of Science ®Google Scholar
• Olshausen , B. A. and Field , D. J. 1996 . Emergence of simple-cell receptive field properties by learning a sparse code for natural images . Nature , 381 : 607 – 609 .
   PubMed Web of Science ®Google Scholar
• Parkhurst , D. J. and Niebur , E. 2003 . Scene content selected by active vision . Spatial Vision , 16 ( 2 ) : 125 – 154 .
   PubMedGoogle Scholar
• Peters , R. J. , Iyer , A. , Itti , L. and Koch , C. 2005 . Components of bottom-up gaze allocation in natural images . Vision Research , 45 ( 8 ) : 2397 – 2416 .
   PubMed Web of Science ®Google Scholar
• Poynton , C. 2003 . Digital video and HDTV , San Francisco , CA : Morgan Kaufmann Publishers .
   Google Scholar
• Reinagel , P. and Zador , A. M. 1999 . Natural scene statistics at the centre of gaze . Network: Computation in Neural Systems , 10 : 341 – 350 .
   PubMed Web of Science ®Google Scholar
• Smith , T. J. and Henderson , J. M. 2008 . Edit blindness: The relationship between attention and global change blindness in dynamic scenes . Journal of Eye Movement Research , 2 ( 2 ) : 1 – 17 .
   Web of Science ®Google Scholar
• Tatler , B. W. , Baddeley , R. J. and Gilchrist , I. D. 2005 . Visual correlates of fixation selection: Effects of scale and time . Vision Research , 45 : 643 – 659 .
   PubMed Web of Science ®Google Scholar
• Tatler , B. W. , Baddeley , R. J. and Vincent , B. T. 2006 . The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task . Vision Research , 46 : 1857 – 1862 .
   PubMed Web of Science ®Google Scholar
• Tatler , B. W. , Hayhoe , M. M. , Land , M. F. and Ballard , D. H. 2011 . Eye guidance in natural vision: Reinterpreting salience . Journal of Vision , 11 ( 5 ) : 1 – 23 .
   Web of Science ®Google Scholar
• Tatler , B. W. and Vincent , B. T. 2009 . The prominence of behavioural biases in eye guidance . Visual Cognition , 17 ( 6–7 ) : 1029 – 1054 .
   Web of Science ®Google Scholar
• Vig , E. , Dorr , M. and Barth , E. 2009 . Efficient visual coding and the predictability of eye movements on natural movies . Spatial Vision , 22 ( 5 ) : 397 – 408 .
   PubMedGoogle Scholar
• Vig , E. , Dorr , M. , Martinetz , T. and Barth , E. 2011 . Eye movements show optimal average anticipation with natural dynamic scenes . Cognitive Computation , 3 ( 1 ) : 79 – 88 .
   Web of Science ®Google Scholar
• Vig , E. , Dorr , M. , Martinetz , T. , & Barth , E. in press . Intrinsic dimensionality predicts the saliency of natural dynamic scenes . IEEE Transactions on Pattern Analysis and Machine Intelligence .
   Google Scholar
• Wandell , B. A. 1995 . Foundations of vision . Sunderland , MA : Sinauer Associates .
   Google Scholar
• Wolfe , J. M. 1998 . “ Visual search ” . In Attention , Edited by: Pashler , H. 13 – 73 . Hove, UK: Psychology Press .
   Google Scholar
• Zelinsky , G. forthcoming . TAM: Explaining off-object fixations and central fixation tendencies as effects of population averaging during search . Visual Cognition .
   Web of Science ®Google Scholar
• Zetzsche , C. and Barth , E. 1990 . Fundamental limits of linear filters in the visual processing of two-dimensional signals . Vision Research , 30 : 1111 – 1117 .
   PubMed Web of Science ®Google Scholar
• Zhang , L. , Tong , M. H. , & Cottrell , G. W. 2009 . SUNDAy: Saliency using natural statistics for dynamic analysis of scenes . In Proceedings of the 31st annual Cognitive Science conference , Amsterdam , The Netherlands 2944 2949 . Mahwah, NJ: Lawrence Erlbaum .
   Google Scholar
• Zhang , L. , Tong , M. H. , Marks , T. K. , Shan , H. and Cottrell , G. W. 2008 . SUN: A Bayesian framework for saliency using natural statistics . Journal of Vision , 8 ( 7 ) : 1 – 20 .
   Web of Science ®Google Scholar