A Computational Model of “Active Vision” for Visual Search in Human–Computer Interaction

REFERENCES

• Altarriba , J. , Kambe , G. , Pollatsek , A. and Rayner . 2001 . Semantic codes are not used in integrating information across eye fixations in reading: Evidence from fluent Spanish-English bilinguals . Perception and Psychophysics , 63 : 875 – 890 .
   PubMed Web of Science ®Google Scholar
• Anderson , J. R. , Matessa , M. and Lebiere , C. 1997 . ACT–R: A theory of higher level cognition and its relation to visual attention . Human–Computer Interaction , 12 : 439 – 462 .
   Web of Science ®Google Scholar
• Barbur , J. L. , Forsyth , P. M. and Wooding , D. S. 1990 . “ Eye movements and search performance. ” . In Visual search 2 Edited by: Brogan , D. , Gale , A. and Carr , K. 253 – 264 . London , , UK : Taylor & Francis. .
   Google Scholar
• Bertera , J. H. and Rayner , K. 2000 . Eye movements and the span of effective stimulus in visual search . Perception & Psychophysics , 62 : 576 – 585 .
   PubMed Web of Science ®Google Scholar
• Bouma , H. 1970 . Interaction effects in parafoveal letter recognition . Nature , 226 : 177 – 178 .
   PubMed Web of Science ®Google Scholar
• Brumby , D. P. and Howes , A. Good enough but I'll just check: Web-Page search as attentional refocusing . Proceedings of the International Conference on Cognitive Modeling . pp. 253 – 264 . Pittsburgh , PA : University of Pittsburgh. .
   Google Scholar
• Brumby , D. P. and Howes , A. 2008 . Strategies for guiding interactive search: An empirical investigation into the consequences of label relevance for assessment and selection . Human–Computer Interaction , 23 : 1 – 46 .
   Web of Science ®Google Scholar
• Byrne , M. D. 2001 . ACT–R/PM and menu selection: Applying a cognitive architecture to HCI . International Journal of Human–Computer Studies , 55 : 41 – 84 .
   Web of Science ®Google Scholar
• Card , S. K. User perceptual mechanisms in the search of computer command menus . Proceedings of the Conference on Human Factors in Computing Systems . pp. 190 – 196 . New York , NY : ACM. .
   Google Scholar
• Casco , C. and Campana , G. 1999 . Spatial interactions in simple and combined-feature visual search . Spatial Vision , 12 : 467 – 483 .
   PubMedGoogle Scholar
• Findlay , J. M. and Brown , V. 2006 . Eye scanning of multi-element displays: I. Scanpath planning . Vision Research , 46 : 179 – 195 .
   PubMed Web of Science ®Google Scholar
• Findlay , J. M. and Gilchrist , I. D. 2003 . Active vision: The psychology of looking and seeing Oxford , , UK : Oxford University Press. .
   Google Scholar
• Fleetwood , M. D. and Byrne , M. D. 2006 . Modeling the visual search of displays: A revised ACT–R/PM model of icon search based on eye tracking data . Human–Computer Interaction , 21 : 153 – 197 .
   Web of Science ®Google Scholar
• Fu , W. and Pirolli , P. 2007 . SNIF–ACT: A cognitive model of user navigation on the world wide web . Human–Computer Interaction , 22 : 355 – 412 .
   Web of Science ®Google Scholar
• Halverson , T. 2008 . An “active vision” computational model of visual search for human–computer interaction Retrieved from ProQuest Dissertations and Theses Open Database. http://pqdtopen.proquest.com/#viewpdf?dispub=3346648
   Google Scholar
• Halverson , T. and Hornof , A. J. Explaining eye movements in the visual search of varying density layouts . Proceedings of the International Conference on Cognitive Modeling . pp. 124 – 129 . Pittsburgh , PA : University of Pittsburgh. .
   Google Scholar
• Halverson , T. and Hornof , A. J. Local density guides visual search: Sparse groups are first and faster . Proceedings of the Human Factors and Ergonomics Society Annual Meeting . Santa Monica , CA : Human Factors and Ergonomics Society. .
   Google Scholar
• Halverson , T. and Hornof , A. J. A minimal model of for predicting visual search in human–computer interaction . Proceedings of the Conference on Human Factors in Computing System . pp. 431 – 434 . New York , NY : ACM. .
   Google Scholar
• Henderson , J. M. and Pierce , G. L. 2008 . Eye movements during scene viewing: Evidence for mixed control of fixation durations . Psychonomic Bulletin & Review , 15 : 566 – 573 .
   PubMed Web of Science ®Google Scholar
• Hooge , I. T. C. and Erkelens , C. J. 1996 . Control of fixation duration in a simple search task . Perception and Psychophysics , 58 : 969 – 976 .
   PubMed Web of Science ®Google Scholar
• Hornof , A. J. 2001 . Visual search and mouse pointing in labeled versus unlabeled two-dimensional visual hierarchies . ACM Transactions on Computer–Human Interaction , 8 : 171 – 197 .
   Google Scholar
• Hornof , A. J. 2004 . Cognitive strategies for the visual search of hierarchical computer displays . Human–Computer Interaction , 19 : 183 – 223 .
   Web of Science ®Google Scholar
• Hornof , A. J. and Halverson , T. 2002 . Cleaning up systematic error in eye tracking data by using required fixation locations . Behavior Research Methods, Instruments, and Computers , 34 : 592 – 604 .
   PubMedGoogle Scholar
• Hornof , A. J. and Halverson , T. Cognitive strategies and eye movements for searching hierarchical computer displays . Proceedings of the Conference on Human Factors in Computing Systems . pp. 249 – 256 . New York , NY : ACM. .
   Google Scholar
• Horowitz , T. S. and Wolfe , J. M. 2001 . Search for multiple targets: Remember the targets, forget the search . Perception & Psychophysics , 63 : 272 – 285 .
   PubMed Web of Science ®Google Scholar
• Irwin , D. E. 1996 . Integrating information across saccadic eye movements . Current Direction in Psychological Science , 5 : 94 – 100 .
   Web of Science ®Google Scholar
• John , B. E. , Prevas , K. , Salvucci , D. D. and Koedinger , K. Predictive human performance modeling made easy . Proceedings of the Conference on Human Factors in Computing Systems . pp. 455 – 462 . New York , NY : ACM. .
   Google Scholar
• Kieras , D. E. June 2005 . EPIC Progress (Meeting of Office of Naval Research Grantees in the Area of Cognitive Architectures) June , Pittsburgh , PA : University of Pittsburgh. . Retrieved from ftp://www.eecs.umich.edu/∼kieras/docs/EPIC/KierasONR2005.pdf
   Google Scholar
• Kieras , D. E. 2004 . EPIC architecture principles of operation Retrieved from http://www.eecs.umich.edu/∼kieras/docs/EPIC/EPICPrinOp.pdf
   Google Scholar
• Kieras , D. E. and Marshall , S. P. Visual availability and fixation memory in modeling visual search using the EPIC architecture . Proceedings of the Annual Meeting of the Cognitive Science Society . pp. 423 – 428 . Mahwah , NJ : Erlbaum. .
   Google Scholar
• Kieras , D. E. and Meyer , D. E. 1997 . An overview of the EPIC architecture for cognition and performance with application to human–computer interaction . Human–Computer Interaction , 12 : 391 – 438 .
   Web of Science ®Google Scholar
• Kieras , D. E. , Wood , S. D. and Meyer , D. E. 1997 . Predictive engineering models based on the EPIC architecture for a multimodal high-performance human–computer interaction task . ACM Transactions on Computer–Human Interaction , 4 : 230 – 275 .
   Google Scholar
• Klein , R. M. and MacInnes , W. J. 1999 . Inhibition of return is a foraging facilitator in visual search . Psychological Science , 10 : 346 – 352 .
   Web of Science ®Google Scholar
• Koostra , G. , Nederveen , A. and de Boer , B. On the bottom-up and top-down influences of eye movements . Proceedings of the Annual Meeting of the Cognitive Science Society . pp. 2538 Mahwah , NJ : Erlbaum. .
   Google Scholar
• Logan , G. D. 1978 . Attention in character classification tasks: Evidence for the automaticity of component stages . Journal of Experimental Psychology: General , 107 : 32 – 63 .
   Web of Science ®Google Scholar
• Logan , G. D. 1979 . On the use of concurrent memory load to measure attention and automaticity . Journal of Experimental Psychology: Human Perception & Performance , 5 : 189 – 207 .
   Web of Science ®Google Scholar
• Lohse , G. L. 1993 . A cognitive model for understanding graphical perception . Human–Computer Interaction , 8 : 353 – 388 .
   Google Scholar
• Motter , B. C. and Belky , E. J. 1998 . The guidance of eye movements during active visual search . Vision Research , 38 : 1805 – 1815 .
   PubMed Web of Science ®Google Scholar
• Newell , A. 1973 . “ You can't play 20 questions with nature and win: Projective comments on the papers of this symposium. ” . In Visual information processing Edited by: Chase , W. G. 283 – 308 . New York , NY : Academic Press. .
   Google Scholar
• Newell , A. 1990 . Unified theories of cognition Cambridge , MA : Harvard University Press. .
   Google Scholar
• Oh , S. and Kim , M. 2004 . The role of spatial working memory is visual search efficiency . Psychonomic Bulletin & Review , 11 : 275 – 281 .
   PubMed Web of Science ®Google Scholar
• Ojanpää , H. , Näsänen , R. and Kojo , I. 2002 . Eye movements in the visual search of word lists . Vision Research , 42 : 1499 – 1512 .
   PubMed Web of Science ®Google Scholar
• Perlman , G. Making the right choices with menus . Proceedings of IFIP International Conference on Human–Computer Interaction . pp. 317 – 321 . Amsterdam , , the Netherlands : North-Holland. .
   Google Scholar
• Pomplun , M. , Reingold , E. M. and Shen , J. 2003 . Area activation: A computational model of saccadic selectivity in visual search . Cognitive Science , 27 : 299 – 312 .
   Web of Science ®Google Scholar
• Salvucci , D. D. 2001 . An integrated model of eye movements and visual encoding . Cognitive Systems Research , 1 : 201 – 220 .
   Google Scholar
• Salvucci , D. D. and Goldberg , J. H. Identifying fixations and saccades in eye-tracking protocol . Proceedings of the Eye Tracking Research and Applications Symposium . New York , NY : ACM. .
   Google Scholar
• Shore , D. I. and Klein , R. M. 2000 . On the manifestations of memory in visual search . Spatial Vision , 14 ( 1 ) : 59 – 75 .
   PubMedGoogle Scholar
• Somberg , B. L. A comparison of rule-based and positionally constant arrangements of computer menu items . Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface . pp. 79 – 84 . New York , NY : ACM. .
   Google Scholar
• Teo , L. and John , B. E. Towards a tool for predicting goal-directed exploratory behavior . Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting . pp. 950 – 954 . Mahwah , NJ : Erlbaum. .
   Google Scholar
• Teo , L. and John , B. E. The evolution of a goal-directed exploration model: Effects of information scent and GoBack utility on successful exploration . Proceedings of the 10th International Conference on Cognitive Modeling . pp. 253 – 258 . Philadelphia , PA : Drexel University. .
   Google Scholar
• Tollinger , I. , Lewis , R. L. , McCurdy , M. , Tollinger , P. , Vera , A. , Howes , A. and Pelton , L. Supporting efficient development of cognitive models at multiple skill levels: Exploring recent advances in constraint-based modeling . Proceedings of the Conference on Human Factors in Computing Systems . pp. 411 – 420 . New York , NY : ACM. .
   Google Scholar
• Wolfe , J. M. 1994 . Guided search 2.0: A revised model of visual search . Psychonomic Bulletin and Review , 1 : 202 – 238 .
   PubMed Web of Science ®Google Scholar
• Wolfe , J. M. and Gancarz , G. 1996 . “ Guided search 3.0: A model of visual search catches up with Jay Enoch 40 years later. ” . In Basic and clinical applications of vision science Edited by: Lakshminarayanan , V. 189 – 192 . Dordrecht , , the Netherlands : Kluwer Academic. .
   Google Scholar
• Wolfe , J. M. and Horowitz , T. S. 2004 . What attributes guide the deployment of visual attention and how do they do it? . Nature Reviews Neuroscience , 5 : 1 – 7 .
   Web of Science ®Google Scholar
• Woodman , G. F. , Vogel , E. K. and Luck , S. J. 2001 . Visual search remains efficient when visual working memory is full . Psychological Science , 12 : 219 – 224 .
   PubMed Web of Science ®Google Scholar
• Yang , S. N. 2009 . Effects of gaze-contingent text changes on fixation duration in reading . Vision Research , 49 : 2843 – 2855 .
   PubMed Web of Science ®Google Scholar