A Real-Time Eye Tracking System for Predicting and Preventing Postcompletion Errors

REFERENCES

• Altmann , E. M. and Trafton , J. G. 2002 . Memory for goals: An activation-based model . Cognitive Science , 26 : 39 – 83 .
   Web of Science ®Google Scholar
• Altmann , E. M. and Trafton , J. G. 2007 . Timecourse of recovery from task interruption: Data and a model . Psychonomics Bulletin and Review , 14 : 1079 – 1084 .
   PubMed Web of Science ®Google Scholar
• Baars , B. J. 1992 . “ The many uses of error: Twelve steps to a unified framework. ” . In Experimental slips and human errors: Exploring the architecture of volition Edited by: Baars , B. J. 3 – 34 . New York, NY : Plenum. .
   Google Scholar
• Barber , C. and Stanton , N. A. 1996 . Human error identification techniques applied to public technology: Predictions copared with observed use . Applied Ergonomics , 27 : 119 – 131 .
   Google Scholar
• Boehm-Davis , D. A. and Remington , R. 2009 . Reducing the disruptive effects of interruption: A cognitive framework for analysing the costs and benefits of intervetion strategies . Accident Analysis and Prevention , 41 : 1124 – 1129 .
   PubMed Web of Science ®Google Scholar
• Burke , M. , Hornof , A. , Nilsen , E. and Gorman , N. 2005 . High-cost banner blindness: Ads increase perceived workload, hinder visual search, and are forgotten . ACM Transactions on Computer-Human Interaction , 12 : 423 – 445 .
   Google Scholar
• Byrne , M. D. Preventing postcompletion errors: How much cue is enough? . Proceedings of the Thirtieth Annual Conference of the Cognitive Science Society . Edited by: Love , B. C. , McRae , K. and Sloutsky , V. M. pp. 351 – 356 . Austin, TX : Cognitive Science Society. .
   Google Scholar
• Byrne , M. D. and Bovair , S. 1997 . A working memory model of a common procedural error . Cognitive Science , 21 ( 1 ) : 31 – 61 .
   Google Scholar
• Byrne , M. D. and Davis , E. M. 2006 . Task structure and postcompletion error in the execution of a routine procedure . Human Factors , 48 : 627 – 638 .
   Google Scholar
• Ceaparu , I. , Lazar , J. , Bessiere , K. , Robinson , J. and Shneiderman , B. 2004 . Determining causes and severity of end-user frustration . International Journal of Human–Computer Interaction , 17 : 333 – 356 .
   Web of Science ®Google Scholar
• Chou , C. D. and Funk , K. Management of multiple tasks: Cockpit task management errors . Proceedings of IEEE International Conference on Systems, Man and Cybernetics . pp. 470 – 474 . New York, NY : IEEE. .
   Google Scholar
• Chung , P. H. and Byrne , M. D. 2008 . Cue effectiveness in mitigating postcompletion errors in a routine procedural task . International Journal of Human–Computer Studies , 66 : 217 – 232 .
   Google Scholar
• Cooper , R. P. and Shallice , T. 2000 . Contention scheduling and the control of routine activities . Cognitive Neuropsychology , 17 : 297 – 338 .
   PubMed Web of Science ®Google Scholar
• Czerwinski , M. , Cutrell , E. and Horovitz , E. Instant messaging: Effects of relevance and time . Proceedings of CHI 2000 Conference . New York, NY : ACM. .
   Google Scholar
• Dehais , F. , Causse , M. and Pastor , J. 2008 . Embedded eye tracker in real aircraft: new perspectives on pilot/aircraft interaction monitoring ICRAT 2008
   Google Scholar
• De Santis , A. and Iacoviello , D. 2009 . Robust real time eye tracking for computer interface for disabled people . Computer Methods and Programs in Biomedicine , 96 : 1 – 11 .
   Google Scholar
• Dodhia , R. M. and Dismukes , R. K. 2009 . Interruptions create prospective memory tasks . Applied Cognitive Psychology , 23 : 73 – 89 .
   Web of Science ®Google Scholar
• Donmez , B. , Boyle , L. and Lee , J. D. 2007 . Safety implications of providing real-time feedback to distracted drivers . Accident Analysis and Prevention , 39 : 581 – 590 .
   PubMed Web of Science ®Google Scholar
• Eichele , T. , Debener , S. , Calhoun , V. D. , Specht , K. , Engel , A. K. , Hugdahl , K. and Ullsperger , M. 2008 . Prediction of human errors by maladapative changes in even-related brain networks . Proceedings of the National Academy of Sciences , 105 : 6173 – 6178 .
   PubMed Web of Science ®Google Scholar
• Fawcett , T. 2006 . An introduction to ROC analysis . Pattern Recognition Letters , 27 : 861 – 874 .
   Web of Science ®Google Scholar
• Gray , W. D. 2000 . The nature and processing of errors in interactive behavior . Cognitive Science , 24 : 205 – 248 .
   Google Scholar
• Gray , W. D. 2004 . “ Errors in interactive behavior. ” . In Encyclopedia of human–computer interaction Edited by: Bainbridge , W. S. 230 – 235 . Great Barrington, MA : Berkshire. .
   Google Scholar
• Heiner , A. and Asokan , N. Using salience differentials to making visual cues noticeable . Proceedings of the 1st Conference on Usability, Psychology, and Security . New York, NY : ACM. .
   Google Scholar
• Hodgetts , H. M. and Jones , D. M. 2006a . Contextual cues aid recovery from interruption: The role of associative activation . Journal of Experimental Psychology: Learning, Memory & Cognition , 32 : 1120 – 1132 .
   PubMed Web of Science ®Google Scholar
• Hodgetts , H. M. and Jones , D. M. 2006b . Interruption of the Tower of London task: Support for a goal activation approach . Journal of Experimental Psychology: General , 135 : 103 – 115 .
   PubMed Web of Science ®Google Scholar
• Ji , Q. , Zhu , Z. and Lan , P. 2004 . Real-time nonintrusive monitoring and prediction of driver fatigue . IEEE Transactions on Vehicular Technology , 53 : 1052 – 1068 .
   Web of Science ®Google Scholar
• Just , M. A. and Carpenter , P. A. 1976 . Eye fixations and cognitive processes . Cognitive Psychology , 8 : 441 – 480 .
   Web of Science ®Google Scholar
• Kirwan , B. 1992a . Human error identification in human reliability assessment. Part 1: Overview of approaches . Applied Ergonomics , 23 : 299 – 318 .
   PubMed Web of Science ®Google Scholar
• Kirwan , B. 1992b . Human error identification in human reliability assessment. Part 2: Detailed comparison of techniques . Applied Ergonomics , 23 : 371 – 381 .
   PubMed Web of Science ®Google Scholar
• Koppel , R. , Metlay , J. P. , Coehn , A. , Abaluck , B. , Localio , A. R. , Kimmel , S. E. and Strom , B. L. 2005 . Role of computerized physician order entry systems in facilitating medication errors . Journal of American Medical Association , : 1197 – 1203 . (293)
   Google Scholar
• Li , S. Y. W. , Blandford , A. , Cairns , P. and Young , R. M. 2008 . The effect of interruptions on postcompletion and other procedural errors: An account based on the activation-based goal memory model . Journal of Experimental Psychology: Applied , 14 : 314 – 328 .
   PubMed Web of Science ®Google Scholar
• Li , S. Y. W. , Cox , A. L. , Blandford , A. , Cairns , P. and Abeles , A. Further investigations into post-completion error: The effects of interruption position and duration . Proceedings of the Twenty-Eighth Annual Meeting of the Cognitive Science Society . Mahwah, NJ : Erlbaum. .
   Google Scholar
• Loukopoulos , L. D. , Dismukes , R. L. and Barshi , I. Cockpit interruptions and distractions: A line observation study . Proceediings of the 11th International Symposium on Aviation Psychology . Edited by: Jensen , R. Columbus : Ohio State University Press. .
   Google Scholar
• Macmillan , N. A. and Creelman , C. D. 2005 . Detection theory: A user's guide Mahwah, NJ : Erlbaum. .
   Google Scholar
• Marshall , P. 2007 . Indentifying cognitive state from eye metrics . Aviation, Space and Environmental Medicine , 78 ( 1 ) : B165 – B175 .
   Google Scholar
• Monk , C. A. , Trafton , J. G. and Boehm-Davis , D. A. 2008 . The effect of interruption duration and demand on the resumpting suspended goals . Journal of Experimental Psychology: Applied , 14 : 299 – 313 .
   PubMed Web of Science ®Google Scholar
• Norman , D. A. 1981 . Categorization of action slips . Psychological Review , 88 ( 1 ) : 1 – 15 .
   Web of Science ®Google Scholar
• National Transportation and Safety Board . 2005 . Railraod accident report Washington, DC : Author. .
   Google Scholar
• Peng , C.-Y. J. , Lee , K. L. and Ingersoll , G. M. 2002 . An introduction to logistic regression analysis and reporting . The Journal of Educational Research , 96 : 3 – 14 .
   Web of Science ®Google Scholar
• Perrow , C. 1999 . Normal accidents: Living with high-risk technologies Princeton, NJ : Princeton University Press. .
   Google Scholar
• Pompei , F. J. , Sharon , T. , Buckley , S. J. and Kemp , J. An automobile-integrated system for assessing and reacting to driver cognitive load . Proceedings of Convergence 2002 . pp. 411 – 416 . Piscataway, NJ : IEEE SAE. .
   Google Scholar
• Rasmussen , J. 1982 . Human errors: A taxonomy for describing human malfunction in industrial installations . Journal of Occupational Accidents , 4 : 311 – 335 .
   Google Scholar
• Rasmussen , J. and Jensen , A. 1974 . Mental procedures in real-life tasks: A case study of electronic troubleshooting . Ergonomics , 17 : 293 – 307 .
   PubMed Web of Science ®Google Scholar
• Ratwani , R. M. , McCurry , J. M. and Trafton , J. G. Predicting postcompletion errors using eye movements . Proceedings of the 2008 Conference on Human Factors in Computing Systems, CHI 2008 . Edited by: Czerwinski , M. , Lund , A. M. and Tan , D. S. pp. 539 – 542 . New York, NY : ACM. .
   Google Scholar
• Ratwani , R. M. and Trafton , J. G. 2008 . Spatial memory guides task resumption . Visual Cognition , 16 : 1001 – 1010 .
   Web of Science ®Google Scholar
• Ratwani , R. M. and Trafton , J. G. Developing a predictive model of postcompletion errors . Proceedings of the 31st Annual Meeting of the Cognitive Science Society . Red Hook, NY : Curran. .
   Google Scholar
• Ratwani , R. M. and Trafton , J. G. 2010a . A generalized model for predicting postcompletion errors . Topics in Cognitive Science , 2 : 154 – 167 .
   Google Scholar
• Ratwani , R. M. and Trafton , J. G. Single operator, multiple robots: An eye movement based theoretic model of operator situation awareness . Proceedings of the 5th ACM/IEEE Conference on Human Robot Interaction . New York, NY : ACM. .
   Google Scholar
• Rayner , K. 1998 . Eye movements in reading and information processing: 20 years of research . Psychological Bulletin , 85 : 618 – 660 .
   Google Scholar
• Reason , J. 1990 . Human error New York, NY : Cambridge University Press. .
   Google Scholar
• Schnell , T. and Wu , T. Applying eye tracking as an alternative approach for activation of controls and functions in aircraft . Proceedings of the 5th International Conference on Human Interaction with Complex Systems . New York, NY : ACM. .
   Google Scholar
• Sellen , A. J. and Norman , D. A. 1992 . “ The psychology of slips. ” . In Experimental slips and human error: Exploring the architecture of volition Edited by: Baars , B. J. 317 – 339 . New York, NY : Plenum. .
   Google Scholar
• Shappell , S. A. and Wiegmann , D. A. 2001 . Applying reason: The human factors analysis and classification system (HFACS) . Human Factors and Aerospace Safety , 1 ( 1 ) : 59 – 86 .
   Google Scholar
• Stanton , N. A. and Stevenage , S. V. 1998 . Learning to predict human error: Issues of acceptability, reliability and validity . Ergonomics , 41 : 1737 – 1756 .
   PubMed Web of Science ®Google Scholar
• Swets , J. A. , ed. 1964 . Signal detection and recognition by human observers New York, NY : Wiley. .
   Google Scholar
• Swets , J. A. 1986a . Form of empirical ROCs in discrimination and diagnostic tasks: Implications for theory and measurement of performance . Psychological Bulletin , 99 : 181 – 198 .
   PubMed Web of Science ®Google Scholar
• Swets , J. A. 1986b . Indices of discrimination or diagnostic accuracy: Their ROCs and implied models . Psychological Bulletin , 99 ( 1 ) : 100 – 117 .
   PubMed Web of Science ®Google Scholar
• Swets , J. A. 1992 . The science of choosing the right decision threshold in high-stakes diagnostics . American Psychologist , 47 : 522 – 532 .
   PubMed Web of Science ®Google Scholar
• Tabachnick , B. G. and Fidell , L. S. 2001 . Using multivariate statistics, , 4th ed. Needham Heights, MA : Allyn & Bacon. .
   Google Scholar
• Trafton , J. G. , Altmann , E. M. and Brock , D. P. Huh, what was I doing? How people use environmental cues after an interruption . Proceedings of the 49th. Annual Meeting of the Human Factors and Ergonomics Society . Santa Monica, CA : HFES. .
   Google Scholar
• Trafton , J. G. , Altmann , E. M. , Brock , D. P. and Mintz , F. E. 2003 . Preparing to resume an interrupted task: Effects of prospective goal encoding and retrospective rehearsal . International Journal of Human–Computer Studies , 58 : 583 – 603 .
   Web of Science ®Google Scholar
• Trafton , J. G. , Altmann , E. M. and Ratwani , R. M. A memory for goals model of sequence errors . 9th International Conference on Cognitive Modeling – ICCM2009 .
   Google Scholar
• Wilson , G. F. and Russell , C. A. 2003 . Operator functional state classification using multiple psychophysiological features in an air traffic control task . Human Factors , 45 : 381 – 389 .
   PubMed Web of Science ®Google Scholar