Human–automation interaction for multiple robot control: the effect of varying automation assistance and individual differences on operator performance

References

• Adams, E. 2013. Fundamentals of Game Design. Berkeley: New Riders.
   Google Scholar
• Barber, D., L. Davis, D. Nicholson, N. Finkelstein, and J. Y. C. Chen. 2008. “The Mixed Initiative Experimental (MIX) Testbed for Human Robot Interactions with Varied Levels of Automation.” Paper presented at Proceedings of the 26th Army Science Conference, Orlando, FL, December 1–4.
   Google Scholar
• Barnes, M. J., J. Y. C. Chen, F. Jentsch, T. Oron-Gilad, E. Redden, L. Elliott, and A. W. Evans III. 2014. “Designing for Humans in Autonomous Systems: Military Applications.” Aberdeen Proving Ground, MD: Army Research Lab. Report No. ARL-TR-6782.
   Google Scholar
• Biederman, I., R. J. Mezzanotte, and J. C. Rabinowitz. 1982. “Scene Perception: Detecting and Judging Objects Undergoing Relational Violations.” Cognitive Psychology 14 (2): 143–177.
   PubMed Web of Science ®Google Scholar
• Calhoun, G. L., H. A. Ruff, M. H. Draper, and E. J. Wright. 2011. “Automation-level Transference Effects in Simulated Multiple Unmanned Aerial Vehicle Control.” Journal of Cognitive Engineering and Decision Making 5 (1): 55–82.
   Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2010. “Supervisory Control of Robots Using RoboLeader.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 54 (19): 1483–1487.
   Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2012a. “Supervisory Control of Multiple Robots Effects of Imperfect Automation and Individual Differences.” Human Factors: The Journal of the Human Factors and Ergonomics Society 54 (2): 157–174.
   PubMed Web of Science ®Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2012b. “Supervisory Control of Multiple Robots in Dynamic Tasking Environments.” Ergonomics 55 (9): 1043–1058.
   PubMed Web of Science ®Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2014. “Human–agent Teaming for Multi-robot Control: A Review of Human Factors Issues.” IEEE Transactions on Human-Machine Systems 44 (1): 13–29.
   Web of Science ®Google Scholar
• Chen, J. Y. C., M. J. Barnes, and M. Harper-Sciarini. 2011. “Supervisory Control of Multiple Robots: Human-performance Issues and User-interface Design.” IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 41 (4): 435–454.
   PubMed Web of Science ®Google Scholar
• Chen, J. Y. C., P. J. Durlach, J. A. Sloan, and L. D. Bowens. 2008. “Human-robot Interaction in the Context of Simulated Route Reconnaissance Missions.” Military Psychology 20 (3): 135.
   Web of Science ®Google Scholar
• Chen, J. Y. C., and C. T. Joyner. 2009. “Concurrent Performance of Gunner’s and Robotic Operator’s Tasks in a Multi-tasking Environment.” Military Psychology 21 (1): 98–113.
   Web of Science ®Google Scholar
• Chen, J. Y. C., S. G. Lakhmani, K. Stowers, A. R. Selkowitz, J. L. Wright, and M. J. Barnes. 2018. “Situation Awareness-based Agent Transparency and Human-autonomy Teaming Effectiveness.” Theoretical Issues in Ergonomics Science. doi:10.1080/1463922X.2017.1315750.
   Google Scholar
• Chen, J. Y. C., and P. I. Terrence. 2009. “Effects of Imperfect Automation and Individual Differences on Concurrent Performance of Military and Robotics Tasks in a Simulated Multitasking Environment.” Ergonomics 52 (8): 907–920.
   PubMed Web of Science ®Google Scholar
• Chiappe, D., M. Conger, J. Liao, J. L. Caldwell, and K. L. Vu. 2013. “Improving Multi-tasking Ability through Action Videogames.” Applied Ergonomics 44 (2): 278–284.
   PubMed Web of Science ®Google Scholar
• Choi, J. J., Y. Kim, and S. S. Kwak. 2014. “The Autonomy Levels and the Human Intervention Levels of Robots: The Impact of Robot Types in Human-robot Interaction.” In Robot and Human Interactive Communication, 2014 RO-MAN: The 23rd IEEE International Symposium on, 1069–1074. IEEE.
   Google Scholar
• Cummings, M. L., A. Clare, and C. Hart. 2010. “The Role of Human-automation Consensus in Multiple Unmanned Vehicle Scheduling.” Human Factors: The Journal of the Human Factors and Ergonomics Society 52 (1): 17–27.
   PubMed Web of Science ®Google Scholar
• Davies, R. D., and R. Parasuraman. 1982. The Psychology of Vigilance. London: Academic Press.
   Google Scholar
• Defense Science Board. 2016. Summer Study on Autonomy. Washington, DC: Office of the Under Secretary of Defense.
   Google Scholar
• Derryberry, D., and M. A. Reed. 2002. “Anxiety-related Attentional Biases and Their Regulation by Attentional Control.” Journal of Abnormal Psychology 111 (2): 225.
   PubMed Web of Science ®Google Scholar
• Ehmke, C., and S. Wilson. 2007. “Identifying Web Usability Problems from Eye-tracking Data.” Paper presented at the 21st British HCI Group Annual Conference on People and Computers: HCI... but Not as We Know It, Lancaster, UK, September 3–7.
   Google Scholar
• Endsley, M. R. 2000. “Direct Measurement of Situation Awareness: Validity and use of SAGAT.” Chapter 8 In Situation Awareness Analysis and Measurement, edited by M. R. Endsley and D. J. Garland, 10. Mahwah: Lawrence Erlbaum Associates.
   Google Scholar
• Flemisch, F., Y. Canpolat, E. Altendorf, G. Webel, M. Itoh, M. Baltzer, M. Pacaux-Lemoine, D. Abbink, and P. Schutte. 2017. “Shared and Cooperative Control of Ground and Air Vehicles: Introduction and General Overview,” 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada, 858–863. doi: 10.1109/SMC.2017.8122717
   Google Scholar
• Goldberg, J. H., and X. P. Kotval. 1999. “Computer Interface Evaluation Using Eye Movements: Methods and Constructs.” International Journal of Industrial Ergonomics 24 (6): 631–645.
   Web of Science ®Google Scholar
• Green, C. S., and D. Bavelier. 2003. “Action Video Game Modifies Visual Selective Attention.” Nature 423 (6939): 534–537.
   PubMed Web of Science ®Google Scholar
• Green, C. S., and D. Bavelier. 2006. “Enumeration versus Multiple Object Tracking: The Case of Action Video Game Players.” Cognition 101 (1): 217–245.
   PubMed Web of Science ®Google Scholar
• Gugerty, L., and J. Brooks. 2004. “Reference-frame Misalignment and Cardinal Direction Judgments: Group Differences and Strategies.” Journal of Experimental Psychology: Applied 10 (2): 75.
   PubMed Web of Science ®Google Scholar
• Hancock, P. A. 2014. “Automation: How much is too much?” Ergonomics 57 (3): 449–454.
   PubMed Web of Science ®Google Scholar
• Hart, S. G., and L. E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” In Human Mental Workload, edited by P. A. Hancock and N. Meshkati, 139–183. Amsterdam: North Holland Press.
   Google Scholar
• Hubert-Wallander, B., C. S. Green, and D. Bavelier. 2011. “Stretching the Limits of Visual Attention: The Case of Action Video Games.” Wiley Interdisciplinary Reviews: Cognitive Science 2 (2): 222–230.
   PubMed Web of Science ®Google Scholar
• Iqbal, S. T., X. S. Zheng, and B. P. Bailey. 2004. “Task-evoked Pupillary Response to Mental Workload in Human-computer Interaction.” Paper presented at CHI 2004 Conference on Human Factors in Computing Systems, Vienna, Austria, April 24–29.
   Google Scholar
• Kaber, D. B. 2017. “Issues in Human-automation Interaction Modeling: Presumptive Aspects of Frameworks of Types and Levels of Automation.” Journal of Cognitive Engineering and Decision Making. [ Article first published online: October 19, 2017]. doi: 10.1177/1555343417737203.
   Web of Science ®Google Scholar
• Kaber, D. B., and M. R. Endsley. 2004. “The Effects of Level of Automation and Adaptive Automation on Human Performance, Situation Awareness and Workload in a Dynamic Control Task.” Theoretical Issues in Ergonomics Science 5 (2): 113–153.
   Google Scholar
• Kang, M. J., M. Hsu, I. M. Krajbich, G. Loewenstein, S. M. McClure, J. T. Wang, and C. F. Camerer. 2009. “The Wick in the Candle of Learning: Epistemic Curiosity Activates Reward Circuitry and Enhances Memory.” Psychological Science 20 (8): 963–973.
   PubMed Web of Science ®Google Scholar
• Lathan, C. E., and M. Tracey. 2002. “The Effects of Operator Spatial Perception and Sensory Feedback on Human-robot Teleoperation Performance.” Presence: Teleoperators and Virtual Environments 11 (4): 368–377.
   Web of Science ®Google Scholar
• Lewis, M., H. Wang, S. Y. Chien, P. Velagapudi, P. Scerri, and K. Sycara. 2010. “Choosing Autonomy Modes for Multirobot Search.” Human Factors 52 (2): 225–233.
   PubMed Web of Science ®Google Scholar
• Macmillan, N. A., and C. D. Creelman. 2004. Detection Theory: A User’s Guide. New York: Lawrence Erlbaum Associates.
   Google Scholar
• Manzey, D., J. Reichenbach, and L. Onnasch. 2008. “Performance Consequences of Automated Aids in Supervisory Control: The Impact of Function Allocation.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 52 (4): 297–301.
   Google Scholar
• Manzey, D., J. Reichenbach, and L. Onnasch. 2012. “Human Performance Consequences of Automated Decision Aids: The Impact of Degree of Automation and System Experience.” Journal of Cognitive Engineering and Decision Making 6 (1): 57–87.
   Google Scholar
• McKinley, R. A., L. K. McIntire, and M. A. Funke. 2011. “Operator Selection for Unmanned Aerial Systems: Comparing Video Game Players and Pilots.” Aviation, Space, and Environmental Medicine 82 (6): 635–642.
   PubMedGoogle Scholar
• Mentzer, C. I., and E. R. Johnson. 2014. “Dismounted Soldier Autonomy Tools (DSAT) – From Conception to Deployment.” Paper presented at 6th annual National Defence Industrial Association Ground Vehicle Systems Engineering & Technology Symposium, Novi, Michigan, August 12–14.
   Google Scholar
• Onnasch, L., C. D. Wickens, H. Li, and D. Manzey. 2014. “Human Performance Consequences of Stages and Levels of Automation: An Integrated Meta-analysis.” Human Factors 56 (3): 476–488.
   PubMed Web of Science ®Google Scholar
• Parasuraman, R., K. A. Cosenzo, and E. De Visser. 2009. “Adaptive Automation for Human Supervision of Multiple Uninhabited Vehicles: Effects on Change Detection, Situation Awareness, and Mental Workload.” Military Psychology 21 (2): 270.
   Web of Science ®Google Scholar
• Parasuraman, R., and D. H. Manzey. 2010. “Complacency and Bias in Human Use of Automation: An Attentional Integration.” Human Factors: The Journal of the Human Factors and Ergonomics Society 52 (3): 381–410.
   PubMed Web of Science ®Google Scholar
• Parasuraman, R., R. Molloy, and I. L. Singh. 1993. “Performance Consequences of Automation-induced ‘Complacency’.” The International Journal of Aviation Psychology 3 (1): 1–23.
   Google Scholar
• Parasuraman, R., and V. Riley. 1997. “Humans and Automation: Use, Misuse, Disuse, Abuse.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39 (2): 230–253.
   Web of Science ®Google Scholar
• Parasuraman, R., T. B. Sheridan, and C. D. Wickens. 2000. “A Model for Types and Levels of Human Interaction with Automation” IEEE Transactions on Systems, Man, and Cybernetics, Part A (Systems and Humans) 30 (3): 286–297.
   Google Scholar
• Peavler, W. S. 1974. “Pupil Size, Information Overload, and Performance Differences.” Psychophysiology 11 (5): 559–566.
   PubMed Web of Science ®Google Scholar
• Posner, M. I. 1980. “Orienting of Attention.” Quarterly Journal of Experimental Psychology 32 (1): 3–25.
   PubMed Web of Science ®Google Scholar
• Posner, M. I., and S. E. Petersen. 1989. “The Attention System of the Human Brain.” St. Louis, MO: Washington University. Report No. TR–89–1.
   Google Scholar
• Reinerman-Jones, L., G. Matthews, and J. E. Mercado. 2016. “Detection Tasks in Nuclear Power Plant Operation: Vigilance Decrement and Physiological Workload Monitoring.” Safety Science 88: 97–107.
   Web of Science ®Google Scholar
• Reingold, E. M., N. Charness, M. Pomplun, and D. M. Stampe. 2001. “Visual Span in Expert Chess Players: Evidence from Eye Movements.” Psychological Science 12 (1): 48–55.
   PubMed Web of Science ®Google Scholar
• Sheridan, T. B. 2000. “Function Allocation: Algorithm, Alchemy or Apostasy?” International Journal of Human-Computer Studies 52 (2): 203–216.
   Web of Science ®Google Scholar
• Singh, I. L., R. Molloy, and R. Parasuraman. 1993. “Individual Differences in Monitoring Failures of Automation.” The Journal of General Psychology 120 (3): 357–373.
   Web of Science ®Google Scholar
• SMI RED Tech Specs, SensoMotoric Instruments GmbH, Teltow, Germany. 2013.
   Google Scholar
• Snyder, M. G., Z. Qu, J. Y. C. Chen, and M. J. Barnes. 2010. “RoboLeader for Reconnaissance by a Team of Robotic Vehicles.” Paper presented at 2010 International Symposium on Collaborative Technologies and Systems (CTS), Chicago, Illinois, May 17–21.
   Google Scholar
• SAE (Society of Automotive Engineers). 2014. Taxonomy and Definitions for Terms Related to On-road Motor Vehicle Automated Driving Systems (Standard J3016_201401). Warrendale, PA: SAE International.
   Google Scholar
• Squire, P. N., and R. Parasuraman. 2010. “Effects of Automation and Task Load on Task Switching during Human Supervision of Multiple Semi-autonomous Robots in a Dynamic Environment.” Ergonomics 53 (8): 951–961.
   PubMed Web of Science ®Google Scholar
• Steinhauer, S. R., G. J. Siegle, R. Condray, and M. Pless. 2004. “Sympathetic and Parasympathetic Innervation of Pupillary Dilation during Sustained Processing.” International Journal of Psychophysiology 52 (1): 77–86.
   PubMed Web of Science ®Google Scholar
• Szalma, J. L., and G. S. Taylor. 2011. “Individual Differences in Response to Automation: The Five Factor Model of Personality.” Journal of Experimental Psychology: Applied 17 (2): 71.
   PubMed Web of Science ®Google Scholar
• Van Orden, K. F., T. Jung, and S. Makeig. 2000. “Combined Eye Activity Measures Accurately Estimate Changes in Sustained Visual Task Performance.” Biological Psychology 52 (3): 221–240.
   PubMed Web of Science ®Google Scholar
• Van Orden, K. F., W. Limbert, S. Makeig, and T. Jung. 2001. “Eye Activity Correlates of Workload during a Visuospatial Memory Task.” Human Factors: The Journal of the Human Factors and Ergonomics Society 43 (1): 111–121.
   PubMed Web of Science ®Google Scholar
• Yang, G. Z., J. Cambias, K. Cleary, E. Daimler, J. Drake, P. E. Dupont, N. Hata, et al. 2017. “ Medical Robotics—Regulatory Ethical and Legal Considerations for Increasing Levels of Autonomy.” Science Robotics 2.
   Web of Science ®Google Scholar
• Wright, J. L., J. Y. C. Chen, M. J. Barnes, and P. A. Hancock. 2017. Agent Reasoning Transparency: The Influence of Information Level on Automation-induced Complacency. (ARL-TR-8044). Aberdeen Proving Ground, MD: Army Research Laboratory.
   Google Scholar
• Wright, J. L., J. Y. C. Chen, S. A. Quinn, and M. J. Barnes. 2013. “The Effects of Level of Autonomy on Human-Agent Teaming for Multi-Robot Control and Local Security Maintenance” (ARL-TR-6724). Aberdeen Proving Ground, MD: Army Research Laboratory.
   Google Scholar