Situation awareness-based agent transparency and human-autonomy teaming effectiveness

References

• Allen, J. E., C. I. Guinn, and E. Horvtz. Sep./Oct. 1999. “Mixed-Initiative Interaction.” IEEE Intelligent Systems and their Applications 14(5): 14–23. doi: 10.1109/5254.796083.
   Web of Science ®Google Scholar
• Barnes, M. J., J. Y. C. Chen, and F. Jentsch. 2015. “Designing for Mixed-Initiative Interactions between Human and Autonomous Systems in Complex Environments.” 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Hong Kong: IEEE. 1386–1390. doi: 10.1109/SMC.2015.246.
   Google Scholar
• Barrett, S., P. Stone, S. Kraus, and A. Rosenfeld (2012). “Learning Teammate Models for ad hoc Teamwork.” In AAMAS Adaptive Learning Agents (ALA) Workshop, Valencia. 57–63.
   Google Scholar
• Bass, E. J., L. A. Baumgart, and K. K. Shepley. 2013. “The Effect of Information Analysis Automation Display Content on Human Judgment Performance in Noisy Environments.” Journal of Cognitive Engineering and Decision Making 7(1): 49–65.
   PubMedGoogle Scholar
• Behymer, K. J., M. J. Patzek, C. D. Rothwell, and H. A. Ruff. Forthcoming. Initial Evaluation of the Intelligent Multi-UXV Planner with Adaptive Collaborative/Control Technologies (IMPACT). Technical Report: AFRL-RH-WP-TR-2016-TBD, Wright-Patterson AFB, OH: Air Force Research Lab.
   Google Scholar
• Beller, J., M. Heesen, and M. Vollrath. 2013. “Improving the Driver-Automation Interaction: An Approach Using Automation Uncertainty.” Human Factors: The Journal of the Human Factors and Ergonomics Society 55(6): 1130–1141. doi: 10.1177/0018720813482327.
   PubMed Web of Science ®Google Scholar
• Bitan, Y., and J. Meyer. 2007. “Self-Initiated and Respondent Actions in a Simulated Control Task.” Ergonomics 50(5): 763–788. doi: 10.1080/00140130701217149.
   PubMed Web of Science ®Google Scholar
• Bradshaw, J. M., P. J. Feltovich, and M. Johnson. 2012. “Human-Agent Interaction.” In The Handbook of Human-Machine Interaction: A Human-Centered Design Approach, edited by G. A. Boy, 283–299. Surrey: Ashgate Publishing Ltd.
   Google Scholar
• Bruni, S., J. J. Marquez, A. Brzezinski, C. Nehmeand, Y. Boussemart. 2007, June. “Introducing a Human-Automation Collaboration Taxonomy (HACT) in Command and Control Decision-Support Systems." In Proceedings of the 12th International Command and Control Research and Technology Symposium. Newport, RI.
   Google Scholar
• Calhoun, G. L, H. A. Ruff, K. J. Behymer, and E. M. Mersch. 2017. “Operator-Autonomy Teaming Interfaces to Support Multi-Unmanned Vehicle Missions.” In Advances in Human Factors in Robots and Unmanned Systems, edited by P. Savage-Knepshield and J. Y. C. Chen, 113–126. Warsaw: Springer International Publishing.
   Google Scholar
• Cannon-Bowers, J., E. Salas, and S. Converse. 1993. “Shared Mental Models in Expert Team Decision Making.” In Individual and Group Decision Making: Current Issues, edited by N. J. Castellan, 221–246. Hillsdale, NJ: Erlbaum.
   Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2010. “Supervisory Control of Robots Using RoboLeader.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting. San Francisco, CA: Sage. 1483–1487. doi: 10.1177/154193121005401927.
   Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2012a. “Supervisory Control of Multiple Robots Effects of Imperfect Automation and Individual Differences.” Human Factors: The Journal of the Human Factors and Ergonomics Society 54(2): 157–174. doi: 10.1177/0018720811435843.
   PubMed Web of Science ®Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2012b. “Supervisory Control of Multiple Robots in Dynamic Tasking Environments.” Ergonomics 55(9): 1043–1058. doi: 10.1080/00140139.2012.689013.
   PubMed Web of Science ®Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2014. “Human-Agent Teaming for Multirobot Control: A Review of Human Factors Issues.” IEEE Transactions on Human-Machine Systems 44(1) 13–29. doi: 10.1109/THMS.2013.2293535.
   Web of Science ®Google Scholar
• Chen, J. Y. C., and M. J. Barnes. 2015. “Agent Transparency for Human-Agent Teaming Effectiveness.” 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Hong Kong: IEEE Press. 1381–1385. doi: 10.1109/SMC.2015.245.
   Google Scholar
• Chen, J. Y. C., M. J. Barnes, A. R. Selkowitz, K. Stowers, S. G. Lakhmani, and N. Kasdaglis. 2016. “Human-Autonomy Teaming and Agent Transparency.” Companion Publication of the 21st International Conference on Intelligent User Interfaces. Sonoma, CA: ACM. 28–31. doi: 10.1145/2876456.2879479.
   Google Scholar
• Chen, J. Y. C., K. Procci, M. Boyce, J. Wright, A. Garcia, and M. Barnes. 2014. Situation Awareness-Based Agent Transparency. Report No. ARL-TR-6905, Aberdeen Proving Ground, MD, U.S. Army Research Laboratory.
   Google Scholar
• Cook, M. B., and H. S. Smallman. 2008. “Human Factors of the Confirmation Bias in Intelligence Analysis: Decision Support from Graphical Evidence Landscapes.” Human Factors: The Journal of the Human Factors and Ergonomics Society 50(5): 745–754. doi: 10.1518/001872008X354183.
   PubMed Web of Science ®Google Scholar
• de Visser, E. J., M. Cohen, A. Freedy, and R. Parasuraman. 2014. “A Design Methodology for Trust Cue Calibration in Cognitive Agents,” In Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments, edited by R. Shumaker, S.Lackey, 251–262. Cham, Swtizerland: Springer International Publishing. doi: 10.1007/978-3-319-07458-0_24.
   Google Scholar
• DeChurch, L. A., and J. R. Mesmer-Magnus. 2010. “The Cognitive Underpinnings of Effective Teamwork: a Meta-Analysis.” Journal of Applied Psychology 95(1): 32–53. doi: 10.1037/a0017328.
   PubMed Web of Science ®Google Scholar
• Defense Science Board. 2016. Defense Science Board Summer Study on Autonomy, Washington, DC : Under Secretary of Defense.
   Google Scholar
• Department of Defense. 2013. “Autonomy Research Pilot Initiative Web Feature.” Last modified June 14. http://www.acq.osd.mil/chieftechnologist/arpi.html.
   Google Scholar
• Endsley, M. R. 1995. "Toward a Theory of Situation Awareness in Dynamic Systems." Human Factors: The Journal of the Human Factors and Ergonomics Society 37(1): 32–64. doi: 10.1518/001872095779049543.
   Web of Science ®Google Scholar
• Fern, L., and R. J. Shively. 2009. “A Comparison of Varying Levels of Automation on the Supervisory Control of Multiple UASs.” Proceedings of AUVSIs Unmanned Systems North America. New York, NY: Curran Associates Inc. 10–13. https://www.researchgate.net/profile/Lisa_Fern/publication/257645042_A_COMPARISON_OF_VARYING_LEVELS_OF_AUTOMATION_ON_THE_SUPERVISORY_CONTROL_OF_MULTIPLE_UASs/links/004635258b5a8ed6b7000000.pdf.
   Google Scholar
• Fong, T. W., I. Nourbakhsh, C. Kunz, L. Flueckiger, J. Schreiner, R. Ambrose, R. Burridge, et al. 2005. “The Peer-to-Peer Human-Robot Interaction Project.” AIAA Space 2005. Long Beach, CA: American Institute of Aeronautics and Astronautics. doi: 10.2514/6.2005-6750.
   Google Scholar
• Fong, T. W., C. Thorpe, and C. Baur. 2003. “Robot, Asker of Questions.” Robotics and Autonomous Systems 42(3): 235–243. doi: 10.1016/S0921-8890(02)00378-0.
   Web of Science ®Google Scholar
• Gillespie, K., M. Molineaux, M.W. Floyd, S. S. Wattam, and D. W. Aha. 2015. “Goal Reasoning for an Autonomous Squad Member," Technical Report GT-IRIM-CR-2015-001 , In Goal Reasoning: Papers from the ACS Workshop, edited by D. W. Aha, 52–67. Atlanta, GA: Georgia Institute of Technology, Institute for Robotics and Intelligent Machines.
   Google Scholar
• Goodrich, M. A. 2013. “Multitasking and Multi-Robot Management.” In Oxford Handbook of Cognitive Engineering, edited by J. D. Lee and A. Kirklik, 379–394. New York, NY: Oxford University Press. doi: 10.1093/oxfordhb/9780199757183.013.0025.
   Google Scholar
• Gunning, D. 2016. Explainable Artificial Intelligence. http://www.darpa.mil/program/explainable-artificial-intelligence.
   Google Scholar
• Hayes, B., and B. Scassellati. 2013. “Challenges in Shared-Environment Human-Robot Collaboration.” Paper presented at the 8th ACM/IEEE International Conference on Human-Robot Interaction, Workshop on Collaborative Manipulation. Tokyo, Japan, March 3-6. http://bradhayes.info/papers/hayes_challenges_HRI_collab_2013.pdf.
   Google Scholar
• Helldin, T. 2014. “Transparency for Future Semi-Automated Systems.” PhD diss., Orebro University.
   Google Scholar
• Helldin, T., U. Ohlander, G. Falkman, and M. Riveiro. 2014. “Transparency of Automated Combat Classification.” Engineering Psychology and Cognitive Ergonomics 22–33. doi: 10.1007/978-3-319-07515-0_3.
   Google Scholar
• Jones, D. G., and Kaber, D. B. 2004. “Situation Awareness Measurement and the Situation Awareness Global Assessment Technique.” Handbook of Human Factors and Ergonomics Methods, edited by N. A. Stanton, A. Hedge, K. Brookhuis, E. Salas, and H. W. Hendrick, 42–1-42-8. London: Taylor & Francis.
   Google Scholar
• Kaupp, T., A. Makarenko, and H. Durrant-Whyte. 2010. “Human-Robot Communication for Collaborative Decision Making—A Probabilistic Approach.” Robotics and Autonomous Systems 58(5): 444–456. doi: 10.1016/j.robot.2010.02.003.
   Web of Science ®Google Scholar
• Koola, P. M., S. Ramachandran, and K. Vadakkeveedu. (2016). “How Do We Train a Stone to Think? A Review of Machine Intelligence and its Implications.” Theoretical Issues in Ergonomics Science 17(2): 211–238. doi: 10.1080/1463922X.2015.1111462.
   Web of Science ®Google Scholar
• Lee, J. D. 2012. “Trust, Trustworthiness, and Trustability.” Presented at the Workshop on Human Machine Trust for Robust Autonomous Systems. Ocala, FL, (2012 Jan–Feb).
   Google Scholar
• Lee, J. D., and K. A. See. 2004 “Trust in Automation: Designing for Appropriate Reliance.” Human Factors: The Journal of the Human Factors and Ergonomics Society 46(1): 50–80. doi: 10.1518/hfes.46.1.50_30392.
   PubMed Web of Science ®Google Scholar
• Linegang, M. P., H. A. Stoner, M. J. Patterson, B. D. Seppelt, J. D. Hoffman, Z. B. Crittendon, and J. D. Lee. 2006. “Human-Automation Collaboration in Dynamic Mission Planning: A Challenge Requiring an Ecological Approach.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 50(23): 2482–2486. doi: 10.1177/154193120605002304.
   Google Scholar
• Lyons, J. B. 2013. “Being Transparent About Transparency: A Model For Human-Robot Interaction." Technical Report SS-13-07. In Trust and Autonomous Systems: Papers from the AAAI Spring Symposium, D. Sofge, G. Kruijff, W.F. Lawless , pp. 48–53. doi: https://pdfs.semanticscholar.org/bf51/f5448981d985e082f2d9511d276ca6519944.pdf.
   Google Scholar
• Lyons, J. B., and P. R. Havig. 2014. “Transparency in a Human-Machine Context: Interface Approaches for Fostering Shared Awareness/Intent." In Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments, edited by R. Shumaker, S. Lackey, pp. 181–190. Cham, Swtizerland: Springer International Publishing. doi: 10.1007/978-3-319-07458-0_18.
   Google Scholar
• Lyons, J. B., G. G. Sadler, K. Koltai, H. Battiste, N. T. Ho, L. C. Hoffmann, D. Smith, W. Johnson, and R. Shively. 2017. “Shaping Trust Through Transparent Design: Theoretical and Experimental Guidelines.” In Advances in Human Factors in Robots and Unmanned Systems, pp. 127–136, Cham, Switzerland: Springer International Publishing.
   Google Scholar
• Mathieu, J. E., T. S. Heffner, G. F. Goodwin, E. Salas, and J. A. Cannon-Bowers. 2000. “The Influence of Shared Mental Models on Team Process and Performance.” Journal of Applied Psychology 85(2): 273–283. doi: 10.1037/0021-9010.85.2.273.
   PubMed Web of Science ®Google Scholar
• McGuirl, J. M., and N. B. Sarter. 2006. “Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information.” Human Factors: The Journal of the Human Factors and Ergonomics Society 48(4): 656–665. doi: 10.1518/001872006779166334.
   PubMed Web of Science ®Google Scholar
• Mercado, J. E., M. A. Rupp, J. Y. C. Chen, M. J. Barnes, D. Barber, and K. Procci. 2016. “Intelligent Agent Transparency in Human-Agent Teaming for Multi-UxV Management.” Human Factors: The Journal of the Human Factors and Ergonomics Society 58.3(2016): 401–415. doi: 10.1177/0018720815621206.
   Google Scholar
• Meyer, J., and J. D. Lee. 2013. “Trust, Reliance, and Compliance.” In The Oxford Handbook of Cognitive Engineering, edited by J. D. Lee and A. Kirlik, pp.109–124. New York, NY: Oxford University Press. doi: 10.1093/oxfordhb/9780199757183.013.0007.
   Google Scholar
• Neyedli, H. F., J. G. Hollands, and G. A. Jamieson. 2009. “Human Reliance on an Automated Combat ID System: Effects of Display Format.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Sage Publications) 53(4): 212–216. doi: 10.1177/154193120905300411.
   Google Scholar
• Parasuraman, R., M. Barnes, and K. Cosenzo. 2007. “Adaptive Automation For Human-Robot Teaming in Future Command and Control Systems.” International Journal of Command and Control 1(2): 43–68.
   Google Scholar
• Parasuraman, R., and C. A. Miller. 2004. “Trust and Etiquette in High-Criticality Automated Systems.” Communications of the ACM 47(4): 51–55. doi: 10.1145/975817.975844.
   Web of Science ®Google Scholar
• Parasuraman, R., R. Molloy, and I. L. Singh. 1993. “Performance Consequences of Automation-Induced ‘Complacency’ ”. The International Journal of Aviation Psychology 3(1): 1–23. doi: 10.1207/s15327108ijap0301_1.
   Google Scholar
• Parasuraman, R., and V. Riley. 1997. “Humans and Automation: Use, Misuse, Disuse, Abuse.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39(2): 230–253. doi: 10.1518/001872097778543886.
   Web of Science ®Google Scholar
• Rao, A. S., and M. P. Georgeff. 1995. “BDI Agents: From Theory to Practice.” Proceedings of the First International Conference on Multiagent Systems. Palo Alto, CA: Association for the Advancement of Artificial Intelligence Press, 312–319.
   Google Scholar
• Russell, S., and P. Norvig. 2009. Artificial Intelligence: A Modern Approach. 3rd ed. Upper Saddle River, NJ: Prentice Hall Press.
   Google Scholar
• Selkowitz, A. R., S. G. Lakhmani, C. N. Larios, and J. Y. C. Chen. 2016. “Agent Transparency and the Autonomous Squad Member.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60(1): 1319–1323. doi: 10.1177/1541931213601305
   Google Scholar
• Selkowitz, A. R., C. N. Larios, S. G. Lakhmani, and J. Y. C. Chen. 2017. “Displaying Information to Support Transparency for Autonomous Platforms.” Advances in Human Factors in Robots and Unmanned Systems. Orlando, FL: Springer International Publishing, 161. doi: 10.1007/978-3-319-41959-6_14.
   Google Scholar
• Seppelt, B. D., and J. D. Lee. 2007. “Making Adaptive Cruise Control (ACC) Limits Visible.” International Journal of Human-Computer Studies 65(3): 192–205. doi: 10.1016/j.ijhcs.2006.10.001.
   Web of Science ®Google Scholar
• Shattuck, L. G. 2015. “Transitioning to Autonomy: A Human Systems Integration Perspective.” Presented at Transitioning to Autonomy: Changes in the role of humans in air transportation, Moffett Field, CA, 10–12 March 2015. https://human-factors.arc.nasa.gov/workshop/autonomy/download/presentations/Shaddock%20.pdf.
   Google Scholar
• Singh, P., B. Barry, and H. Liu. 2004. “Teaching Machines About Everyday Life.” BT Technology Journal 22(4): 227–240. doi: 10.1023/B:BTTJ.0000047601.53388.74.
   Google Scholar
• Smith, P. J., C. E. McCoy, and C. Layton. 1997. “Brittleness in the design of cooperative problem-solving systems: The effects on user performance.” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 27(3): 360–371. doi: 10.1109/3468.568744.
   Web of Science ®Google Scholar
• Stanton, N. A., M. S. Young, and G. H. Walker. 2007. “The Psychology of Driving Automation: a Discussion with Professor Don Norman.” International Journal of Vehicle Design 45(3): 289–306. doi: 10.1504/IJVD.2007.014906.
   Web of Science ®Google Scholar
• Stowers, K., J. Y. C. Chen, N. Kasdaglis, O. Newton, M. Rupp, and M. Barnes. Forthcoming. Effects of Situation Awareness-Based Agent Transparency Information on Human Agent Teaming for Multi- UxV Management, Report No. ARL-TR-XX, Aberdeen Proving Ground, MD: Army Research Lab.
   Google Scholar
• Stubbs, K., D. Wettergreen, and P. H. Hinds. 2007. “Autonomy and Common Ground in Human-Robot Interaction: A Field Study.” IEEE Intelligent Systems 22(2): 42–50. doi: 10.1109/MIS.2007.21.
   Web of Science ®Google Scholar
• Sycara, K., and G. Sukthankar. 2006. “Literature review of teamwork models.” Report No. CMU-RI-TR-06-50. Pittsburgh, PA: Robotics Institute, Carnegie Mellon University.
   Google Scholar
• Thomaz, A. L., and C. Breazeal. 2006. “Transparency and Socially Guided Machine Learning.” Paper presented at the 5th International Conference on Development and Learning (ICDL), Bloomington, IN, May 31-June 3.
   Google Scholar
• Tufte, E. R. 2001. The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press.
   Google Scholar
• Warner Norcross and Judd. 2015. Trucking, Mining Industries Blazing a Path to Vehicle Autonomy. January 14. http://www.wnj.com/Publications/Trucking-Mining-Industries-Blazing-a-Path-to-Vehic.
   Google Scholar
• Wooldridge, M., and N. R. Jennings. 1995. “Intelligent Agents: Theory and Practice.” The Knowledge Engineering Review 10(2): 115–152. doi: 10.1017/S0269888900008122.
   Web of Science ®Google Scholar
• Wright, J. L., J. Y. C. Chen, P. A. Hancock, I. Yi, and M. J. Barnes. Forthcoming. “Transparency of Agent Reasoning and its Effect on Automation-Induced Complacency.” Report No. ARL-TR-XX, Aberdeen Proving Ground, MD: Army Research Lab.
   Google Scholar
• Wright, J. L., J. Y. C. Chen, S. A. Quinn, and M. J. Barnes. 2013. “The Effects of Level of Autonomy on Human-Agent Teaming for Multi-Robot Control and Local Security Maintenance ” Report No: ARL-TR-6724, Aberdeen Proving Ground, MD:, Army Research Laboratory..
   Google Scholar
• Zhou, J., and F. Chen. 2015. “Making Machine Learning Useable.” International Journal of Computational Science and Engineering 14(2): 91–109. doi: 10.1504/IJISTA.2015.074069.
   Google Scholar