Advanced search
Publication Cover
Theoretical Issues in Ergonomics Science Volume 24, 2023 - Issue 2
Submit an article Journal homepage
12,509
Views
3
CrossRef citations to date
0
Altmetric
Articles

The role of shared mental models in human-AI teams: a theoretical review

Robert W. Andrewsa School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, USAView further author information
,
J. Mason Lillyb College of Computing, Georgia Institute of Technology, Atlanta, GA, USAORCID Iconhttps://orcid.org/0000-0002-4573-9322View further author information
ORCID Icon,
Divya Srivastavac School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, USAORCID Iconhttps://orcid.org/0000-0003-1063-5344View further author information
ORCID Icon &
Karen M. Feigha School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, USACorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0002-0281-7634View further author information
ORCID Icon
Pages 129-175 | Received 12 Nov 2021, Accepted 29 Mar 2022, Published online: 18 Apr 2022

References

  • Abbeel, Pieter, and Andrew Y. Ng. 2004. “Apprenticeship Learning via Inverse Reinforcement Learning.” In Twenty-First International Conference on Machine learning - ICML ‘04. ACM Press, Banff, Alberta, Canada, 1. doi:10.1145/1015330.1015430.
  • Adadi, Amina, and Mohammed Berrada. 2018. “Peeking inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI).” IEEE Access. 6 (2018): 52138–52160. doi:10.1109/ACCESS.2018.2870052.
  • Baker, Michael. 1994. “A Model for Negotiation in Teaching-Learning Dialogues.” Journal of Artificial Intelligence in Education 5 (2): 199–254.
  • Bansal, Gagan, Besmira Nushi, Ece Kamar, Walter S. Lasecki, Daniel S. Weld, and Eric Horvitz. 2019. “Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance.” Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 7 (1): 2–11. https://www.aaai.org/ojs/index.php/HCOMP/article/view/5285.
  • Bass, Ellen J., Matthew L. Bolton, Karen M. Feigh, Dennis Griffith, Elsa Gunter, and William Mansky John Rushby. 2011. “Toward a Multi-Method Approach to Formalizing Human-Automation Interaction and Human-Human Communications.” In IEEE International Conference of Systems Man and Cybernetics. IEEE, Anchorage, AK.
  • Beers, Pieter J., Paul A. Kirschner, Henny P. A. Boshuizen, and Wim H. Gijselaers. 2007. “ICT-Support for Grounding in the Classroom.” Instructional Science 35 (6): 535–556. doi:10.1007/s11251-007-9018-5.
  • Bierhals, R., I. Schuster, P. Kohler, and P. Badke-Schaub. 2007. “Shared Mental Models–Linking Team Cognition and Performance.” CoDesign 3 (1): 75–94. doi:10.1080/15710880601170891.
  • Bisantz, Ann., and Emilie. Roth. 2007. “Analysis of Cognitive Work.” Reviews of Human Factors and Ergonomics 3 (1): 1–43. doi:10.1518/155723408X299825.
  • Bolstad, Cheryl A., and Mica R. Endsley. 1999. “Shared Mental Models and Shared Displays: An Empirical Evaluation of Team Performance.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 43 (3): 213–217. doi:10.1177/154193129904300318.
  • Bosse, Tibor, Zulfiqar A. Memon, and Jan. Treur. 2011. “A Recursive Bdi Agent Model for Theory of Mind and Its Applications.” Applied Artificial Intelligence 25 (1): 1–44. doi:10.1080/08839514.2010.529259.
  • Burgoon, J. K., V. Manusov, and L. K. Guerrero (2021). Nonverbal Communication (2nd ed.). New York, NY: Routledge.
  • Brunélis, Thierry and Le Blaye, Patrick. 2009. Towards a human centered methodology for the Dynamic Allocation of functions. Revue d’Intelligence Artificielle. 23: 503–522. doi:10.3166/ria.23.503-522. https://www.researchgate.net/publication/220578475_Towards_a_human_centered_methodology_for_the_Dynamic_Allocation_of_functions
  • Burns, Catherine M., Laura K. Thompson, and Antonio Rodriguez. 2002. “Mental Workload and the Display of Abstraction Hierarchy Information.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 46 (3): 235–239. doi:10.1177/154193120204600304.
  • Burtscher, Michael J., and Jeannette Oostlander. 2019. “Perceived Mutual Understanding (PMU): Development and Initial Testing of a German Short Scale for Perceptual Team Cognition.” European Journal of Psychological Assessment 35 (1): 98–108. doi:10.1027/1015-5759/a000360.
  • Cannon-Bowers, Janis A., and Eduardo Salas. 2001. “Reflections on Shared Cognition.” Journal of Organizational Behavior 22 (2): 195–202. doi:10.1002/job.82.
  • Celemin, C., and J. Ruiz-del Solar. 2015. “COACH: Learning Continuous Actions from COrrective Advice Communicated by Humans.” In 2015 International Conference on Advanced Robotics (ICAR), 581–586. doi:10.1109/ICAR.2015.7251514.
  • Chakraborti, Tathagata, Sarath Sreedharan, Anagha Kulkarni, and S. Kambhampati. 2017. “Alternative Modes of Interaction in Proximal Human-in-the-Loop Operation of Robots.” ArXiv Abs/1703.08930 (2017).
  • Chakraborty, Supriyo, Richard Tomsett, Ramya Raghavendra, Daniel Harborne, Moustafa Alzantot, Federico Cerutti, Mani Srivastava, et al. 2017. “Interpretability of Deep Learning Models: A Survey of Results.” In 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, San Francisco, CA, 1–6. doi:10.1109/UIC-ATC.2017.8397411.
  • Chen, Letian, Rohan Paleja, Muyleng Ghuy, and Matthew Gombolay. 2020. Joint Goal and Strategy Inference across Heterogeneous Demonstrators via Reward Network Distillation, 659–668. New York, NY: Association for Computing Machinery. doi:10.1145/3319502.3374791.
  • Clark, Herbert H., and Edward F. Schaefer. 1989. “Contributing to Discourse.” Cognitive Science 13 (2): 259–294. doi:10.1207/s15516709cog1302\_7.
  • Cohen, Philip R., and Hector J. Levesque. 1991. “Teamwork.” Noûs 25 (4): 487–512. doi:10.2307/2216075.
  • Converse, Sharolyn, J. A. Cannon-Bowers, and E. Salas. 1993. “Shared Mental Models in Expert Team Decision Making.” Individual and Group Decision Making: Current Issues 221 (1993): 221–246.
  • Cooke, N. J., R. Stout, K. Rivera, and E. Salas. 1998. “Exploring Measures of Team Knowledge.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 42(3): 215–219. doi:10.1177/154193129804200307
  • Cooke, Nancy J., Eduardo Salas, Janis A. Cannon-Bowers, and Renée J. Stout. 2000. “Measuring Team Knowledge.” Human Factors 42 (1): 151–173. doi:10.1518/001872000779656561.
  • Cooke, Nancy J., Eduardo Salas, Preston A. Kiekel, and Brian Bell. 2004. “Advances in Measuring Team Cognition.” In Team Cognition: Understanding the Factors That Drive Process and Performance, 83–106. Washington, DC: American Psychological Association. doi:10.1037/10690-005.
  • Cooke, Nancy J., Jamie C. Gorman, Christopher W. Myers, and Jasmine L. Duran. 2013. “Interactive Team Cognition - Cooke – 2013”. Cognitive Science 37 (2): 255–285. https://doi.org/10.1111/cogs.12009
  • Craik, Kenneth James Williams. 1967. The Nature of Explanation. Cambridge. Cambridge University Press. https://philpapers.org/rec/CRATNO
  • Das Chakladar, Debashis, and Sanjay Chakraborty. 2018. “EEG Based Emotion Classification Using “Correlation Based Subset Selection.” Biologically Inspired Cognitive Architectures 24 (2018): 98–106. doi:10.1016/j.bica.2018.04.012.
  • DeChurch, Leslie A., and Jessica R. Mesmer-Magnus. 2010. “Measuring Shared Team Mental Models: A Meta-Analysis.” Group Dynamics: Theory, Research, and Practice 14 (1): 1–14. doi:10.1037/a0017455.
  • Dionne, Shelley D., Hiroki Sayama, Chanyu Hao, and Benjamin James Bush. 2010. “The Role of Leadership in Shared Mental Model Convergence and Team Performance Improvement: An Agent-Based Computational Model.” The Leadership Quarterly 21 (6): 1035–1049. doi:10.1016/j.leaqua.2010.10.007.
  • Dong, Zhihang, Tongshuang Wu, Sicheng Song, and Mingrui Zhang. 2020. “Interactive Attention Model Explorer for Natural Language Processing Tasks with Unbalanced Data Sizes.” In 2020 IEEE Pacific Visualization Symposium (PacificVis), 46–50. doi:10.1109/PacificVis48177.2020.1031.
  • Doshi-Velez, Finale, and Been Kim. 2017. “Towards a Rigorous Science of Interpretable Machine Learning.” arXiv:1702.08608 [cs, Stat]. http://arxiv.org/abs/1702.08608. arXiv: 1702.08608.
  • Edmondson, Amy. 1999. “Psychological Safety and Learning Behavior in Work Teams.” Administrative Science Quarterly 44 (2): 350–383. doi:10.2307/2666999.
  • Einhorn, Hillel, and Robin Hogarth. 1986. “Judging Probable Cause.” Psychological Bulletin 99 (1): 3–19. doi:10.1037/0033-2909.99.1.3.
  • Endsley, Mica R. 1995. “Measurement of Situation Awareness in Dynamic Systems.” Human Factors: The Journal of the Human Factors and Ergonomics Society 37 (1): 65–84. doi:10.1518/001872095779049499.
  • Endsley, M. R. 2004. Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition (2nd ed.). CRC Press. https://doi.org/10.1201/b11371
  • Endsley, Mica R. 2016. “Toward a Theory of Situation Awareness in Dynamic Systems.” In Human Factors. Los Angeles, CA: Sage CA. doi:10.1518/001872095779049543.
  • Entin, Eileen B., and Elliot E. Entin. 2000. “Assessing Team Situation Awareness in Simulated Military Missions.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 44 (1): 73–76. doi:10.1177/154193120004400120.
  • Erber, Joan T., Irene G. Prager, Marie Williams, and Marisa A. Caiola. 1996. “Age and Forgetfulness: Confidence in Ability and Attribution for Memory Failures.” Psychology and Aging 11 (2): 310–315. doi:10.1037/0882-7974.11.2.310.
  • Fan, X., and J. Yen. 2011. “Modeling Cognitive Loads for Evolving Shared Mental Models in Human-Agent Collaboration.” IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics: A Publication of the IEEE Systems, Man, and Cybernetics Society 41 (2): 354–367. doi:10.1109/TSMCB.2010.2053705.
  • Feigh, Karen M., Michael C. Dorneich, and Caroline C. Hayes. 2012a. “Toward a Characterization of Adaptive Systems: A Framework for Researchers and System Designers.” Human Factors 54 (6): 1008–1024. doi:10.1177/0018720812443983.
  • Feigh, Karen M., Michael C. Dorneich, and Caroline C. Hayes. 2012b. “Toward a Characterization of Adaptive Systems: A Framework for Researchers and System Designers.” Human Factors 54 (6): 1008–1024. doi:10.1177/0018720812443983.
  • Fernandez, Rosemarie, Sachita Shah, Elizabeth D. Rosenman, Steve W. J. Kozlowski, Sarah Henrickson Parker, and James A. Grand. 2017. “Developing Team Cognition: A Role for Simulation.” Simulation in Healthcare: Journal of the Society for Simulation in Healthcare 12 (2): 96–103. doi:10.1097/SIH.0000000000000200.
  • Finley, Patrick M. 2013. “A study comparing table-based and list-based smartphone interface usability”. Graduate Theses and Dissertations. 13295. https://lib.dr.iastate.edu/etd/13295, https://core.ac.uk/download/pdf/38926044.pdf
  • Forrester, Jay W. 1971. “Counterintuitive Behavior of Social Systems.” Theory and Decision 2 (2): 109–140. doi:10.1007/BF00148991.
  • French, B., A. Duenser, and A. Heathcote. 2018. Trust in Automation - A Literature Review. CSIRO Report EP184082. CSIRO, Australia. https://www.scribd.com/document/532432101/trust-in-automation-a-literature-review-report, https://www.semanticscholar.org/paper/Trust-in-Automation-A-Literature-Review-French-Duenser/92f07d3d1356307decb6e97382ad884d0f62668d
  • Fu, Justin, Katie Luo, and Sergey Levine. 2018. “Learning Robust Rewards with Adversarial Inverse Reinforcement Learning.” arXiv:1710.11248 [cs] (Aug. 2018). http://arxiv.org/abs/1710.11248. arXiv: 1710.11248.
  • Felix Gervits, Dean Thurston, Ravenna Thielstrom, Terry Fong, Quinn Pham, and Matthias Scheutz. 2020. Toward Genuine Robot Teammates: Improving Human-Robot Team Performance Using Robot Shared Mental Models. In Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS ‘20). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 429–437.
  • Gilson, Richard D., Daniel J. Garland, and Jefferson M. Koonce. (Eds). 1994. Situational Awareness in Complex Systems. Proceedings to the Center for Applied Human Factors in Aviation (CAHFA) Conference on Situational Awareness in Complex Systems, Orlando, FL, February 1-3, 1993. Daytona Beach, FL: Embry-Riddle Aeronautical University Press. https://apps.dtic.mil/sti/citations/ADA281448
  • Gmytrasiewicz, Piotr J., and Edmund H. Durfeet. 1995. A Rigorous, Operational Formalization of Recursive, Proceedings of the First International Conference on Multiagent Systems, June 12-14, 1995, San Francisco, California, USA. Cambridge, MA: The MIT Press. ISBN 0-262-62102-9, 125–132.
  • Gombolay, Matthew C., Ronald J. Wilcox, and Julie A. Shah. 2018. “Fast Scheduling of Robot Teams Performing Tasks with Temporospatial Constraints.” IEEE Transactions on Robotics 34 (1): 220–239. doi:10.1109/TRO.2018.2795034.
  • Hammond, Jennifer. 2001. Scaffolding: teaching and Learning in Language and Literacy Education. Newtown, NSW: PETA, Primary English Teaching Association. OCLC: 1045428892.
  • Hanna, Nader, and Deborah Richards. 2018. “The Impact of Multimodal Communication on a Shared Mental Model, Trust, and Commitment in Human–Intelligent Virtual Agent Teams.” Multimodal Technologies and Interaction 2 (3): 48. doi:10.3390/mti2030048.
  • Hedges, Ashley R., Heather J. Johnson, Lawrence R. Kobulinsky, Jamie L. Estock, David. Eibling, and Amy L. Seybert. 2019. “Effects of Cross-Training on Medical Teams’ Teamwork and Collaboration: Use of Simulation.” Pharmacy 7 (1): 13. doi:10.3390/pharmacy7010013.
  • Hoffman, Robert R., Shane T. Mueller, Gary Klein, and Jordan Litman. 2019. “Metrics for Explainable AI: Challenges and Prospects.” arXiv:1812.04608 [cs] (Feb. 2019). http://arxiv.org/abs/1812.04608. arXiv: 1812.04608.
  • Hollan, James, Edwin Hutchins, and David Kirsh. 2000. “Distributed Cognition: Toward a New Foundation for Human-Computer Interaction Research.” ACM Transactions on Computer-Human Interaction 7 (2): 174–196. doi:10.1145/353485.353487.
  • Hutchins, Edwin, and Tove Klausen. 1996. “Distributed Cognition in an Airline Cockpit.” In Cognition and Communication at Work. 1st ed., edited by Yrjo Engeström and David Middleton, 15–34. Cambridge: Cambridge University Press. doi:10.1017/CBO9781139174077.002.
  • IJtsma, Martijn, Lanssie M. Ma, Amy R. Pritchett, and Karen M. Feigh. 2019. “Computational Methodology for the Allocation of Work and Interaction in Human-Robot Teams.” Journal of Cognitive Engineering and Decision Making 13 (4): 221–241. doi:10.1177/1555343419869484.
  • Isenberg, Petra, Danyel Fisher, Sharoda Paul, Meredith Morris, Kori Inkpen, and Mary Czerwinski. 2012. “Co-Located Collaborative Visual Analytics around a Tabletop Display.” IEEE Transactions on Visualization and Computer Graphics 18 (5): 689–702. doi:10.1109/TVCG.2011.287.
  • Jagacinski, Richard J., and Richard A. Miller. 1978. “Describing the Human Operator’s Internal Model of a Dynamic System.” Human Factors: The Journal of the Human Factors and Ergonomics Society 20 (4): 425–433. doi:10.1177/001872087802000406.
  • Janzen, Michael E., and Kim J. Vicente. 1997. “Attention Allocation within the Abstraction Hierarchy.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 41 (1): 274–278. doi:10.1177/107118139704100162.
  • Javaux, Denis. 1998. “An Algorithmic Method for Predicting Pilot-Mode Interaction Difficulties.” In 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No. 98CH36267), Vol. 1. IEEE, E21–1.
  • Jeong, Heisawn, and Michelene T. H. Chi. 2007. “Knowledge Convergence and Collaborative Learning.” Instructional Science 35 (4): 287–315. doi:10.1007/s11251-006-9008-z.
  • Johnsen, Bjørn Helge, Heidi Kristina Westli, Roar Espevik, Torben Wisborg, and Guttorm Brattebø. 2017. “High-Performing Trauma Teams: frequency of Behavioral Markers of a Shared Mental Model Displayed by Team Leaders and Quality of Medical Performance.” Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 25 (1): 109. doi:10.1186/s13049-017-0452-3.
  • Johnson-Laird, P. N. 1980. “Mental Models in Cognitive Science.” Cognitive Science 4 (1): 71–115. doi:10.1016/S0364-0213(81)80005-5.
  • Philip N. Johnson-Laird. 1983. Mental models: towards a cognitive science of language, inference, and consciousness. Cambridge, MA: Harvard University Press, 528 p.
  • Jonker, Catholijn, M. Riemsdijk, and Bas Vermeulen. 2010. Shared Mental Models: A Conceptual Analysis. https://www.researchgate.net/publication/221456658/_Shared/_Mental/_Models/_-/_A/_Conceptual/_Analysis
  • Kaber, David B., and Mica R. Endsley. 2004. “The Effects of Level of Automation and Adaptive Automation on Human Performance, Situation Awareness and Workload in a Dynamic Control Task.” Theoretical Issues in Ergonomics Science 5 (2): 113–153. doi:10.1080/1463922021000054335.
  • Kaber, David B., Jennifer M. Riley, Kheng-Wooi Tan, and Mica R. Endsley. 2001. “On the Design of Adaptive Automation for Complex Systems.” International Journal of Cognitive Ergonomics 5 (1): 37–57. doi:10.1207/S15327566IJCE0501_3.
  • Kim, S. Y., S. M. Lee, and E. N. Johnson. 2008. “Analysis of Dynamic Function Allocation between Human Operators and Automation Systems.” In in Proceedings of AIAA Modeling and Simulation Technologies Conference and Exhibit. AIAA Modeling and Simulation Technologies Conference and Exhibit, 18–21 August 2008, Honolulu, Hawaii. doi:10.2514/6.2008-6673.
  • Klimoski, Richard, and Susan Mohammed. 1994. “Team Mental Model: Construct or Metaphor?” Journal of Management 20 (2): 403–437. doi:10.1016/0149-2063(94)90021-3.
  • Knippenberg, Daan van, Carsten K. W. De Dreu, and Astrid C. Homan. 2004. “Work Group Diversity and Group Performance: An Integrative Model and Research Agenda.” The Journal of Applied Psychology 89 (6): 1008–1022. doi:10.1037/0021-9010.89.6.1008.
  • Knox, W. Bradley, and Peter Stone. 2009. “Interactively Shaping Agents via Human Reinforcement: The TAMER Framework.” In Proceedings of the Fifth International Conference on Knowledge Capture (K-CAP ‘09). Association for Computing Machinery, New York, NY, USA, 9–16. doi:10.1145/1597735.1597738.
  • Krämer, Nicole. 2010. “Psychological Research on Embodied Conversational Agents: The Case of Pedagogical Agents.” Journal of Media Psychology 22 (2): 47–51. doi:10.1027/1864-1105/a000007.
  • Lee, John D., and Katrina A. See. 2004. “Trust in Automation: Designing for Appropriate Reliance.” Human Factors 46 (1): 50–80. arXiv:. PMID: 15151155. doi:10.1518/hfes.46.1.50_30392.
  • Lewis, Kyle. 2003. “Measuring Transactive Memory Systems in the Field: Scale Development and Validation.” The Journal of Applied Psychology 88 (4): 587–604. doi:10.1037/0021-9010.88.4.587.
  • Lim, Beng-Chong, and Katherine J. Klein. 2006. “Team Mental Models and Team Performance: A Field Study of the Effects of Team Mental Model Similarity and Accuracy.” Journal of Organizational Behavior 27 (4): 403–418. doi:10.1002/job.387.
  • Lipton C. Zachary. 2018. The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery. Queue 16, 3 (May-June 2018), 31–57. doi:10.1145/3236386.3241340
  • Luo, L., N. Chakraborty, and K. Sycara. 2015. “Distributed Algorithms for Multirobot Task Assignment with Task Deadline Constraints.” IEEE Transactions on Automation Science and Engineering 12 (3): 876–888. doi:10.1109/TASE.2015.2438032.
  • Lyons, Joseph B., and Paul R. Havig. (2014). Transparency in a Human-Machine Context: Approaches for Fostering Shared Awareness/Intent. In: Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments, edited by R. Shumaker and S. Lackey, VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. doi:10.1007/978-3-319-07458-0_18
  • Marks, M. A., S. J. Zaccaro, and J. E. Mathieu. 2000. “Performance Implications of Leader Briefings and Team-Interaction Training for Team Adaptation to Novel Environments.” The Journal of Applied Psychology 85 (6): 971–986. doi:10.1037/0021-9010.85.6.971.
  • Mathieu, John E., Tonia S. Heffner, Gerald F. Goodwin, Eduardo Salas, and Janis A. Cannon-Bowers. 2000. “The Influence of Shared Mental Models on Team Process and Performance.” The Journal of Applied Psychology 85 (2): 273–283. doi:10.1037/0021-9010.85.2.273.
  • McComb, Sara A. 2007. “Mental Model Convergence: The Shift from Being an Individual to Being a Team Member.” In Multi-Level Issues in Organizations and Time, edited by Fred Dansereau and Francis J. Yammarino. Research in Multi-Level Issues, Vol. 6. Bingley: Emerald Group Publishing Limited, 95–147. doi:10.1016/S1475-9144(07)06005-5.
  • McEwan, Desmond, Geralyn R. Ruissen, Mark A. Eys, Bruno D. Zumbo, and Mark R. Beauchamp. 2017. “The Effectiveness of Teamwork Training on Teamwork Behaviors and Team Performance: A Systematic Review and Meta-Analysis of Controlled Interventions.” PloS One 12 (1): e0169604. doi:10.1371/journal.pone.0169604.
  • McVee, Mary B., Kailonnie Dunsmore, and James R. Gavelek. 2005. “Schema Theory Revisited.” Review of Educational Research 75 (4): 531–566. https://www.jstor.org/stable/3516106. doi:10.3102/00346543075004531.
  • Mehrabian, Albert. 1972. Nonverbal Communication. New York, NY: Transaction Publishers. https://doi.org/10.4324/9781351308724
  • Miller, C. 2004. “Human-Computer Etiquette: Managing Expections with Intentional Agents.” Communications of the ACM 47 (4): 31.
  • Mingyue Ma, Lanssie, Terrence Fong, Mark J. Micire, Yun Kyung Kim, and Karen Feigh. 2018. “Human-Robot Teaming: Concepts and Components for Design.” In Field and Service Robotics (Springer Proceedings in Advanced Robotics), edited by Marco Hutter and Roland Siegwart, 649–663. Cham: Springer International Publishing. doi:10.1007/978-3-319-67361-5\_42.
  • Mohammed, Susan, Richard Klimoski, and Joan R. Rentsch. 2000. “The Measurement of Team Mental Models: We Have No Shared Schema.” Organizational Research Methods 3 (2): 123–165. . Publisher: SAGE Publications Inc. doi:10.1177/109442810032001.
  • Mohammed, Susan, and Brad C. Dumville. 2001. “Team Mental Models in a Team Knowledge Framework: expanding Theory and Measurement across Disciplinary Boundaries.” Journal of Organizational Behavior 22 (2): 89–106. doi:10.1002/job.86.
  • Mohammed, Yakubu Bala, and Damla Karagozlu. 2021. “A Review of Human-Computer Interaction Design Approaches towards Information Systems Development.” Brain. Broad Research in Artificial Intelligence and Neuroscience 12 (1): 229–250. doi:10.18662/brain/12.1/180.
  • Morrison, Jeffery G., and Jonathan P. Gluckman. 1994. “Definitions and Prospective Guidelines for the Application of Adaptive Automation.” In Automation Technology and Human Performance Conference.
  • Mueller, Shane T., Robert R. Hoffman, William Clancey, Abigail Emrey, and Gary Klein. 2019. “Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI.” arXiv:1902.01876 [cs]. http://arxiv.org/abs/1902.01876. arXiv: 1902.01876.
  • Naikar, Neelam. 2005. “A Methodology for Work Domain Analysis, the First Phase of Cognitive Work Analysis.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 49 (3): 312–316. doi:10.1177/154193120504900321.
  • National Academies of Sciences Engineering and Medicine. 2022. Human-AI Teaming: State-of-the-Art and Research Needs. Washington, DC: The National Academies Press. doi:10.17226/26355.
  • Norman, Donald A. 1987. Some observations on mental models. Human-computer interaction: Amultidisciplinary approach. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 241–244. https://dl.acm.org/doi/10.5555/58076.58097
  • Orasanu, Judith. 1990. Shared Mental Models and Crew Decision Making. Princeton, NJ: Princeton University, Cognitive Science Laboratory.
  • Osman, Aznoora, Mohammad Hafiz Ismail, and Nadia Abdul Wahab. 2009. “Combinging Fisheye with List: Evaluating the Learnability and User Satisfaction,” International Conference on Computer Technology and Development, 2009, pp. 49–52. doi:10.1109/ICCTD.2009.247.
  • Parasuraman, Raja, Brian Hilburn, Robert Mol, and Indramani Singh. 1991. “Adaptive Automation and Human Performance: III. Effects of Practice on the Benefits and Costs of Automation Shifts.” Technical Report. Naval Air Warfare Center.
  • Pateria, Shubham, Budhitama Subagdja, Ah-hwee Tan, and Chai Quek. 2021. “Hierarchical Reinforcement Learning: A Comprehensive Survey.” ACM Computing Surveys 54 (5): 1–35. doi:10.1145/3453160.
  • Patrick, John, and Nic James. 2004. “Process Tracing of Complex Cognitive Work Tasks.” Journal of Occupational and Organizational Psychology 77 (2): 259–280. doi:10.1348/096317904774202171.
  • Perzanowski, Dennis, Alan Schultz, W. Adams, E. Marsh, and Magdalena Bugajska. 2001. “Building a Multimodal Human-Robot Interface.” IEEE Intelligent Systems 16 (1): 16–21. doi:10.1109/MIS.2001.1183338.
  • Plaisant, Catherine, Brett Milash, Anne Rose, Seth Widoff, and Ben Shneiderman. 1996. Lifelines: Visualizing Personal Histories, 221–227. New York, NY: ACM Press.
  • Premack, David, and Guy Woodruff. 1978. “Does the Chimpanzee Have a Theory of Mind?” Behavioral and Brain Sciences 1 (4): 515–526. doi:10.1017/S0140525X00076512.
  • Pritchett, Amy R., So Young Kim, and Karen M. Feigh. 2014. “Measuring Human-Automation Function Allocation.” Journal of Cognitive Engineering and Decision Making 8 (1): 52–77. doi:10.1177/1555343413490166.
  • Rabinowitz, Neil C., Frank Perbet, H. Francis Song, Chiyuan Zhang, S. M. Ali Eslami, and Matthew Botvinick. 2018. “Machine Theory of Mind.” arXiv:1802.07740 [cs] (March 2018). http://arxiv.org/abs/1802.07740. arXiv: 1802.07740.
  • Ramachandran, Deepak, and Eyal Amir. 2007. “Bayesian Inverse Reinforcement Learning.” In Proceedings of the 20th International Joint Conference on Artifical Intelligence (IJCAI’07). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2586–2591.
  • Rasmussen, Jens. 1979. On the Structure of Knowledge - A Morphology of Metal Models in a Man-Machine System Context. Risø National Laboratory. https://orbit.dtu.dk/en/publications/on-the-structure-of-knowledge-a-morphology-of-metal-models-in-a-m
  • Rentsch, Joan R, and Ioana R. Mot. 2012. “Elaborating Cognition in Teams: Cognitive Similarity Configurations.” In Theories of Team Cognition: Cross-Disciplinary Perspectives, 145–170. New York, NY: Routledge/Taylor & Francis Group.
  • Resick, Christian J., Marcus W. Dickson, Jacqueline K. Mitchelson, Leslie K. Allison, and Malissa A. Clark. 2010. “Team Composition, Cognition, and Effectiveness: Examining Mental Model Similarity and Accuracy.” Group Dynamics: Theory, Research, and Practice 14 (2): 174–191. doi:10.1037/a0018444.
  • Rothrock, Ling, Richard Koubek, Frederic Fuchs, Michael Haas, and Gavriel Salvendy. 2002. “Review and Reappraisal of Adaptive Interfaces: Toward Biologically Inspired Paradigms.” Theoretical Issues in Ergonomics Science 3 (1): 47–84. doi:10.1080/14639220110110342.
  • Rouse, William B. 1977. “A Theory of Human Decision Making in Stochastic Estimation Tasks.” IEEE Transactions on Systems, Man, and Cybernetics 7 (4): 274–283. doi:10.1109/TSMC.1977.4309702.
  • Rouse, William B., and Nancy M. Morris. 1986. “On Looking into the Black Box: Prospects and Limits in the Search for Mental Models.” Psychological Bulletin 100 (3): 349–363. doi:10.1037/0033-2909.100.3.349.
  • Rumelhart, D., and Andrew Ortony. 1977. “The Representation of Knowledge in Memory.” In Schooling and the Acquisition of Knowledge, edited by R. C. Anderson, R. J. Spiro, and W. E. Montague, (1st ed.). Routledge. doi:10.4324/9781315271644.
  • Russell, Stuart J., and Peter Norvig. 2020. Artificial Intelligence: A Modern Approach. 4th ed. Hoboken, NJ: Pearson. /content/one-dot-com/one-dot-com/us/en/higher-education/program.html
  • Ryan, Sharon, and Rory V. O’Connor. 2012. Social interaction, team tacit knowledge and transactive memory: empirical support for the agile approach. https://ulir.ul.ie/handle/10344/2698 Accepted: 2012-11-30T11:41:59Z.
  • Salem, Maha, Stefan Kopp, Ipke Wachsmuth, Katharina Rohlfing, and Frank Joublin. 2012. “Generation and Evaluation of Communicative Robot Gesture.” International Journal of Social Robotics 4 (2): 201–217. doi:10.1007/s12369-011-0124-9.
  • Sarter, Nadine B., and David D. Woods. 1991. “Situation Awareness: A Critical but Ill-Defined Phenomenon.” The International Journal of Aviation Psychology 1 (1): 45–57. doi:10.1207/s15327108ijap0101_4.
  • Scerbo, Mark W., Frederick G. Freeman, and Peter J. Mikulka. 2003. “A Brain-Based System for Adaptive Automation.” Theoretical Issues in Ergonomics Science 4 (1-2): 200–219. doi:10.1080/1463922021000020891.
  • Schank, Roger C, and Robert P. Abelson. 1977. Scripts, Plans, Goals and Understanding: An Inquiry into Human Knowledge Structures, 248. Oxford, England: Lawrence Erlbaum.
  • Scheutz, Matthias, Scott A. DeLoach, and Julie A. Adams. 2017. “A Framework for Developing and Using Shared Mental Models in Human-Agent Teams.” Journal of Cognitive Engineering and Decision Making 11 (3): 203–224. doi:10.1177/1555343416682891.
  • Sharp, H., Y. Rogers, and J. Preece. 2007. Interaction Design: Beyond Human-Computer Interaction. United Kingdom: Wiley. https://books.google.com/books?id=kcEZAQAAIAAJ.
  • Siemon, Dominik; Redlich, Beke; Lattemann, Christoph; and Robra-Bissantz, Susanne. 2017. “Forming Virtual Teams – Visualization with Digital Whiteboards to Increase Shared Understanding, Satisfaction and Perceived Effectiveness” ICIS 2017 Proceedings. 9. https://aisel.aisnet.org/icis2017/SocialMedia/Presentations/9
  • Singh, Ronal Rajneshwar. 2018. “Designing for Multi-Agent Collaboration: A Shared Mental Model Perspective.” https://minerva-access.unimelb.edu.au/items/5f5ea395-d150-51c7-980b-01b9321ac953
  • Sitterley, T. E. and Berge, W. A. Degradation of learned skills: Effectiveness of practice methods on simulated space flight skill retention. Seattle: The Boeing Company, Report 0180-15081-1, Prepared under NASA Contract No. NAS9-10962, 1972. https://ntrs.nasa.gov/citations/19730001426
  • Sørmo, Frode, Jörg Cassens, and Agnar Aamodt. 2005. “Explanation in Case-Based Reasoning–Perspectives and Goals.” Artificial Intelligence Review 24 (2): 109–143. doi:10.1007/s10462-005-4607-7.
  • Stein, Dan J. 1992. “Schemas in the Cognitive and Clinical Sciences: An Integrative Construct.” Journal of Psychotherapy Integration 2 (1): 45–63. doi:10.1037/h0101236.
  • Stone, Debbie, Jarrett, Caroline, Woodroffe, Mark and Minocha, Shailey 2005. User Interface Design and Evaluation. Morgan Kaufmann Series in Interactive Technologies. San Francisco: Morgan Kaufman.
  • Stout R. J., J. A. Cannon-Bowers, and E. Salas. 2017. “The role of shared mental models in developing team situational awareness: Implications for training.” In Situational Awareness, Routledge, pp. 287–318. doi:10.4324/9781315087924-18
  • Sun, Liting, Wei Zhan, and Masayoshi Tomizuka. 2018. “Probabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learning.” In 2018 21st International Conference on Intelligent Transportation Systems (ITSC), 2111–2117. doi:10.1109/ITSC.2018.8569453.
  • Sutcliffe, Alistair, and Uma Patel. 1996. “3D or Not 3D: Is It Nobler in the Mind?” In People and Computers XI, edited by Martina Angela Sasse, R. Jim Cunningham, and Russel L. Winder, 79–94. London: Springer London..
  • Sutcliffe, Alistair, Mark Ennis, and Jhen-Jia Hu. 2000. “Evaluating the Effectiveness of Visual User Interfaces for Information Retrieval.” International Journal of Human-Computer Studies 53 (5): 741–763. doi:10.1006/ijhc.2000.0416.
  • Swaab, Roderick I., Tom Postmes, Peter Neijens, Marius H. Kiers, and Adrie C. M. Dumay. 2002. “Multiparty Negotiation Support: The Role of Visualization’s Influence on the Development of Shared Mental Models.” Journal of Management Information Systems 19 (1): 129–150. doi:10.1080/07421222.2002.11045708.
  • Van Bussel, F. J. 1980. “Human Prediction of Time Series.” IEEE Transactions on Systems, Man, & Cybernetics 10 (7): 410–414. doi:10.1109/TSMC.1980.4308524.
  • Van den Bossche, Piet, Wim Gijselaers, Mien Segers, Geert Woltjer, and Paul Kirschner. 2011. “Team Learning: building Shared Mental Models.” Instructional Science 39 (3): 283–301. doi:10.1007/s11251-010-9128-3.
  • Van Heusden, Arnold R. 1980. “Human Prediction of Third-Order Autoregressive Time Series.” IEEE Transactions on Systems, Man, & Cybernetics 10 (1): 38–43. doi:10.1109/TSMC.1980.4308350.
  • Veldhuyzen, Wim, and Henk G. Stassen. 1977. “The Internal Model Concept: An Application to Modeling Human Control of Large Ships.” Human Factors: The Journal of the Human Factors and Ergonomics Society 19 (4): 367–380. doi:10.1177/001872087701900405.
  • Volz, K. 2018. “Cognitive Skill Degradation: Analysis and Evaluation in Flight Planning.” (2018)./paper/Cognitive-skill-degradation%3A-Analysis-and-in-flight-Volz/134f87f2b5e5c1ddb756a8912481d69264b1afcc, https://dr.lib.iastate.edu/entities/publication/e7516e4a-e770-433c-989c-1f7794735f2a
  • Walsh, Sarah E., and Karen M. Feigh. 2021. “Differentiating ‘Human in the Loop’ Decision Strategies.” In IEEE Conference on Systems Man and Cybernetics. Melbourn, Australia: IEEE. (virtual).
  • Wang, L., Z. Lin, H. Wang, and S. Chen. 2013. “Study on Motivation Mechanism of R D Team Creativity Based on Team Shared Mental Model.” In 2013 Proceedings of PICMET ‘13: Technology Management in the IT-Driven Services (PICMET), 635–640. ISSN: 2159–5100.
  • Webber, Sheila Simsarian, Gilad Chen, Stephanie C. Payne, Sean M. Marsh, and Stephen J. Zaccaro. 2000. “Enhancing Team Mental Model Measurement with Performance Appraisal Practices.” Organizational Research Methods 3 (4): 307–322. doi:10.1177/109442810034001.
  • Wegner, Daniel M. 1987. “Transactive Memory: A Contemporary Analysis of the Group Mind.” In Theories of Group Behavior, edited by Brian Mullen and George R. Goethals, 185–208. New York, NY: Springer. doi:10.1007/978-1-4612-4634-3\_9.
  • Wickens, Christopher D. 2008. “Situation Awareness: Review of Mica Endsley’s 1995 Articles on Situation Awareness Theory and Measurement.” Human Factors 50 (3): 397–403. doi:10.1518/001872008X288420.
  • Wood, David, Jerome S. Bruner, and Gail Ross. 1976. “The Role of Tutoring in Problem Solving.” Journal of Child Psychology and Psychiatry, and Allied Disciplines 17 (2): 89–100. doi:10.1111/j.1469-7610.1976.tb00381.x.
  • Ryunosuke Yokoya, Tetsuya Ogata, Jun Tani, Kazunori Komatani and H. G. Okuno. 2007. “Discovery of other individuals by projecting a self-model through imitation.” IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, pp. 1009–1014. doi: 10.1109/IROS.2007.4399153. https://ieeexplore.ieee.org/document/4399153
  • Yusoff, Nor’ain Mohd, and Siti Salwah Salim. 2020. Shared Mental Model Processing in Visualization Technologies: A Review of Fundamental Concepts and a Guide to Future Research in Human-Computer Interaction, Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy: 17th International Conference, EPCE 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part IJul 2020. Berlin, Heidelberg: Springer. 238–256. doi:10.1007/978-3-030-49044-7\_20.
  • Zeiler, Matthew D., and Rob Fergus. 2014. “Visualizing and Understanding Convolutional Networks.” In Computer Vision – ECCV 2014, edited by David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars, 818–833. Cham: Springer International Publishing.
  • Zhang, Yu. 2008. “Role-Based Shared Mental Models.” In 2008 International Symposium on Collaborative Technologies and Systems, 424–431. doi:10.1109/CTS.2008.4543960.
  • Ziebart, Brian D., Andrew Maas, J. Andrew Bagnell, and Anind K. Dey. 2008. Maximum Entropy Inverse Reinforcement Learning, 6. Menlo Park, California: The AAAI Press. Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.