References
- Bailey, R. E., Kramer, L. J., Kennedy, K. D., Stephens, C. L., & Etherington, T. J. (2017). An assessment of reduced crew and single pilot operations in commercial transport aircraft operations. AIAA/IEEE digital avionics systems conference - Proceedings.
- Bailey, R. W. (1982). Human performance engineering: A guide for system designers. Prentice-Hall.
- Barnes, M., Chen, J., & Jentsch, F. (2015). Designing for mixed-initiative interactions between human and autonomous systems in complex environments. Systems, Man, and Cybernetics (SMC), 2015 IEEE international conference (pp. 1386–1390).
- Bilimoria, K. D., Johnson, W. W., & Schutte, P. C. (2014). Conceptual framework for single pilot operations. Proceedings of the international conference on human-computer interaction in aerospace (pp. 1–8).
- Bottomley, P. A., Doyle, J. R., & Green, R. H. (2000). Testing the reliability of weight elicitation methods: Direct rating versus point allocation. Journal of Marketing Research, 37(4), 508–513. https://doi.org/https://doi.org/10.1509/jmkr.37.4.508.18794
- Brandt, S. L., Lachter, J., Russell, R., & Shively, R. J. (2018). A human-autonomy teaming approach for a flight-following task. In Advances in intelligent systems and computing (pp. 12–22). Cham: Springer.
- Chen, J., Barnes, M., Wright, J., Stowers, K., & Lakhmani, S. (2017). Situation awareness-based agent transparency for human-autonomy teaming effectiveness. Micro- and nanotechnology sensors, systems and applications IX. International Society for Optics and Photonics (Vol. 10194, pp. 1019–1041). Teh publisher.
- Chen, J. Y., & Barnes, M. J. (2014). Human–agent teaming for multirobot control: A review of human factors issues. IEEE Transactions on Human-Machine Systems, 44(1), 13–29. https://doi.org/https://doi.org/10.1109/THMS.2013.2293535
- Chen, J. Y., Procci, K., Boyce, M., Wright, J., Garcia, A., & Barnes, M. (2014). Situation awareness-based agent transparency (Report No. ARL-TR-6905). Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
- Comerford, D., Brandt, S. L., Lachter, J. B., Wu, S.-C., Mogford, R. H., Battiste, V., & Johnson, W. W. (2013). NASA’s Single-pilot operations technical interchange meeting. Proceedings and findings.
- Connaughton, S., & Daly, J. (2004). Identification with leader: A comparison of perceptions of identification among geographically dispersed and co-located teams. Corporate Communication: An International Journal, 9(2), 89–103. https://doi.org/https://doi.org/10.1108/13563280410534294
- Cooke, N., Gorman, J., Myers, C., & Duran, J. (2013). Interactive team cognition. Cognitive Science, 37(2), 255–285. https://doi.org/https://doi.org/10.1111/cogs.12009
- Craig, R. (1999). Communication theory as a field. Communication Theory, 9(2), 119–161. https://doi.org/https://doi.org/10.1111/j.1468-2885.1999.tb00355.x
- De Visser, E. J., Cohen, M., Freedy, A., & Parasuraman, R. (2014). A design methodology for trust cue calibration in cognitive agents. International conference on virtual, augmented and mixed reality (pp. 251–262).
- De Visser, E. J., Pak, R., & Shaw, T. H. (2018). From ‘automation’to ‘autonomy’: The importance of trust repair in human–machine interaction. Ergonomics, 61(10), 1409–1427. https://doi.org/https://doi.org/10.1080/00140139.2018.1457725
- DeChurch, L., & Mesmer-Magnus, J. (2010). The cognitive underpinnings of effective teamwork: A meta-analysis. Journal of Applied Psychology, 95(1), 32–53. https://doi.org/https://doi.org/10.1037/a0017328
- Dekker, S. W., & Woods, D. D. (2002). MABA-MABA or abracadabra? Progress on human–automation coordination. Cognition, Technology & Work, 4(4), 240–244. https://doi.org/https://doi.org/10.1007/s101110200022
- Demir, M., McNeese, N. J., & Cooke, N. J. (2017a). Team situation awareness within the context of human-autonomy teaming. Cognitive Systems Research, 46, 3–12. https://doi.org/https://doi.org/10.1016/j.cogsys.2016.11.003
- Demir, M., McNeese, N. J., & Cooke, N. J. (2017b). Team synchrony in human-autonomy teaming. International conference on applied human factors and ergonomics (pp. 303–312). Springer.
- Dorneich, M., Mathan, S., Ververs, P., Whitlow, S., & Hayes, C. (2012). Considering etiquette in the design of adaptive systems. Journal of Cognitive Engineering and Decision Making, 6(2), 243–265. https://doi.org/https://doi.org/10.1177/1555343412441001
- Dorneich, M., Olofinboba, O., Ververs, P., Winchester, W., & Krishnamurthi, S. (2002). Alerting and Notification of Conditions Outside the Aircraft (ANCOA): Integrated alerting guidelines and conceptual design. Technical Report prepared for NASA Langley Research Center under contract NAS1-00107. Honeywell Laboratories.
- Dorneich, M. C., Rogers, W., Whitlow, S. D., & DeMers, R. (2016). Human performance risks and benefits of adaptive systems on the flight deck. International Journal of Aviation Psychology, 26(1–2), 15–35. https://doi.org/http://doi.org/10.1080/10508414.2016.1226834
- Dorneich, M. C., Whitlow, S. D., Ververs, P. M., & Rogers, W. H. (2003). Mitigating cognitive bottlenecks via an augmented cognition adaptive system. IEEE international conference on systems, man and cybernetics. Conference theme-system security and assurance (Cat. No. 03CH37483) (Vol. 1, pp. 937–944).
- Endsley, M. (2015). Autonomous horizons: System autonomy in the air force - A path to the future (Autonomous Horizons No. AF/ST TR 15-01). Washington DC: Department of the Air Force Headquarters of the Air Force.
- Endsley, M. R. (1996). Automation and situation awareness. In R. Parasuraman & M. Mouloua (Eds.), Automation and Human Performance: Theory and Applications, 163–181. Mahwah, NJ: Erlbaum.
- Endsley, M. R. (2017). From here to autonomy: Lessons learned from human-automation research. Human Factors: The Journal of the Human Factors and Ergonomics Society, 59(1), 5–27. https://doi.org/https://doi.org/10.1177/0018720816681350
- Errington, J., Reising, D., & Burns, C. (2009). ASM consortium guidelines: Effective alarm management practices. ASM Consortium.
- Ezer, N., Bruni, S., Cai, Y., Hepenstal, S. J., Miller, C. A., & Schmorrow, D. D. (2019). Trust engineering for human-AI teams. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63(1), 322–326. https://doi.org/https://doi.org/10.1177/1071181319631264
- Feigh, K. M., Dorneich, M. C., & Hayes, C. C. (2012). Toward a characterization of adaptive systems A framework for researchers and system designers. Human Factors: The Journal of the Human Factors and Ergonomics Society, 54(6), 1008–1024. https://doi.org/https://doi.org/10.1177/0018720812443983
- Feigh, K. M., & Pritchett, A. R. (2014). Requirements for effective function allocation: A critical review. Journal of Cognitive Engineering and Decision Making, 8(1), 23–32. https://doi.org/https://doi.org/10.1177/1555343413490945
- Fitts, P. M., Viteles, M. S., Barr, N. L., Brimhall, D. R., Finch, G., Gardner, E., Kellum, W. E., & Stevens, S. S. (1951). Human engineering for an effective air-navigation and traffic-control system, and appendixes 1 thru 3. Tech. rep., Ohio State Univ Research Foundation Columbus.
- Frost, E. M. (2019). Creating a well-situated human-autonomy team: The effects of team structure [Doctoral Dissertation]. Wright State University.
- Goodrich, M. (2010). On maximizing fan-out: Towards controlling multiple unmanned vehicles. Human-robot interactions in future military operations (pp. 375–395).
- Goodrich, M. (2013). Multitasking and multi-robot. In J. D. Lee & A. Kirklik (Eds.), The Oxford Handbook of cognitive engineering (pp. 379). Oxford University Press.
- Gore, B. F., & Wolter, C. (2014). A task analytic process to define future concepts in aviation. International conference on digital human modeling and applications in health, safety, ergonomics and risk management (pp. 236–246).
- Gorman, J., Cooke, N., & Winner, J. (2006). Measuring team situation awareness in decentralized command and control environments. Ergonomics, 49(12–13), 1312–1325. https://doi.org/https://doi.org/10.1080/00140130600612788
- Hancock, P. A. (2017). Imposing limits on autonomous systems. Ergonomics, 60(2), 248–291. https://doi.org/https://doi.org/10.1080/00140139.2016.1190035
- Hardin, B., & Goodrich, M. (2009). On using mixed-initiative control: A perspective for managing large-scale robotic teams. Proceedings of the 4th ACM/IEEE international conference on Human robot interaction.
- Hart, S., & Staveland, L. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139–183. https://doi.org/https://doi.org/10.1016/S0166-4115(08)62386-9
- Hayes, C., & Miller, C. (2010). Human-computer etiquette: cultural expectations and the design implications they place on computers and technology. Taylor & Francis.
- Hinds, P., Roberts, T., & Jones, H. (2004). Whose job is it anyway? A study of human-robot interaction in a collaborative task. In Human-computer interaction (pp. 151–181). Lawrence Erlbaum Associates, Inc.
- Hoc, J. M. (2000). From human-machine interaction to human-machine cooperation. Ergonomics, 43(7), 833–843. https://doi.org/https://doi.org/10.1080/001401300409044
- Hockey, G., Åkerstedt, T., Gaillard, A., Manzey, D., Mulder, L., Pattyn, N., & Tattersall, A. (2011). Human performance in extended space operations. Report of ESA Topical Team in Psychology.
- Hollnagel, E., & Woods, D. D. (1983). Cognitive systems engineering: New wine in new bottles. International Journal of Man-machine Studies, 18(6), 583–600. https://doi.org/https://doi.org/10.1016/S0020-7373(83)80034-0
- Israelsen, B. W., & Ahmed, N. R. (2019). “Dave … I can assure you … that it’s going to be all right … ” A definition, case for, and survey of algorithmic assurances in human-autonomy trust relationships. ACM Computing Surveys (CSUR), 51(6), 1–37. https://doi.org/https://doi.org/10.1145/3267338
- Klein, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J. (2004). Ten challenges for making automation a” team player” in joint human-agent activity. IEEE Intelligent Systems, 19(6), 91–95. https://doi.org/https://doi.org/10.1109/MIS.2004.74
- Klimoski, R., & Mohammed, S. (1994). Shared mental model: Construct or metaphor? Journal of Management, 20(2), 403–437. https://doi.org/https://doi.org/10.1177/014920639402000206
- Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46(1), 50–80. https://doi.org/https://doi.org/10.1518/hfes.46.1.50.30392
- LePine, J., Piccolo, R., Jackson, C., Mathieu, J., & Saul, J. (2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personel Psychology, 61(2), 273–307. https://doi.org/https://doi.org/10.1111/j.1744-6570.2008.00114.x
- Marks, M., Mathieu, J., & Zaccaro, S. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26(3), 356–376. https://doi.org/https://doi.org/10.5465/amr.2001.4845785
- Mathieu, J., Maynard, M., Rapp, T., & Gilson, L. (2008). Team effectiveness 1997–2007: A review of recent advancements and a glimpse into the future. Journal of Management, 34(3), 410–476. https://doi.org/https://doi.org/10.1177/0149206308316061
- McDermott, P., Dominguez, C., Kasdaglis, N., Ryan, M., Trahan, I., & Nelson, A. (2018). Human-machine teaming systems engineering guide. MITRE.
- McNeese, N. J., Demir, M., Cooke, N. J., & Myers, C. (2018). Teaming with a synthetic teammate: Insights into human-autonomy teaming. Human Factors: The Journal of the Human Factors and Ergonomics Society, 60(2), 262–273. https://doi.org/https://doi.org/10.1177/0018720817743223
- Mercado, J. E., Rupp, M. A., Chen, J. Y., Barnes, M. J., Barber, D., & Procci, K. (2016). Intelligent agent transparency in human–agent teaming for Multi-UxV management. Human Factors: The Journal of the Human Factors and Ergonomics Society, 58(3), 401–415. https://doi.org/https://doi.org/10.1177/0018720815621206
- Miller, C., Funk, H., Goldman, R., & Wu, P. (2004). A ‘Playbook’for variable autonomy control of multiple, heterogeneous unmanned air vehicles. Human performance, situation awareness, and automation (pp. 210–214).
- Miller, C., Goldman, R., Funk, H., Wu, P., & Pate, B. (2004). A playbook approach to variable autonomy control: Application for control of multiple, heterogeneous unmanned air vehicles. Proceedings of FORUM 60, the annual meeting of the american helicopter society (pp. 7–10).
- Miller, C., Pelican, M., & Goldman, R. (2000). ‘Tasking’interfaces for flexible interaction with automation: Keeping the operator in control. Proceedings of the conference on human interaction with complex systems (pp. 123–128).
- Miller, C. A., Funk, H., Wu, P., Goldman, R., Meisner, J., & Chapman, M. (2005). The playbook approach to adaptive automation. Proceedings of the human factors and ergonomics society annual meeting (pp. 15–19). SAGE Publications.
- Miller, C. A., Funk, H. B., Dorneich, M., & Whitlow, S. D. (2002). A playbook interface for mixed initiative control of multiple unmanned vehicle teams. 21st digital avionics systems conference (Vol. 2, pp. 7E4–7E4). IEEE.
- Miller, C. A., & Parasuraman, R. (2007). Designing for flexible interaction between humans and automation: Delegation interfaces for supervisory control. Human Factors: The Journal of the Human Factors and Ergonomics Society, 49(1), 57–75. https://doi.org/https://doi.org/10.1518/001872007779598037
- Nass, C. (2004). Etiquette equality: Exhibitions and expectations of computer politeness. Communications of the Association for Computing Machinery, 47(4), 35–37. https://doi.org/https://doi.org/10.1145/975817.975841
- Nass, C., Steuer, J., & Tauber, E. (1994). Computers are social actors. Proceedings of the SIGCHI conference on human factors in computing systems (pp. 72–78). ACM.
- Neogi, N. A. (2016). Capturing safety requirements to enable effective task allocation between humans and automaton in increasingly autonomous systems. 16th AIAA aviation technology, integration, and operations conference (pp. 3594).
- Norman, D. A., & Shallice, T. (1986). Attention to action: Willed and automatic control of behavior. In R. Davidson, G. Schwartz, & D. Shapiro (Eds.), Consciousness and self-regulation (Vol. 4, pp. 1–18). Boston, MA: Springer.
- Norman, D. A. (1990). The ‘problem’with automation: Inappropriate feedback and interaction, not ‘over-automation’. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 327(1241), 585–593. https://doi.org/https://doi.org/10.1098/rstb.1990.0101
- Oppermann, R. (1994). Adaptive user support: Ergonomic design of manually and automatically adaptable software. CRC Press.
- Panganiban, A. R., Matthews, G., & Long, M. D. (2020). Transparency in autonomous teammates: Intention to support as teaming information. Journal of Cognitive Engineering and Decision Making, 14(2), 174–190. https://doi.org/https://doi.org/10.1177/1555343419881563
- Parasuraman, R., & Miller, C. (2004). Trust and etiquette in high-criticality automated systems. Communications of the Association for Computing Machinery, 47(4), 51–55. https://doi.org/https://doi.org/10.1145/975817.975844
- Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors: The Journal of the Human Factors and Ergonomics Society, 39(2), 230–253. https://doi.org/https://doi.org/10.1518/001872097778543886
- Parasuraman, R., Sheridan, T., & Wickens, C. (2008). Situational awareness, mental workload and trust in automation: Viable, empirically supported cognitive engineering constructs. Journal of Cognitive Engineering and Decision Making, 2(2), 140–160. https://doi.org/https://doi.org/10.1518/155534308X284417
- Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A model for types and levels of human interaction with automation. IEEE transactions on systems, man, and cybernetics-part A: Systems and humans (pp. 286–297).
- Patel, J., Dorneich, M., Mott, D., Bahrami, A., & Giammanco, C. (2013). Improving coalition planning by making plans alive. IEEE Transactions on Intelligent Systems, 28(1), 17–25. https://doi.org/https://doi.org/10.1109/MIS.2012.88
- Price, H. (1985). The allocation of functions in systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 27(1), 33–45. https://doi.org/https://doi.org/10.1177/001872088502700104
- Rico, R., Sánchez-Manzanares, M., Gil, F., & Gibson, C. (2008). Team implicit coordination processes: A team knowledge-based approach. Academy of Management Review, 33(1), 163–184. https://doi.org/https://doi.org/10.5465/amr.2008.27751276
- Salas, E., Shuffler, M., Thayer, A., Bedwell, W., & Lazzara, E. (2015). Understanding and improving teamwork in organizations: A scientifically based practical guide. Human Resource Management, 54(4), 599–622. https://doi.org/https://doi.org/10.1002/hrm.21628
- Salas, E., Sims, D., & Burke, C. (2005). Is there a “big five” in teamwork? Small group research.
- Sarter, N. B., Woods, D. D., & Billings, C. E. (1997). Automation surprises. In Salvendy, G. (Ed.), Handbook of human factors and ergonomics (pp. 1926–1943).
- Shively, R. J., Brandt, S. L., Lachter, J., Matessa, M., Sadler, G., & Battiste, H. (2016). Application of Human-Autonomy Teaming (HAT) Patterns to Reduced Crew Operations (RCO). International conference on engineering psychology and cognitive ergonomics (pp. 244–255).
- Shively, R. J., Lachter, J., Brandt, S. L., Matessa, M., Battiste, V., & Johnson, W. W. (2017). Why human-autonomy teaming? International conference on applied human factors and ergonomics (pp. 3–11).
- Smith, P. J., McCoy, C. E., & Layton, C. (1997). Brittleness in the design of cooperative problem-solving systems: The effects on user performance. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 27(3), 360–371. https://doi.org/https://doi.org/10.1109/3468.568744
- Stewart, G. (2006). A meta-analytic review of relationships between team design features and team performance. Journal of Management, 32(1), 29–54. https://doi.org/https://doi.org/10.1177/0149206305277792
- Tenney, Y. J., Rogers, W. H., & Pew, R. W. (1995). Pilot opinions on high level flight deck automation issues: Toward the development of a design philosophy. Contractor Report 4669. NASA Langley Research Center.
- Tokadlı, G., & Dorneich, M. (2019). Interaction paradigms: From human-human teaming to human-autonomy teaming. Digital Avionics Systems Conference (DASC) (pp. 8–12), San Diego, CA.
- Tokadlı, G., Dorneich, M., & Gonzales-Torres, T. (2018). Preliminary guidelines for human-agent teams in space operations beyond low earth orbit. In 2018 IEEE/AIAA 37th Digital Avionics Systems Conference (DASC) (pp. 1–9). IEEE.
- Tokadlı, G., Dorneich, M., & Matessa, M. (in review). Towards human-autonomy teaming in reduced crew and single pilot operations: Domain analysis and requirements. Journal of Air Transportation.
- USAF. (2013). Autonomy science and technology strategy, US Air Force Research Lab. Dayton, OH.
- Vagia, M., Transeth, A. A., & Fjerdingen, S. A. (2016). A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed? Applied Ergonomics, 53(Part A), 190–202. https://doi.org/https://doi.org/10.1016/j.apergo.2015.09.013
- Volz, K., Yang, E., Dudley, R., Lynch, E., Dropps, M., & Dorneich, M. C. (2016). An evaluation of cognitive skill degradation in information automation. Proceedings of the human factors and ergonomics society. https://doi.org/http://doi.org/10.1177/1541931213601043.
- Vu, K.-P. L., Lachter, J., Battiste, V., & Strybel, T. Z. (2018). Single pilot operations in domestic commercial aviation. Human Factors: The Journal of the Human Factors and Ergonomics Society, 60(6), 755–762. https://doi.org/https://doi.org/10.1177/0018720818791372
- Walker, P., Miller, C., Mueller, J., Sycara, K., & Lewis, M. (2019). A Playbook-Based Interface for Human Control of Swarms. In Mouloua, M., & Hancock, P. A. (Eds.), Human Performance in Automated and Autonomous Systems: Emerging Issues and Practical Perspectives. https://doi.org/https://doi.org/10.1201/9780429458323-4
- Walliser, J. C., De Visser, E. J., Wiese, E., & Shaw, T. H. (2019). Team structure and team building improve human–Machine teaming with autonomous agents. Journal of Cognitive Engineering and Decision Making, 13(4), 258–278. https://doi.org/https://doi.org/10.1177/1555343419867563
- Whitlow, S. D., Dorneich, M. C., Funk, H. B., & Miller, C. A. (2002). Providing appropriate situation awareness within a mixed-initiative control system. IEEE international conference on systems, man and cybernetics (Vol. 5, pp. 5–9).
- Wiener, E., Kanki, B., & Helmreich, R. (1993). Cockpit resource management. Academic Press.
- Wildman, J., Thayer, A., Pavlas, D., Salas, E., Stewart, J., & Howse, W. (2012). Team knowledge research: Emerging trends and critical needs. Human Factors: The Journal of the Human Factors and Ergonomics Society, 54(1), 84–111. https://doi.org/https://doi.org/10.1177/0018720811425365
- Woods, D. D. (1995). The alarm problem and directed attention in dynamic fault management. Ergonomics, 38(11), 2371–2393. https://doi.org/https://doi.org/10.1080/00140139508925274
- Woods, D. D. (2016). The risks of autonomy. Journal of Cognitive Engineering and Decision Making, 10(2), 131–133. https://doi.org/https://doi.org/10.1177/1555343416653562
- Yang, E., & Dorneich, M. (2018). Affect-aware adaptive tutoring based on human-automation etiquette strategies. Human Factors: The Journal of the Human Factors and Ergonomics Society, 60(4), 510–526. https://doi.org/https://doi.org/10.1177/0018720818765266