“Is something amiss?” Investigating individuals’ competence in estimating swarm degradation

References

• Amraii, S. A., P. Walker, M. Lewis, N. Chakraborty, and K. Sycara. 2014, May. “Explicit vs. Tacit Leadership in Influencing the Behavior of Swarms.” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2209–2214. IEEE.
   Google Scholar
• Bass, E. J., and A. R. Pritchett. 2002, September. “Human-Automated Judgment Learning: A Methodology to Investigate Human Interaction with Automated Judges.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 46 (3): 362–366. doi:10.1177/154193120204600331.
   Google Scholar
• Bass, E. J., and A. R. Pritchett. 2008. “Human-Automated Judge Learning: A Methodology for Examining human Interaction with Information Analysis Automation.” IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 38 (4): 759–776. doi:10.1109/TSMCA.2008.923068.
   Web of Science ®Google Scholar
• Bates, D., M. Mächler, B. Bolker, and S. Walker. 2015. “Fitting Linear Mixed-Effects Models Using lme4.” Journal of Statistical Software 67 (1): 1–48. doi:10.18637/jss.v067.i01.
   Web of Science ®Google Scholar
• Berman, S., V. Kumar, and R. Nagpal. 2011, May. “Design of Control Policies for Spatially Inhomogeneous robot Swarms with Application to Commercial Pollination.” In 2011 IEEE International Conference on Robotics and Automation, 378–385. IEEE.
   Google Scholar
• Brambilla, M., E. Ferrante, M. Birattari, and M. Dorigo. 2013. “Swarm Robotics: A Review from the Swarm Engineering Perspective.” Swarm Intelligence 7 (1): 1–41. doi:10.1007/s11721-012-0075-2.
   Web of Science ®Google Scholar
• Capiola, A., Lyons J. B., Hamdan I., Nishimura K., Sycara K., Lewis M., Lee M. A., and Borders M. 2020, July. “The Effects of Asset Degradation on Human Trust in Swarms.” In International Conference on Human-Computer Interaction, 537–549. Cham: Springer.
   Google Scholar
• Casner, S. M., and E. L. Hutchins. 2019. “What Do We Tell the Drivers? Toward Minimum Driver Training Standards for Partially Automated Cars.” Journal of Cognitive Engineering and Decision Making 13 (2): 55–66. doi:10.1177/1555343419830901.
   Web of Science ®Google Scholar
• Choi, H., and N. Swanson. 2020. “Understanding Worker Trust in Industrial Robots for Improving Workplace Safety.” In edited by Chang S. Nam and Joseph B. Lyons. Trust Trust in Human-Robot Interaction, 123–141. Cambridge, Massachusetts: Academic Press.
   Google Scholar
• Chung, T. H. 2020, October. “DARPA OFFensive Swarm-Enabled Tactics (OFFSET): Advancing Swarm Capabilities.” Presented at the Autonomy Community of Interest Scalable Teaming of Autonomous Systems Working Group.
   Google Scholar
• Curran, P. G. 2016. “Methods for the Detection of Carelessly Invalid Responses in Survey Data.” Journal of Experimental Social Psychology 66: 4–19. doi:10.1016/j.jesp.2015.07.006.
   Web of Science ®Google Scholar
• de Visser, E. J., R. Pak, and T. H. Shaw. 2018. “From ‘Automation’ to ‘Autonomy’: The Importance of Trust Repair in Human-Machine Interaction.” Ergonomics 61 (10): 1409–1427. doi:10.1080/00140139.2018.1457725.
   PubMed Web of Science ®Google Scholar
• Endsley, M. R. 2017. “From Here to Autonomy: Lessons Learned from Human–Automation Research.” Human Factors 59 (1): 5–27. doi:10.1177/0018720816681350.
   PubMed Web of Science ®Google Scholar
• Endsley, M. R., and E. O. Kiris. 1995. “The out-of-the-Loop Performance Problem and Level of Control in Automation.” Human Factors: The Journal of the Human Factors and Ergonomics Society 37 (2): 381–394. doi:10.1518/001872095779064555.
   Web of Science ®Google Scholar
• Fox, E. L., J. W. Houpt, and P. S. Tsang. 2021. “Derivation and Demonstration of a New Metric forMultitasking Performance.” Human Factors. 63(5), 833–853. doi:10.1177/0018720820951089.
   PubMed Web of Science ®Google Scholar
• Guznov, S., A. Nelson, J. Lyons, and D. Dycus. 2015. “The Effects of Automation Reliability and Multi-Tasking on Trust and Reliance in a Simulated Unmanned System Control Task.” In HCI International 2015 - Posters’ Extended Abstracts. HCI 2015. Communications in Computer andInformation Science, Vol. 529, edited by C. Stephanidis. Cham: Springer. doi:10.1007/978-3-319-21383-5_103.
   Google Scholar
• Hamdan, I., A. Capiola, G. M. Alarcon, J. B. Lyons, K. Nishimura, K. Sycara, and M. Lewis. (2021). “Exploring the Effects of Swarm Degradations on Trustworthiness Perceptions, Reliance Intentions, and Reliance Behaviors.” In Accepted for Presentation at the Human Factors and Ergonomics Society 65th International Annual Meeting, Baltimore, MD.
   Google Scholar
• Hancock, P. 2013. “In Search of Vigilance: The Problem of Iatrogenically Created Psychological Phenomena.” The American Psychologist 68 (2): 97–109. doi:10.1037/a0030214.
   PubMed Web of Science ®Google Scholar
• Hussein, A., S. Elsawah, and H. A. Abbass. 2020. “The Reliability and Transparency Bases of Trust in Human-Swarm Interaction: Principles and Implications.” Ergonomics 63 (9): 1116–1132. doi:10.1080/00140139.2020.1764112.
   PubMed Web of Science ®Google Scholar
• Im, H. Y., S. H. Zhong, and J. Halberda. 2016. “Grouping by Proximity and the Visual Impression of Approximate Number in Random Dot Arrays.” Vision Research 126: 291–307.
   PubMed Web of Science ®Google Scholar
• Keller, D., and S. Rice. 2009. “System-Wide versus Component-Specific Trust Using Multiple Aids.” The Journal of General Psychology 137 (1): 114–128. doi:10.1080/00221300903266713.
   Web of Science ®Google Scholar
• Kolling, A., P. Walker, N. Chakraborty, K. Sycara, and M. Lewis. 2016. “Human Interaction with Robot Swarms: A Survey.” IEEE Transactions on Human-Machine Systems 46 (1): 9–26. doi:10.1109/THMS.2015.2480801.
   Web of Science ®Google Scholar
• Lee, J. D. 2001. “Emerging Challenges in Cognitive Ergonomics: Managing Swarms of Self-organizing Agent-based Automation.” Theoretical Issues in Ergonomics Science 2 (3): 238–250. doi:10.1080/14639220110104925.
   Google Scholar
• Lee, J. D., and K. A. See. 2004. “Trust in Automation: Designing for Appropriate Reliance.” HumanFactors 46 (1): 50–80.
   PubMed Web of Science ®Google Scholar
• Lenth, R., H. Singmann, J. Love, P. Buerkner, and M. Herve. 2018. “Emmeans: Estimated Marginal Means, aka Least-squares Means.” R Package Version 1 (1): 3.
   Google Scholar
• Lindstedt, J. K., and M. D. Byrne. 2018. “Simple Agglomerative Visual Grouping for ACT-R.” In Proceedings of the 16th International Conference on Cognitive Modeling, 68–73.
   Google Scholar
• Litman, L.,. J. Robinson, and T. Abberbock. 2017. “TurkPrime.com: A Versatile Crowdsourcing Data Acquisition Platform for the Behavioral Sciences.” Behavior Research Methods 49 (2): 433–442.
   PubMed Web of Science ®Google Scholar
• Liu, R., F. Jia, W. Luo, M. Chandarana, C. Nam, M. Lewis, and K. P. Sycara. 2019, May. “Trust-aware Behavior Reflection for Robot Swarm Self-healing.” In Aamas, 122–130.
   Google Scholar
• Madhavan, P., and D. A. Wiegmann. 2007. “Similarities and Differences between Human–Human and Human–Automation Trust: An Integrative Review.” Theoretical Issues in Ergonomics Science 8 (4): 277–301. doi:10.1080/14639220500337708.
   Google Scholar
• Nagavalli, S., S. Y. Chien, M. Lewis, N. Chakraborty, and K. Sycara. 2015, March. “Bounds of Neglect Benevolence in Input Timing for Human Interaction with Robotic Swarms.” In 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 197–204. IEEE.
   Google Scholar
• Nam, C., H. Li, S. Li, M. Lewis, and K. Sycara. 2018, October. “Trust of Humans in Supervisory Control of Swarm Robots with Varied Levels of Autonomy.” In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 825–830. IEEE.
   Google Scholar
• Nam, C., P. Walker, M. Lewis, and K. Sycara. 2017, August. “Predicting Trust in Human Control of Swarms via Inverse Reinforcement Learning.” In 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 528–533. IEEE.
   Google Scholar
• Parasuraman, R., and V. Riley. 1997. “Humans and Automation: Use, Misuse, Disuse, and Abuse.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39 (2): 230–253. doi:10.1518/001872097778543886.
   Web of Science ®Google Scholar
• Perugini, M., M. Gallucci, and G. Costantini. 2018. “A Practical Primer to Power Analysis for Simple Experimental Designs.” International Review of Social Psychology 31 (1): 1–23. doi:10.5334/irsp.181.
   Web of Science ®Google Scholar
• R Studio Team. 2020. RStudio: Integrated Development for R. Rstudio. Boston, MA: R. RStudio. Inc. http://www.rstudio.com/.
   Google Scholar
• Richardson, J. T. 2011. “Eta Squared and Partial Eta Squared as Measures of Effect Size in Educational Research.” Educational Research Review 6 (2): 135–147. doi:10.1016/j.edurev.2010.12.001.
   Web of Science ®Google Scholar
• Roundtree, K. A., M. A. Goodrich, and J. A. Adams. 2019. “Transparency: Transitioning from Human–Machine Systems to Human-Swarm Systems.” Journal of Cognitive Engineering and Decision Making 13 (3): 171–195. doi:10.1177/1555343419842776.
   Web of Science ®Google Scholar
• Singmann, H., B. Bolker, J. Westfall, F. Aust, and M. S. Ben-Shachar. 2015. “Afex: Analysis of Factorial Experiments.” R package version 0.13–145.
   Google Scholar
• Stürzel, F., and L. Spillmann. 2004. “Perceptual Limits of Common Fate.” Vision Research 44 (13): 1565–1573.
   PubMed Web of Science ®Google Scholar
• United States Air Force. 2019. “Science and Technology Strategy: Strengthening USAF Science and Technology for 2030 and Beyond.” (pp. 1–23). https://www.af.mil/Portals/1/documents/2019%20SAF%20story%20attachments/Air%20Force%20Science%20and%20Technology%20Strategy.pdf.
   Google Scholar
• Walker, P., S. Nunnally, M. Lewis, A. Kolling, N. Chakraborty, and K. Sycara. 2012, October. “Neglect Benevolence in Human Control of Swarms in the Presence of Latency.” In 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 3009–3014. IEEE.
   Google Scholar
• Zhang, Z., and K. H. Yuan. 2018. Practical Statistical Power Analysis Using Webpower and R. Granger, Indiana: ISDSA Press.
   Google Scholar