703
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Teaming with a Robot in Mixed Reality: Dynamics of Trust, Self-Efficacy, and Mental Models Affected by Information Richness

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon show all
Received 08 Nov 2023, Accepted 11 Mar 2024, Published online: 09 Apr 2024

References

  • Andersen, E., O’Rourke, E., Liu, Y.-E., Snider, R., Lowdermilk, J., Truong, D., Cooper, S., & Popovic, Z. (2012). The impact of tutorials on games of varying complexity. [Paper presentation]. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 59–68. https://doi.org/10.1145/2207676.2207687
  • Beggiato, M., & Krems, J. F. (2013). The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation Research Part F: Traffic Psychology and Behaviour, 18, 47–57. https://doi.org/10.1016/j.trf.2012.12.006
  • Berg, J., Lottermoser, A., Richter, C., & Reinhart, G. (2019). Human-Robot-Interaction for mobile industrial robot teams. Procedia CIRP, 79, 614–619. https://doi.org/10.1016/j.procir.2019.02.080
  • Brunner, E., & Munzel, U. (2000). The nonparametric Behrens-Fisher problem: Asymptotic theory and a small-sample approximation. Biometrical Journal, 42(1), 17–25. https://doi.org/10.1002/(SICI)1521-4036(200001)42:1<17::AID-BIMJ17>3.0.CO;2-U
  • DiMaggio, P. (1996). Are art-museum visitors different from other people? The relationship between attendance and social and political attitudes in the United States. Poetics, 24(2–4), 161–180. https://doi.org/10.1016/S0304-422X(96)00008-3
  • Durso, F. T., Rawson, K. A., & Girotto, S. (2007). Comprehension and situation awareness. In F. T. Durso, R. S. Nickerson, S. T. Dumais, S. Lewandowsky, & T. J. Perfect (Eds.), Handbook of applied cognition (pp. 163–193). John Wiley & Sons Ltd.
  • Edelmann, A., Stumper, S., Kronstorfer, R., & Petzoldt, T. (2020). Effects of user instruction on acceptance and trust in automated driving [Paper presentation]. 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), September 2020, Rhodes, Greece, 1–6. https://doi.org/10.1109/ITSC45102.2020.9294511
  • Endsley, M. R. (2000). Situation models: An avenue to the modeling of mental models. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(1), 61–64. https://doi.org/10.1177/154193120004400117
  • Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114(4), 864–886. https://doi.org/10.1037/0033-295X.114.4.864
  • Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146
  • Flick, U. (2018). An introduction to qualitative research (6th). Sage Publications Limited.
  • Flick, U., & Gaskell, G. (2000). Episodic interviewing. In M. W. Bauer (Eds.), Qualitative researching with text, image and sound (pp. 75–92). Sage. https://doi.org/10.4135/9781849209731.n5
  • Gill, M. J., Swann, W. B., & Silvera, D. H. (1998). On the genesis of confidence. Journal of Personality and Social Psychology, 75(5), 1101–1114. https://doi.org/10.1037/0022-3514.75.5.1101
  • Graetz, G., & Michaels, G. (2018). Robots at work. The Review of Economics and Statistics, 100(5), 753–768. https://doi.org/10.1162/rest_a_00754
  • Hoff, K. A., & Bashir, M. (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57(3), 407–434. https://doi.org/10.1177/0018720814547570
  • Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6(2), 65–70.
  • JASP Team. (2019). JASP. https://jasp-stats.org/
  • JOANNEUM RESEARCH Forschungsgesellschaft mbH. (2022). Mobile manipulation. Retrieved November 28, 2022, from https://www.joanneum.at/en/robotics/infrastructure/mobile-manipulation
  • Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112–133. https://doi.org/10.1177/1558689806298224
  • Kao, D., Magana, A. J., & Mousas, C. (2021). Evaluating tutorial-based instructions for controllers in virtual reality games. Proceedings of the ACM on Human-Computer Interaction, 5(CHI PLAY), 1–28. https://doi.org/10.1145/3474661
  • Kieras, D. E., & Bovair, S. (1984). The role of a mental model in learning to operate a device. Cognitive Science, 8(3), 255–273. https://doi.org/10.1207/s15516709cog0803_3
  • Kirchberg, V. (1996). Museum visitors and non-visitors in Germany: A representative survey. Poetics, 24(2–4), 239–258. https://doi.org/10.1016/S0304-422X(96)00007-1
  • Klein, G., Woods, D., Bradshaw, J., Hoffman, R., & Feltovich, P. (2004). Ten challenges for making automation a "team player" in joint human-agent activity. IEEE Intelligent Systems, 19(6), 91–95. https://doi.org/10.1109/MIS.2004.74
  • Körber, M. (2019). Theoretical considerations and development of a questionnaire to measure trust in automation [Series Title: Advances in intelligent systems and computing]. In S. Bagnara, R. Tartaglia, S. Albolino, T. Alexander, & Y. Fujita (Eds.), Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018) (pp. 13–30, Vol. 823). Springer International Publishing. https://doi.org/10.1007/978-3-319-96074-6_2
  • Körber, M., Baseler, E., & Bengler, K. (2018). Introduction matters: Manipulating trust in automation and reliance in automated driving. Applied Ergonomics, 66, 18–31. https://doi.org/10.1016/j.apergo.2017.07.006
  • Krampell, M., Solís-Marcos, I., & Hjälmdahl, M. (2020). Driving automation state-of-mind: Using training to instigate rapid mental model development. Applied Ergonomics, 83, 102986. https://doi.org/10.1016/j.apergo.2019.102986
  • Kraus, J., Scholz, D., Stiegemeier, D., & Baumann, M. (2020). The more you know: Trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency. Human Factors, 62(5), 718–736. https://doi.org/10.1177/0018720819853686
  • Kuka, D., Elias, O., Martins, R., Lindinger, C., Pramböck, A., Jalsovec, A., Maresch, P., Hörtner, H., & Brandl, P. (2009). DEEP SPACE: High resolution VR platform for multi-user interactive narratives. In I. A. Iurgel, N. Zagalo, & P. Petta (Eds.), Interactive storytelling (pp. 185–196). Springer.
  • Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46(1), 50–80. https://doi.org/10.1518/hfes.46.1.50_30392
  • Leichtmann, B., Hartung, J., Wilhelm, O., & Nitsch, V. (2023). New short scale to measure workers’ attitudes toward the implementation of cooperative robots in industrial work settings: Instrument development and exploration of attitude structure. International Journal of Social Robotics, 15(6), 909–930. https://doi.org/10.1007/s12369-023-00996-0
  • Leichtmann, B., Lottermoser, A., Berger, J., & Nitsch, V. (2022). Personal space in human-robot interaction at work: Effect of room size and working memory load. ACM Transactions on Human-Robot Interaction, 11(4), 1–19. https://doi.org/10.1145/3536167
  • Leichtmann, B., Meyer, K., & Mara, M. (2022). CoBot studio clean-up – Deep space edition: Effect of introductory information on evaluation and collaborative human-robot team performance in a mixed reality game. Open Science Framework. https://doi.org/10.17605/OSF.IO/7RKDB
  • Leichtmann, B., & Nitsch, V. (2020). How much distance do humans keep toward robots? Literature review, meta-analysis, and theoretical considerations on personal space in human-robot interaction. Journal of Environmental Psychology, 68, 101386. https://doi.org/10.1016/j.jenvp.2019.101386
  • Leichtmann, B., Nitsch, V., & Mara, M. (2022). Crisis ahead? Why human-robot interaction user studies may have replicability problems and directions for improvement. Frontiers in Robotics and AI, 9, 838116. https://doi.org/10.3389/frobt.2022.838116
  • Mara, M., Meyer, K., Heiml, M., Pichler, H., Haring, R., Krenn, B., Gross, S., Reiterer, B., Layer-Wagner, T. (2021). CoBot Studio VR: A virtual reality game environment for transdisciplinary research on interpretability and trust in human-robot collaboration. 4th International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI 2021), March 2021, Boulder, Colorado, USA. https://openreview.net/forum?id=ZlAhl-wrYqH
  • Mastandrea, S., Bartoli, G., & Bove, G. (2007). Learning through ancient art and experiencing emotions with contemporary art: Comparing visits in two different museums. Empirical Studies of the Arts, 25(2), 173–191. https://doi.org/10.2190/R784-4504-37M3-2370
  • Mastandrea, S., Bartoli, G., & Bove, G. (2009). Preferences for ancient and modern art museums: Visitor experiences and personality characteristics. Psychology of Aesthetics, Creativity, and the Arts, 3(3), 164–173. https://doi.org/10.1037/a0013142
  • Mobile Industrial Robots. (2022). Mobile robot from Mobile Industrial Robots - MiR100. Retrieved November 28, 2022, from https://www.mobile-industrial-robots.com/solutions/robots/mir100/
  • Morin, R., Léger, P.-M., Senecal, S., Bastarache-Roberge, M.-C., Lefèbrve, M., Fredette, M. (2016). The effect of game tutorial: A comparison between casual and hardcore gamers. Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY Companion '16), October 2016, New York, NY, USA, 229–237. https://doi.org/10.1145/2968120.2987730
  • Neyer, F. J., Felber, J., & Gebhardt, C. (2012). Entwicklung und Validierung einer Kurzskala zur Erfassung von Technikbereitschaft. Diagnostica, 58(2), 87–99. https://doi.org/10.1026/0012-1924/a000067
  • Phillips, E., Ososky, S., Grove, J., & Jentsch, F. (2011). From tools to teammates: Toward the development of appropriate mental models for intelligent robots. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55(1), 1491–1495. https://doi.org/10.1177/1071181311551310
  • Reiterer, B., Brandstötter, M., Mara, M., Rammer, D., Haring, R., Heiml, M., Meyer, K., Hoffmann, T., Weyrer, M., Hofbaur, M. (2023). An immersive game projection setup for studies on collaboration with a real robot. Proceedings of the Austrian Robotics Workshop (ARW’23), April 2023, Linz, Austria.
  • Robinson, N. L., Hicks, T.-N., Suddrey, G., & Kavanagh, D. J. (2020). The robot self-efficacy scale: Robot self-efficacy, likability and willingness to interact increases after a robot-delivered tutorial [Paper presentation]. 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), August 2020, Naples, Italy, 272–277. https://doi.org/10.1109/RO-MAN47096.2020.9223535
  • Rueben, M., Klow, J., Duer, M., Zimmerman, E., Piacentini, J., Browning, M., Bernieri, F. J., Grimm, C. M., & Smart, W. D. (2021). Mental models of a mobile shoe rack: Exploratory findings from a long-term in-the-wild study. ACM Transactions on Human-Robot Interaction, 10(2), 1–36. https://doi.org/10.1145/3442620
  • Scheel, A. M., Tiokhin, L., Isager, P. M., & Lakens, D. (2021). Why hypothesis testers should spend less time testing hypotheses. Perspectives on Psychological Science: a Journal of the Association for Psychological Science, 16(4), 744–755. https://doi.org/10.1177/1745691620966795
  • Schreier, M. (2014). The sage handbook of qualitative data analysis (U. Flick (Ed.)). SAGE Publications Ltd. https://doi.org/10.4135/9781446282243
  • Sciutti, A., Mara, M., Tagliasco, V., & Sandini, G. (2018). Humanizing human-robot interaction: On the importance of mutual understanding. IEEE Technology and Society Magazine, 37(1), 22–29. https://doi.org/10.1109/MTS.2018.2795095
  • St. Clair, A., & Mataric, M. (2015). How robot verbal feedback can improve team performance in human-robot task collaborations. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI’15), March 2015, New York, NY, USA, 213–220. https://doi.org/10.1145/2696454.2696491
  • Universal Robots. (2022). CB3 Family | Collaborative robots by Universal Robots. Retrieved November 28, 2022, from https://www.universal-robots.com/cb3/
  • van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., Hinne, M., Kucharský, Š., Ly, A., Marsman, M., Matzke, D., Gupta, A. R. K. N., Sarafoglou, A., Stefan, A., Voelkel, J. G., & Wagenmakers, E.-J. (2021). The JASP guidelines for conducting and reporting a Bayesian analysis. Psychonomic Bulletin & Review, 28(3), 813–826. https://doi.org/10.3758/s13423-020-01798-5
  • Wang, N., Pynadath, D. V., & Hill, S. G. (2016). Trust calibration within a human-robot team: Comparing automatically generated explanations [Paper presentation]. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), March 2016, Christchurch, New Zealand, 109–116. https://doi.org/10.1109/HRI.2016.7451741