Misalignment in Semantic User Model Elicitation via Conversational Agents: A Case Study in Navigation Support for Visually Impaired People

References

• Abdulrahman, A., Richards, D., Ranjbartabar, H., & Mascarenhas, S. (2019). Belief-based agent explanations to encourage behaviour change. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents. ACM (Association for Computing Machinery New York United States). https://doi.org/10.1145/3308532.3329444
   Google Scholar
• Ahmetovic, D., Guerreiro, J., Ohn-Bar, E., Kitani, K. M., & Asakawa, C. (2019). Impact of expertise on interaction preferences for navigation assistance of visually impaired individuals [Paper presentation]. Proceedings of the 16th International Web for All Conference. ACM (Association for Computing Machinery New York United States). https://doi.org/10.1145/3315002.3317561
   Google Scholar
• Azenkot, S., & Lee, N. B. (2013). Exploring the use of speech input by blind people on mobile devices. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, n (pp. 11:1–11:8). New York, NY, USA: ACM. https://doi.org/10.1145/2513383.2513440
   Google Scholar
• Azenkot, S., Prasain, S., Borning, A., Fortuna, E., Ladner, R. E., & Wobbrock, J. O. (2011). Enhancing independence and safety for blind and deaf-blind public transit riders. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 3247–3256). ACM (Association for Computing Machinery New York United States). https://doi.org/10.1145/1978942.1979424
   Google Scholar
• Balata, J., Mikovec, Z., & Slavik, P. (2018). Conversational agents for physical world navigation. In Studies in Conversational UX Design (pp. 61–83). Springer.
   Google Scholar
• Bangor, A., Kortum, P., & Miller, J. (2008). The system usability scale (sus): An empirical evaluation. International Journal of Human-Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
   Web of Science ®Google Scholar
• Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual sus scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123. https://doi.org/10.5555/2835587.2835589
   Google Scholar
• Berka, J. J., Balata, J. J., Jonker, C. C., Mikovec, Z. Z., Riemsdijk, v., & Tielman, M. (2020). Sep Additional files belonging to the paper: Misalignment in user model elicitation via conversational agents. 4TU.ResearchData. Retrieved from https://doi.org/10.4121/12901496.v1
   Google Scholar
• Brachman, R., & Levesque, H. (2004). Knowledge representation and reasoning. Morgan Kaufmann.
   Google Scholar
• Brooke, J. (1996). Sus: A” quick and dirty” usability scale. In P. Jordan, B. Thomas, I. McClelland, & B. Weerdmeester (Eds.), (p. 189–194). Taylor & Francis.
   Google Scholar
• Bujacz, M., Baranski, P., Moranski, M., Strumillo, P., & Materka, A. (2008). Remote guidance for the blind – A proposed teleassistance system and navigation trials. In HSI 2008 (pp 888–892). IEEE.
   Google Scholar
• Campbell, N, S. I. Hunyadi L. (2020). The temporal structure of multimodal communication. intelligent systems reference library. In (Ed.), (p. vol 164). Springer.
   Google Scholar
• Converse, S. A., Cannon-Bowers, J. A., Salas, E. (1991). Team member shared mental models: A theory and some methodological issues. In Proceedings of the Human Factors Society 35th Annual Meeting, (p. 1417–1421). SAGE Publishing.
   Google Scholar
• Cranefield, S., Winikoff, M., Dignum, V., & Dignum, F. (2017). No pizza for you: Value-based plan selection in BDI agents. In International Joint Conference on Artificial Intelligence.
   Google Scholar
• Dignum, V. (2017). Responsible autonomy. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (p. 4698–4704). AAAI Press.
   Google Scholar
• Emarketer (2017). May). Alexa, Say What?! Voice-Enabled Speaker Usage to Grow Nearly 130% This Year. Retrieved from https://www.emarketer.com/
   Google Scholar
• Esfandiari-Baiat, G., Hunyadi, L., & Esposito, A, S. I. Hunyadi L. (2020). The temporal structure of multimodal communication. Intelligent systems reference library. In (Ed.), (p. vol 164). Springer.
   Google Scholar
• Fan, X., & Yen, J. (2010). Modeling cognitive loads for evolving shared mental models in human–agent collaboration. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 41(2), 354–367. https://doi.org/10.1109/TSMCB.2010.2053705
   PubMed Web of Science ®Google Scholar
• Faria, J., Lopes, S., Fernandes, H., Martins, P., & Barroso, J. (2010). Electronic white cane for blind people navigation assistance. In WAC 2010 (pp. 1–7). IEEE.
   Google Scholar
• Faulkner, T. K., Niekum, S., & Thomaz, A. (2018). Asking for Help Effectively via Modeling of Human Beliefs. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. ACM (Association for Computing Machinery New York United States).
   Google Scholar
• Friedman, B., Jr., P, H. K., & Borning, A. (2006). Human-computer interaction and management information systems: Foundations advances in management information systems, volume 5 (advances in management information systems). In P. Zhang & D. Galletta (Eds.), (p. 348–372). M.E. Sharpe.
   Google Scholar
• Georgiou, T., & Demiris, Y. (2017). Adaptive user modelling in car racing games using behavioural and physiological data. User Modeling and User-Adapted Interaction, 27(2), 267–311. https://doi.org/10.1007/s11257-017-9192-3
   PubMed Web of Science ®Google Scholar
• Golledge, R. G. (1993). Geography and the disabled: A survey with special reference to vision impaired and blind populations. Transactions of the Institute of British Geographers, 18(1), 63–85. https://doi.org/10.2307/623069
   Web of Science ®Google Scholar
• Golledge, R. G. (1999). Wayfinding behavior: Cognitive mapping and other spatial processes. JHU press.
   Google Scholar
• Guerreiro, J., Ohn-Bar, E., Ahmetovic, D., Kitani, K., & Asakawa, C. (2018). How context and user behavior affect indoor navigation assistance for blind people. In Proceedings of the Internet of Accessible Things (p. 2). ACM (Association for Computing Machinery New York United States). https://doi.org/10.1145/3192714.3192829
   Google Scholar
• Haller, H., Nguyen, V.-B., Debizet, G., Laurillau, Y., Coutaz, J., & Calvary, G. (2017). Energy consumption in smarthome: Persuasive interaction respecting user’s values. In The 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications. IEEE.
   Google Scholar
• Harbers, M. (2011). [Explaining agent behavior in virtual training]. [Unpublished doctoral dissertation].
   Google Scholar
• IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems (2017). Ethically Aligned Design – A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems, Version 2. The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. Retrieved from https://ethicsinaction.ieee.org/
   Google Scholar
• Kayal, A., Brinkman, W.-P., Neerincx, M. A., & Riemsdijk, M. B. V. (2018). Automatic resolution of normative conflicts in supportive technology based on user values. ACM Transactions on Internet Technology, 18(4), 1–41:21. https://doi.org/10.1145/3158371
   Web of Science ®Google Scholar
• Kließ, M. S., Stoelinga, M., & Riemsdijk, v. (2019). From good intentions to behaviour change: Probabilistic feature diagrams for behaviour support agents. In PRIMA 2019: Principles and Practice of Multi-Agent Systems. (pp. 354–369). Springer International Publishing.
   Google Scholar
• Laranjo, L., Dunn, A., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A., & Coiera, E. (2018). Conversational agents in healthcare: A systematic review. Journal of the American Medical Informatics Association, 25(9), 1248–1258. https://doi.org/10.1093/jamia/ocy072
   PubMed Web of Science ®Google Scholar
• Lüttich, K., Mossakowski, T., Krieg-Brückner, B. (2004). Ontologies for the semantic web in Casl. In Recent Trends in Algebraic Development Techniques, 17th International Workshop (WADT’04) (Vol. 3423, pp. 106–125). Springer.
   Google Scholar
• Menekse, M., Purzer, S., & Heo, D. (2019). An investigation of verbal episodes that relate to individual and team performance in engineering student teams. International Journal of STEM Education, 6(6). https://doi.org/10.1186/s40594-019-0160-9
   Google Scholar
• Nam, C. S., Li, Y., Yamaguchi, T., & Smith-Jackson, T. L. (2012). Haptic user interfaces for the visually impaired: Implications for haptically enhanced science learning systems. International Journal of Human-Computer Interaction, 28(12), 784–798. https://doi.org/10.1080/10447318.2012.661357
   Web of Science ®Google Scholar
• Ohn-Bar, E., Guerreiro, J., Kitani, K., & Asakawa, C. (2018). Variability in reactions to instructional guidance during smartphone-based assisted navigation of blind users. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(3), 1–25. https://doi.org/10.1145/3264941
   Google Scholar
• Palani, H. P., Fink, P. D. S., & Giudice, N. A. (2020). Design guidelines for schematizing and rendering haptically perceivable graphical elements on touchscreen devices. International Journal of Human–Computer Interaction, 36(15), 1393–1414. https://doi.org/10.1080/10447318.2020.1752464
   Web of Science ®Google Scholar
• Palanica, A., Thommandram, A., & Fossat, Y. (2019). Adult verbal comprehension performance is better from human speakers than social robots, but only for easy questions. International Journal of Social Robotics, 11(2), 359–369. https://doi.org/10.1007/s12369-018-0504-5
   Web of Science ®Google Scholar
• Pasotti, P., Jonker, C. M., & Riemsdijk, v. (2017). Action identification hierarchies for behaviour support agents. In Workshop on Cognitive Knowledge Acquisition and Applications.
   Google Scholar
• Pasotti, P., Riemsdijk, v., & Jonker, C. M. (2016). Representing human habits: towards a habit support agent. In European Conference on Artificial Intelligence. ResearchGate.
   Google Scholar
• Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018). Voice interfaces in everyday life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, (pp. 640:1–640:12). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3173574.3174214
   Google Scholar
• Scheutz, M., DeLoach, S. A., & Adams, J. A. (2017). A framework for developing and using shared mental models in human-agent teams. Journal of Cognitive Engineering and Decision Making, 11(3), 203–224. https://doi.org/10.1177/1555343416682891
   Web of Science ®Google Scholar
• Schwartz, S. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. Advances in Experimental Social Psychology, 25, 1–65. https://doi.org/10.1016/S0065-2601(08)60281-6
   Web of Science ®Google Scholar
• Sciuto, A., Saini, A., Forlizzi, J., & Hong, J. I. (2018). In Proceedings of the 2018 Designing Interactive Systems Conference).” hey alexa, what’s up?”: A mixed-methods studies of in-home conversational agent usage (pp. 857–868). New York, NY, USA: ACM. Retrieved from 10.1145/3196709.3196772
   Google Scholar
• Serramia, M., Lopez-Sanchez, M., Rodriguez-Aguilar, J. A., Rodriguez, M., Wooldridge, M., & Morales, J. (2018). Moral values in norm decision making. In International Conference on Autonomous Agents and Multiagent Systems. ACM (Association for Computing Machinery New York United States).
   Google Scholar
• Stephanidis, C., Salvendy, G., Antona, M., Chen, J., Dong, J., Duffy, V., Fang, X., Fidopiastis, C., Fragomeni, G., Fu, L. P., Guo, Y., Harris, D., Ioannou, A., Jeong, K-a (., Konomi, S., Krömker, H., Kurosu, M., Lewis, J., Marcus, A., … Zhou, J. (2019). Seven HCI grand challenges. International Journal of Human–Computer Interaction, 35(14), 1229–1269. https://doi.org/10.1080/10447318.2019.1619259
   Web of Science ®Google Scholar
• Tielman, M., Jonker, C., & Riemsdijk, v. (2018). What should I do? Deriving norms from action, values and context. In MRC – Tenth International Workshop Modelling and Reasoning in Context, Held at FAIM. CEUR Workshop Proceedings.
   Google Scholar
• Tuttle, D. W., & Tuttle, N. R. (2004). Self-esteem and adjusting with blindness: The process of responding to life’s demands. Charles C Thomas Publisher.
   Google Scholar
• van de Poel, v d. (2013). Translating values into design requirements. In D. P. Michelfelder, N. McCarthy, & D. E. Goldberg (Eds.), (chap. Philosophy and engineering: Reflections on practice, principles and process). Springer.
   Google Scholar
• van de Poel, v d., et al. (2015). Handbook of ethics, values and technological design. In J. van den Hoven (Ed.) (p. 89–115). Springer.
   Google Scholar
• van Riemsdijk, v., Jonker, C. M., & Lesser, V. (2015). Creating Socially Adaptive Electronic Partners. In International Conference on Autonomous Agents and Multiagent Systems. ACM (Association for Computing Machinery New York United States).
   Google Scholar
• Verhagen, R., Neerincx, M., & Tielman, M. (2021). A two-dimensional explanation framework to classify ai as incomprehensible, interpretable, or understandable. In ExtrAAMAS. Springer's Lecture Notes in Computer Science.
   Google Scholar
• Völkel, T., & Weber, G. (2008). The 10th International ACM SIGACCESS Conference. Routecheckr: personalized multicriteria routing for mobility impaired pedestrians. In Proceedings of on Computers and accessibility (pp. 185–192). ACM (Association for Computing Machinery New York United States).
   Google Scholar
• Vtyurina, A. (2019). Towards non-visual web search. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (pp. 429–432). New York, NY, USA: ACM.
   Google Scholar
• Wald, M. (2020). Ai data-driven personalisation and disability inclusion. Frontiers in Artificial Intelligence, 3, 571955. https://doi.org/10.3389/frai.2020.571955
   PubMedGoogle Scholar
• White, R. W., & Grant, P. (2009). Designing a visible city for visually impaired users. Proceedings of the 2009 International Conference on Inclusive Design. Royal College of Art, London, England.
   Google Scholar
• WHO (2009). ICD update and revision platform: change the definition of blindness. Retrieved from http://www.who.int/blindness/ChangetheDefinitionofBlindness.pdf
   Google Scholar
• Wycherley, R. J., & Nicklin, B. H. (1970). The heart rate of blind and sighted pedestrians on a town route. Ergonomics, 13(2), 181–192. https://doi.org/10.1080/00140137008931131
   PubMed Web of Science ®Google Scholar
• Yamaoka, M., Hara, S., & Abe, M. (2015). 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), Dec). A spoken dialog system with redundant response to prevent user misunderstanding. In (p. 223–226). https://doi.org/10.1109/APSIPA.2015.7415511
   Google Scholar