‘I do not know’: an examination of reactions to virtual agents that fail to answer the user’s questions

References

• Akhtar, M., J. Neidhardt, and H. Werthner 2019. The Potential of Chatbots: Analysis of Chatbot Conversations. In: 2019 IEEE 21st Conference on Business Informatics (CBI), Moscow, 1, 397–404.
   Google Scholar
• Alba, J. W., and E. F. Williams. 2013. “Pleasure Principles: A Review of Research on Hedonic Consumption.” Journal of Consumer Psychology 23 (1): 2–18. https://doi.org/10.1016/j.jcps.2012.07.003.
   Web of Science ®Google Scholar
• Barasch, A., E. E. Levine, and M. E. Schweitzer. 2016. “Bliss is Ignorance: How the Magnitude of Expressed Happiness Influences Perceived naiveté and Interpersonal Exploitation.” Organizational Behavior and Human Decision Processes 137 (November): 184–206. https://doi.org/10.1016/j.obhdp.2016.05.006.
   Google Scholar
• Baumgarten, N., and J. House. 2010. “I Think and I Don’t Know in English as Lingua Franca and Native English Discourse.” Journal of Pragmatics 42 (5): 1184–1200. https://doi.org/10.1016/j.pragma.2009.09.018.
   Web of Science ®Google Scholar
• Baylor, A. L., and S. Kim. 2009. “Designing Nonverbal Communication for Pedagogical Agents: When Less is More.” Computers in Human Behavior 25 (2): 450–457. https://doi.org/10.1016/j.chb.2008.10.008.
   Web of Science ®Google Scholar
• Beach, W. A., and T. R. Metzger. 1997. “Claiming Insufficient Knowledge.” Human Communication Research 23 (4): 562–588. https://doi.org/10.1111/j.1468-2958.1997.tb00410.x.
   Web of Science ®Google Scholar
• Bergmann, K., F. Eyssel, and S. Kopp2012. A Second Chance to Make a First Impression? How Appearance and Nonverbal Behavior Affect Perceived Warmth and Competence of Virtual Agents Over Time. In: International Conference on Intelligent Virtual Agents, Springer, Berlin, 126–138.
   Google Scholar
• Blut, M., N. Chowdhry, V. Mittal, and C. Brock. 2015. “E-Service Quality: A Meta-Analytic Review.” Journal of Retailing 91 (4): 679–700. https://doi.org/10.1016/j.jretai.2015.05.004.
   Web of Science ®Google Scholar
• Botschen, G., E. M. Thelen, and R. Pieters. 1999. “Using Means‐End Structures for Benefit Segmentation: An Application to Services.” European Journal of Marketing 33 (1/2): 38–58. https://doi.org/10.1108/EUM0000000004491.
   Google Scholar
• Broadbent, E. 2017. “Interactions with Robots: The Truths We Reveal About Ourselves.” Annual Review of Psychology 68 (1): 627–652. https://doi.org/10.1146/annurev-psych-010416-043958.
   PubMedGoogle Scholar
• Bromuri, S., A. P. Henkel, D. Iren, and V. Urovi. 2020. “Using AI to Predict Service Agent Stress from Emotion Patterns in Service Interactions.” Journal of Service Management 32 (4): 581–611. https://doi.org/10.1108/JOSM-06-2019-0163.
   Web of Science ®Google Scholar
• Bull, P., and K. Mayer. 1993. “How Not to Answer Questions in Political Interviews.” Political Psychology 14 (4): 651–666. https://doi.org/10.2307/3791379.
   Web of Science ®Google Scholar
• Cappuccio, M. L., E. B. Sandoval, O. Mubin, M. Obaid, and M. Velonaki. 2021. “Can Robots Make Us Better Humans?” International Journal of Social Robotics 13 (1): 7–22. https://doi.org/10.1007/s12369-020-00700-6.
   Web of Science ®Google Scholar
• Chahal, H., and P. Devi. 2013. “Identifying Satisfied/Dissatisfied Service Encounters in Higher Education.” Quality Assurance in Education 21 (2): 211–222. https://doi.org/10.1108/09684881311310728.
   Google Scholar
• Chattaraman, V., W. S. Kwon, J. E. Gilbert, and K. Ross. 2019. “Should AI-Based, Conversational Digital Assistants Employ Social-Or Task-Oriented Interaction Style? A Task-Competency and Reciprocity Perspective for Older Adults.” Computers in Human Behavior 90 (January): 315–330. https://doi.org/10.1016/j.chb.2018.08.048.
   Google Scholar
• Chaves, A. P., and M. A. Gerosa. 2021. “How Should My Chatbot Interact? A Survey on Social Characteristics in Human–Chatbot Interaction Design.” International Journal of Human–Computer Interaction 37 (8): 729–758. https://doi.org/10.1080/10447318.2020.1841438.
   Web of Science ®Google Scholar
• Chen, Q. Q., and H. J. Park. 2021. “How Anthropomorphism Affects Trust in Intelligent Personal Assistants.” Industrial Management & Data Systems 121 (12): 2722–2732. https://doi.org/10.1108/IMDS-12-2020-0761.
   Web of Science ®Google Scholar
• Choi, Y., M. Choi, M. Oh, and S. Kim. 2020. “Service Robots in Hotels: Understanding the Service Quality Perceptions of Human-Robot Interaction.” Journal of Hospitality Marketing & Management 29 (6): 613–635. https://doi.org/10.1080/19368623.2020.1703871.
   Web of Science ®Google Scholar
• Crolic, C., F. Thomaz, R. Hadi, and A. T. Stephen. 2022. “Blame the Bot: Anthropomorphism and Anger in Customer–Chatbot Interactions.” Journal of Marketing 86 (1): 132–148. https://doi.org/10.1177/00222429211045687.
   Web of Science ®Google Scholar
• Cronin, J. J., Jr, and S. A. Taylor. 1992. “Measuring Service Quality: A Reexamination and Extension.” Journal of Marketing 56 (3): 55–68. https://doi.org/10.1177/002224299205600304.
   Web of Science ®Google Scholar
• Cuddy, A. J., P. Glick, and A. Beninger. 2011. “The Dynamics of Warmth and Competence Judgments, and Their Outcomes in Organizations.” Research in Organizational Behavior 31:73–98. https://doi.org/10.1016/j.riob.2011.10.004.
   Web of Science ®Google Scholar
• Davis, F. D. 1993. “User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts.” International Journal of Man-Machine Studies 38 (3): 475–487. https://doi.org/10.1006/imms.1993.1022.
   Google Scholar
• Dunning, D., K. Johnson, J. Ehrlinger, and J. Kruger. 2003. “Why People Fail to Recognize Their Own Incompetence.” Current Directions in Psychological Science 12 (3): 83–87. https://doi.org/10.1111/1467-8721.01235.
   Web of Science ®Google Scholar
• Ekström, M. 2009. “Announced Refusal to Answer: A Study of Norms and Accountability in Broadcast Political Interviews.” Discourse Studies 11 (6): 681–702. https://doi.org/10.1177/1461445609347232.
   Web of Science ®Google Scholar
• Epley, N. 2018. “A Mind Like Mine: The Exceptionally Ordinary Underpinnings of Anthropomorphism.” Journal of the Association for Consumer Research 3 (4): 591–598. https://doi.org/10.1086/699516.
   Google Scholar
• Epley, N., A. Waytz, S. Akalis, and J. T. Cacioppo. 2008. “When We Need a Human: Motivational Determinants of Anthropomorphism.” Social Cognition 26 (2): 143–155. https://doi.org/10.1521/soco.2008.26.2.143.
   Web of Science ®Google Scholar
• Exline, J. J., and A. L. Geyer. 2004. “Perceptions of Humility: A Preliminary Study.” Self and Identity 3 (2): 95–114. https://doi.org/10.1080/13576500342000077.
   Web of Science ®Google Scholar
• Fiske, S. T., A. J. Cuddy, and P. Glick. 2007. “Universal Dimensions of Social Cognition: Warmth and Competence.” Trends in Cognitive Sciences 11 (2): 77–83. https://doi.org/10.1016/j.tics.2006.11.005.
   PubMed Web of Science ®Google Scholar
• Froehle, C. M., and A. V. Roth. 2004. “New Measurement Scales for Evaluating Perceptions of the Technology-Mediated Customer Service Experience.” Journal of Operations Management 22 (1): 1–21. https://doi.org/10.1016/j.jom.2003.12.004.
   Web of Science ®Google Scholar
• Ghazali, A. S., J. Ham, E. Barakova, and P. Markopoulos. 2020. “Persuasive Robots Acceptance Model (PRAM): Roles of Social Responses within the Acceptance Model of Persuasive Robots.” International Journal of Social Robotics 12 (5): 1075–1092. https://doi.org/10.1007/s12369-019-00611-1.
   Web of Science ®Google Scholar
• Gnewuch, U., S. Morana, and A. Maedche 2017. Towards Designing Cooperative and Social Conversational Agents for Customer Service, Proceedings of the 38th International Conference on Information Systems (ICIS), South Korea, South Korea, 1–13.
   Google Scholar
• Gutman, J. 1982. “A Means-End Chain Model Based on Consumer Categorization Processes.” Journal of Marketing 46 (2): 60–72. https://doi.org/10.1177/002224298204600207.
   Web of Science ®Google Scholar
• Hagá, S., and K. R. Olson. 2017. “‘If I Only Had a Little Humility, I Would Be perfect’: Children’s and adults’ Perceptions of Intellectually Arrogant, Humble, and Diffident People.” The Journal of Positive Psychology 12 (1): 87–98. https://doi.org/10.1080/17439760.2016.1167943.
   Web of Science ®Google Scholar
• Haggard, M., W. C. Rowatt, J. C. Leman, B. Meagher, C. Moore, T. Fergus, D. Whitcomb, H. Battaly, J. Baehr, and D. Howard-Snyder. 2017. “Finding Middle Ground Between Intellectual Arrogance and Intellectual Servility: Development and Assessment of the Limitations-Owning Intellectual Humility Scale.” Personality and Individual Differences 124 (April): 184–193. https://doi.org/10.1016/j.paid.2017.12.014.
   Google Scholar
• Hansson, I., S. Buratti, and C. M. Allwood. 2017. “Experts’ and novices’ Perception of Ignorance and Knowledge in Different Research Disciplines and Its Relation to Belief in Certainty of Knowledge.” Frontiers in Psychology 8 (March): Article 377. https://doi.org/10.3389/fpsyg.2017.00377.
   Google Scholar
• Hartley, A. G., R. M. Furr, E. G. Helzer, E. Jayawickreme, K. R. Velasquez, and W. Fleeson. 2016. “Morality’s Centrality to Liking, Respecting, and Understanding Others.” Social Psychological and Personality Science 7 (7): 648–657. https://doi.org/10.1177/1948550616655359.
   Web of Science ®Google Scholar
• Hartline, M. D., and K. C. Jones. 1996. “Employee Performance Cues in a Hotel Service Environment: Influence on Perceived Service Quality, Value, and Word-Of-Mouth Intentions.” Journal of Business Research 35 (3): 207–215. https://doi.org/10.1016/0148-2963(95)00126-3.
   Web of Science ®Google Scholar
• Hu, Y. 2021. “An Improvement or a Gimmick? The Importance of User Perceived Values, Previous Experience, and Industry Context in Human–Robot Service Interaction.” Journal of Destination Marketing & Management 21 (September). https://doi.org/10.1016/j.jdmm.2021.100645.
   Google Scholar
• Huynh, H. P., and A. Dicke-Bohmann. 2020. “Humble Doctors, Healthy Patients? Exploring the Relationships Between Clinician Humility and Patient Satisfaction, Trust, and Health Status.” Patient Education and Counseling 103 (1): 173–179. https://doi.org/10.1016/j.pec.2019.07.022.
   PubMed Web of Science ®Google Scholar
• Köhler, C. F., A. J. Rohm, K. de Ruyter, and M. Wetzels. 2011. “Return on Interactivity: The Impact of Online Agents on Newcomer Adjustment.” Journal of Marketing 75 (2): 93–108. https://doi.org/10.1509/jm.75.2.93.
   Web of Science ®Google Scholar
• Krumrei-Mancuso, E. J. 2017. “Intellectual Humility and Prosocial Values: Direct and Mediated Effects.” The Journal of Positive Psychology 12 (1): 13–28. https://doi.org/10.1080/17439760.2016.1167938.
   Web of Science ®Google Scholar
• Lakshmanan, A., and H. S. Krishnan. 2011. “The Aha! Experience: Insight and Discontinuous Learning in Product Usage.” Journal of Marketing 75 (6), November: 105–123. https://doi.org/10.1509/jm.10.0348.
   Web of Science ®Google Scholar
• Lee, E. J. 2008. “Flattery May Get Computers Somewhere, Sometimes: The Moderating Role of Output Modality, Computer Gender, and User Gender.” International Journal of Human-Computer Studies 66 (11): 789–800. https://doi.org/10.1016/j.ijhcs.2008.07.009.
   Web of Science ®Google Scholar
• Lee, M., G. Lucas, J. Mell, E. Johnson, and J. Gratch 2019. What’s on Your Virtual Mind? Mind Perception in Human-Agent Negotiations. In: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents, Paris, France, 38–45.
   Google Scholar
• Li, H., T. Daugherty, and F. Biocca. 2003. “The Role of Virtual Experience in Consumer Learning.” Journal of Consumer Psychology 13 (4): 395–407. https://doi.org/10.1207/S15327663JCP1304_07.
   Web of Science ®Google Scholar
• Liew, T. W., S. M. Tan, and C. Jayothisa. 2013. “The Effects of Peer-Like and Expert-Like Pedagogical Agents on learners’ Agent Perceptions, Task-Related Attitudes, and Learning Achievement.” Journal of Educational Technology & Society 16 (4): 275–286.
   Web of Science ®Google Scholar
• Littlepage, G. E., G. W. Schmidt, E. W. Whisler, and A. G. Frost. 1995. “An Input-Process-Output Analysis of Influence and Performance in Problem-Solving Groups.” Journal of Personality and Social Psychology 69 (5): 877–889. https://doi.org/10.1037/0022-3514.69.5.877.
   Web of Science ®Google Scholar
• Longoni, C., and L. Cian. 2022. “Artificial Intelligence in Utilitarian Vs. Hedonic Contexts: The ‘Word-Of-machine’ Effect.” Journal of Marketing 86 (1): 91–108. https://doi.org/10.1177/0022242920957347.
   Web of Science ®Google Scholar
• Matsui, T., and S. Yamada. 2019. “Designing Trustworthy Product Recommendation Virtual Agents Operating Positive Emotion and Having Copious Amount of Knowledge.” Frontiers in Psychology 10 (April). https://doi.org/10.3389/fpsyg.2019.00675.
   PubMed Web of Science ®Google Scholar
• Min, H. K., and Y. Hu. 2022. “Revisiting the Effects of Smile Intensity on Judgments of Warmth and Competence: The Role of Industry Context.” International Journal of Hospitality Management 102 (April): 103152. https://doi.org/10.1016/j.ijhm.2022.103152.
   Google Scholar
• Nielsen, R., J. A. Marrone, and H. S. Slay. 2010. “A New Look at Humility: Exploring the Humility Concept and Its Role in Socialized Charismatic Leadership.” Journal of Leadership & Organizational Studies 17 (1): 33–43. https://doi.org/10.1177/1548051809350892.
   Google Scholar
• Owens, B. P., M. D. Johnson, and T. R. Mitchell. 2013. “Expressed Humility in Organizations: Implications for Performance, Teams, and Leadership.” Organization Science 24 (5): 1517–1538. https://doi.org/10.1287/orsc.1120.0795.
   Web of Science ®Google Scholar
• Pollay, R. W. 1986. “The Distorted Mirror: Reflections on the Unintended Consequences of Advertising.” Journal of Marketing 50 (2): 18–36. https://doi.org/10.1177/002224298605000202.
   Web of Science ®Google Scholar
• Porter, T., C. R. Baldwin, M. T. Warren, E. D. Murray, K. Cotton Bronk, M. J. Forgeard, N. E. Snow, and E. Jayawickreme. 2021. “Clarifying the Content of Intellectual Humility: A Systematic Review and Integrative Framework.” Journal of Personality Assessment 104 (5): 573–585. https://doi.org/10.1080/00223891.2021.1975725.
   PubMed Web of Science ®Google Scholar
• Poynor, C., and S. Wood. 2010. “Smart Subcategories: How Assortment Formats Influence Consumer Learning and Satisfaction.” Journal of Consumer Research 37 (1): 159–175. https://doi.org/10.1086/649906.
   Web of Science ®Google Scholar
• Prentice, C., S. Dominique Lopes, and X. Wang. 2020. “The Impact of Artificial Intelligence and Employee Service Quality on Customer Satisfaction and Loyalty.” Journal of Hospitality Marketing & Management 29 (7): 739–756. https://doi.org/10.1080/19368623.2020.1722304.
   Web of Science ®Google Scholar
• Price, L. L., E. J. Arnould, and S. L. Deibler. 1995. “Consumers’ Emotional Responses to Service Encounters: The Influence of the Service Provider.” International Journal of Service Industry Management 6 (3): 34–63. https://doi.org/10.1108/09564239510091330.
   Google Scholar
• Rapp, A., L. Curti, and A. Boldi. 2021. “The Human Side of Human-Chatbot Interaction: A Systematic Literature Review of ten Years of Research on Text-Based Chatbots.” International Journal of Human-Computer Studies 151 (July): 102630. https://doi.org/10.1016/j.ijhcs.2021.102630.
   Web of Science ®Google Scholar
• Reeves, B., and C. Nass. 1996. The Media Equation: How People Treat Computers, Television, and New Media Like Real People. Cambridge, United Kingdom: Cambridge University Press.
   Google Scholar
• Ryu, J., and A. L. Baylor. 2005. “The Psychometric Structure of Pedagogical Agent Persona.” Technology, Instruction, Cognition and Learning 2 (4): 291–314.
   Google Scholar
• Sarstedt, M., J. F. Hair Jr, C. Nitzl, C. M. Ringle, and M. C. Howard. 2020. “Beyond a Tandem Analysis of SEM and PROCESS: Use of PLS-SEM for Mediation Analyses!” International Journal of Market Research 62 (3): 288–299. https://doi.org/10.1177/1470785320915686.
   Web of Science ®Google Scholar
• Setlur, V., and M. Tory 2022. How Do You Converse with an Analytical Chatbot? Revisiting Gricean Maxims for Designing Analytical Conversational Behavior. In: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, April, 1–17.
   Google Scholar
• Skipper, M. 2021. “The Humility Heuristic, Or: People Worth Trusting Admit to What They Don’t Know.” Social Epistemology 35 (3): 323–336. https://doi.org/10.1080/02691728.2020.1809744.
   Web of Science ®Google Scholar
• Smithson, M. 1993. “Ignorance and Science: Dilemmas, Perspectives, and Prospects.” Knowledge 15 (2): 133–156. https://doi.org/10.1177/107554709301500202.
   Google Scholar
• Söderlund, M. 2022. “Service Robots with (Perceived) Theory of Mind: An Examination of humans’ Reactions.” Journal of Retailing and Consumer Services 67 (July). https://doi.org/10.1016/j.jretconser.2022.102999.
   Google Scholar
• Söderlund, M., and H. Berg. 2020. “Employee Emotional Displays in the Extended Service Encounter: A Happiness-Based Examination of the Impact of Employees Depicted in Service Advertising.” Journal of Service Management 31 (1): 115–136. https://doi.org/10.1108/JOSM-06-2019-0208.
   Web of Science ®Google Scholar
• Söderlund, M., and E. L. Oikarinen. 2021. “Service Encounters with Virtual Agents: An Examination of Perceived Humanness as a Source of Customer Satisfaction.” European Journal of Marketing 55 (13): 94–121. https://doi.org/10.1108/EJM-09-2019-0748.
   Web of Science ®Google Scholar
• Söderlund, M., E. L. Oikarinen, and T. M. Tan. 2021. “The Happy Virtual Agent and Its Impact on the Human Customer in the Service Encounter.” Journal of Retailing and Consumer Services 59 (March): 102401. https://doi.org/10.1016/j.jretconser.2020.102401.
   Web of Science ®Google Scholar
• Suich Bass, A. 2018, GrAit Expectations, Special report, The Economist, March 31st.
   Google Scholar
• Taecharungroj, V. 2023. ““What Can ChatGpt do?” Analyzing Early Reactions to the Innovative AI Chatbot on Twitter.” Big Data and Cognitive Computing 7 (1): 35. https://doi.org/10.3390/bdcc7010035.
   Google Scholar
• Tan, S. M., and T. W. Liew. 2020. “Designing Embodied Virtual Agents as Product Specialists in a Multi-Product Category E-Commerce: The Roles of Source Credibility and Social Presence.” International Journal of Human–Computer Interaction 36 (12): 1136–1149. https://doi.org/10.1080/10447318.2020.1722399.
   Web of Science ®Google Scholar
• Treem, J. W. 2012. “Communicating Expertise: Knowledge Performances in Professional-Service Firms.” Communication Monographs 79 (1): 23–47. https://doi.org/10.1080/03637751.2011.646487.
   Web of Science ®Google Scholar
• Tsui, A. B. 1991. “The Pragmatic Functions of I Don’t Know.” Text-Interdisciplinary Journal for the Study of Discourse 11 (4): 607–622. https://doi.org/10.1515/text.1.1991.11.4.607.
   Google Scholar
• Veletsianos, G. 2009. “The Impact and Implications of Virtual Character Expressiveness on Learning and Agent–Learner Interactions.” Journal of Computer Assisted Learning 25 (4): 345–357. https://doi.org/10.1111/j.1365-2729.2009.00317.x.
   Web of Science ®Google Scholar
• Verhagen, T., J. Van Nes, F. Feldberg, and W. Van Dolen. 2014. “Virtual Customer Service Agents: Using Social Presence and Personalization to Shape Online Service Encounters.” Journal of Computer-Mediated Communication 19 (3): 529–545. https://doi.org/10.1111/jcc4.12066.
   Web of Science ®Google Scholar
• Voss, R. 2009. “Studying Critical Classroom Encounters: The Experiences of Students in German College Education.” Quality Assurance in Education 17 (2): 156–173. https://doi.org/10.1108/09684880910951372.
   Google Scholar
• Voss, R., T. Gruber, and A. Reppel. 2010. “Which Classroom Service Encounters Make Students Happy or Unhappy? Insights from an Online CIT Study.” International Journal of Educational Management 24 (7): 615–636. https://doi.org/10.1108/09513541011080002.
   Google Scholar
• Wang, C. Y. 2018. “Customer Participation and the Roles of Self-Efficacy and Adviser-Efficacy.” International Journal of Bank Marketing 37 (1): 241–257. https://doi.org/10.1108/IJBM-10-2017-0220.
   Web of Science ®Google Scholar
• Weatherall, A. 2011. “I Don’t Know as a Prepositioned Epistemic Hedge.” Research on Language & Social Interaction 44 (4): 317–337. https://doi.org/10.1080/08351813.2011.619310.
   Web of Science ®Google Scholar
• Whitcomb, D., H. Battaly, J. Baehr, and D. Howard-Snyder. 2017. “Intellectual Humility: Owning Our Limitations.” Philosophy and Phenomenological Research 94 (3): 1–31. https://doi.org/10.1111/phpr.12228.
   Web of Science ®Google Scholar
• White, R. W. 1959. “Motivation Reconsidered: The Concept of Competence.” Psychological Review 66 (5): 297–333. https://doi.org/10.1037/h0040934.
   PubMed Web of Science ®Google Scholar
• Wojciszke, B. 2005. “Morality and Competence in Person-And Self-Perception.” European Review of Social Psychology 16 (1): 155–188. https://doi.org/10.1080/10463280500229619.
   Google Scholar
• Wright, J. C., T. Nadelhoffer, T. Perini, A. Langville, M. Echols, and K. Venezia. 2017. “The Psychological Significance of Humility.” The Journal of Positive Psychology 12 (1): 3–12. https://doi.org/10.1080/17439760.2016.1167940.
   Web of Science ®Google Scholar
• Zhao, X., J. G. Lynch Jr, and Q. Chen. 2010. “Reconsidering Baron and Kenny: Myths and Truths About Mediation Analysis.” Journal of Consumer Research 37 (2): 197–206. https://doi.org/10.1086/651257.
   Web of Science ®Google Scholar