Does Artificial Intelligence Satisfy You? A Meta-Analysis of User Gratification and User Satisfaction with AI-Powered Chatbots

References

• Note: References marked with an asterisk indicate studies included in the meta-analysis
   Google Scholar
• *Ashfaq, M., Yun, J., & Yu, S. (2021). My smart speaker is cool! Perceived coolness, perceived values, and users’ attitude toward smart speakers. International Journal of Human–Computer Interaction, 37(6), 560–573. https://doi.org/10.1080/10447318.2020.1841404
   Web of Science ®Google Scholar
• *Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020). I, Chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents. Telematics and Informatics, 54, 101473. https://doi.org/10.1016/j.tele.2020.101473
   Web of Science ®Google Scholar
• Arias, A., Martínez, L. H., Hincapie, R. A., Granada, M. (2015). An IEEE Xplore database literature review regarding the interaction between electric vehicles and power grids. In: 2015 IEEE PES Innovative Smart Grid Technologies Latin America (ISGT LATAM) (pp. 673–678). IEEE.
   Google Scholar
• Bae, M. (2018). Understanding the effect of the discrepancy between sought and obtained gratification on social networking site users’ satisfaction and continuance intention. Computers in Human Behavior, 79, 137–153. https://doi.org/10.1016/j.chb.2017.10.026
   Web of Science ®Google Scholar
• Balakrishnan, J., & Griffiths, M. D. (2017). Social media addiction: What is the role of content in YouTube? Journal of Behavioral Addictions, 6(3), 364–377. https://doi.org/10.1556/2006.6.2017.058
   PubMed Web of Science ®Google Scholar
• *Belanche, D., Casaló, L. V., & Flavián, C. (2019). Artificial Intelligence in FinTech: Understanding robo-advisors adoption among customers. Industrial Management & Data Systems, 119(7), 1411–1430. https://doi.org/10.1108/IMDS-08-2018-0368
   Web of Science ®Google Scholar
• Bhirud, N., Tataale, S., Randive, S., & Nahar, S. (2019). A literature review on chatbots in healthcare domain. International Journal of Scientific & Technology Research, 8(7), 225–231.
   Google Scholar
• Biocca, F., Harms, C., & Burgoon, J. K. (2003). Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence: Teleoperators and Virtual Environments, 12(5), 456–480. https://doi.org/10.1162/105474603322761270
   Web of Science ®Google Scholar
• Birkle, C., Pendlebury, D. A., Schnell, J., & Adams, J. (2020). Web of science as a data source for research on scientific and scholarly activity. Quantitative Science Studies, 1(1), 363–376. https://doi.org/10.1162/qss_a_00018
   Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2009). Introduction to meta‐analysis. Wiley.
   Google Scholar
• Cheng, Y., Chen, Y. R., Hung-Baesecke, R., & Jin, Y. (2019). When CSR meets mobile SNA users in mainland China: An examination of gratifications sought, CSR motives, and relational outcomes in natural disasters. International Journal of Communication, 13, 319–341. https://ijoc.org/index.php/ijoc/article/view/10169
   Google Scholar
• Cheng, Y., & Jiang, H. (2020a). AI-powered mental health chatbots: Examining users’ motivations, active communicative action, and engagement after mass-shooting disasters. Journal of Contingencies and Crisis Management, 28(3), 339–354. https://doi.org/10.1111/1468-5973.12319
   Web of Science ®Google Scholar
• Cheng, Y., & Jiang, H. (2020b). How do AI-driven chatbots impact user experience? Examining gratifications, perceived privacy risk, satisfaction, loyalty, and continued use. Journal of Broadcasting & Electronic Media, 64(4), 592–614. https://doi.org/10.1080/08838151.2020.1834296
   Web of Science ®Google Scholar
• Cheng, Y., Liang, J. W. & Leung, L. (2015). Social network service use on mobile devices: An examination of gratifications, civic attitudes and civic engagement in China. New Media & Society, 17(7), 1096–1116. http://dx.doi.org/10.1177/1461444814521362
   Google Scholar
• Cheng, Y., Wang, Y., & Zhao, W. (2022). Shared virtual reality experiences during the COVID-19 pandemic: Exploring the gratifications and effects of engagement with immersive videos. International Journal of Environmental Research and Public Health. 19(9), 5056, https://doi.org/10.3390/ijerph19095056
   Google Scholar
• Cheng, Y., Xie, C., Wang, Y., & Jiang, H. (2023). Chatbots and Health: Mental Health. In E. Ho, C. Bylund & J. van Weert (Eds.), The International Encyclopedia of Health Communication. John Wiley & Sons, Inc.
   Google Scholar
• *Chung, M., Ko, E., Joung, H., & Kim, S. J. (2020). Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research, 117, 587–595. https://doi.org/10.1016/j.jbusres.2018.10.004
   Web of Science ®Google Scholar
• Chung, K., & Park, R. C. (2019). Chatbot-based healthcare service with a knowledge base for cloud computing. Cluster Computing, 22(S1), 1925–1937. https://doi.org/10.1007/s10586-018-2334-5
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum.
   Google Scholar
• *De Cicco, R., e Silva, S. C., & Alparone, F. R. (2020). Millennials’ attitude toward chatbots: An experimental study in a social relationship perspective. International Journal of Retail & Distribution Management, 48(11), 1213–1233. https://doi.org/10.1108/IJRDM-12-2019-0406
   Web of Science ®Google Scholar
• Dhir, A., Chen, S., & Nieminen, M. (2016). The effects of demographics, technology accessibility, and unwillingness to communicate in predicting internet gratifications and heavy internet use among adolescents. Social Science Computer Review, 34(3), 278–297. https://doi.org/10.1177/0894439315582854
   Web of Science ®Google Scholar
• Dunne, A., Lawlor, M. A., & Rowley, J. (2010). Young people’s use of online social networking sites–a uses and gratifications perspective. Journal of Research in Interactive Marketing, 4(1), 46–58. https://doi.org/10.1108/17505931011033551
   Google Scholar
• Ellison, N. B., Steinfield, C., & Lampe, C. (2007). The benefits of Facebook “friends:” Social capital and college students’ use of online social network sites. Journal of Computer-Mediated Communication, 12(4), 1143–1168. https://doi.org/10.1111/j.1083-6101.2007.00367.x
   Web of Science ®Google Scholar
• *Eren, B. A. (2021). Determinants of customer satisfaction in chatbot use: Evidence from a banking application in Turkey. International Journal of Bank Marketing, 39(2), 294–311. https://doi.org/10.1108/IJBM-02-2020-0056
   Web of Science ®Google Scholar
• Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Addison-Wesley.
   Google Scholar
• Gan, C., & Li, H. (2018). Understanding the effects of gratifications on the continuance intention to use WeChat in China: A perspective on uses and gratifications. Computers in Human Behavior, 78, 306–315. https://doi.org/10.1016/j.chb.2017.10.003
   Web of Science ®Google Scholar
• Gan, C., & Wang, W. (2015). Uses and gratifications of social media: A comparison of microblog and WeChat. Journal of Systems and Information Technology, 17(4), 351–363. https://doi.org/10.1108/JSIT-06-2015-0052
   Google Scholar
• Gros, D., Wanner, B., Hackenholt, A., Zawadzki, P., & Knautz, K. (2017). World of streaming. Motivation and gratification on Twitch [Paper presentation]. International Conference on Social Computing and Social Media (pp. 44–57). Cham: Springer.
   Google Scholar
• Herzog, H. (1940). Professor quiz: A gratification study. In P. F. Lazarsfeld (Ed.), Radio and the printed page. (pp. 64–93). Duell, Sloan & Pearce.
   Google Scholar
• Herzog, H. (1944). What do we really know about daytime serial listeners. In P. F. Lazarsfeld & F. N. Stanton (Eds.), Radio research 1942-1943. (pp. 3–33). Duell, Sloan & Pearce.
   Google Scholar
• Higgins, J. P., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta‐analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186
   PubMed Web of Science ®Google Scholar
• Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., & Sterne, J. A. C. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ, 343(2), d5928–d5928. https://doi.org/10.1136/bmj.d5928
   PubMed Web of Science ®Google Scholar
• Hu, A. W. L., & Tang, L. R. (2010). Factors motivating sports broadcast viewership with fan identification as a mediator. Social Behavior and Personality: An International Journal, 38(5), 681–689. https://doi.org/10.2224/sbp.2010.38.5.681
   Web of Science ®Google Scholar
• Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings. (2nd ed.). Sage.
   Google Scholar
• Hwang, W., & Salvendy, G. (2009). Integration of usability evaluation studies via a novel meta-analytic approach: What are significant attributes for effective evaluation? International Journal of Human-Computer Interaction, 25(4), 282–306. https://doi.org/10.1080/10447310802629793
   Web of Science ®Google Scholar
• James, M. L., Wotring, C. E., & Forrest, E. J. (1995). An exploratory study of the perceived benefits of electronic bulletin board use and their impact on other communication activities. Journal of Broadcasting & Electronic Media, 39(1), 30–50. https://doi.org/10.1080/08838159509364287
   Web of Science ®Google Scholar
• Java, A., Song, X., Finin, T., & Tseng, B. (2007). Why we twitter: Understanding microblogging usage and communities [Paper presentation]. Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis (pp. 56–65). https://doi.org/10.1145/1348549.1348556
   Google Scholar
• Johnson, P. R., Yang, S. (2009). Uses and gratifications of Twitter: An examination of user motives and satisfaction of Twitter use. In: Communication Technology Division of the Annual Convention of the Association for Education in Journalism and Mass Communication in Boston, MA.
   Google Scholar
• Katz, E., Blumler, J. G., & Gurevitch, M. (1973). Uses and gratifications research. Public Opinion Quarterly, 37(4), 509. https://doi.org/10.1086/268109
   Web of Science ®Google Scholar
• Katz, E., Blumler, J. G., & Gurevitch, M. (1974). Utilization of mass communication by the individual. In J.G. Blumler & E. Katz (Eds.), The Uses of Mass Communications: Current Perspectives on Gratifications Research (pp. 19–32). SAGE Publications.
   Google Scholar
• Lasswell, H. (1948). The structure and function of communications in society. In L. Bryson (Ed.), The communication of ideas (pp. 136–139). Harper.
   Google Scholar
• Leung, L., & Wei, R. (2000). More than just talk on the move: Uses and gratifications of the cellular phone. Journalism & Mass Communication Quarterly, 77(2), 308–320. https://doi.org/10.1177/107769900007700206
   Web of Science ®Google Scholar
• *Li, L., Lee, K. Y., Emokpae, E., & Yang, S. B. (2021). What makes you continuously use chatbot services? Evidence from Chinese online travel agencies. Electronic Markets, 31(3), 575–599. https://doi.org/10.1007/s12525-020-00454-z
   PubMed Web of Science ®Google Scholar
• Li, H., Liu, Y., Xu, X., Heikkilä, J., & van der Heijden, H. (2015). Modeling hedonic is continuance through the uses and gratifications theory: An empirical study in online games. Computers in Human Behavior, 48, 261–e272. https://doi.org/10.1016/j.chb.2015.01.053
   Web of Science ®Google Scholar
• Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Sage.
   Google Scholar
• Liu, L., Guo, F., Zou, Z., & Duffy, V. G. (2022). Application, development and future opportunities of collaborative robots (cobots) in manufacturing: A literature review. International Journal of Human–Computer Interaction, 1–18. https://doi.org/10.1080/10447318.2022.2041907
   Web of Science ®Google Scholar
• Liu, I. L., Cheung, C. M., & Lee, M. K. (2016). User satisfaction with microblogging: Information dissemination versus social networking. Journal of the Association for Information Science and Technology, 67(1), 56–70. https://doi.org/10.1002/asi.23371
   Web of Science ®Google Scholar
• Lyle, J., & Hoffman, H. R. (1972). Children’s use of television and other media. In E. A. Rubinstein, G. A. Comstock, & J. P. Murray (Eds). Television and Social Behavior: Reports and Papers (pp. 129–256). United States: National Institute of Mental Health.
   Google Scholar
• Ma, Q., Chan, A. H., & Teh, P. L. (2021). Insights into older adults’ technology acceptance through meta-analysis. International Journal of Human–Computer Interaction, 37(11), 1049–1062. https://doi.org/10.1080/10447318.2020.1865005
   Web of Science ®Google Scholar
• *Nguyen, D. M., Chiu, Y. T. H., & Le, H. D. (2021). Determinants of continuance intention towards banks’ chatbot services in Vietnam: A necessity for sustainable development. Sustainability, 13(14), 7625. https://doi.org/10.3390/su13147625
   Web of Science ®Google Scholar
• Olsen, A. (2020). Summon user experience: A study of the summon laptop and mobile interface. College & Undergraduate Libraries, 27(2–4), 420–434. https://doi.org/10.1080/10691316.2020.1837046
   Web of Science ®Google Scholar
• Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic reviews, 10(1), 1–11. https://doi.org/10.1186/s13643-021-01626-4
   PubMed Web of Science ®Google Scholar
• Palmgreen, P. (1984). Uses and gratifications: A theoretical perspective. Annals of the International Communication Association, 8(1), 20–55. https://doi.org/10.1080/23808985.1984.11678570
   Google Scholar
• Palmgreen, P., & Rayburn, J. D. (1982). Gratifications sought and media exposure an expectancy value model. Communication Research, 9(4), 561–580. https://doi.org/10.1177/009365082009004004
   Web of Science ®Google Scholar
• Palmgreen, P., Wenner, L. A., & Rayburn, J. D. (1980). Relations between gratifications sought and obtained: A study of television news. Communication Research, 7(2), 161–192. https://doi.org/10.1177/009365028000700202
   Web of Science ®Google Scholar
• Papacharissi, Z. (2002). The self online: The utility of personal home pages. Journal of Broadcasting & Electronic Media, 46(3), 346–368. https://doi.org/10.1207/s15506878jobem4603_3
   Web of Science ®Google Scholar
• Papacharissi, Z. (2008). Uses and gratifications. In M. Salwen & D. Stacks (Eds.),Uses and gratifications: An integrated approach to communication theory and research. (pp. 137–152). Lawrence Erlbaum.
   Google Scholar
• Perse, E. M., & Ferguson, D. A. (2000). The benefits and costs of web surfing. Communication Quarterly, 48(4), 343–359. https://doi.org/10.1080/01463370009385603
   Google Scholar
• *Pitardi, V., & Marriott, H. R. (2021). Alexa, she’s not human but… Unveiling the drivers of consumers’ trust in voice‐based artificial intelligence. Psychology & Marketing, 38(4), 626–642. https://doi.org/10.1002/mar.21457
   Web of Science ®Google Scholar
• Ramirez, A., Jr, Dimmick, J., Feaster, J., & Lin, S. F. (2008). Revisiting interpersonal media competition: The gratification niches of instant messaging, e-mail, and the telephone. Communication Research, 35(4), 529–547. https://doi.org/10.1177/0093650208315979
   Web of Science ®Google Scholar
• Rapp, A., Curti, L., & Boldi, A. (2021). The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots. International Journal of Human-Computer Studies, 151, 102630. https://doi.org/10.1016/j.ijhcs.2021.102630
   Web of Science ®Google Scholar
• Rese, A., Ganster, L., & Baier, D. (2020). Chatbots in retailers’ customer communication: How to measure their acceptance? Journal of Retailing and Consumer Services, 56, 102176. https://doi.org/10.1016/j.jretconser.2020.102176
   Web of Science ®Google Scholar
• Review Manager (RevMan) [Computer program]. Version 5.4. The Cochrane Collaboration, 2020.
   Google Scholar
• Rubin, A. M. (1983). Television uses and gratifications: The interactions of viewing patterns and motivations. Journal of Broadcasting, 27(1), 37–51. https://doi.org/10.1080/08838158309386471
   Web of Science ®Google Scholar
• Rubin, A. M. (2009). The uses-and-gratifications perspective of media effects. In J. Bryant, M. B. Oliver (Eds.), Media effects: Advances in theory and research. (pp. 165–184). Routledge.
   Google Scholar
• Ruggiero, T. E. (2000). Uses and gratifications theory in the 21st century. Mass Communication and Society, 3(1), 3–37. https://doi.org/10.1207/S15327825MCS0301_02
   Google Scholar
• Smock, A. D., Ellison, N. B., Lampe, C., & Wohn, D. Y. (2011). Facebook as a toolkit: A uses and gratification approach to unbundling feature use. Computers in Human Behavior, 27(6), 2322–2329. https://doi.org/10.1016/j.chb.2011.07.011
   Web of Science ®Google Scholar
• *Shao, C., & Kwon, K. H. (2021). Hello Alexa! Exploring effects of motivational factors and social presence on satisfaction with artificial intelligence‐enabled gadgets. Human Behavior and Emerging Technologies, 3(5), 978–988. https://doi.org/10.1002/hbe2.293
   Google Scholar
• Skoric, M. M., Zhu, Q., Goh, D., & Pang, N. (2016). Social media and citizen engagement: A meta-analytic review. New Media & Society, 18(9), 1817–1839. https://doi.org/10.1177/1461444815616221
   Web of Science ®Google Scholar
• Stafford, T. F., Stafford, M. R., & Schkade, L. L. (2004). Determining uses and gratifications for the Internet. Decision Sciences, 35(2), 259–288. https://doi.org/10.1111/j.00117315.2004.02524.x
   Web of Science ®Google Scholar
• Tu, C. H., & McIsaac, M. (2002). The relationship of social presence and interaction in online classes. American Journal of Distance Education, 16(3), 131–150. https://doi.org/10.1207/S15389286AJDE1603_2
   Google Scholar
• Verhulsdonck, G., Howard, T., & Tham, J. (2021). Investigating the impact of design thinking, content strategy, and artificial intelligence: A “streams” approach for technical communication and user experience. Journal of Technical Writing and Communication, 51(4), 468–492. https://doi.org/10.1177/00472816211041951
   Google Scholar
• Walton, R. (2016). Supporting human dignity and human rights: A call to adopt the first principle of human-centered design. Journal of Technical Writing and Communication, 46(4), 402–426. https://doi.org/10.1177/0047281616653496
   Google Scholar
• Wimmer, R. D., & Dominick, J. R. (1997). Mass media research: An introduction (5th ed.). Wadsworth.
   Google Scholar
• Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021). Are we there yet?-A systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4(21), 1–18. https://doi.org/10.3389/frai.2021.654924
   Google Scholar
• Wright, C. R. (1960). Functional analysis and mass communication. Public Opinion Quarterly, 24(4), 605–620. https://doi.org/10.1086/266976
   Web of Science ®Google Scholar
• Xu, J. (2020). Does the medium matter? A meta-analysis on using social media vs. traditional media in crisis communication. Public Relations Review, 46(4), 101947. https://doi.org/10.1016/j.pubrev.2020.101947
   Web of Science ®Google Scholar
• *Zarouali, B., Van den Broeck, E., Walrave, M., & Poels, K. (2018). Predicting consumer responses to a chatbot on Facebook. Cyberpsychology, Behavior, and Social Networking, 21(8), 491–497. https://doi.org/10.1089/cyber.2017.0518
   PubMed Web of Science ®Google Scholar
• *Zhu, Y., Janssen, M., Wang, R., & Liu, Y. (2021). It Is Me, Chatbot: Working to address the COVID-19 outbreak-related Mental Health Issues in China. User experience, satisfaction, and influencing Factors. International Journal of Human–Computer Interaction, 1–13.
   Web of Science ®Google Scholar