Understanding User Preferences in Developing a Mental Healthcare AI Chatbot: A Conjoint Analysis Approach

References

• Al Farisi, R., Ferdiana, R., & Adji, T. B. (2022, July). The effect of anthropomorphic design cues on increasing chatbot empathy. In 2022 1st International Conference on Information System & Information Technology (ICISIT) (pp. 370–375). IEEE.
   Google Scholar
• Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021). Artificially intelligent chatbots in digital mental health interventions: A review. Expert Review of Medical Devices, 18(sup1), 37–49. https://doi.org/10.1080/17434440.2021.2013200
   PubMedGoogle Scholar
• Broadbent, E., Kumar, V., Li, X., Sollers 3rd, J., Stafford, R. Q., MacDonald, B. A., & Wegner, D. M. (2013). Robots with display screens: A robot with a more humanlike face display is perceived to have more mind and a better personality. PloS One, 8(8), e72589. https://doi.org/10.1371/journal.pone.0072589
   PubMed Web of Science ®Google Scholar
• Cabral, R. R., & Smith, T. B. (2011). Racial/ethnic matching of clients and therapists in mental health services: A meta-analytic review of preferences, perceptions, and outcomes. Journal of Counseling Psychology, 58(4), 537–554. https://doi.org/10.1037/a0025266
   PubMed Web of Science ®Google Scholar
• Cameron, G., Cameron, D., Megaw, G., Bond, R. R., Mulvenna, M. D., O’Neill, S., Armour, C., & McTear, M. F. (2018). Best practices for designing chatbots in mental healthcare – A case study on iHelpr.
   Google Scholar
• Carroll, J. D., & Green, P. E. (1995). Psychometric methods in marketing research: Part I, conjoint analysis. Journal of Marketing Research, 32(4), 385–391. https://doi.org/10.1177/002224379503200401
   Web of Science ®Google Scholar
• Chiang, A. H., Trimi, S., & Lo, Y. J. (2022). Emotion and service quality of anthropomorphic robots. Technological Forecasting and Social Change, 177, 121550. https://doi.org/10.1016/j.techfore.2022.121550
   Web of Science ®Google Scholar
• Chung, W. Y., Nam, J., Ryong, K., & Lee, D. (2022). When, how, and what kind of information should Internet service providers disclose? A study on the transparency that users want. Telematics and Informatics, 70, 101799. https://doi.org/10.1016/j.tele.2022.101799
   Web of Science ®Google Scholar
• Costa, P. T., & McCrae, R. R. (1999). A five-factor theory of personality. In The five-factor model of personality: Theoretical perspectives (Vol. 2, pp. 51–87). Guilford Press.
   Google Scholar
• Daher, K., Casas, J., Khaled, O. A., & Mugellini, E. (2020, October). Empathic chatbot response for medical assistance. In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (pp. 1–3).
   Google Scholar
• Dave, R., Sargeant, K., Vanamala, M., & Seliya, N. (2022). Review on psychology research based on artificial intelligence methodologies. Journal of Computer and Communications, 10(5), 113–130. https://doi.org/10.4236/jcc.2022.105008
   Google Scholar
• De Visser, E. J., Monfort, S. S., McKendrick, R., Smith, M. A., McKnight, P. E., Krueger, F., & Parasuraman, R. (2016). Almost human: Anthropomorphism increases trust resilience in cognitive agents. Journal of Experimental Psychology. Applied, 22(3), 331–349. https://doi.org/10.1037/xap0000092
   PubMed Web of Science ®Google Scholar
• Epley, N., Waytz, A., Akalis, S., & Cacioppo, J. T. (2008). When we need a human: Motivational determinants of anthropomorphism. Social Cognition, 26(2), 143–155. https://doi.org/10.1521/soco.2008.26.2.143
   Web of Science ®Google Scholar
• Feine, J., Adam, M., Benke, I., Maedche, A., & Benlian, A. (2020). Exploring design principles for enterprise chatbots: An analytic hierarchy process study. Designing for Digital Transformation. Co-Creating Services with Citizens and Industry: 15th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2020, Kristiansand, Norway, December 2–4, 2020, Proceedings 15 (pp. 126–141). Springer International Publishing.
   Google Scholar
• Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017). Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Mental Health, 4(2), e7785. https://doi.org/10.2196/mental.7785
   Web of Science ®Google Scholar
• Friedrich, M. J. (2017). Depression is the leading cause of disability around the world. JAMA, 317(15), 1517–1517. https://doi.org/10.1001/jama.2017.3826
   Web of Science ®Google Scholar
• Go, E., & Sundar, S. S. (2019). Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions. Computers in Human Behavior, 97, 304–316. https://doi.org/10.1016/j.chb.2019.01.020
   Web of Science ®Google Scholar
• Gobron, S., Ahn, J., Thalmann, D., Skowron, M., & Kappas, A. (2013). Impact study of nonverbal facial cues on spontaneous chatting with virtual humans. Journal of Virtual Reality and Broadcasting, 10(6). https://doi.org/10.20385/1860-2037/10.2013.6
   Google Scholar
• Gong, L. (2008). How social is social responses to computers? The function of the degree of anthropomorphism in computer representations. Computers in Human Behavior, 24(4), 1494–1509. https://doi.org/10.1016/j.chb.2007.05.007
   Web of Science ®Google Scholar
• Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H. C., & Jeste, D. V. (2019). Artificial intelligence for mental health and mental illnesses: An overview. Current Psychiatry Reports, 21(11), 116. https://doi.org/10.1007/s11920-019-1094-0
   PubMed Web of Science ®Google Scholar
• Green, P. E., & Srinivasan, V. (1990). Conjoint analysis in marketing research: New developments and directions. Journal of Marketing, 54(4), 3–19. https://doi.org/10.1177/002224299005400402
   Web of Science ®Google Scholar
• Halfin, A. (2007). Depression: The benefits of early and appropriate treatment. American Journal of Managed Care, 13(4), S92.
   PubMed Web of Science ®Google Scholar
• Hewlett, E., Takino, S., Nishina, Y., & Prinz, C. (2021). Tackling the mental health impact of the COVID-19 crisis: An integrated, whole-of-society response. Organisation for Economic Co-operation and Development (OECD).
   Google Scholar
• Hinson, J. A., & Swanson, J. L. (1993). Willingness to seek help as a function of self‐disclosure and problem severity. Journal of Counseling & Development, 71(4), 465–470. https://doi.org/10.1002/j.1556-6676.1993.tb02666.x
   Web of Science ®Google Scholar
• Huang, M., & Ki, E. J. (2023). Examining the effect of anthropomorphic design cues on healthcare chatbots acceptance and organization-public relationships: Trust in a warm human vs. a competent machine. International Journal of Human–Computer Interaction, 1–13. https://doi.org/10.1080/10447318.2023.2290378
   Web of Science ®Google Scholar
• Ishiguro, H. (2008). Studies on humanlike robots–humanoid, android and geminoid. In Simulation, Modeling, and Programming for Autonomous Robots: First International Conference, SIMPAR 2008 Venice, Italy, November 3–6, 2008. Proceedings 1 (p. 2). Springer Berlin Heidelberg.
   Google Scholar
• Jang, G., & Seo, Y. (2022). The counselor’s perceptions of psychological counseling chatbots. Korea Journal of Counseling, 23(6), 17–48.
   Google Scholar
• Janssen, A., Cardona, D. R., Passlick, J., & Breitner, M. H. (2022). How to make chatbots productive–A user-oriented implementation framework. International Journal of Human–Computer Studies, 168, 102921. https://doi.org/10.1016/j.ijhcs.2022.102921
   Web of Science ®Google Scholar
• Kim, D., Song, Y., Kim, S., Lee, S., Wu, Y., Shin, J., & Lee, D. (2023). How should the results of artificial intelligence be explained to users?–Research on consumer preferences in user-centered explainable artificial intelligence. Technological Forecasting and Social Change, 188, 122343. https://doi.org/10.1016/j.techfore.2023.122343
   Web of Science ®Google Scholar
• Kim, S., & Kim, S. (2021). Who is suffering from the “corona blues”? An analysis of the impacts of the COVID-19 pandemic on depression and its implications for health policy. International Journal of Environmental Research and Public Health, 18(23), 12273. https://doi.org/10.3390/ijerph182312273
   PubMed Web of Science ®Google Scholar
• Kim, W., & Kim, C. (2019). What influences the decision to get counseling? Understanding the help-seeking decisions using the prototype willingness model. Korea Journal of Counseling, 20(1), 21–37.
   Google Scholar
• King, C. (2016). Psychotherapists’ personal appearance and the therapeutic relationship: A grounded theory of client perspectives [Unpublished doctoral dissertation]. University of the West of England. https://pdfs.semanticscholar.org/58cc/99fcfedb5a39aae386e521989804412ba6c6.pdf
   Google Scholar
• Konrath, S., Falk, E., Fuhrel-Forbis, A., Liu, M., Swain, J., Tolman, R., Cunningham, R., & Walton, M. (2015). Can text messages increase empathy and prosocial behavior? The development and initial validation of text to connect. PLOS One, 10(9), e0137585. https://doi.org/10.1371/journal.pone.0137585
   PubMed Web of Science ®Google Scholar
• Krueger, R. A. (2014). Focus groups: A practical guide for applied research. Sage Publications.
   Google Scholar
• Kuhail, M. A., Thomas, J., Alramlawi, S., Shah, S. J. H., & Thornquist, E. (2022, October). Interacting with a chatbot-based advising system: Understanding the effect of chatbot personality and user gender on behavior. Informatics, 9(4), 81. MDPI. https://doi.org/10.3390/informatics9040081
   Google Scholar
• Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46(1), 50–80. https://doi.org/10.1518/hfes.46.1.50_30392
   PubMed Web of Science ®Google Scholar
• Lee, J., Lee, D., & Lee, J. G. (2022). Influence of rapport and social presence with an AI psychotherapy chatbot on users’ self-disclosure. International Journal of Human–Computer Interaction, 40(7), 1–12. https://doi.org/10.1080/10447318.2022.2146227
   Web of Science ®Google Scholar
• Leyens, J., Cortes, B., Demoulin, S., Dovidio, J. F., Fiske, S. T., Gaunt, R., Paladino, M., Rodriguez‐Perez, A., Rodriguez‐Torres, R., & Vaes, J. (2003). Emotional prejudice, essentialism, and nationalism: The 2002 Tajfel Lecture. European Journal of Social Psychology, 33(6), 703–717. https://doi.org/10.1002/ejsp.170
   Web of Science ®Google Scholar
• Li, C. Y., & Zhang, J. T. (2023). Chatbots or me? Consumers’ switching between human agents and conversational agents. Journal of Retailing and Consumer Services, 72, 103264. https://doi.org/10.1016/j.jretconser.2023.103264
   Web of Science ®Google Scholar
• Li, Q., Luximon, Y., & Zhang, J. (2023). The influence of anthropomorphic cues on patients’ perceived anthropomorphism, social presence, trust building, and acceptance of health care conversational agents: Within-subject web-based experiment. Journal of Medical Internet Research, 25, e44479. https://doi.org/10.2196/44479
   PubMed Web of Science ®Google Scholar
• MacIntyre, M. R., Cockerill, R. G., Mirza, O. F., & Appel, J. M. (2023). Ethical considerations for the use of artificial intelligence in medical decision-making capacity assessments. Psychiatry Research, 328, 115466. https://doi.org/10.1016/j.psychres.2023.115466
   PubMed Web of Science ®Google Scholar
• Moilanen, J., Visuri, A., Suryanarayana, S. A., Alorwu, A., Yatani, K., & Hosio, S. (2022, November). Measuring the effect of mental health chatbot personality on user engagement. In Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia (pp. 138–150).
   Google Scholar
• Moitra, M., Santomauro, D., Collins, P. Y., Vos, T., Whiteford, H., Saxena, S., & Ferrari, A. J. (2022). The global gap in treatment coverage for major depressive disorder in 84 countries from 2000–2019: A systematic review and Bayesian meta-regression analysis. PLOS Medicine, 19(2), e1003901. https://doi.org/10.1371/journal.pmed.1003901
   PubMed Web of Science ®Google Scholar
• Nass, C. (2004). Etiquette equality: Exhibitions and expectations of computer politeness. Communications of the ACM, 47(4), 35–37. https://doi.org/10.1145/975817.975841
   Web of Science ®Google Scholar
• Nass, C., & Steuer, J. (1993). Voices, boxes, and sources of messages: Computers and social actors. Human Communication Research, 19(4), 504–527. https://doi.org/10.1111/j.1468-2958.1993.tb00311.x
   Web of Science ®Google Scholar
• Nass, C., Fogg, B. J., & Moon, Y. (1996). Can computers be teammates? International Journal of Human–Computer Studies, 45(6), 669–678. https://doi.org/10.1006/ijhc.1996.0073
   Web of Science ®Google Scholar
• Park, I., Lee, J., Lee, D., Lee, C., & Chung, W. Y. (2022). Changes in consumption patterns during the COVID-19 pandemic: Analyzing the revenge spending motivations of different emotional groups. Journal of Retailing and Consumer Services, 65, 102874. https://doi.org/10.1016/j.jretconser.2021.102874
   Web of Science ®Google Scholar
• Pham, K. T., Nabizadeh, A., & Selek, S. (2022). Artificial intelligence and chatbots in psychiatry. The Psychiatric Quarterly, 93(1), 249–253. https://doi.org/10.1007/s11126-022-09973-8
   PubMed Web of Science ®Google Scholar
• Qiu, H., He, H., Zhang, S., Li, A., & Lan, Z. (2023). SMILE: Single-turn to multi-turn inclusive language expansion via ChatGPT for mental health support. arXiv Preprint, arXiv:2305.00450
   Google Scholar
• Remes, O., Mendes, J. F., & Templeton, P. (2021). Biological, Psychological, and Social Determinants of Depression: A Review of Recent Literature. Brain Sciences, 11(12), 1633. https://doi.org/10.3390/brainsci11121633
   PubMed Web of Science ®Google Scholar
• Russell, K. A., Swift, J. K., Penix, E. A., & Whipple, J. L. (2022). Client preferences for the personality characteristics of an ideal therapist. Counselling Psychology Quarterly, 35(2), 243–259. https://doi.org/10.1080/09515070.2020.1733492
   Web of Science ®Google Scholar
• Severe, J., Tang, R., Horbatch, F., Onishchenko, R., Naini, V., & Blazek, M. C. (2020). Factors influencing patients’ initial decisions regarding telepsychiatry participation during the COVID-19 pandemic: Telephone-based survey. JMIR Formative Research, 5(1), e25469. https://doi.org/10.2196/27357
   Google Scholar
• Shon, M., Shin, J., Hwang, J., & Lee, D. (2021). Free contents vs. inconvenience costs: Two faces of online video advertising. Telematics and Informatics, 56, 101476. https://doi.org/10.1016/j.tele.2020.101476
   Web of Science ®Google Scholar
• Siu, A. L., Bibbins-Domingo, K., Grossman, D. C., Baumann, L. C., Davidson, K. W., Ebell, M., García, F. A. R., Gillman, M., Herzstein, J., Kemper, A. R., Krist, A. H., Kurth, A. E., Owens, D. K., Phillips, W. R., Phipps, M. G., & Pignone, M. P. (2016). Screening for depression in adults: US Preventive Services Task Force recommendation statement. JAMA, 315(9), 908–914. https://doi.org/10.1001/jama.2016.0763
   PubMed Web of Science ®Google Scholar
• Skjuve, M., Følstad, A., Fostervold, K. I., & Brandtzaeg, P. B. (2021). My chatbot companion–A study of human–chatbot relationships. International Journal of Human–Computer Studies, 149, 102601. https://doi.org/10.1016/j.ijhcs.2021.102601
   Web of Science ®Google Scholar
• Spalter, D. (2014). How clients choose their psychotherapist: influences on selecting and staying with a therapist [Doctoral dissertation]. Middlesex University/Metanoia Institute.
   Google Scholar
• Srivastava, A., Pandey, I., Akhtar, M. S., & Chakraborty, T. (2023, April). Response-act guided reinforced dialogue generation for mental health counseling. In Proceedings of the ACM Web Conference 2023 (pp. 1118–1129).
   Google Scholar
• Thomas, L., MacMillan, J., McColl, E., Hale, C., & Bond, S. (1995). Comparison of focus group and individual interview methodology in examining patient satisfaction with nursing care. Social Sciences in Health, 1(4), 206–220.
   Google Scholar
• Topkaya, N. (2015). Factors influencing psychological help seeking in adults: A qualitative study. Educational Sciences: Theory and Practice, 15(1), 21–31.
   Google Scholar
• Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y. L., & Atun, R. (2020). Conversational agents in health care: Scoping review and conceptual analysis. Journal of Medical Internet Research, 22(8), e17158. https://doi.org/10.2196/17158
   PubMed Web of Science ®Google Scholar
• Vogel, D. L., Wade, N. G., Wester, S. R., Larson, L., & Hackler, A. H. (2007). Seeking help from a mental health professional: The influence of one’s social network. Journal of Clinical Psychology, 63(3), 233–245. https://doi.org/10.1002/jclp.20345
   PubMed Web of Science ®Google Scholar
• Waytz, A., Heafner, J., & Epley, N. (2014). The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of Experimental Social Psychology, 52, 113–117. https://doi.org/10.1016/j.jesp.2014.01.005
   Web of Science ®Google Scholar