Older Adults’ Interaction With Intelligent Virtual Assistants: The Role of Information Modality and Feedback

References

• Abdullah, F., & Ward, R. (2016). Developing a General Extended Technology Acceptance Model for E-Learning (GETAMEL) by analysing commonly used external factors. Computers in Human Behavior, 56, 238–256. https://doi.org/10.1016/j.chb.2015.11.036
   Web of Science ®Google Scholar
• Adesope, O. O., & Nesbit, J. C. (2012). Verbal redundancy in multimedia learning environments: A meta-analysis. Journal of Educational Psychology, 104(1), 250–263. https://doi.org/10.1037/a0026147
   Web of Science ®Google Scholar
• Alkasasbeh, A. A., & Ghinea, G. (2020). Using olfactory media cues in e-learning–perspectives from an empirical investigation. Multimedia Tools and Applications, 79(27), 19265–19287. https://doi.org/10.1007/s11042-020-08763-3
   Web of Science ®Google Scholar
• Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M., & Naumer, M. (2005). Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research, 166(3–4), 559–571. https://doi.org/10.1007/s00221-005-2396-5
   PubMed Web of Science ®Google Scholar
• Atkinson, R. K., Mayer, R. E., & Merrill, M. M. (2005). Fostering social agency in multimedia learning: Examining the impact of an animated agent’s voice. Contemporary Educational Psychology, 30(1), 117–139. https://doi.org/10.1016/j.cedpsych.2004.07.001
   Web of Science ®Google Scholar
• Baddeley, A. (1992). Working memory. Science (New York, N.Y.), 255(5044), 556–559. https://doi.org/10.1126/science.1736359
   PubMed Web of Science ®Google Scholar
• Baldwin, C. L., & Ash, I. K. (2011). Impact of sensory acuity on auditory working memory span in young and older adults. Psychology and Aging, 26(1), 85–91. https://doi.org/10.1037/a0020360
   PubMed Web of Science ®Google Scholar
• Balota, D. A., Dolan, P. O., & Duchek, J. M. (2000). Memory changes in healthy young and older adults. In E. Tulving & F. Craik (Eds.), The Oxford handbook of memory (pp. 395–410). Oxford University Press.
   Google Scholar
• Bartie, P., Mackaness, W., Lemon, O., Dalmas, T., Janarthanam, S., Hill, R. L., Dickinson, A., & Liu, X. (2018). A dialogue based mobile virtual assistant for tourists: The SpaceBook Project. Computers, Environment and Urban Systems, 67, 110–123. https://doi.org/10.1016/j.compenvurbsys.2017.09.010
   Web of Science ®Google Scholar
• Beldad, A., Hegner, S., & Hoppen, J. (2016). The effect of virtual sales agent (VSA) gender–product gender congruence on product advice credibility, trust in VSA and online vendor, and purchase intention. Computers in Human Behavior, 60, 62–72. https://doi.org/10.1016/j.chb.2016.02.046
   Web of Science ®Google Scholar
• Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation-confirmation model. MIS Quarterly, 25(3), 351–370. https://doi.org/10.2307/3250921
   Web of Science ®Google Scholar
• Bol, N., Smets, E. M., Rutgers, M. M., Burgers, J. A., de Haes, H. C., Loos, E. F., & Van Weert, J. C. (2013). Do videos improve website satisfaction and recall of online cancer-related information in older lung cancer patients? Patient Education and Counseling, 92(3), 404–412. https://doi.org/10.1016/j.pec.2013.06.004
   PubMed Web of Science ®Google Scholar
• Bol, N., Van Weert, J. C., de Haes, H. C., Loos, E. F., & Smets, E. M. (2015). The effect of modality and narration style on recall of online health information: Results from a Web based experiment. Journal of Medical Internet Research, 17(4), e104. https://doi.org/10.2196/jmir.4164
   PubMed Web of Science ®Google Scholar
• Braga, R. T., Ó Catháin, C., O’Connor, N. E., & Murray, N. (2020). A Quality of Experience assessment of haptic and augmented reality feedback modalities in a gait analysis system. Plos One, 15(3), e0230570. https://doi.org/10.1371/journal.pone.0230570
   PubMed Web of Science ®Google Scholar
• Buinhas, S., Cláudio, A. P., Carmo, M. B., Balsa, J., Cavaco, A., Mendes, A., Félix, I., Pimenta, N., & Guerreiro, M. P. (2019). Virtual assistant to improve self-care of older people with type 2 diabetes: First prototype. Gerontechnology.
   Google Scholar
• Burke, J. L., Prewett, M. S., Gray, A. A., Yang, L., Stilson, F. R. B., Coovert, M. D., Elliot, L. R., & Redden, E. (2006). Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis [Paper presentation]. Proceedings of the 8th International Conference on Multimodal Interfaces, Banff, Alberta, Canada. https://doi.org/10.1145/1180995.1181017
   Google Scholar
• Castro-Alonso, J. C., & Sweller, J. (2019). The modality effect of cognitive load theory. In International conference on applied human factors and ergonomics. Springer.
   Google Scholar
• Cerekovic, A., Aran, O., & Gatica-Perez, D. (2017). Rapport with virtual agents: What do human social cues and personality explain? IEEE Transactions on Affective Computing, 8(3), 382–395. https://doi.org/10.1109/TAFFC.2016.2545650
   Web of Science ®Google Scholar
• Chattaraman, V., Kwon, W.-S., Gilbert, J. E., & Ross, K. (2019). Should AI-based, conversational digital assistants employ social- or task-oriented interaction style? A task-competency and reciprocity perspective for older adults. Computers in Human Behavior, 90, 315–330. https://doi.org/10.1016/j.chb.2018.08.048
   Web of Science ®Google Scholar
• Cheikh-Ammar, M., & Barki, H. (2016). The influence of social presence, social exchange and feedback features on SNS continuous use: The Facebook context. Journal of Organizational and End User Computing, 28(2), 33–52. https://doi.org/10.4018/JOEUC.2016040103
   Web of Science ®Google Scholar
• Chen, K., & Chan, A. H. S. (2014). Gerontechnology acceptance by elderly Hong Kong Chinese: A senior technology acceptance model (STAM). Ergonomics, 57(5), 635–652. https://doi.org/10.1080/00140139.2014.895855
   PubMed Web of Science ®Google Scholar
• Chinese Nutrition Society (2016). The Chinese dietary guidelines. People’s Medical Publishing House. http://dg.cnsoc.org/article/04/8a2389fd5520b4f30155be1475e02741.html
   Google Scholar
• Chiou, E. K., Schroeder, N. L., & Craig, S. D. (2020). How we trust, perceive, and learn from virtual humans: The influence of voice quality. Computers & Education, 146, 103756. https://doi.org/10.1016/j.compedu.2019.103756
   Web of Science ®Google Scholar
• Czaja, S. J., Charness, N., Fisk, A. D., Hertzog, C., Nair, S. N., Rogers, W. A., & Sharit, J. (2006). Factors predicting the use of technology: Findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE). Psychology and Aging, 21(2), 333–352. https://doi.org/10.1037/0882-7974.21.2.333
   PubMed Web of Science ®Google Scholar
• Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2020). How artificial intelligence will change the future of marketing. Journal of the Academy of Marketing Science, 48(1), 24–42. https://doi.org/10.1007/s11747-019-00696-0
   Web of Science ®Google Scholar
• Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
   Web of Science ®Google Scholar
• Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1003. https://doi.org/10.1287/mnsc.35.8.982
   Web of Science ®Google Scholar
• Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1992). Extrinsic and intrinsic motivation to use computers in the workplace. Journal of Applied Social Psychology, 22(14), 1111–1132. https://doi.org/10.1111/j.1559-1816.1992.tb00945.x
   Web of Science ®Google Scholar
• De Looper, M., Damman, O., Smets, E., Timmermans, D., & Van Weert, J. (2020). Adapting online patient decision aids: effects of modality and narration style on patients’ satisfaction, information recall and informed decision making. Journal of Health Communication, 25(9), 712–726. https://doi.org/10.1080/10810730.2020.1840674
   PubMed Web of Science ®Google Scholar
• Elkins, A. C., & Derrick, D. C. (2013). The sound of trust: Voice as a measurement of trust during interactions with embodied conversational agents. Group Decision and Negotiation, 22(5), 897–913. https://doi.org/10.1007/s10726-012-9339-x
   Web of Science ®Google Scholar
• Farage, M. A., Miller, K. W., Ajayi, F., & Hutchins, D. (2012). Design principles to accommodate older adults. Global Journal of Health Science, 4(2), 2–25. https://doi.org/10.5539/gjhs.v4n2p2
   PubMedGoogle Scholar
• Farivar, S., Abouzahra, M., & Ghasemaghaei, M. (2020). Wearable device adoption among older adults: A mixed-methods study. International Journal of Information Management, 55, 102209. https://doi.org/10.1016/j.ijinfomgt.2020.102209
   PubMed Web of Science ®Google Scholar
• Fisk, A. D., Czaja, S. J., Rogers, W. A., Charness, N., & Sharit, J. (2009). Designing for older adults: Principles and creative human factors approaches second edition. Taylor and Francis.
   Google Scholar
• Fountoukidou, S., Ham, J., Matzat, U., & Midden, C. (2018). Using an artificial agent as a behavior model to promote assistive technology acceptance. In J. Ham, E. Karapanos, P. P. Morita, & C. M. Burns (Eds.), Persuasive technology. International Conference on Persuasive Technology. Springer.
   Google Scholar
• Ghasemaghaei, M., Hassanein, K., & Benbasat, I. (2019). Assessing the design choices for online recommendation agents for older adults: Older does not always mean simpler information technology. MIS Quarterly, 43(1), 329–346. https://doi.org/10.25300/MISQ/2019/13947
   Web of Science ®Google Scholar
• Ghorayeb, A., Comber, R., & Gooberman-Hill, R. (2021). Older adults’ perspectives of smart home technology: Are we developing the technology that older people want? International Journal of Human-Computer Studies, 147, 102571. https://doi.org/10.1016/j.ijhcs.2020.102571
   Web of Science ®Google Scholar
• Ginns, P. (2005). Meta-analysis of the modality effect. Learning and Instruction, 15(4), 313–331. https://doi.org/10.1016/j.learninstruc.2005.07.001
   Web of Science ®Google Scholar
• Goudey, A., & Bonnin, G. (2016). Must smart objects look human? Study of the impact of anthropomorphism on the acceptance of companion robots. Recherche et Applications en Marketing (English Edition), 31(2), 2–20. https://doi.org/10.1177/2051570716643961
   Google Scholar
• Graham, R. (1999). Use of auditory icons as emergency warnings: Evaluation within a vehicle collision avoidance application. Ergonomics, 42(9), 1233–1248. https://doi.org/10.1080/001401399185108
   PubMed Web of Science ®Google Scholar
• Grassi, M., & Casco, C. (2010). Audiovisual bounce-inducing effect: When sound congruence affects grouping in vision. Attention, Perception & Psychophysics, 72(2), 378–386. https://doi.org/10.3758/APP.72.2.378
   PubMed Web of Science ®Google Scholar
• Guo, Y. R., Goh, D. H.-L., Muhamad, H. B. H., Ong, B. K., & Lei, Z. (2016). Experimental evaluation of affective embodied agents in an information literacy game [Paper presentation]. Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries, Newark, NJ. https://doi.org/10.1145/2910896.2910897
   Google Scholar
• Gursoy, D., Chi, O. H., Lu, L., & Nunkoo, R. (2019). Consumers acceptance of artificially intelligent (AI) device use in service delivery. International Journal of Information Management, 49, 157–169. https://doi.org/10.1016/j.ijinfomgt.2019.03.008
   Web of Science ®Google Scholar
• Ha, Q.-A., Chen, J. V., Uy, H. U., & Capistrano, E. P. (2021). Exploring the privacy concerns in using intelligent virtual assistants under perspectives of information sensitivity and anthropomorphism. International Journal of Human–Computer Interaction, 37(6), 512–527. https://doi.org/10.1080/10447318.2020.1834728
   Web of Science ®Google Scholar
• Han, B., & Kim, K. (2015). Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices. Journal on Multimodal User Interfaces, 9(3), 173–181. https://doi.org/10.1007/s12193-015-0177-4
   Web of Science ®Google Scholar
• Han, S., & Yang, H. (2018). Understanding adoption of intelligent personal assistants: A parasocial relationship perspective. Industrial Management & Data Systems, 118(3), 618–636. https://doi.org/10.1108/IMDS-05-2017-0214
   Web of Science ®Google Scholar
• Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
   Web of Science ®Google Scholar
• Heerink, M., Kröse, B., Evers, V., & Wielinga, B. (2010). Assessing acceptance of assistive social agent technology by older adults: The Almere model. International Journal of Social Robotics, 2(4), 361–375. https://doi.org/10.1007/s12369-010-0068-5
   Web of Science ®Google Scholar
• Hercegfi, K., Komlódi, A., Köles, M., & Tóvölgyi, S. (2019). Eye-tracking-based wizard-of-oz usability evaluation of an emotional display agent integrated to a virtual environment. Acta Polytechnica Hungarica, 16(2), 145–162. https://doi.org/10.13016/M2WTJD-3L91
   Web of Science ®Google Scholar
• Horning, M. A. (2017). Interacting with news: Exploring the effects of modality and perceived responsiveness and control on news source credibility and enjoyment among second screen viewers. Computers in Human Behavior, 73, 273–283. https://doi.org/10.1016/j.chb.2017.03.023
   Web of Science ®Google Scholar
• Hoy, M. B. (2018). Alexa, Siri, Cortana, and more: An introduction to voice assistants. Medical Reference Services Quarterly, 37(1), 81–88. https://doi.org/10.1080/02763869.2018.1404391
   PubMedGoogle Scholar
• Hu, H. J., Yen, J., & Guan, S. S. (2008). A study on the interface usability of B2C hypermarket E-commerce website. In 2008 IEEE Asia-Pacific Services Computing Conference (pp. 1202–1207). IEEE.
   Google Scholar
• Hu, Q., Lu, Y., Pan, Z., Gong, Y., & Yang, Z. (2021). Can AI artifacts influence human cognition? The effects of artificial autonomy in intelligent personal assistants. International Journal of Information Management, 56, 102250. https://doi.org/10.1016/j.ijinfomgt.2020.102250
   Web of Science ®Google Scholar
• Huang, G., & Pitts, B. (2020). Age-related differences in takeover request modality preferences and attention allocation during semi-autonomous driving. In Q. Gao & J. Zhou (Eds.), Human aspects of IT for the aged population. Technologies, design and user experience (pp. 135–146). Springer.
   Google Scholar
• Iordanescu, L., Grabowecky, M., & Suzuki, S. (2011). Object-based auditory facilitation of visual search for pictures and words with frequent and rare targets. Acta psychologica, 137(2), 252–259. https://doi.org/10.1016/j.actpsy.2010.07.017
   PubMed Web of Science ®Google Scholar
• Iordanescu, L., Guzman-Martinez, E., Grabowecky, M., & Suzuki, S. (2008). Characteristic sounds facilitate visual search. Psychonomic Bulletin & Review, 15(3), 548–554. https://doi.org/10.3758/PBR.15.3.548
   PubMed Web of Science ®Google Scholar
• Jacko, J., Emery, V. K., Edwards, P. J., Ashok, M., Barnard, L., Kongnakorn, T., Moloney, K. P., & Sainfort, F. (2004). The effects of multimodal feedback on older adults’ task performance given varying levels of computer experience. Behaviour & Information Technology, 23(4), 247–264. https://doi.org/10.1080/01449290310001659213
   Web of Science ®Google Scholar
• Jacko, J., Scott, I., Sainfort, F., Barnard, L., Edwards, P. J., Emery, V. K., Kongnakorn, T., Moloney, K. P., & Zorich, B. S. (2003). Older adults and visual impairment: What do exposure times and accuracy tell us about performance gains associated with multimodal feedback? [Paper presentation]. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Ft. Lauderdale, FL. https://doi.org/10.1145/642611.642619
   Google Scholar
• Jianan, L., & Abas, A. (2020). Development of human-computer interactive interface for intelligent automotive. International Journal of Artificial Intelligence, 7(2), 13–21. https://doi.org/10.36079/lamintang.ijai-0702.134
   Google Scholar
• Kahneman, D. (1973). Attention and effort (Vol. 1063). Prentice-Hall.
   Google Scholar
• Keil, M., & Johnson, R. D. (2002). Feedback channels: Using social presence theory to compare voice mail to e-mail. Journal of Information Systems Education, 13(4), 295–302.
   Google Scholar
• Kim, K. J., Sundar, S. S., & Park, E. (2011). The effects of screen-size and communication modality on psychology of mobile device users. In CHI’11 Extended Abstracts on Human Factors in Computing Systems (pp. 1207–1212). ACM. https://doi.org/10.1145/1979742.1979749
   Google Scholar
• Kim, Y., & Baylor, A. L. (2006). A social-cognitive framework for pedagogical agents as learning companions. Educational Technology Research and Development, 54(6), 569–596. https://doi.org/10.1007/s11423-006-0637-3
   Web of Science ®Google Scholar
• King, K., Ellis, T. J. (2009). Comparison of social presence in voice-based and text-based asynchronous computer conferences. In 2009 42nd Hawaii International Conference on System Sciences (pp. 1–10). IEEE.
   Google Scholar
• Klaus, P., & Zaichkowsky, J. (2020). AI voice bots: A services marketing research agenda. Journal of Services Marketing, 34(3), 389–398. https://doi.org/10.1108/JSM-01-2019-0043
   Web of Science ®Google Scholar
• Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E. (2019). The personalization of conversational agents in health care: Systematic review. Journal of Medical Internet Research, 21(11), e15360. https://doi.org/10.2196/15360
   PubMed Web of Science ®Google Scholar
• Korad, S., Rake, R., Kumar, V. (2020). Global Intelligent Virtual Assistant Market: Opportunity and Forecast, 2020–2027. https://www.alliedmarketresearch.com/intelligent-virtual-assistant-market
   Google Scholar
• Kreijns, K., Kirschner, P. A., & Jochems, W. (2003). Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: A review of the research. Computers in Human Behavior, 19(3), 335–353. https://doi.org/10.1016/S0747-5632(02)00057-2
   Web of Science ®Google Scholar
• Laeeq, K., & Memon, Z. A. (2021). Scavenge: An intelligent multi-agent based voice-enabled virtual assistant for LMS. Interactive Learning Environments, 1-19, 29(6), 954–972. https://doi.org/10.1080/10494820.2019.1614634
   Google Scholar
• Lang, A. (1995). Defining audio/video redundancy from a limited-capacity information processing perspective. Communication Research, 22(1), 86–115. https://doi.org/10.1177/009365095022001004
   Web of Science ®Google Scholar
• Lang, A. (2000). The limited capacity model of mediated message processing. Journal of Communication, 50(1), 46–70. https://doi.org/10.1111/j.1460-2466.2000.tb02833.x
   Web of Science ®Google Scholar
• Large, D. R., Kim, H., Merenda, C., Leong, S., Harvey, C., Burnett, G., & Gabbard, J. (2019). Investigating the effect of urgency and modality of pedestrian alert warnings on driver acceptance and performance. Transportation Research Part F: Traffic Psychology and Behaviour, 60, 11–24. https://doi.org/10.1016/j.trf.2018.09.028
   Web of Science ®Google Scholar
• Laurienti, P. J., Burdette, J. H., Maldjian, J. A., & Wallace, M. T. (2006). Enhanced multisensory integration in older adults. Neurobiology of Aging, 27(8), 1155–1163. https://doi.org/10.1016/j.neurobiolaging.2005.05.024
   PubMed Web of Science ®Google Scholar
• Leahy, W., & Sweller, J. (2011). Cognitive load theory, modality of presentation and the transient information effect. Applied Cognitive Psychology, 25(6), 943–951. https://doi.org/10.1002/acp.1787
   Web of Science ®Google Scholar
• Leahy, W., Chandler, P., & Sweller, J. (2003). When auditory presentations should and should not be a component of multimedia instruction. Applied Cognitive Psychology, 17(4), 401–418. https://doi.org/10.1002/acp.877
   Web of Science ®Google Scholar
• Lee, J., Poliakoff, E., & Spence, C. (2009). The effect of multimodal feedback presented via a touch screen on the performance of older adults. In M. E. Altinsoy, U. Jekosch, & S. Brewster (Eds.), International conference on haptic and audio interaction design. Heidelberg.
   Google Scholar
• Lee, K. M. (2004). Presence, explicated. Communication Theory, 14(1), 27–50. https://doi.org/10.1111/j.1468-2885.2004.tb00302.x
   Web of Science ®Google Scholar
• Lee, K. M., Jung, Y., Kim, J., & Kim, S. R. (2006). Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people's loneliness in human–robot interaction. International Journal of Human-Computer Studies, 64(10), 962–973. https://doi.org/10.1016/j.ijhcs.2006.05.002
   Web of Science ®Google Scholar
• Lee, M. C. (2010). Explaining and predicting users’ continuance intention toward e-learning: An extension of the expectation–confirmation model. Computers & Education, 54(2), 506–516. https://doi.org/10.1016/j.compedu.2009.09.002
   Web of Science ®Google Scholar
• Leung, K. F., Wong, W. W., Tay, M. S. M., Chu, M. M. L., & Ng, S. S. W. (2005). Development and validation of the interview version of the Hong Kong Chinese WHOQOL-BREF. Quality of Life Research, 14(5), 1413–1419. https://doi.org/10.1007/s11136-004-4772-1
   PubMed Web of Science ®Google Scholar
• Li, J. (2015). The benefit of being physically present: A survey of experimental works comparing copresent robots, telepresent robots and virtual agents. International Journal of Human-Computer Studies, 77, 23–37. https://doi.org/10.1016/j.ijhcs.2015.01.001
   Web of Science ®Google Scholar
• Li, J., Ma, Q., Chan, A. H. S., & Man, S. S. (2019). Health monitoring through wearable technologies for older adults: Smart wearables acceptance model. Applied Ergonomics, 75, 162–169. https://doi.org/10.1016/j.apergo.2018.10.006
   PubMed Web of Science ®Google Scholar
• Lin, L., Atkinson, R. K., Christopherson, R. M., Joseph, S. S., & Harrison, C. J. (2013). Animated agents and learning: Does the type of verbal feedback they provide matter? Computers & Education, 67, 239–249. https://doi.org/10.1016/j.compedu.2013.04.017
   Web of Science ®Google Scholar
• Liu, N., & Yu, R. (2017). Identifying design feature factors critical to acceptance and usage behavior of smartphones. Computers in Human Behavior, 70, 131–142. https://doi.org/10.1016/j.chb.2016.12.073
   Web of Science ®Google Scholar
• Martin-Hammond, A., Vemireddy, S., & Rao, K. (2019). Exploring older adults’ beliefs about the use of intelligent assistants for consumer health information management: A participatory design study. JMIR Aging, 2(2), e15381. https://doi.org/10.2196/15381
   PubMedGoogle Scholar
• Mayer, R. E., Sobko, K., & Mautone, P. D. (2003). Social cues in multimedia learning: Role of speaker’s voice. Journal of Educational Psychology, 95(2), 419–425. https://doi.org/10.1037/0022-0663.95.2.419
   Web of Science ®Google Scholar
• McLean, G., & Osei-Frimpong, K. (2019). Hey Alexa… examine the variables influencing the use of artificial intelligent in-home voice assistants. Computers in Human Behavior, 99, 28–37. https://doi.org/10.1016/j.chb.2019.05.009
   Web of Science ®Google Scholar
• McMurray, J., Strudwick, G., Forchuk, C., Morse, A., Lachance, J., Baskaran, A., Allison, L., & Booth, R. (2017). The importance of trust in the adoption and use of intelligent assistive technology by older adults to support aging in place: Scoping review protocol. JMIR Research Protocols, 6(11), e8772. https://doi.org/10.2196/resprot.8772
   Google Scholar
• Meyerhoff, H. S., & Huff, M. (2016). Semantic congruency but not temporal synchrony enhances long-term memory performance for audio-visual scenes. Memory & Cognition, 44(3), 390–402. https://doi.org/10.3758/s13421-015-0575-6
   PubMed Web of Science ®Google Scholar
• Monks, J., Olaru, A., Tal, I., & Muntean, G.-M. (2017). Quality of experience assessment of 3D video synchronised with multisensorial media components [Paper presentation]. 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Cagliari, Italy. https://doi.org/10.1109/BMSB.2017.7986129
   Google Scholar
• Moreno, R., & Mayer, R. E. (2002). Verbal redundancy in multimedia learning: When reading helps listening. Journal of Educational Psychology, 94(1), 156–163. https://doi.org/10.1037/0022-0663.94.1.156
   Web of Science ®Google Scholar
• Nallam, P., Bhandari, S., Sanders, J., & Martin-Hammond, A. (2020). A question of access: Exploring the perceived benefits and barriers of intelligent voice assistants for improving access to consumer health resources among low-income older adults. Gerontology & Geriatric Medicine, 6, 2333721420985975. https://doi.org/10.1177/2333721420985975
   Web of Science ®Google Scholar
• Naumann, A. B., Wechsung, I., & Hurtienne, J. (2010). Multimodal interaction: A suitable strategy for including older users? Interacting with Computers, 22(6), 465–474. https://doi.org/10.1016/j.intcom.2010.08.005
   Web of Science ®Google Scholar
• Nesbitt, K. V., & Hoskens, I. (2008). Multi-sensory game interface improves player satisfaction but not performance. In Proceedings of the Ninth Conference on Australasian User Interface. Australian compute society.
   Google Scholar
• O’Brien, K., Liggett, A., Ramirez-Zohfeld, V., Sunkara, P., & Lindquist, L. A. (2020). Voice‐controlled intelligent personal assistants to support aging in place. Journal of the American Geriatrics Society, 68(1), 176–179. https://doi.org/10.1111/jgs.16217
   PubMed Web of Science ®Google Scholar
• Oviatt, S. (2003). Multimodal interfaces. In A. Sears & J. A. Jacko (Eds.), The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications (Vol. 14, pp. 286–304). CRC Press.
   Google Scholar
• Pagani, M., Racat, M., & Hofacker, C. F. (2019). Adding voice to the omnichannel and how that affects brand trust. Journal of Interactive Marketing, 48, 89–105. https://doi.org/10.1016/j.intmar.2019.05.002
   Web of Science ®Google Scholar
• Palmeiro, A. R., van der Kint, S., Vissers, L., Farah, H., de Winter, J. C., & Hagenzieker, M. (2018). Interaction between pedestrians and automated vehicles: A Wizard of Oz experiment. Transportation Research Part F: Traffic Psychology and Behaviour, 58, 1005–1020. https://doi.org/10.1016/j.trf.2018.07.020
   Web of Science ®Google Scholar
• Park, Y., Heo, H., & Lee, K. (2015). Enhanced auditory feedback for Korean touch screen keyboards. International Journal of Human-Computer Studies, 73, 1–11. https://doi.org/10.1016/j.ijhcs.2014.08.002
   Web of Science ®Google Scholar
• Pitts, B. J., & Sarter, N. (2018). What you don’t notice can harm you: Age-related differences in detecting concurrent visual, auditory, and tactile cues. Human Factors, 60(4), 445–464. https://doi.org/10.1177/0018720818759102
   PubMed Web of Science ®Google Scholar
• Portolese Dias, L., & Trumpy, R. (2014). Online instructor’s use of audio feedback to increase social presence and student satisfaction. Journal of Educators Online, 11(2), 1–19. https://doi.org/10.9743/JEO.2014.2.5
   Google Scholar
• Poushneh, A. (2021). Impact of auditory sense on trust and brand affect through auditory social interaction and control. Journal of Retailing and Consumer Services, 58, 102281. https://doi.org/10.1016/j.jretconser.2020.102281
   Web of Science ®Google Scholar
• Pradhan, A., Findlater, L., Lazar, A. (2019). “Phantom friend” or “just a box with information” personification and ontological categorization of smart speaker-based voice assistants by older adults. Proceedings of the ACM on Human-Computer Interaction, 3, 1–21. https://doi.org/10.1145/3359316
   PubMedGoogle Scholar
• Qiu, L., & Benbasat, I. (2009). Evaluating anthropomorphic product recommendation agents: A social relationship perspective to designing information systems. Journal of Management Information Systems, 25(4), 145–182. https://doi.org/10.2753/MIS0742-1222250405
   Web of Science ®Google Scholar
• Reeves, B., & Nass, C. (1996). The media equation: How people treat computers, television, and new media like real people. Cambridge University Press.
   Google Scholar
• Reis, A., Paulino, D., Paredes, H., & Barroso, J. (2017). Using intelligent personal assistants to strengthen the elderlies’ social bonds. In M. Antona & C. Stephanidis (Eds.). Universal Access in Human–Computer Interaction. Human and Technological Environments.
   Google Scholar
• Rhee, C. E., & Choi, J. (2020). Effects of personalization and social role in voice shopping: An experimental study on product recommendation by a conversational voice agent. Computers in Human Behavior, 109, 106359. https://doi.org/10.1016/j.chb.2020.106359
   Web of Science ®Google Scholar
• Ritzhaupt, A. D., Gomes, N. D., & Barron, A. E. (2008). The effects of time-compressed audio and verbal redundancy on learner performance and satisfaction. Computers in Human Behavior, 24(5), 2434–2445. https://doi.org/10.1016/j.chb.2008.02.017
   Web of Science ®Google Scholar
• Rosson, M. B., & Carroll, J. M. (2002). Scenario-based design. In A. Sears & J. Jacko (Eds.), Human-computer interaction: Development process (pp. 145–164). L. Erlbaum Associates Inc.
   Google Scholar
• Sallnäs, E. L. (2004). The effect of modality on social presence, presence and performance in collaborative virtual environments [Doctoral dissertation]. KTH.
   Google Scholar
• Salthouse, T. A. (1996). The processing-speed theory of adult age differences in cognition. Psychological Review, 103(3), 403–428. https://doi.org/10.1037/0033-295x.103.3.403
   PubMed Web of Science ®Google Scholar
• Santos, J., Rodrigues, J. J., Silva, B. M., Casal, J., Saleem, K., & Denisov, V. (2016). An IoT-based mobile gateway for intelligent personal assistants on mobile health environments. Journal of Network and Computer Applications, 71, 194–204. https://doi.org/10.1016/j.jnca.2016.03.014
   Web of Science ®Google Scholar
• Schuetzler, R. M., Giboney, J. S., Grimes, G. M., & Nunamaker, J. F. Jr, (2018). The influence of conversational agent embodiment and conversational relevance on socially desirable responding. Decision Support Systems, 114, 94–102. https://doi.org/10.1016/j.dss.2018.08.011
   Web of Science ®Google Scholar
• Shneiderman, B., & Plaisant, C. (2009). Designing the user interface (5th ed.). Addison Wesley.
   Google Scholar
• Silvervarg, A., Haake, M., Pareto, L., Tärning, B., & Gulz, A. (2011). Pedagogical agents: Pedagogical interventions via integration of task-oriented and socially oriented conversation. Annual Meeting of the American Educational Research Association.
   Google Scholar
• Spence, C. (2010). Crossmodal spatial attention. Annals of the New York Academy of Sciences, 1191(1), 182–200. https://doi.org/10.1111/j.1749-6632.2010.05440.x
   PubMedGoogle Scholar
• Statista. (2020). Population of adults aged 65 and older in the United States in 2019, by state. https://www.statista.com/statistics/736211/senior-population-of-the-us-by-state/
   Google Scholar
• Tang, Y., & Hew, K. F. (2020). Does mobile instant messaging facilitate social presence in online communication? A two-stage study of higher education students. International Journal of Educational Technology in Higher Education, 17(1), 1–17. https://doi.org/10.1186/s41239-020-00188-0
   Web of Science ®Google Scholar
• Tenneti, R., Johnson, D., Goldenberg, L., Parker, R. A., & Huppert, F. A. (2012). Towards a capabilities database to inform inclusive design: Experimental investigation of effective survey-based predictors of human-product interaction. Applied Ergonomics, 43(4), 713–726. https://doi.org/10.1016/j.apergo.2011.11.005
   PubMed Web of Science ®Google Scholar
• Thakur, N., & Han, C. Y. (2019). Framework for a personalized intelligent assistant to elderly people for activities of daily living. International Journal of Recent Trends in Human Computer Interaction, 9(1), 1–22. https://doi.org/10.48550/arXiv.2107.07344
   Google Scholar
• Thomas, R. A., West, R. E., & Borup, J. (2017). An analysis of instructor social presence in online text and asynchronous video feedback comments. The Internet and Higher Education, 33, 61–73. https://doi.org/10.1016/j.iheduc.2017.01.003
   Web of Science ®Google Scholar
• Trajkova, M., & Martin-Hammond, A. (2020). “Alexa is a toy”: Exploring older adults’ reasons for using, limiting, and abandoning echo [Paper presentation]. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI. https://doi.org/10.1145/3313831.3376760
   Google Scholar
• Tsai, W.-C., & Lee, C.-F. (2009). A study on the icon feedback types of small touch screen for the elderly. In C. Stephanidis (Ed.), Universal Access in Human-Computer Interaction. International Conference on Universal Access in Human-Computer Interaction.
   Google Scholar
• Tulshan, A. S., & Dhage, S. N. (2019). Survey on virtual assistant: Google Assistant, Siri, Cortana, Alexa. In S. Thampi, O. Marques, S. Krishnan, K. Li, D. Ciuonzo, & M. Kolekar (Eds.), Advances in signal processing and intelligent recognition systems. International Symposium on Signal Processing and Intelligent Recognition Systems. Singapore: Springer. https://doi.org/10.1007/978-981-13-5758-9_17
   Google Scholar
• Turk, M. (2014). Multimodal interaction: A review. Pattern Recognition Letters, 36, 189–195. https://doi.org/10.1016/j.patrec.2013.07.003
   Web of Science ®Google Scholar
• Tussyadiah, I. P., Zach, F. J., & Wang, J. (2020). Do travelers trust intelligent service robots? Annals of Tourism Research, 81, 102886. https://doi.org/10.1016/j.annals.2020.102886
   Web of Science ®Google Scholar
• United Nations. (2019). World population ageing 2019. https://www.un.org/en/development/desa/population/publications/pdf/ageing/WorldPopulationAgeing2019-Highlights.pdf
   Google Scholar
• van der Meij, H. (2013). Motivating agents in software tutorials. Computers in Human Behavior, 29(3), 845–857. https://doi.org/10.1016/j.chb.2012.10.018
   Web of Science ®Google Scholar
• Veletsianos, G. (2012). How do learners respond to pedagogical agents that deliver social-oriented non-task messages? Impact on student learning, perceptions, and experiences. Computers in Human Behavior, 28(1), 275–283. https://doi.org/10.1016/j.chb.2011.09.010
   Web of Science ®Google Scholar
• Veletsianos, G., & Doering, A. (2010). Long-term student experiences in a hybrid, open-ended and problem based Adventure Learning program. Australasian Journal of Educational Technology, 26(2), 280–296. https://doi.org/10.14742/ajet.1096
   Web of Science ®Google Scholar
• Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540
   Web of Science ®Google Scholar
• Wan, Y., Prinet, J. C., & Sarter, N. (2017). Visual and auditory feedback to improve touchscreen usability in turbulence. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61(1), 89–93. https://doi.org/10.1177/1541931213601488
   Google Scholar
• Wang, X., & Yan, K. (2019). Immersive human–computer interactive virtual environment using large-scale display system. Future Generation Computer Systems, 96, 649–659. https://doi.org/10.1016/j.future.2017.07.058
   Web of Science ®Google Scholar
• Wang, Z., David, P., Srivastava, J., Powers, S., Brady, C., D’Angelo, J., & Moreland, J. (2012). Behavioral performance and visual attention in communication multitasking: A comparison between instant messaging and online voice chat. Computers in Human Behavior, 28(3), 968–975. https://doi.org/10.1016/j.chb.2011.12.018
   Web of Science ®Google Scholar
• Whang, C., & Im, H. (2021). “I Like Your Suggestion!” the role of humanlikeness and parasocial relationship on the website versus voice shopper’s perception of recommendations. Psychology & Marketing, 38(4), 581–595. https://doi.org/10.1002/mar.21437
   Web of Science ®Google Scholar
• WHO. (2015). Definition of an older or elderly person: Proposed working definition of an older person in Africa for the MDS project. World Health Organization. http://www.who.int/healthinfo/survey/ageingdefnolder/en/
   Google Scholar
• Wickens, C. D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159–177. https://doi.org/10.1080/14639220210123806
   Google Scholar
• Wolf, C. T. (2019). Explainability scenarios: Towards scenario-based XAI design [Paper presentation]. Proceedings of the 24th International Conference on Intelligent User Interfaces, Marina del Ray, CA. https://doi.org/10.1145/3301275.3302317
   Google Scholar
• Xu, S., Fang, X., Brzezinski, J., & Chan, S. (2008). Development of a dual-modal presentation of texts for small screens. International Journal of Human–Computer Interaction, 24(8), 776–793. https://doi.org/10.1080/10447310802537566
   Web of Science ®Google Scholar
• Yang, H., & Lee, H. (2019). Understanding user behavior of virtual personal assistant devices. Information Systems and e-Business Management, 17(1), 65–87. https://doi.org/10.1007/s10257-018-0375-1
   Web of Science ®Google Scholar
• Zhou, J., Rau, P.-L P., & Salvendy, G. (2012). Use and design of handheld computers for older adults: A review and appraisal. International Journal of Human-Computer Interaction, 28(12), 799–826. https://doi.org/10.1080/10447318.2012.668129
   Web of Science ®Google Scholar
• Zhou, J., Rau, P.-L P., & Salvendy, G. (2014). Older adults’ use of smart phones: An investigation of the factors influencing the acceptance of new functions. Behaviour & Information Technology, 33(6), 552–560. https://doi.org/10.1080/0144929X.2013.780637
   Web of Science ®Google Scholar