Interactive Output Modalities Design for Enhancement of User Trust Experience in Highly Autonomous Driving

References

• Abe, G., Sato, K., & Itoh, M. (2015, October). Driver’s trust in automted driving when passing other traffic objects [Paper presentation]. In 2015 IEEE International Conference on Systems, Man, and Cybernetics, (pp. 897–902). IEEE. https://doi.org/10.1109/SMC.2015.165
   Google Scholar
• Árnason, J. I., Jepsen, J., Koudal, A., Schmidt, M. R., & Serafin, S. (2014). Volvo intelligent news: A context aware multi modal proactive recommender system for in-vehicle use. Pervasive and Mobile Computing, 14, 95–111. https://doi.org/10.1016/j.pmcj.2014.06.005
   Web of Science ®Google Scholar
• Autohome Research Institute (2023). Hard-hitting report “Insights into automobile consumption in China in 2023”. Autohome.com. https://www.autohome.com.cn/news/202312/1291757.html
   Google Scholar
• Babakus, E., & Mangold, W. G. (1992). Adapting the SERVQUAL scale to hospital services: An empirical investigation. Health Services Research, 26(6), 767–786. https://doi.org/10.17265/1537-1506/2014.05.001
   PubMed Web of Science ®Google Scholar
• Balfe, N., Sharples, S., & Wilson, J. R. (2015). Impact of automation: Measurement of performance, workload and behaviour in a complex control environment. Applied Ergonomics, 47, 52–64. https://doi.org/10.1016/j.apergo.2014.08.002
   PubMed Web of Science ®Google Scholar
• Barnard, Y., & Lai, F. (2010). Spotting sheep in Yorkshire: Using eye-tracking for studying situation awareness in a driving simulator [Paper presentation]. Human Factors: A System View of Human, Technology and Organisation. Annual Conference of the Europe Chapter of the Human Factors and Ergonomics Society 2009.
   Google Scholar
• Bazilinskyy, P., Petermeijer, S. M., Petrovych, V., Dodou, D., & De Winter, J. C. F. (2018). Take-over requests in highly automated driving: A crowdsourcing multimedia survey on auditory, vibrotactile, and visual displays. Transportation Research Part F: Traffic Psychology and Behaviour, 56, 82–98. https://doi.org/10.1016/j.trf.2018.04.001
   Web of Science ®Google Scholar
• Beller, J., Heesen, M., & Vollrath, M. (2013). Improving the driver–automation interaction: An approach using automation uncertainty. Human Factors, 55(6), 1130–1141. https://doi.org/10.1177/0018720813482327
   PubMed Web of Science ®Google Scholar
• Benyon, D. (2014). Designing interactive systems: A comprehensive guide to HCI, UX and interaction design. Pearson.
   Google Scholar
• Bohus, D., & Horvitz, E. (2010)., November). Facilitating multiparty dialog with gaze, gesture, and speech [Paper presentation]. International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, (pp. 1–8). https://doi.org/10.1145/1891903.1891910
   Google Scholar
• Brinkley, J., Daily, S. B., & Gilbert, J. E. (2018). A survey of visually impaired consumers about self-driving vehicles. Journal on Technology and Persons with Disabilities, 6(2018), 274–283.
   Google Scholar
• Brookhuis, K. A., & De Waard, D. (2010). Monitoring drivers’ mental workload in driving simulators using physiological measures. Accident; Analysis and Prevention, 42(3), 898–903. https://doi.org/10.1016/j.aap.2009.06.001
   PubMed Web of Science ®Google Scholar
• Bunt, H., Beun, R. J., & Borghuis, T. (Eds.). (1998). Multimodal human-computer communication: Systems, techniques, and experiments (Vol. 1374). Springer Science & Business Media. https://doi.org/10.1007/bfb0052309
   Google Scholar
• Carsten, O., Lai, F. C., Barnard, Y., Jamson, A. H., & Merat, N. (2012). Control task substitution in semiautomated driving: Does it matter what aspects are automated? Human Factors, 54(5), 747–761. https://doi.org/10.1177/0018720812460246
   PubMed Web of Science ®Google Scholar
• Chang, K. J., Cho, G., Song, W., Kim, M. J., Ahn, C. W., & Song, M. (2022). Personalized EV driving sound design based on the driver's total emotion recognition. SAE International Journal of Advances and Current Practices in Mobility, 5(2022-01-0972), 921–929.
   Google Scholar
• Charles, R. L., & Nixon, J. (2019). Measuring mental workload using physiological measures: A systematic review. Applied Ergonomics, 74, 221–232. https://doi.org/10.1016/j.apergo.2018.08.028
   PubMed Web of Science ®Google Scholar
• Cutugno, F., Leano, V. A., Rinaldi, R., & Mignini, G. (2012, May). Multimodal framework for mobile interaction [Paper presentation]. International Working Conference on Advanced Visual Interfaces, (pp. 197–203). https://doi.org/10.1145/2254556.2254592
   Google Scholar
• de Winter, J. C. F., Happee, R., Martens, M. H., & Stanton, N. A. (2014). Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence. Transportation Research Part F: Traffic Psychology and Behaviour, 27, 196–217. https://doi.org/10.1016/j.trf.2014.06.016
   Web of Science ®Google Scholar
• Deng, M., Chen, J., Wu, Y., Ma, S., Li, H., Yang, Z., & Shen, Y. (2024). Using voice recognition to measure trust during interactions with automated vehicles. Applied Ergonomics, 116, 104184. https://doi.org/10.1016/j.apergo.2023.104184
   PubMed Web of Science ®Google Scholar
• Detjen, H., Faltaous, S., Pfleging, B., Geisler, S., & Schneegass, S. (2021). How to increase automated vehicles’ acceptance through in-vehicle interaction design: A review. International Journal of Human–Computer Interaction, 37(4), 308–330. https://doi.org/10.1080/10447318.2020.1860517
   Web of Science ®Google Scholar
• Development Research Center of the State Council, China Society of Automotive Engineers, & Volkswagen Group (China). (2023). Annual report on automotive industry in Chine (2022). China Development Press.
   Google Scholar
• Dey, A. K. (2000). Providing architectural support for building context-aware applications. Georgia Institute of Technology.
   Google Scholar
• Fagnant, D. J., & Kockelman, K. (2015). Preparing a nation for autonomous vehicles: Opportunities, barriers and policy recommendations. Transportation Research Part A: Policy and Practice, 77, 167–181. https://doi.org/10.1016/j.tra.2015.04.003
   Web of Science ®Google Scholar
• Forster, Y., Hergeth, S., Naujoks, F., Krems, J., & Keinath, A. (2019). User education in automated driving: Owner’s manual and interactive tutorial support mental model formation and human-automation interaction. Information, 10(4), 143. https://doi.org/10.3390/info10040143
   Google Scholar
• Gaudin, S. (2012). Autonomous cars will arrive within 10 years, Intel CTO says. ComputerWorld, 22.
   Google Scholar
• Gefen, D., Karahanna, E., & Straub, D. W. (2003). Trust and TAM in online shopping: An integrated model. MIS Quarterly, 1, 27, 51–90. https://doi.org/10.2307/30036519
   Web of Science ®Google Scholar
• Geitner, C., Biondi, F., Skrypchuk, L., Jennings, P., & Birrell, S. (2019). The comparison of auditory, tactile, and multimodal warnings for the effective communication of unexpected events during an automated driving scenario. Transportation Research Part F: Traffic Psychology and Behaviour, 65, 23–33. https://doi.org/10.1016/j.trf.2019.06.011
   Web of Science ®Google Scholar
• Gkartzonikas, C., & Gkritza, K. (2019). What have we learned? A review of stated preference and choice studies on autonomous vehicles. Transportation Research Part C: Emerging Technologies, 98, 323–337. https://doi.org/10.1016/j.trc.2018.12.003
   Web of Science ®Google Scholar
• Gold, C., Körber, M., Hohenberger, C., Lechner, D., & Bengler, K. (2015). Trust in automation–before and after the experience of take-over scenarios in a highly automated vehicle. Procedia Manufacturing, 3, 3025–3032. https://doi.org/10.1016/j.promfg.2015.07.847
   Google Scholar
• Hancock, P. A., Nourbakhsh, I., & Stewart, J. (2019). On the future of transportation in an era of automated and autonomous vehicles. Proceedings of the National Academy of Sciences of the United States of America, 116(16), 7684–7691. https://doi.org/10.1073/pnas.1805770115
   PubMed Web of Science ®Google Scholar
• Hartwich, F., Beggiato, M., & Krems, J. F. (2018). Driving comfort, enjoyment and acceptance of automated driving–effects of drivers’ age and driving style familiarity. Ergonomics, 61(8), 1017–1032. https://doi.org/10.1080/00140139.2018.1441448
   PubMed Web of Science ®Google Scholar
• Hasenjäger, M., & Wersing, H. (2017)., October). Personalization in advanced driver assistance systems and autonomous vehicles: A review [Paper presentation]. 2017 Ieee 20th International Conference on Intelligent Transportation Systems (Itsc), (pp. 1–7). IEEE. https://doi.org/10.1109/ITSC.2017.8317803
   Google Scholar
• Häuslschmid, R., von Buelow, M., Pfleging, B., & Butz, A. (2017, March). Supporting Trust in autonomous driving [Paper presentation]. 22nd International Conference on Intelligent User Interfaces, (pp. 319–329). https://doi.org/10.1145/3025171.3025198
   Google Scholar
• Hochheiser, H., & Shneiderman, B. (2000). Performance benefits of simultaneous over sequential menus as task complexity increases. International Journal of Human-Computer Interaction, 12(2), 173–192. https://doi.org/10.1207/S15327590IJHC1202_2
   Web of Science ®Google Scholar
• Hoedemaeker, M. (2000). Driving behaviour with ACC and the acceptance by individual drivers (pp. 506–509). IEEE. https://doi.org/10.1109/ITSC.2000.881121
   Google Scholar
• Hoff, K. A., & Bashir, M. (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57(3), 407–434. https://doi.org/10.1177/0018720814547570
   PubMed Web of Science ®Google Scholar
• Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. OUP Oxford.
   Google Scholar
• Holthausen, B. E., Wintersberger, P., Walker, B. N., & Riener, A. (2020, September). Situational trust scale for automated driving (STS-AD): Development and initial validation [Paper presentation]. 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, (pp. 40–47). https://doi.org/10.1145/3409120.3410637
   Google Scholar
• Hong, S., Maeng, J., Kim, H. J., & Yang, J. H. (2022). Development of warning methods for planned and unplanned takeover requests in a simulated automated driving vehicle [Paper presentation]. Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, (pp. 65–74). https://doi.org/10.1145/3543174.3545999
   Google Scholar
• Hussein, I., Mahmud, M., & Tap, A. O. M. (2014, September). A survey of user experience practice: A point of meet between academic and industry [Paper presentation]. 2014 3rd International Conference on User Science and Engineering (i-USEr), (pp. 62–67). IEEE. https://doi.org/10.1109/IUSER.2014.7002678
   Google Scholar
• IBM Accessibility Research (2017). Creating the World’s Most Accessible, Self-Driving Vehicle. https://www.ibm.com/able/accessible-transportation.html. (accessed 9 May, 2022).
   Google Scholar
• Jaimes, A., & Sebe, N. (2007). Multimodal human–computer interaction: A survey. Computer Vision and Image Understanding, 108(1-2), 116–134. https://doi.org/10.1016/j.cviu.2006.10.019
   Web of Science ®Google Scholar
• Jian, J. Y., Bisantz, A. M., & Drury, C. G. (2000). Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4(1), 53–71. https://doi.org/10.1207/S15327566IJCE0401_04
   Google Scholar
• Khastgir, S., Birrell, S., Dhadyalla, G., & Jennings, P. (2018). Calibrating trust through knowledge: Introducing the concept of informed safety for automation in vehicles. Transportation Research Part C: Emerging Technologies, 96, 290–303. https://doi.org/10.1016/j.trc.2018.07.001
   Web of Science ®Google Scholar
• König, M., & Neumayr, L. (2017). Users’ resistance towards radical innovations: The case of the self-driving car. Transportation Research Part F: Traffic Psychology and Behaviour, 44, 42–52. https://doi.org/10.1016/j.trf.2016.10.013
   Web of Science ®Google Scholar
• Koo, J., Kwac, J., Ju, W., Steinert, M., Leifer, L., & Nass, C. (2015). Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM), 9(4), 269–275. https://doi.org/10.1007/s12008-014-0227-2
   Google Scholar
• Lalanne, D., Nigay, L., Palanque, P., Robinson, P., Vanderdonckt, J., & Ladry, J. F. (2009)., November). Fusion engines for multimodal input: A survey [Paper presentation]. Proceedings of the 2009 International Conference on Multimodal Interfaces, (pp. 153–160). https://doi.org/10.1145/1647314.1647343
   Google Scholar
• Landry, S., & Jeon, M. (2017). Participatory Design Research Methodologies: A Case Study in Dancer Sonification [Paper presentation]. Proceedings of the 23rd International Conference on Auditory Display - ICAD 2017. https://doi.org/10.21785/icad2017.069
   Google Scholar
• Landsberger, H. A. (1958). Hawthorne Revisited: Management and the Worker, Its Critics, and Developments in Human Relations in Industry.
   Google Scholar
• Lazar, J., Feng, J. H., & Hochheiser, H. (2017). Research methods in human-computer interaction. Morgan Kaufmann. https://doi.org/10.1016/b978-0-12-805390-4.09986-6
   Google Scholar
• Lee, S., Hong, J., Jeon, G., Jo, J., Boo, S., Kim, H., Jung, S., Park, J., Choi, I., & Kim, S. (2023). Investigating effects of multimodal explanations using multiple In-vehicle displays for takeover request in conditionally automated driving. Transportation Research Part F: Traffic Psychology and Behaviour, 96, 1–22. https://doi.org/10.1016/j.trf.2023.05.014
   Web of Science ®Google Scholar
• Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46(1), 50–80. https://doi.org/10.1518/hfes.46.1.50_30392
   PubMed Web of Science ®Google Scholar
• Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 22(140), 1–55.
   Google Scholar
• Lu, Y., & Sarter, N. (2019). Eye tracking: A process-oriented method for inferring trust in automation as a function of priming and system reliability. IEEE Transactions on Human-Machine Systems, 49(6), 560–568. https://doi.org/10.1109/THMS.2019.2930980
   Web of Science ®Google Scholar
• Ma, J., Bai, Y. (2024). Context-engine-based interaction design of in-vehicle navigation. Automotive Engineering, 46(1), 18–28.
   Google Scholar
• Ma, J., Li, J., & Huang, H. (2022). Evaluation of multimodal and multi-staged alerting strategies for forward collision warning systems. Sensors (Basel, Switzerland), 22(3), 1189. https://doi.org/10.3390/s22031189
   PubMed Web of Science ®Google Scholar
• Ma, J., Li, J., Wang, W., Huang, H., Zhang, X., & Zhao, J. (2024). The impact of co-pilot displays use on driver workload and driving performance exploring the impact of co-pilot display on drivers’ workload and driving performance. Applied Ergonomics, 114, 104138. https://doi.org/10.1016/j.apergo.2023.104138
   PubMed Web of Science ®Google Scholar
• Ma, R. H., Morris, A., Herriotts, P., & Birrell, S. (2021). Investigating what level of visual information inspires trust in a user of a highly automated vehicle. Applied Ergonomics, 90, 103272. https://doi.org/10.1016/j.apergo.2020.103272
   PubMed Web of Science ®Google Scholar
• Manchon, J. B., Beaufort, R., Bueno, M., & Navarro, J. (2022). Why does the automation say one thing but does something else? Effect of the feedback consistency and the timing of error on trust in automated driving. Information, 13(10), 480. https://doi.org/10.3390/info13100480
   Google Scholar
• Man, S. S., Ding, M., Li, X., Chan, A. H. S., & Zhang, T. (2024). Acceptance of highly automated vehicles: The role of facilitating condition, technology anxiety, social influence and trust. International Journal of Human–Computer Interaction, 1–12. https://doi.org/10.1080/10447318.2024.2316389
   Web of Science ®Google Scholar
• Martin, J. C. (1995). Cooperations between modalities and binding through synchrony in multimodal interfaces. PhD, Telecom, Paris.
   Google Scholar
• McGinty, L., & Smyth, B. (2000). Personalised route planning: A case-based approach. In European workshop on advances in case-based reasoning (pp. 431–443). Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-44527-7_37
   Google Scholar
• McKercher, B., & Darcy, S. (2018). Re-conceptualizing barriers to travel by people with disabilities. Tourism Management Perspectives, 26, 59–66. https://doi.org/10.1016/j.tmp.2018.01.003
   Web of Science ®Google Scholar
• Monsaingeon, N., Caroux, L., Langlois, S., & Lemercier, C. (2023). Multimodal interface and reliability displays: Effect on attention, mode awareness, and trust in partially automated vehicles. Frontiers in Psychology, 14, 1107847. https://doi.org/10.3389/fpsyg.2023.1107847
   PubMed Web of Science ®Google Scholar
• Müller, C., & Friedland, G. (2009, February). Multimodal interfaces for automotive applications (MIAA). In Proceedings of the [Paper presentation]. 14th International Conference on Intelligent User Interfaces, (pp. 493–494). https://doi.org/10.1145/1502650.1502732
   Google Scholar
• Navarro, J., Osiurak, F., Ovigue, M., Charrier, L., & Reynaud, E. (2019). Highly automated driving impact on drivers’ gaze behaviors during a car-following task. International Journal of Human–Computer Interaction, 35(11), 1008–1017. https://doi.org/10.1080/10447318.2018.1561788
   Web of Science ®Google Scholar
• Nielsen, J. (1994). Usability inspection methods [Paper presentation]. Conference Companion on Human Factors in Computing Systems. (pp. 413–414). https://doi.org/10.1145/259963.260531
   Google Scholar
• Nordhoff, S., Kyriakidis, M., Van Arem, B., & Happee, R. (2019). A multi-level model on automated vehicle acceptance (MAVA): A review-based study. Theoretical Issues in Ergonomics Science, 20(6), 682–710. https://doi.org/10.1080/1463922X.2019.1621406
   Web of Science ®Google Scholar
• Novák, J. Š., Masner, J., Benda, P., Šimek, P., & Merunka, V. (2023). Eye tracking, usability, and user experience: A systematic review. International Journal of Human–Computer Interaction, 1–17. https://doi.org/10.1080/10447318.2023.2221600
   Web of Science ®Google Scholar
• Oliveira, L., Luton, J., Iyer, S., Burns, C., Mouzakitis, A., Jennings, P., & Birrell, S. (2018)., September). Evaluating how interfaces influence the user interaction with fully autonomous vehicles [Paper presentation]. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, (pp. 320–331). https://doi.org/10.1145/3239060.3239065
   Google Scholar
• Oviatt, S., Lunsford, R., & Coulston, R. (2005, April). Individual differences in multimodal integration patterns: What are they and why do they exist? [Paper presentation]. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (pp. 241–249). https://doi.org/10.1145/1054972.1055006
   Google Scholar
• Parasuraman, R., Masalonis, A. J., & Hancock, P. A. (2000). Fuzzy signal detection theory: Basic postulates and formulas for analyzing human and machine performance. Human Factors, 42(4), 636–659. https://doi.org/10.1518/001872000779697980
   PubMed Web of Science ®Google Scholar
• Park, D., Lee, Y., & Kim, Y. M. (2023). Effects of autonomous driving context and anthropomorphism of in-vehicle voice agents on intimacy, trust, and intention to use. International Journal of Human–Computer Interaction, 1–14. https://doi.org/10.1080/10447318.2023.2262271
   Web of Science ®Google Scholar
• Pearson, K. (1895). VII. Note on regression and inheritance in the case of two parents. Proceedings of the Royal Society of London, 58(347–352), 240–242. https://doi.org/10.1098/rspl.1895.0041
   Google Scholar
• Pettersson, I., & Karlsson, I. M. (2015). Setting the stage for autonomous cars: A pilot study of future autonomous driving experiences. IET Intelligent Transport Systems, 9(7), 694–701. https://doi.org/10.1049/iet-its.2014.0168
   Web of Science ®Google Scholar
• Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C., McCullough, K. E., & Ansari, R. (2002). Multimodal human discourse: Gesture and speech. ACM Transactions on Computer-Human Interaction, 9(3), 171–193. https://doi.org/10.1145/568513.568514
   Google Scholar
• Ranjbar, P. (2018, July). Ready-Ride Helps Persons with Blindness and Deafblindness to Ride More Independently. In Proceedings of theEuropean Congress of Adapted Physical Activity (EUCAPA).
   Google Scholar
• Ranjbar, P., Krishnakumari, P. K., Andersson, J., & Klingegård, M. (2022). Vibrotactile guidance for trips with autonomous vehicles for persons with blindness, deafblindness, and deafness. Transportation Research Interdisciplinary Perspectives, 15, 100630. https://doi.org/10.1016/j.trip.2022.100630
   Google Scholar
• Ranjbar, P., Stranneby, D., Akner Koler, C., & Borg, E. (2017). Identification of vibrotactile morse code on abdomen and wrist. International Journal of Engineering Technology and Scientific Innovation, 1(4), 351–366.
   Google Scholar
• Reeves, L. M., Lai, J., Larson, J. A., Oviatt, S., Balaji, T. S., Buisine, S., Collings, P., Cohen, P., Kraal, B., Martin, J.-C., McTear, M., Raman, T. V., Stanney, K. M., Su, H., & Wang, Q. Y. (2004). Guidelines for multimodal user interface design. Communications of the ACM, 47(1), 57–59. https://doi.org/10.1145/962081.962106
   Web of Science ®Google Scholar
• Reeves, B., & Nass, C. (1996). The media equation: How people treat computers, television, and new media like real people. Cambridge, UK, 10(10).
   Google Scholar
• Robert Jr, L. P. (2016, February). Monitoring and trust in virtual teams [Paper presentation]. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, (pp. 245–259). https://doi.org/10.1145/2818048.2820076
   Google Scholar
• SAE International (2021). Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. https://doi.org/10.4271/J3016_202104
   Google Scholar
• Schaefer, K. E., & Straub, E. R. (2016). Will passengers trust driverless vehicles? Removing the steering wheel and pedals [Paper presentation]. 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), IEEE, March). (pp. 159–165). https://doi.org/10.1109/COGSIMA.2016.7497804
   Google Scholar
• Schramm, R., de Kruiff, J., Doerfler, R., Merkt, J., Kampmann, P., & Walter, F. (2022, June). AI in automotive audio: approaching dynamic driving sound design. In Audio Engineering Society Conference: 2022 AES International Conference on Automotive Audio. Audio Engineering Society.
   Google Scholar
• Sheh, J., & Shen, X.-J. (2001). User requirements in mobile systems. In Americas Conference on Information Systems (AMCIS).
   Google Scholar
• Skinner, B. F. (1953). Principles of behavior. Appleton-Century-Crofts.
   Google Scholar
• Stickdorn, M., & Schneider, J. (2012). This is service design thinking: Basics, tools, cases. John Wiley & Sons.
   Google Scholar
• Stranneby, D., Ranjbar, P., Akner-Koler, C., & Borg, E. (2012). Ready-Ride: a positioning and communication system to increase the autonomy of riders with visual impairment/deafblindness. In TeMA Hörsel 2012, Linköping.
   Google Scholar
• Strömberg, H., Pettersson, I., Andersson, J., Rydström, A., Dey, D., Klingegård, M., & Forlizzi, J. (2018). Designing for social experiences with and within autonomous vehicles-exploring methodological directions. Design Science, 4, 1–29. https://doi.org/10.1017/dsj.2018.9
   Web of Science ®Google Scholar
• Sun, X., & Zhang, Y. (2021). Improvement of autonomous vehicles trust through synesthetic-based multimodal interaction. IEEE Access, 9, 28213–28223. https://doi.org/10.1109/ACCESS.2021.3059071
   Web of Science ®Google Scholar
• Ulahannan, A., Cain, R., Thompson, S., Skrypchuk, L., Mouzakitis, A., Jennings, P., & Birrell, S. (2020a). User expectations of partial driving automation capabilities and their effect on information design preferences in the vehicle. Applied Ergonomics, 82, 102969. https://doi.org/10.1016/j.apergo.2019.102969
   PubMed Web of Science ®Google Scholar
• Ulahannan, A., Jennings, P., Oliveira, L., & Birrell, S. (2020b). Designing an adaptive interface: Using eye tracking to classify how information usage changes over time in partially automated vehicles. IEEE Access, 8, 16865–16875. https://doi.org/10.1109/ACCESS.2020.2966928
   Web of Science ®Google Scholar
• Verberne, F. M., Ham, J., & Midden, C. J. (2012). Trust in smart systems: Sharing driving goals and giving information to increase trustworthiness and acceptability of smart systems in cars. Human Factors, 54(5), 799–810. https://doi.org/10.1177/0018720812443825
   PubMed Web of Science ®Google Scholar
• Wadud, Z., MacKenzie, D., & Leiby, P. (2016). Help or hindrance? The travel, energy and carbon impacts of highly automated vehicles. Transportation Research Part A: Policy and Practice, 86, 1–18. https://doi.org/10.1016/j.tra.2015.12.001
   Web of Science ®Google Scholar
• Waytz, A., Heafner, J., & Epley, N. (2014). The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of Experimental Social Psychology, 52, 113–117. https://doi.org/10.1016/j.jesp.2014.01.005
   Web of Science ®Google Scholar
• Woide, M., Stiegemeier, D., Pfattheicher, S., & Baumann, M. (2021). Measuring driver-vehicle cooperation: Development and validation of the Human-Machine-Interaction-Interdependence Questionnaire (HMII). Transportation Research Part F: Traffic Psychology and Behaviour, 83, 424–439. https://doi.org/10.1016/j.trf.2021.11.003
   Web of Science ®Google Scholar
• Xiao, B., Girand, C., & Oviatt, S. L. (2002, September). Multimodal integration patterns in children. In INTERSPEECH.
   Google Scholar
• Xiao, B., Lunsford, R., Coulston, R., Wesson, M., & Oviatt, S. (2003). Modeling multimodal integration patterns and performance in seniors: Toward adaptive processing of individual differences [Paper presentation]. In Proceedings of the 5th International Conference on Multimodal Interfaces. (pp. 265–272). https://doi.org/10.1145/958432.958480
   Google Scholar
• Yang, X. J., Unhelkar, V. V., Li, K., & Shah, J. A. (2017, March). Evaluating effects of user experience and system transparency on trust in automation [Paper presentation]. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, (pp. 408–416). https://doi.org/10.1145/2909824.3020230
   Google Scholar
• You, F., Fu, Q., Yang, J., Chen, H., Cui, W., & Wang, J. (2023). Team situation awareness-based augmented reality head-up display design for security requirements. International Journal of Human–Computer Interaction, 1–20. https://doi.org/10.1080/10447318.2023.2231281
   Web of Science ®Google Scholar
• Yun, H., & Yang, J. H. (2020). Multimodal warning design for take-over request in conditionally automated driving. European Transport Research Review, 12(1), 1–11. https://doi.org/10.1186/s12544-020-00427-5
   Web of Science ®Google Scholar
• Zuo, Y., Ma, J., Gong, Z., Zhao, J., & Zang, L. (2024, June). User interaction mode selection and preferences in different driving states of automotive intelligent cockpit. In International Conference on Human-Computer Interaction (pp. 262–274). Springer Nature Switzerland.
   Google Scholar
• Zuo, Y., & Ma, J. (2023). User Demand Analysis of User-centered Automotive Cockpit Context Components. Proceedings of the Eleventh International Symposium of [Paper presentation]. Chinese CHI. https://doi.org/10.1145/3629606.3629649
   Google Scholar