Exploring the Role of AR Cognitive Interface in Enhancing Human-Vehicle Collaborative Driving Safety: A Design Perspective

Abstract

In autonomous driving vehicles, the heterogeneity between human and automation agents can cause conflicts in decision-making and behaviour due to the difference in perception of hazardous situations. Augmented Reality Human-Machine Interfaces (AR-HMI) provide an opportunity to support driving performance by enabling drivers to intuitively access shared perception and explanation of the automated vehicle. One possible approach to AR-HMI design is to simplify the information of driving tasks based on vehicle context understanding, although there is currently a lack of systematic understanding of how collaborative mechanisms or cognitive features contribute to AR-HMI information design. Therefore, this work develops an augmented reality cognitive interface design method for autonomous driving. It aims to identify novel collaborative interface information visualization and provide a common language and inspiration for the design space.

Keywords:

• Cognitive interface
• human-vehicle collaboration
• AR-HMI
• intelligent interface
• active safety

Disclosure statement

We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work, there is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled.

Additional information

Funding

This research was supported by the Fundamental Research Funds for the Central Universities; the High-Level Foreign Expert Project (G2022133031L, G2023133041L); Shenzhen Science and Technology Program (GJHZ20220913142401002); National Social Science Fund of China (No. 19FYSB040); Innovative talents of Nanchang “Double Hundred Plan”; Shenzhen Basic Research Program for Shenzhen Virtual University Park (2021Szvup175); CES-Kingfar Excellent Young Scholar Joint Research Funding (No.202002JG26); China Scholarship Council Foundation (2020-1509).

Notes on contributors

Fang You

Fang You, Tongji University, Director of the User Experience Laboratory and Automotive Interaction Design Laboratory at the College of Arts and Media, Tongji University. Research areas include intelligent interaction design, automotive interaction design, and digital media design.

Yuwei Liang

Yuwei Liang, College of Arts and Media, Tongji University. Research interests include augmented reality, human-agent interaction, human factors and user experience.

Qianwen Fu

Qianwen Fu, Tongji University, studying at the College of Design and Innovation, Tongji University. Research interests include intelligent automotive interaction design and human factors and experience design of intelligent systems.

Jun Zhang

Jun Zhang, College of Design and Innovation, Tongji University and School of Design, The Hong Kong Polytechnic University. His research interests include augmented reality, human-agent interaction, human factors and user experience.