Effects of User Interface Orientation on Sense of Immersion in Augmented Reality

Abstract

The sense of immersion provided by overlying computer-generated graphics over actual items is one of augmented reality’s distinguishing features. It is affected by multiple factors such as the user interface orientation in the virtual physical hybrid space. There have been many studies on realistic graphic rendering and multimodal interaction in augmented reality. Few studies, however, have systematically investigated the influence of the user interface orientations, more specifically the user-based orientation (UO) and object-based orientation (OO), on various aspects of immersion. We developed the UO and OO user interface prototypes and evaluated the sense of immersion in terms of engagement, engrossment, and overall immersion. The results showed that the user interface orientations in augmented reality had a significant influence on users’ perceived engagement and engrossment, whereas there was no significant difference in overall immersion. Particularly, compared to the OO user interfaces, the UO user interfaces exhibited higher perceived usability and slower focus of attention switching. Generalising implications for alternative augmented reality are provided.

Keywords:

• Spatial orientation
• user interface orientation
• sense of immersion
• augmented reality
• user interface

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The datasets generated during and/or analysed during the current study are not publicly available because the current datasets contain privacy information such as participant facial images that are not fully anonymised but are available from the corresponding author on reasonable request.

Additional information

Funding

The research was supported by the programme of Natural Science Foundation of China (ref no 61972346 and 92148205) and the Pioneer and Leading Goose R&D Program of Zhejiang (ref no 2022C03103 and 2023C01045).

Notes on contributors

Xiangdong Li

Xiangdong Li is currently an associate professor of design in the college of computer science and technology, Zhejiang University, P.R. China. His research interests mainly include intelligent user interfaces, cross-device interaction, visual attention, and creative media design.

Kailin Yin

Kailin Yin is currently a doctoral student in the college of computer science and technology, Zhejiang University, P.R. China. Her research interests mainly include intelligent user interface, visual attention estimation, and artificial intelligence-assisted design.

Yifei Shan

Yifei Shan is currently a doctoral student in the college of computer science and technology, Zhejiang University, P.R. China. Her research interests mainly include intelligent human-computer interaction, cognitive science, and machine learning.

Xinyao Wang

Xinyao Wang received Master's degree in engineering from Zhejiang University in 2023. Her research interests mainly include computer-supported collaboration, augmented reality, and multimodal user interface design.

Weidong Geng

Weidong Geng is currently a full professor of computer science in the college of computer science and technology, Zhejiang University, P.R. China. His research interests mainly include digital media, artificial intelligence, cognitive computation, and natural human-computer interaction.