Abstract
Recent research indicates that inappropriate visual coding exacerbates the side effects of cognitive load imbalance in the recognition of graphical symbols on VR/MR interfaces, leading to severe issues in individuals’ understanding of task processes. In response to this situation, a VR/MR interface strategy supporting precision equipment collaborative assembly is proposed. This strategy revolves around interactive cues such as virtual-real scene registration tracking, spatiotemporal data synchronization, eye gaze, and motion capture, aiming to construct a visual coding design mechanism for VR/MR interfaces. The goal is to enhance the quality of assembly intent expression and slow down the accumulation rate of individual mental fatigue. This study designs an experimental VR/MR interface coding prototype system. Through case study experiments, direct evidence is found that the proposed MR interface coding strategy has advantages in assembly completion time, decision-making ability, visual perception experience, and operational interaction experience. The experimental results of this study will be beneficial for guiding the assessment of VR/MR manual micro-operation quality processes, especially in the field of precision assembly.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Notes
Additional information
Funding
Notes on contributors
Xiaoru Li
Xiaoru Li is an associate professor at the School of Mechanical Engineering, Shanghai Institute of Technology. She obtained her PhD in Mechanical Engineering from Shanghai Institute of Technology. Her research interests include ergonomics, human-computer interaction, and electromechanical testing technology.
Shisong Chen
Shisong Chen is a master’s student at the School of Mechanical Engineering, Shanghai Institute of Technology. His research interests include intelligent manufacturing technology, ergonomics, and human-computer interaction.
Yang Wang
Yang Wang is a master’s student at the School of Mechanical and Electrical Engineering, Henan University of Science and Technology. Her research interests include mechatronics control technology, intelligent manufacturing technology, and human-computer interaction.
Zhuo Wang
Zhuo Wang is a lecturer at the School of Mechanical Engineering, Shanghai Institute of Technology. He obtained his PhD in Mechanical Engineering from Northwestern Polytechnical University. His research interests include ergonomics, human-computer interaction, and electromechanical testing technology.
Zihan Guo
Zihan Guo is an undergraduate student at the School of Mechanical Engineering, Shanghai Institute of Technology. His research interests include intelligent manufacturing technology, ergonomics, and human-computer interaction.
Weichu Li
Weichu Li is an undergraduate student at the School of Mechanical Engineering, Shanghai Institute of Technology. His research interests include intelligent manufacturing technology, ergonomics, and human-computer interaction.
Jiacheng Zhang
Jiacheng Zhang is an undergraduate student at the School of Mechanical Engineering, Shanghai Institute of Technology. His research interests include intelligent manufacturing technology, ergonomics, and human-computer interaction.
Xiaoting Du
Xiaoting Du is an undergraduate student at the School of Mechanical Engineering, Shanghai Institute of Technology. Her research interests include intelligent manufacturing technology, ergonomics, and human-computer interaction.
Fucheng Liu
Fucheng Liu is an undergraduate student at the School of Mechanical Engineering, Shanghai Institute of Technology. His research interests include intelligent manufacturing technology, ergonomics, and human-computer interaction.