123
Views
0
CrossRef citations to date
0
Altmetric
Research Articles

Multimodal Interaction Grammar Analysis Based on Two-Stage User-Based Elicitation in 3D Modeling

, &
Pages 2120-2141 | Received 30 Nov 2022, Accepted 25 Sep 2023, Published online: 16 Oct 2023
 

Abstract

Traditional computer-aided design (CAD) tools based on keyboard and mouse interactions present challenges to efficiency and quality in terms of free creation, iteration efficiency, and operational experience. This paper proposes a multimodal interactive guiding grammar framework for virtual-reality modeling scenarios. In studies on the characteristics of multimodal combinations, the present heuristic method leads to a high cognitive load and experimental cost, and the heuristic is difficult. Therefore, we propose a two-stage heuristic method. Subsequently, we use this method to decompose the interaction task into two stages: modalities and interactive operations. A clearer and more specific reference for multimodal selection is provided for the interaction design phase, based on the two dimensions of modality and task. This can reduce the heuristic cost and difficulty of users in completing tasks in multimodal interaction scenarios. Finally, the proposed virtual modeling platform which is used for experimental verification, and the results shows that, compared with traditional modeling, the interactive modeling method built according to the results of modal interaction in this study can better satisfy users in terms of emotional experience. In the index evaluation, high scores are achieved, with an average score of 5 points (1 and 7 are the lowest and highest scores of the evaluation index, respectively), and the large-area distribution of high scores also shows a good user experience. To a certain extent, this method improves the interaction mode of the previous 3D modeling.

Acknowledgements

To the peers and reviewers who have provided suggestions on this paper!

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Wen-Jun Hou

Wen-Jun Hou, born in 1964, PhD, professor. Her research interests include natural interaction, information visualization, interaction design theory and mode et al.

Ge-Xin Guo

Ge-Xin Guo, born in 1999, PhD candidate. Her research interests include human-computer interaction, natural interaction and multimodal user interface.

Yi-Ting Cheng

Yi-Ting Cheng, born in 1997, MFA Her research interests include human-computer interaction and multimodal user interface.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 306.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.