648
Views
3
CrossRef citations to date
0
Altmetric
Research Articles

Point and Select: Effects of Multimodal Feedback on Text Entry Performance in Virtual Reality

ORCID Icon
Pages 3815-3829 | Received 08 Jan 2022, Accepted 22 Jul 2022, Published online: 24 Aug 2022
 

Abstract

The current study examined the effects of visual, auditory, and haptic feedback on VR text entry performance and perceived mental workload across two experiments. In Experiment 1, the feedback was presented as users were pointing from one key to another, dubbed pointing feedback. Results from Experiment 1 indicated that providing haptic pointing feedback led to faster text entry. Results also showed that providing any modality of pointing feedback resulted in more accurate text entry compared to no feedback, but there was no substantial contribution of additional pointing feedback modality to text accuracy when one pointing feedback modality was present. Providing auditory pointing feedback led to greater perceived mental workload of the VR text entry task. In Experiment 2, the feedback was provided when users selected the keys by pressing the trigger on the controller, dubbed selection feedback. Results from Experiment 2 showed that providing auditory or haptic selection feedback led to faster text entry performance and that providing visual selection feedback improved accuracy. The presence of haptic selection feedback led to lower levels of perceived mental workload. These results indicate that the usability of VR text entry tasks changes as a function of when and how feedback is provided.

Acknowledgements

The authors wish to thank the participants who volunteered to take part in the experiments. We would also like to thank anonymous reviewers for taking the time to review this article without any compensation.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Caglar Yildirim

Caglar Yildirim is a faculty member in the Khoury College of Computer Sciences at Northeastern University. His research seeks to apply HCI principles to the design, development, and evaluation of 3D interfaces and interaction paradigms to support and improve human interactions with and through mixed reality environments.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 306.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.