648
Views
3
CrossRef citations to date
0
Altmetric
Research Articles

Point and Select: Effects of Multimodal Feedback on Text Entry Performance in Virtual Reality

ORCID Icon
Pages 3815-3829 | Received 08 Jan 2022, Accepted 22 Jul 2022, Published online: 24 Aug 2022

References

  • Adhikary, J., & Vertanen, K. (2021b). Typing on midair virtual keyboards: Exploring visual designs and interaction styles. In IFIP conference on human-computer interaction (pp. 132–151).
  • Adhikary, J., & Vertanen, K. (2021a). Text entry in virtual environments using speech and a midair keyboard. IEEE Transactions on Visualization and Computer Graphics, 27(5), 2648–2658. https://doi.org/10.1109/TVCG.2021.3067776
  • Bevan, N. (2001). International standards for hci and usability. International Journal of Human-Computer Studies, 55(4), 533–552. https://doi.org/10.1006/ijhc.2001.0483
  • Chen, S., Wang, J., Guerra, S., Mittal, N., & Prakkamakul, S. (2019). Exploring word-gesture text entry techniques in virtual reality. In Extended Abstracts of the 2019 CHI conference on human factors in computing systems (pp. 1–6). https://doi.org/10.1145/3290607.3312762
  • Choe, M., Choi, Y., Park, J., & Kim, H. K. (2019). Comparison of gaze cursor input methods for virtual reality devices. International Journal of Human–Computer Interaction, 35(7), 620–629. https://doi.org/10.1080/10447318.2018.1484054
  • Derby, J. L., Rickel, E. A., Harris, K. J., Lovell, J. A., Chaparro, B. S. (2020). “We didn’t catch that!” using voice text input on a mixed reality headset in noisy environments. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 64, pp. 2102–2106). https://doi.org/10.1177/1071181320641509
  • Dube, T. J., & Arif, A. S. (2019). Text entry in virtual reality: A comprehensive review of the literature. International Conference on Human-Computer Interaction. (pp. 419–437). Springer. https://doi.org/10.1007/978-3-030-22643-5_33
  • Field, A. (2013). Discovering statistics using IBM SPSS statistics. SAGE Publications.
  • Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972). Consequences of failure to meet assumptions underlying the fixed effects analyses of variance and covariance. Review of Educational Research, 42(3), 237–288. https://doi.org/10.3102/00346543042003237
  • Grubert, J., Witzani, L., Ofek, E., Pahud, M., Kranz, M., & Kristensson, P. O. (2018). Effects of hand representations for typing in virtual reality. In 2018 IEEE conference on virtual reality and 3D user interfaces (VR) (pp. 151–158). https://doi.org/10.1109/VR.2018.8446250
  • Grubert, J., Witzani, L., Ofek, E., Pahud, M., Kranz, M., & Kristensson, P. O. (2018). Text entry in immersive head-mounted display-based virtual reality using standard keyboards. In 2018 IEEE conference on virtual reality and 3D user interfaces (VR) (pp. 159–166). https://doi.org/10.1109/VR.2018.8446059
  • Gugenheimer, J., Dobbelstein, D., Winkler, C., Haas, G., & Rukzio, E. (2016). Facetouch: Enabling touch interaction in display fixed UIS for mobile virtual reality. In Proceedings of the 29th annual symposium on user interface software and technology (pp. 49–60).
  • Gupta, A., Samad, M., Kin, K., Kristensson, P. O., & Benko, H. (2020). Investigating remote tactile feedback for mid-air text-entry in virtual reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 350–360). https://doi.org/10.1109/ISMAR50242.2020.00062
  • Hart, S. G. (2006). Nasa-task load index (nasa-tlx); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 50, pp. 904–908). https://doi.org/10.1177/154193120605000909
  • Hoggan, E., Crossan, A., Brewster, S. A., & Kaaresoja, T. (2009). Audio or tactile feedback: Which modality when?. In Proceedings of the SIGCHI conference on human factors in computing systems. (pp. 2253–2256). https://doi.org/10.1145/1518701.1519045
  • Jiang, H., & Weng, D. (2020). Hipad: Text entry for head-mounted displays using circular touchpad. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 692–703). https://doi.org/10.1109/VR46266.2020.00092
  • Kim, Y. M., Rhiu, I., & Yun, M. H. (2020). A systematic review of a virtual reality system from the perspective of user experience. International Journal of Human–Computer Interaction, 36(10), 893–910. https://doi.org/10.1080/10447318.2019.1699746
  • Knierim, P., Schwind, V., Feit, A. M., Nieuwenhuizen, F., & Henze, N. (2018). Physical keyboards in virtual reality: Analysis of typing performance and effects of avatar hands. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1–9).
  • Li, Y., Sarcar, S., Zheng, Y., & Ren, X. (2021). Exploring text revision with backspace and caret in virtual reality. In Proceedings of the 2021 CHI conference on human factors in computing systems (pp. 1–12).
  • Lin, J.-W., Han, P.-H., Lee, J.-Y., Chen, Y.-S., Chang, T.-W., & Chen, K.-W. (2017). Visualizing the keyboard in virtual reality for enhancing immersive experience. In ACM SIGGRAPH 2017 Posters (pp. 1–2). https://doi.org/10.1145/3102163.3102175
  • Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996). Consequences of assumption violations revisited: A quantitative review of alternatives to the one-way analysis of variance f test. Review of Educational Research, 66(4), 579–619. https://doi.org/10.3102/00346543066004579
  • Norman, D. (2013). The design of everyday things: Revised and expanded edition. Basic books.
  • Pham, D.-M., & Stuerzlinger, W. (2019). Hawkey: Efficient and versatile text entry for virtual reality. In 25th ACM symposium on virtual reality software and technology (pp. 1–11). https://doi.org/10.1145/3359996.3364265
  • Rajanna, V., & Hansen, J. P. (2018). Gaze typing in virtual reality: Impact of keyboard design, selection method, and motion. In Proceedings of the 2018 ACM symposium on eye tracking research & applications (pp. 1–10).
  • Schneider, D., Otte, A., Gesslein, T., Gagel, P., Kuth, B., Damlakhi, M. S., Dietz, O., Ofek, E., Pahud, M., Kristensson, P. O., Muller, J., & Grubert, J. (2019). Reconviguration: Reconfiguring physical keyboards in virtual reality. IEEE Transactions on Visualization and Computer Graphics, 25(11), 3190–3201. https://doi.org/10.1109/TVCG.2019.2932239
  • Son, J., Ahn, S., Kim, S., & Lee, G. (2019). Improving two-thumb touchpad typing in virtual reality. In Extended Abstracts of the 2019 CHI conference on human factors in computing systems (pp. 1–6). https://doi.org/10.1145/3290607.3312926
  • Speicher, M., Feit, A. M., Ziegler, P., & Krüger, A. (2018). Selection-based text entry in virtual reality. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1–13).
  • Vertanen, K., & Kristensson, P. O. (2011). A versatile dataset for text entry evaluations based on genuine mobile emails. In Proceedings of the 13th international conference on human computer interaction with mobile devices and services (pp. 295–298). https://doi.org/10.1145/2037373.2037418
  • Walker, J., Li, B., Vertanen, K., & Kuhl, S. (2017). Efficient typing on a visually occluded physical keyboard. In Proceedings of the 2017 CHI conference on human factors in computing systems (pp. 5457–5461).
  • Wu, C.-M., Hsu, C.-W., Lee, T.-K., & Smith, S. (2017). A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment. Virtual Reality, 21(1), 19–29. https://doi.org/10.1007/s10055-016-0296-6
  • Xu, W., Liang, H.-N., Zhao, Y., Zhang, T., Yu, D., Monteiro, D., & Yue, Y. (2019). Ringtext: Dwell-free and hands-free text entry for mobile head-mounted displays using head motions. IEEE Transactions on Visualization and Computer Graphics, 25(5), 1991–2001. https://doi.org/10.1109/TVCG.2019.2898736
  • Yao, P., Lympouridis, V., Zhu, T., Zyda, M., & Jia, R. (2020). Punch typing: Alternative method for text entry in virtual reality. In Symposium on spatial user interaction (pp. 1–2).
  • Yildirim, C., Osborne, E. (2020). Text entry in virtual reality: A comparison of 2d and 3d keyboard layouts. In International conference on human-computer interaction (pp. 450–460).
  • Yu, C., Gu, Y., Yang, Z., Yi, X., Luo, H., Shi, Y. (2017). Tap, dwell or gesture? exploring head-based text entry techniques for hmds. In Proceedings of the 2017 CHI conference on human factors in computing systems (pp. 4479–4488).
  • Yu, D., Fan, K., Zhang, H., Monteiro, D., Xu, W., & Liang, H.-N. (2018). Pizzatext: Text entry for virtual reality systems using dual thumbsticks. IEEE Transactions on Visualization and Computer Graphics, 24(11), 2927–2935. https://doi.org/10.1109/TVCG.2018.2868581
  • Yu, D., Liang, H.-N., Lu, F., Nanjappan, V., Papangelis, K., & Wang, W. (2018). Target selection in head-mounted display virtual reality environments. Journal of Universal Computer Science 24(9), 1217–1243. https://doi.org/10.3217/jucs-024-09-1217

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.