225
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Effect of Reaching Movement Modulation on Experience of Control in Virtual Reality

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Received 30 Mar 2023, Accepted 28 Nov 2023, Published online: 11 Dec 2023

References

  • Al-Ansi, A. (2022). Investigating characteristics of learning environments during the COVID-19 pandemic: A systematic review. Canadian Journal of Learning and Technology, 48(1), 1–27. https://doi.org/10.21432/cjlt28051
  • Aoyagi, K., Wen, W., An, Q., Hamasaki, S., Yamakawa, H., Tamura, Y., Yamashita, A., & Asama, H. (2021). Modified sensory feedback enhances the sense of agency during continuous body movements in virtual reality. Scientific Reports, 11(1), 2553. https://doi.org/10.1038/s41598-021-82154-y
  • Asish, S. M., Kulshreshth, A. K., & Borst, C. (2023). Internal distraction detection utilizing EEG data in an educational VR environment. ACM Symposium on Applied Perception 2023, 8, 1–10. https://doi.org/10.1145/3605495.3605790
  • Benda, B., Esmaeili, S., & Ragan, E. D. (2020). Determining detection thresholds for fixed positional offsets for virtual hand remapping in virtual reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 269–278). https://doi.org/10.1109/ISMAR50242.2020.00050
  • Bergström, J., Knibbe, J., Pohl, H., & Hornbæk, K. (2022). Sense of agency and user experience: Is there a link? ACM Transactions on Computer-Human Interaction, 29(4), 1–22. https://doi.org/10.1145/3490493
  • Blanke, O., & Metzinger, T. (2009). Full-body illusions and minimal phenomenal selfhood. Trends in Cognitive Sciences, 13(1), 7–13. https://doi.org/10.1016/j.tics.2008.10.003
  • Bourdin, P., Martini, M., & Sanchez-Vives, M. V. (2019). Altered visual feedback from an embodied avatar unconsciously influences movement amplitude and muscle activity. Scientific Reports, 9(1), 19747. https://doi.org/10.1038/s41598-019-56034-5
  • Braun, N., Debener, S., Spychala, N., Bongartz, E., Sörös, P., Müller, H. H. O., & Philipsen, A. (2018). The senses of agency and ownership: A review. Frontiers in Psychology, 9, 535. https://doi.org/10.3389/fpsyg.2018.00535
  • Bu-Omer, H. M., Gofuku, A., Sato, K., & Miyakoshi, M. (2021). Parieto-occipital alpha and low-beta EEG power reflect sense of agency. Brain Sciences, 11(6), 743. https://doi.org/10.3390/brainsci11060743
  • Burns, E., Razzaque, S., Panter, A. T., Whitton, M. C., McCallus, M. R., & Brooks, F. P. (2006). The hand is more easily fooled than the eye: Users are more sensitive to visual interpenetration than to visual-proprioceptive discrepancy. Presence: Teleoperators and Virtual Environments, 15(1), 1–15. https://doi.org/10.1162/pres.2006.15.1.1
  • Camporesi, C., & Kallmann, M. (2015). The effects of avatars, stereo vision and display size on reaching and motion reproduction. IEEE Transactions on Visualization and Computer Graphics, 22(5), 1592–1604. https://doi.org/10.1109/TVCG.2015.2440231
  • Caserman, P., Garcia-Agundez, A., & Gobel, S. (2019). A survey of full-body motion reconstruction in immersive virtual reality applications. IEEE Transactions on Visualization and Computer Graphics, 26(10), 3089–3108. https://doi.org/10.1109/TVCG.2019.2912607
  • Cirstea, M. C., Ptito, A., & Levin, M. F. (2003). Arm reaching improvements with short-term practice depend on the severity of the motor deficit in stroke. Experimental Brain Research, 152(4), 476–488. https://doi.org/10.1007/s00221-003-1568-4
  • Cohn, B. A., Maselli, A., Ofek, E., & Gonzalez-Franco, M. (2020). SnapMove: Movement projection mapping in virtual reality. In 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 74–81). https://doi.org/10.1109/AIVR50618.2020.00024
  • Debarba, H. G., Boulic, R., Salomon, R., Blanke, O., & Herbelin, B. (2018). Self-attribution of distorted reaching movements in immersive virtual reality. Computers & Graphics, 76, 142–152. https://doi.org/10.1016/j.cag.2018.09.001
  • Debarba, H. G., Khoury, J.-N., Perrin, S., Herbelin, B., & Boulic, R. (2018). Perception of redirected pointing precision in immersive virtual reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 341–346). https://doi.org/10.1109/VR.2018.8448285
  • Dewey, J. A., & Knoblich, G. (2014). Do implicit and explicit measures of the sense of agency measure the same thing? PLOS One, 9(10), e110118. https://doi.org/10.1371/journal.pone.0110118
  • Grünbaum, T., & Christensen, M. S. (2020). Measures of agency. Neuroscience of Consciousness, 2020(1), niaa019. https://doi.org/10.1093/nc/niaa019
  • Haggard, P. (2017). Sense of agency in the human brain. Nature Reviews. Neuroscience, 18(4), 196–207. https://doi.org/10.1038/nrn.2017.14
  • Haggard, P., Clark, S., & Kalogeras, J. (2002). Voluntary action and conscious awareness. Nature Neuroscience, 5(4), 382–385. https://doi.org/10.1038/nn827
  • Huang, N. E. (2014). Hilbert-Huang transform and its applications (Vol. 16). World Scientific.
  • Isaac, J. H. R., Madhan Kumar, V., & Manivannan, M. (2020). Effect of visual awareness of the real hand on user performance in partially immersive virtual environments: Presence of virtual kinesthetic conflict. International Journal of Human–Computer Interaction, 36(16), 1540–1550. https://doi.org/10.1080/10447318.2020.1768667
  • Janeh, O., Fründt, O., Schönwald, B., Gulberti, A., Buhmann, C., Gerloff, C., Steinicke, F., & Pötter-Nerger, M. (2019). Gait training in virtual reality: Short-term effects of different virtual manipulation techniques in Parkinson’s disease. Cells, 8(5), 419. https://doi.org/10.3390/cells8050419
  • Jeunet, C., Albert, L., Argelaguet, F., & Lécuyer, A. (2018). “Do you feel in control?”: Towards novel approaches to characterise, manipulate and measure the sense of agency in virtual environments. IEEE Transactions on Visualization and Computer Graphics, 24(4), 1486–1495. https://doi.org/10.1109/TVCG.2018.2794598
  • Kang, S. Y., Im, C.-H., Shim, M., Nahab, F. B., Park, J., Kim, D.-W., Kakareka, J., Miletta, N., & Hallett, M. (2015). Brain networks responsible for sense of agency: An EEG study. PLOS One, 10(8), e0135261. https://doi.org/10.1371/journal.pone.0135261
  • Kellmeyer, P. (2018). Neurophilosophical and ethical aspects of virtual reality therapy in neurology and psychiatry. Cambridge Quarterly of Healthcare Ethics, 27(4), 610–627. https://doi.org/10.1017/S0963180118000129
  • Kim, Y. M., Rhiu, I., & Yun, M. H. (2020). A systematic review of a virtual reality system from the perspective of user experience. International Journal of Human–Computer Interaction, 36(10), 893–910. https://doi.org/10.1080/10447318.2019.1699746
  • Kokkinara, E., & Slater, M. (2014). Measuring the effects through time of the influence of visuomotor and visuotactile synchronous stimulation on a virtual body ownership illusion. Perception, 43(1), 43–58. https://doi.org/10.1068/p7545
  • Kokkinara, E., Slater, M., & López-Moliner, J. (2015). The effects of visuomotor calibration to the perceived space and body, through embodiment in immersive virtual reality. ACM Transactions on Applied Perception, 13(1), 1–22. https://doi.org/10.1145/2818998
  • Kong, G., He, K., & Wei, K. (2017). Sensorimotor experience in virtual reality enhances sense of agency associated with an avatar. Consciousness and Cognition, 52, 115–124. https://doi.org/10.1016/j.concog.2017.04.018
  • Kwakkel, G., van Wegen, E. E. H., Burridge, J. H., Winstein, C. J., van Dokkum, L. E. H., Alt Murphy, M., Levin, M. F., & Krakauer, J. W. (2019). Standardized measurement of quality of upper limb movement after stroke: Consensus-based core recommendations from the second stroke recovery and rehabilitation roundtable. Neurorehabilitation and Neural Repair, 33(11), 951–958. https://doi.org/10.1177/1545968319886477
  • Lilija, K., Kyllingsbaek, S., & Hornbaek, K. (2021). Correction of avatar hand movements supports learning of a motor skill. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR) (pp. 455–462). https://doi.org/10.1109/VR50410.2021.00069
  • Limerick, H., Coyle, D., & Moore, J. W. (2014). The experience of agency in human–computer interactions: A review. Frontiers in Human Neuroscience, 8, 643. https://doi.org/10.3389/fnhum.2014.00643
  • Livitcuka, R., Alksnis, R., & Pladere, T. (2023). Impact of interpupillary distance mismatch on visual aftereffects of virtual reality gameplay. In Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) IV (p. 134). https://doi.org/10.1117/12.2666238
  • Lopez-Sola, E., Moreno-Bote, R., & Arsiwalla, X. D. (2021). Sense of agency for mental actions: Insights from a belief-based action-effect paradigm. bioRxiv, 2021, 01.30.428924.
  • Martinez, P. I. C., Maggioni, E., Hornbæk, K., Obrist, M., Subramanian, S. (2018). Beyond the libet clock: Modality variants for agency measurements. In CHI ’18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–14).
  • McEneaney, J. E. (2013). Agency effects in human–computer interaction. International Journal of Human–Computer Interaction, 29(12), 798–813. https://doi.org/10.1080/10447318.2013.777826
  • Moore, J. W. (2016). What is the sense of agency and why does it matter? Frontiers in Psychology, 7, 1272. https://doi.org/10.3389/fpsyg.2016.01272
  • Moore, J. W., & Obhi, S. S. (2012). Intentional binding and the sense of agency: A review. Consciousness & Cognition.
  • Muth, F. V., Wirth, R., & Kunde, W. (2020). Temporal binding past the Libet clock: Testing design factors for an auditory timer. Behavior Research Methods, 53(3), 1322–1341. https://doi.org/10.3758/s13428-020-01474-5
  • Nataraj, R., Sanford, S., Shah, A., & Liu, M. (2020). Agency and performance of reach-to-grasp with modified control of a virtual hand: Implications for rehabilitation. Frontiers in Human Neuroscience, 14, 126. https://doi.org/10.3389/fnhum.2020.00126
  • Newell, K. M., & Liu, Y.-T. (2021). Collective variables and task constraints in movement coordination, control and skill. Journal of Motor Behavior, 53(6), 770–796. https://doi.org/10.1080/00222895.2020.1835799
  • Padrao, G., Gonzalez-Franco, M., Sanchez-Vives, M. V., Slater, M., & Rodriguez-Fornells, A. (2016). Violating body movement semantics: Neural signatures of self-generated and external-generated errors. Neuroimage, 124(Pt A), 147–156. https://doi.org/10.1016/j.neuroimage.2015.08.022
  • Porssut, T., Blanke, O., Herbelin, B., & Boulic, R. (2022). Reaching articular limits can negatively impact embodiment in virtual reality. PLOS One, 17(3), e0255554. https://doi.org/10.1371/journal.pone.0255554
  • Porssut, T., Herbelin, B., & Boulic, R. (2019). Reconciling being in-control vs. being helped for the execution of complex movements in VR. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 529–537). https://doi.org/10.1109/VR.2019.8797716
  • Poupyrev, I., Billinghurst, M., Weghorst, S., & Ichikawa, T. (1996). The go-go interaction technique: Non-linear mapping for direct manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and technology – UIST ’96 (pp. 79–80). https://doi.org/10.1145/237091.237102
  • Raz, G., Gurevitch, G., Vaknin, T., Aazamy, A., Gefen, I., Grunstein, S., Azouri, G., & Goldway, N. (2020). Electroencephalographic evidence for the involvement of mirror-neuron and error-monitoring related processes in virtual body ownership. Neuroimage, 207, 116351. https://doi.org/10.1016/j.neuroimage.2019.116351
  • Roosink, M., Robitaille, N., McFadyen, B. J., Hébert, L. J., Jackson, P. L., Bouyer, L. J., & Mercier, C. (2015). Real-time modulation of visual feedback on human full-body movements in a virtual mirror: Development and proof-of-concept. Journal of Neuroengineering and Rehabilitation, 12(1), 2. https://doi.org/10.1186/1743-0003-12-2
  • Roth, D., & Latoschik, M. E. (2020). Construction of the virtual embodiment questionnaire (VEQ). IEEE Transactions on Visualization and Computer Graphics, 26(12), 3546–3556. https://doi.org/10.1109/TVCG.2020.3023603
  • Sanger, T. D. (2000). Human arm movements described by a low-dimensional superposition of principal components. The Journal of Neuroscience, 20(3), 1066–1072. https://doi.org/10.1523/JNEUROSCI.20-03-01066.2000
  • Sauer, Y., Sipatchin, A., Wahl, S., & García, M. G. (2022). Assessment of consumer VR-headsets’ objective and subjective field of view (FoV) and its feasibility for visual field testing. Virtual Reality, 26(3), 1089–1101. https://doi.org/10.1007/s10055-021-00619-x
  • Sharp, I., Huang, F., & Patton, J. (2011). Visual error augmentation enhances learning in three dimensions. Journal of Neuroengineering and Rehabilitation, 8(1), 52. https://doi.org/10.1186/1743-0003-8-52
  • Shum, L. C., Valdés, B. A., Hodges, N. J., & Loos, H. F. M. V. (2020). Error augmentation in immersive virtual reality for bimanual upper-limb rehabilitation in individuals with and without hemiplegic cerebral palsy. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 28(2), 541–549. https://doi.org/10.1109/TNSRE.2019.2959621
  • Synofzik, M., Vosgerau, G., & Voss, M. (2013). The experience of agency: An interplay between prediction and postdiction. Frontiers in Psychology, 4, 127. https://doi.org/10.3389/fpsyg.2013.00127
  • Tao, G., Garrett, B., Taverner, T., Cordingley, E., & Sun, C. (2021). Immersive virtual reality health games: A narrative review of game design. Journal of Neuroengineering and Rehabilitation, 18(1), 31. https://doi.org/10.1186/s12984-020-00801-3
  • Tieri, G., Tidoni, E., Pavone, E. F., & Aglioti, S. M. (2015). Mere observation of body discontinuity affects perceived ownership and vicarious agency over a virtual hand. Experimental Brain Research, 233(4), 1247–1259. https://doi.org/10.1007/s00221-015-4202-3
  • Wang, L., Huang, M., Qin, C., Wang, Y., & Yang, R. (2022). Movement augmentation in virtual reality: Impact on sense of agency measured by subjective responses and electroencephalography. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 832–833). https://doi.org/10.1109/VRW55335.2022.00267
  • Wang, L., Huang, M., Wang, Y., Yang, R., Liao, K.-L., Zhang, J., & Sun, W. (2021). Movement modulation in virtual rehabilitation: Its influence on agency and motor performance. In 2021 IEEE 9th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1–8). https://doi.org/10.1109/SEGAH52098.2021.9551897
  • Wang, L., Huang, M., Yang, R., Liang, H.-N., Han, J., & Sun, Y. (2023). Survey of movement reproduction in immersive virtual rehabilitation. IEEE Transactions on Visualization and Computer Graphics, 29(4), 2184–2202. https://doi.org/10.1109/TVCG.2022.3142198
  • Wei, Y., Bajaj, P., Scheidt, R., & Patton, J. (2005). Visual error augmentation for enhancing motor learning and rehabilitative relearning. In 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005 (pp. 505–510).
  • Wen, W., & Haggard, P. (2018). Control changes the way we look at the world. Journal of Cognitive Neuroscience, 30(4), 603–619. https://doi.org/10.1162/jocn_a_01226
  • Wen, W., Kuroki, Y., & Asama, H. (2019). The sense of agency in driving automation. Frontiers in Psychology, 10, 2691. https://doi.org/10.3389/fpsyg.2019.02691
  • Wen, W., Yamashita, A., & Asama, H. (2017). Measurement of the perception of control during continuous movement using electroencephalography. Frontiers in Human Neuroscience, 11, 392. https://doi.org/10.3389/fnhum.2017.00392
  • Xu, W., Liang, H.-N., Yu, K., Wen, S., Baghaei, N., & Tu, H. (2023). Acceptance of virtual reality exergames among Chinese older adults. International Journal of Human–Computer Interaction, 39(5), 1134–1148. https://doi.org/10.1080/10447318.2022.2098559
  • Yun, S., Wen, W., An, Q., Hamasaki, S., Yamakawa, H., Tamura, Y., & Yamashita, A. (2017). Investigating the relationship between driver’s sense of agency and EEG: Mu-rhythm is more suppressed in higher SOA case. In 2017 International Symposium on Micro-NanoMechatronics and Human Science (MHS) (pp. 1–6). https://doi.org/10.1109/MHS.2017.8305264
  • Zanatto, D., Chattington, M., & Noyes, J. (2021). Human-machine sense of agency. International Journal of Human–Computer Studies, 156, 102716. https://doi.org/10.1016/j.ijhcs.2021.102716
  • Zhang, J., Huang, M., Yang, R., Wang, Y., Tang, X., Han, J., & Liang, H.-N. (2023). Understanding the effects of hand design on embodiment in virtual reality. Artificial Intelligence for Engineering Design, Analysis and Manufacturing, 37, e10. https://doi.org/10.1017/S0890060423000045

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.