Interacting with virtual characters, objects and environments: investigating immersive virtual reality in rehabilitation

Figures & data

Table 1. Description of the five VR applications (in order) in which participants were immersed.

Application type	Description	Purpose	Observations
Introductory instructional game	A series of directed activities to introduce controls and VR space	Orient to object and character interaction	Orientation to 360-degree VR space. Grasping, lifting, manipulating objects with one or two hands. Non-verbal communication (e.g., waving).
Cafe simulation [19]	Simulation requiring conversation to order a drink/food. Avatar turns-at-talk controlled by the first author using a linked iPad (a “Wizard-of-Oz” protocol; [20].	Simulated conversational interaction	Orientation to 360-degree VR space. Grasping, passing objects with one hand. Verbal communication.
Short film	A non-interactive animated short film in the full 360-degree VR space, requiring users to track the story.	Attention to narrative	Orientation to 360-degree VR space. Response to visual and audio directional cues.
Interactive short film	An animated interactive film where the user directs parts of the narrative by responding to the main character (a talking seagull)	Participation in computer-led verbal interaction. Attention to narrative.	Orientation to 360-degree VR space. Grasping, manipulating objects with one hand. Non-verbal and verbal communication.
Interactive VR game	Participants took the role of a convenience store clerk in a simulation designed to represent the occupation in a humorous way.	Integrating attention, character and object interaction, problem-solving	Orientation to 360-degree VR space. Grasping, lifting, passing, manipulating objects with two hands. Non-verbal and verbal communication.

Figure 1. Observed directions that participants viewed to orient within the virtual space.

A graphic representation of regions around the body in the horizontal and vertical planes. Percentages are given as to what proportion of participants oriented to each space.

Figure 2. Observed regions where participants reached for and/or grasped virtual objects.

A graphic representation of regions around the body in the horizontal and vertical planes. Percentages are given as to what proportion of participants reached for and/or grasped objects within each space.

Table 2. Proportion of participants and virtual experiences where depth perception errors were observed in reaching behaviours.

Errors observed	Participants (N = 13) performing behaviour % (n)	Experiences (N = 52) where behaviour observed % (n)
Over-reach errors	7.69% (1)	15.38% (8)
Under-reach errors	30.77% (4)	7.69% (4)
Both under- and over-reach	23.08% (3)	0%

Table 3. Instances of unconventional behaviour observed with characters in virtual interactions.

Unconventional Behaviour	Times observed	Participants (N = 13) performing behaviour % (n)	Experiences (N = 52) where behaviour observed % (n)
Throwing/ shooting/ hitting character	21	46.15% (6)	25.00% (13)
Giving a false name	4	15.38% (2)	3.85% (2)
Taking clothing accessories from character	3	7.69% (1)	1.92% (1)
Offering food as payment	2	15.38% (2)	3.85% (2)
Yelling at character	1	7.69% (1)	1.92% (1)

Table 4. Type of support required while immersed in virtual reality.

Type of support needed	Times observed	Participants (N = 13) performing behaviour % (n)	Experiences (N = 65) where behaviour observed % (n)
Gameplay support
Locate needed item	14	53.85% (7)	12.31% (8)
How/When to communicate	7	38.46% (5)	10.77% (7)
What to do next	30	61.54% (8)	21.54% (14)
Reinforcement of action	5	23.08% (3)	4.62% (3)
System support
Control use	11	61.54% (8)	12.31% (8)
Physical positioning	11	53.85% (7)	15.38% (10)
Headset adjustment	1	7.69% (1)	1.54% (1)

Figure 3. Technological challenges experienced by users while using immersive virtual reality.

A bar graph depicting the different technological challenges faced by participants. Interference of the tether cord is the most frequently reported challenge, followed by accidentally pausing or exiting the game.

Bryant L, Sedlarevic N, Stubbs P, et al. Collaborative co-design and evaluation of an immersive virtual reality application prototype for communication rehabilitation (DISCOVR prototype). Disabil Rehabil Assist Technol. 2022;19(1):90–99. doi: 10.1080/17483107.2022.2063423.

 PubMed Web of Science ®Google Scholar

Harrington B, Martin B. Universal methods of design. Beverly, Massachusetts: Rockport; 2012.

 Google Scholar

Data availability statement

The data associated with this research is not available due to ethical constraints.