Improving Error Correction and Text Editing Using Voice and Mouse Multimodal Interface

Figures & data

Figure 1. Workflow of the fix task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 2. Workflow of the fix + options task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 3. Workflow of the replace task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 4. Workflow of the copy task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 5. Workflow of the paste task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 6. Workflow of the add task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 7. Workflow of the delete task using the three systems: voice-only (a), voice&gaze (b), and voice&mouse (c).

Figure 8. Experimental setup for the Teyepo system.

Table 1. The results of the separate three-way ANOVAs with repeated measures on the performance time and the task effort.

	Performance time		Task effort
	F-Measure	P-Value	F-Measure	P-Value
Editing Method	F(3, 69) = 32.93	p < 0.0001	F(2, 46) = 65.54	p < 0.0001
Task	F(6, 138) = 30.13	p < 0.0001	F(6, 138) = 59.57	p < 0.0001
Block	F(2, 46) = 0.06	p = 0.94	F(2, 46) = 0.8	p = 0.45
Method $\times$ Task	F(18, 414) = 6.02	p < 0.0001	F(12, 276) = 6.75	p < 0.0001
Method $\times$ Block	F(6, 138) = 0.13	p = 0.99	F(4, 92) = 1.49	p = 0.21
Task $\times$ Block	F(12, 276) = 0.06	p = 0.99	F(12, 276) = 0.77	p = 0.68
Method $\times$ Task $\times$ Block	F(36, 828) = 0.12	p = 1.00	F(24, 552) = 1.41	p = 0.09

Figure 9. The average performance time as a function of the editing method and task.

Figure 10. The average task effort as a function of the editing method and task.

Figure 11. The average perceived NASA-TLX task load as a function of the editing method and task type.

Figure 12. The average SUS score for each editing method.

Figure 13. The preference score as a function of the editing method and task.