Gaze-augmented interaction improves problem-solving: new evidence from verbal protocols

Abstract

When interacting with a problem on a computer screen, users need to select from a range of strategies that the user interface supports. Previous research shows that the problem-solving user interface plays a significant role in the strategy selection, such as by making recall unnecessary or by facilitating planning. What is not very well understood is how the interaction devices, themselves, affect problem-solving strategies. We conducted an experiment in which users interacted with a problem using either a computer mouse or gaze-augmented input. We analysed the qualitative differences in the problem-solving process by investigating the content of verbal protocols. We present a new evidence that shows that the gaze-based interaction is characterised by an increased cognitive processing of thecurrently attended information, leading to better plan development and improved problem-solving strategies. The findings have implications on the design of future gaze-aware problem-solving user interfaces.

Keywords:

• gaze-interaction
• problem-solving
• planning
• interaction design

Acknowledgements

We thank Eliza Poudyal and Mercy Gachoka with help on the analysis of verbal data.

Notes

Technically, the gaze-input is implemented using a call-back function that is automatically invoked every time new gaze-data are available. The function checks whether the point the user is looking at lies on one of the tiles, and identifies the tile.

Issuing a command in both the mouse and gaze-augmented conditions requires the same effort for a button click.