User-Defined Gestures for Dual-Screen Mobile Interaction

ABSTRACT

Existing mobile phones use the front screen for gesture interactions, but they often suffer from usability problems such as content occlusion and spurious triggering caused by fat finger errors. Recent advances in new sensor technologies have made it possible for modern mobile phones to recognize gesture inputs on the rear screen. Although inputs from the backside of a mobile phone have demonstrated their usefulness for simple interaction tasks such as target acquisition, little is known regarding the best practices in gesture design for complex concurrent tasks on dual-screen mobile devices. Therefore, we conducted a three-stage study to explore user-defined multi-finger gestures for concurrent game tasks on a dual-screen mobile device. Experimental results indicate the existence of a consensus between participants regarding gesture choices for specified game tasks. Based on this consensus, we developed a gesture taxonomy and generated a set of user-defined gestures for dual-screen mobile devices. A subsequent benchmark test validated the popularity of the user-defined gestures with both ordinary and professional game players.

Acknowledgment

The authors would like to thank the anonymous reviewers for their insightful comments.

Notes

1. https://www.gamespot.com/playerunknowns-battlegrounds/.

Additional information

Funding

This work was supported by the National Natural Science Foundation of China under Grant No. 61772564, 61202344.

Notes on contributors

Huiyue Wu

Huiyue Wu received the Ph.D. degree in computer science from Institute of Software, the Chinese Academy of Sciences, Beijing, China, in 2010. He is currently an Associate Professor at Sun Yat-sen University, Guangzhou, China. His research interests include vision-based interfaces, gestural interaction, and user-centered design. He has published more than 30 papers in international journals and conference proceedings.

Liuqingqing Yang

Liuqingqing Yang is a graduate student at Sun Yat-sen University, Guangzhou, China. Her research interests include human-computer interaction, interaction design, and usability engineering. She obtained Bachelor of Design Science from Sun Yat-sen University, Guangzhou, China, 2019.