Hierarchical Pointing on Distant Displays with Smart Devices

Abstract

Large display interaction has undergone considerable growth, whereas distant pointing poses challenges due to distance limitations and input devices. Smart devices with superior computing power and rich input capabilities aim to surmount these restrictions. However, pointing interactions in single-layer have limited accuracy in large display scenarios. We investigate a hierarchical pointing approach that couples multiple control modes of rotation attitude, touch operation, and pressure simulation with different cursor strategies. Specifically, it covers the dual-layer cursor with the hierarchical structure, the pressure-dependent multistage gain cursor, and the cursor projection technique based on the target acquisition mechanism. We contrast seven distant pointing techniques in two groups of experiments. Our results indicate that the hierarchical interaction strategy improves user performance, and cursor projection achieves an optimal trade-off between velocity and accuracy for high Fitts’ index of difficulty (ID) contexts.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by the National Key Research and Development Program of China under Grant [No. 2018YFB1005002]; Science and Technology Service Network Initiative (STS) of Chinese Academy of Sciences-Dongguan under Grant [No. 202016002000032]; and The Strategy Priority Research Program of Chinese Academy of Sciences under Grant [No. XDA20080200].

Notes on contributors

Linlin Li

Linlin Li received the BE degree in computer science and technology from Jilin University, Changchun, China, in 2014, where she is currently pursuing a PhD degree. Her current research interests include human–computer interaction, user experience, and data analytics.

Zhiyi Fang

Zhiyi Fang received a PhD degree in computer science from Jilin University, Changchun, China, in 1998. He is currently a professor in computer science at Jilin University and a member of the China Software Industry Association. His research areas include mobile communication and wireless networks.

Weiqin Jia

Weiqin Jia graduated from Beijing Institute of Technology with a bachelor’s degree in 2013, and from the University of the Chinese Academy of Sciences with a master’s degree in 2016. Now she works in Industrial and Commercial Bank of China and is engaged in user experience research.

Fengjun Zhang

Fengjun Zhang received a PhD degree in Mechanical and Electrical Engineering from Harbin Institute of Technology, Harbin, China, in 1999. He is currently a research fellow with Institute of Software, Chinese Academy of Sciences. He has research expertise in the field of virtual reality and human–computer interaction.