ArmMenu: command input on distant displays with proprioception based lateral arm movements

References

• Alt, F., S. Geiger, and W. Höhl. 2018. “ShapelineGuide: Teaching Mid-Air Gestures for Large Interactive Displays.” In Proceedings of the 7th ACM International Symposium on Pervasive Displays, PerDis '18, Munich, Germany, 3:1–3:8. New York, NY: ACM.
   Google Scholar
• Bailly, G. et al. 2011. “Comparing Free Hand Menu Techniques for Distant Displays Using Linear, Marking and Finger-Count Menus.” In Proceedings of the 13th IFIP TC 13 International Conference on Human-computer Interaction - Volume Part II, INTERACT'11, Lisbon, Portugal, 248–262. Berlin: Springer-Verlag.
   Google Scholar
• Bossavit, B., A. Marzo, O. Ardaiz, and A. Pina. 2014. “Hierarchical Menu Selection with a Body-Centered Remote Interface.” Interacting with Computers 26 (5): 389–402. doi: https://doi.org/10.1093/iwc/iwt043
   Web of Science ®Google Scholar
• Callahan, J. et al. 1988. “An Empirical Comparison of Pie vs. Linear Menus.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '88, Washington, DC, USA, 95–100. New York, NY: ACM.
   Google Scholar
• Carter, M. et al. 2016. “PathSync: Multi-User Gestural Interaction with Touchless Rhythmic Path Mimicry.” In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, Santa Clara, CA, USA. New York, NY: ACM.
   Google Scholar
• Chattopadhyay, D., and D. Bolchini. 2014. “Touchless Circular Menus: Toward an Intuitive UI for Touchless Interactions with Large Displays.” In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, AVI '14, Como, Italy, 33–40. New York, NY: ACM.
   Google Scholar
• Chattopadhyay, D., and D. Bolchini. 2015. “Motor-intuitive Interactions Based on Image Schemas: Aligning Touchless Interaction Primitives with Human Sensorimotor Abilities.” Interacting with Computers 27 (3): 327–343. doi: https://doi.org/10.1093/iwc/iwu045
   Web of Science ®Google Scholar
• Chertoff, D. B., R. W. Byers, and J.J. LaViola Jr. 2009. “An Exploration of Menu Techniques Using a 3D Game Input Device.” In Proceedings of the 4th International Conference on Foundations of Digital Games, FDG '09, Orlando, FL, 256–262. New York, NY: ACM.
   Google Scholar
• Cockburn, A., C. Gutwin, J. Scarr, and S. Malacria. 2014. “Supporting Novice to Expert Transitions in User Interfaces.” ACM Computing Surveys 47 (2): 31:1–31:36.
   Web of Science ®Google Scholar
• Fuentes, C. T., and A. J. Bastian. 2010. “Where is Your Arm? Variations in Proprioception Across Space and Tasks.” Journal of Neurophysiology 103 (1): 164–171. doi: https://doi.org/10.1152/jn.00494.2009
   PubMed Web of Science ®Google Scholar
• Han, J., G. Waddington, R. Adams, J. Anson, and Y. Liu. 2016. “Assessing Proprioception: A Critical Review of Methods.” Journal of Sport and Health Science 5 (1): 80–90. doi: https://doi.org/10.1016/j.jshs.2014.10.004
   PubMed Web of Science ®Google Scholar
• Haque, F., M. Nancel, and D. Vogel. 2015. “Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors.” In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, Seoul, Republic of Korea, 3653–3656. New York, NY: ACM.
   Google Scholar
• Hincapié-Ramos, J. D. et al. 2014. “Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-air Interactions.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '14, Toronto, ON, Canada, 1063–1072. New York, NY: ACM.
   Google Scholar
• Jacob, M. G., and J. P. Wachs. 2014. “Context-based Hand Gesture Recognition for the Operating Room.” Pattern Recognition Letters 36: 196–203. doi: https://doi.org/10.1016/j.patrec.2013.05.024
   Web of Science ®Google Scholar
• Jang, S. et al. 2017. “Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion.” In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI '17, Denver, CO, USA, 3328–3339. New York, NY: ACM.
   Google Scholar
• Kinect. 2018a. “Kinect Gestures.” Accessed October 14, 2018. https://support.xbox.com/en-HK/xbox-360/accessories/body-controller.
   Google Scholar
• Kinect. 2018b. “Kinect Hardware Key Features and Benefits.” Accessed October 14, 2018. https://developer.microsoft.com/en-us/windows/kinect/hardware.
   Google Scholar
• Klemmer, S. R., B. Hartmann, and L. Takayama. 2006. “How Bodies Matter: Five Themes for Interaction Design.” In Proceedings of the 6th Conference on Designing Interactive Systems, DIS '06, University Park, PA, USA, 140–149. New York, NY: ACM.
   Google Scholar
• Kulshreshth, A., and J.J. LaViola Jr. 2014. “Exploring the Usefulness of Finger-based 3D Gesture Menu Selection.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '14, Toronto, ON, Canada, 1093–1102. New York, NY: ACM.
   Google Scholar
• Kurtenbach, G., and W. Buxton. 1993. “The Limits of Expert Performance Using Hierarchic Marking Menus.” In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems, CHI '93, Amsterdam, The Netherlands, 482–487. New York, NY, USA: ACM.
   Google Scholar
• Kurtenbach, G. P., A. J. Sellen, and W. A. S. Buxton. 1993. “An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus.” Human-Computer Interaction 8 (1): 1–23. doi: https://doi.org/10.1207/s15327051hci0801_1
   Google Scholar
• Lenman, S., L. Bretzner, and B. Thuresson. 2002. “Using Marking Menus to Develop Command Sets for Computer Vision Based Hand Gesture Interfaces.” In Proceedings of the Second Nordic Conference on Human-Computer Interaction, NordiCHI '02, Aarhus, Denmark, 239–242. New York, NY: ACM.
   Google Scholar
• Li, Y.. 2010. “Gesture Search: A Tool for Fast Mobile Data Access.” In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology, UIST '10, New York, NY, USA, 87–96. New York, NY: ACM.
   Google Scholar
• Li, F. C. Y., D. Dearman, and K. N. Truong. 2009. “Virtual Shelves: Interactions with Orientation Aware Devices.” In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, UIST '09, Victoria, BC, Canada, 125–128. New York, NY: ACM.
   Google Scholar
• Lopes, P. et al. 2015. “Proprioceptive Interaction.” In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, Seoul, Republic of Korea, 939–948. New York, NY: ACM.
   Google Scholar
• Matulic, F., and D. Vogel. 2018. “Multiray: Multi-Finger Raycasting for Large Displays.” In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI '18, Montreal, QC, Canada, 245:1–245:13. New York, NY: ACM.
   Google Scholar
• Mine, M. R., F. P. Brooks Jr., and C. H. Sequin. 1997. “Moving Objects in Space: Exploiting Proprioception in Virtual-environment Interaction.” In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '97, 19–26. New York, NY: ACM Press/Addison-Wesley Publishing Co.
   Google Scholar
• Nacenta, M. A. et al. 2013. “Memorability of Pre-designed and User-defined Gesture Sets.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, Paris, France, 1099–1108. New York, NY: ACM.
   Google Scholar
• Nakai, A., A. Pyae, M. Luimula, S. Hongo, H. Vuola, and J. Smed. 2015. “Investigating the Effects of Motion-based Kinect Game System on User Cognition.” Journal on Multimodal User Interfaces 9 (4): 403–411. doi: https://doi.org/10.1007/s12193-015-0197-0
   Web of Science ®Google Scholar
• Pasqual, Phillip T., and Jacob O. Wobbrock. 2014. “Mouse Pointing Endpoint Prediction Using Kinematic Template Matching.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’14, Toronto, ON, Canada, 743–752. New York, NY: ACM.
   Google Scholar
• Proske, U., and S. C. Gandevia. 2012. “The Proprioceptive Senses: Their Roles in Signaling Body Shape, Body Position and Movement, and Muscle Force.” Physiological Reviews 92 (4): 1651–1697. doi: https://doi.org/10.1152/physrev.00048.2011
   PubMed Web of Science ®Google Scholar
• Ren, G., and E. O'Neill. 2012. “3D Marking Menu Selection with Freehand Gestures.” In 2012 IEEE Symposium on 3D User Interfaces (3DUI), Costa Mesa, CA, 61–68. IEEE.
   Google Scholar
• Rubine, D. 1991. “Specifying Gestures by Example.” In Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH’91, Las Vegas, 329–337. New York, NY: ACM.
   Google Scholar
• Sambrooks, L., and B. Wilkinson. 2013. “Comparison of Gestural, Touch, and Mouse Interaction with Fitts' Law.” In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, OzCHI '13, Adelaide, Australia, 119–122. New York, NY: ACM.
   Google Scholar
• Schofield, W. N.. 1976. “Hand Movements Which Cross the Body Midline: Findings Relating Age Differences to Handedness.” Perceptual and Motor Skills 42 (2): 643–646. doi: https://doi.org/10.2466/pms.1976.42.2.643
   PubMed Web of Science ®Google Scholar
• Schwaller, M., and D. Lalanne. 2013. “Pointing in the Air: Measuring the Effect of Hand Selection Strategies on Performance and Effort.” In Human Factors in Computing and Informatics, Maribor, Slovenia, 732–747. Springer, Berlin, Heidelberg.
   Google Scholar
• Shen, S., H. Wang, and R. Roy Choudhury. 2016. “I Am a Smartwatch and I Can Track My User's Arm.” In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys '16, Singapore, Singapore, 85–96. New York, NY: ACM.
   Google Scholar
• Sherrington, C. 1952. The Integrative Action of the Nervous System. Cambridge, United Kingdom: Cambridge University Press Archive.
   Google Scholar
• Shoemaker, G. et al. 2010. “Body-centric Interaction Techniques for Very Large Wall Displays.” In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, NordiCHI '10, Reykjavik, Iceland, 463–472. New York, NY: ACM.
   Google Scholar
• Uddin, M. S., and C. Gutwin. 2016. “Rapid Command Selection on Multi-Touch Tablets with Single-Handed HandMark Menus.” In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces, ISS '16, Niagara Falls, ON, Canada, 205–214. New York, NY: ACM.
   Google Scholar
• Uddin, M. S., C. Gutwin, and B. Lafreniere. 2016. “HandMark Menus: Rapid Command Selection and Large Command Sets on Multi-Touch Displays.” In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, San Jose, CA, USA, 5836–5848. New York, NY: ACM.
   Google Scholar
• Vinayak, R. K., S. Murugappan, H. R. Liu, and K. Ramani. 2013. “Shape-It-Up: Hand Gesture Based Creative Expression of 3D Shapes Using Intelligent Generalized Cylinders.” Computer-Aided Design, 45 (277–287. Solid and Physical Modeling 2012. doi: https://doi.org/10.1016/j.cad.2012.10.011
   Web of Science ®Google Scholar
• Vogel, D., and R. Balakrishnan. 2005. “Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays.” In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, UIST '05, Seattle, WA, USA, 33–42. New York, NY: ACM.
   Google Scholar
• Walter, R. et al. 2014. “Cuenesics: Using Mid-air Gestures to Select Items on Interactive Public Displays.” In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services, MobileHCI '14, Toronto, ON, Canada, 299–308. New York, NY: ACM.
   Google Scholar
• Walter, R., G. Bailly, and J. Müller. 2013. “StrikeAPose: Revealing Mid-air Gestures on Public Displays.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, Paris, France, 841–850. New York, NY: ACM.
   Google Scholar
• Wasenmüller, O., and D. Stricker. 2017. Comparison of Kinect V1 and V2 Depth Images in Terms of Accuracy and Precision, 34–45. Cham: Springer International Publishing.
   Google Scholar
• Wilson, A. D. et al. 2016. Providing a tele-immersive experience using a mirror metaphor. US Patent 9,325,943.
   Google Scholar
• Wobbrock, J. O., M. R. Morris, and A. D. Wilson. 2009. “User-defined Gestures for Surface Computing.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09, Boston, MA, USA, 1083–1092. New York, NY: ACM.
   Google Scholar
• Yoo, S. et al. 2015. “To Dwell or Not to Dwell: An Evaluation of Mid-Air Gestures for Large Information Displays.” In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction, OzCHI '15, Parkville, VIC, Australia, 187–191, New York, NY: ACM.
   Google Scholar
• Zhai, S. et al. 2012. “Foundational Issues in Touch-Surface Stroke Gesture Design: An Integrative Review.” Foundations and Trends in Human–Computer Interaction 5 (2): 97–205. doi: https://doi.org/10.1561/1100000012
   Google Scholar
• Zhao, S., and R. Balakrishnan. 2004. “Simple vs. Compound Mark Hierarchical Marking Menus.” In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, UIST '04, Santa Fe, NM, USA, 33–42. New York, NY: ACM.
   Google Scholar