Modeling Gesture-Typing Movements

REFERENCES

• Abend, W., Bizzi, E., & Morasso, P. (1982). Human arm trajectory formation. Brain, 105(2), 331–348. doi:10.1093/brain/105.2.331
   PubMed Web of Science ®Google Scholar
• Accot, J., & Zhai, S. (1997). Beyond Fitts’ law: Models for trajectory-based HCI tasks. Proceedings of the CHI 1997 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Andersen, T. H., & Zhai, S. (2008). “Writing with music”: Exploring the use of auditory feedback in gesture interfaces. ACM Transactions on Applied Perception, 7(3), 1–24. doi:10.1145/1773965.1773968
   Web of Science ®Google Scholar
• Bernstein, N. (1967). The co-ordination and regulation of movements. Oxford, UK: Pergamon Press.
   Google Scholar
• Bi, X., Li, Y., & Zhai, S. (2013). Fitts law: Modeling finger touch with Fitts’ law. Proceedings of the CHI 2013 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Bryan, W. L. (1892). On the development of voluntary motor ability. The American Journal of Psychology, 5(2), 125–204. doi:10.2307/1410865
   Google Scholar
• Bryson, A. E., & Ho, Y.-C. (1975). Applied optimal control: Optimization, estimation, and control. New York, NY: Hemisphere.
   Google Scholar
• Campos, F. M. M. O., & Calado, J. M. F. (2009). Approaches to human arm movement control—A review. Annual Reviews in Control, 33(1), 69–77. doi:10.1016/j.arcontrol.2009.03.001
   Web of Science ®Google Scholar
• Cao, X., & Zhai, S. (2007). Modeling human performance of pen stroke gestures. Proceedings of the CHI 2007 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Castellucci, S. J., & MacKenzie, I. S. (2008). Graffiti vs. Unistrokes: An empirical comparison. Proceedings of the CHI 2008 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Diedrichsen, J., Shadmehr, R., & Irvry, R. B. (2010). The coordination of movement: Optimal feedback control and beyond. Trends in Cognitive Sciences, 14(1), 31–39. doi:10.1016/j.tics.2009.11.004
   PubMed Web of Science ®Google Scholar
• Edelman, S., & Flash, T. (1987). A model of handwriting. Biological Cybernetics, 57(1–2), 25–36. doi:10.1007/BF00318713
   PubMed Web of Science ®Google Scholar
• Engelbrecht, S. E. (2001). Minimum principles in motor control. Journal of Mathematical Psychology, 45(3), 497–542. doi:10.1006/jmps.2000.1295
   PubMed Web of Science ®Google Scholar
• Filliben, J. J. (1975). The probability plot correlation coefficient test for normality. Technometrics, 17(1), 111–117. doi:10.1080/00401706.1975.10489279
   Web of Science ®Google Scholar
• Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movements. Journal of Experimental Psychology, 47(6), 381–391. doi:10.1037/h0055392
   PubMedGoogle Scholar
• Flash, T., & Hogan, N. (1985). The coordination of arm movements: An experimentally confirmed mathematical model. Journal of Neuroscience, 5(7), 1688–1703.
   PubMed Web of Science ®Google Scholar
• Flash, T., & Sejnowski, T. J. (2001). Computational approaches to motor control. Current Opinion in Neurobiology, 11(6), 655–662. doi:10.1016/S0959-4388(01)00265-3
   PubMed Web of Science ®Google Scholar
• Fowler, A., Partridge, K., Chelba, C., Bi, X., Ouyang, T., & Zhai, S. (2015). Effects of language modeling and its personalization on touchscreen typing performance. Proceedings of the CHI 2015 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Freeman, F. N. (1914). Experimental analysis of the writing movement. The Psychological Monographs, 17(4), 1–57. doi:10.1037/h0093085
   Google Scholar
• Galbally, J., Fierrez, J., Ortega-Garcia, J., & Plamondon, R. (2012). Synthetic on-line signature generation. Part II: Experimental validation. Pattern Recognition, 45(7), 2622–2632. doi:10.1016/j.patcog.2011.12.007
   Web of Science ®Google Scholar
• Goldberg, D., & Richardson, C. (1993). Touch-typing with a stylus. Proceedings of the CHI 1993 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Greene, P. H. (1982). Why is it easy to control your arms? Journal of Motor Behavior, 14(4), 260–286. doi:10.1080/00222895.1982.10735280
   PubMed Web of Science ®Google Scholar
• Guiard, Y. (1993). On Fitts’s and Hooke’s laws: Simple harmonic movement in upper-limb cyclical aiming. Acta Psychologica, 82(1–3), 139–159. doi:10.1016/0001-6918(93)90009-G
   PubMed Web of Science ®Google Scholar
• Harris, C. M., & Wolpert, D. M. (1998). Signal-dependent noise determines motor planning. Nature, 394, 780–784. doi:10.1038/29528
   PubMed Web of Science ®Google Scholar
• Hawkins, J. C., Sipher, J. K., & Ron, M. I. (2002). U.S. Patent No. 6,493,464. Washington, DC: U.S. Patent and Trademark Office.
   Google Scholar
• Hoff, B., & Arbib, M. A. (1993). Models of trajectory formation and temporal interaction of reach and grasp. Journal of Motor Behavior, 25(3), 175–192. doi:10.1080/00222895.1993.9942048
   PubMed Web of Science ®Google Scholar
• Hogan, N. (1984). An organizing principle for a class of voluntary movements. Journal of Neuroscience, 4(11), 2745–2754.
   PubMed Web of Science ®Google Scholar
• Hogan, N., & Flash, T. (1987). Moving gracefully: Quantitative theories of motor coordination. Trends in Neurosciences, 10(4), 170–174. doi:10.1016/0166-2236(87)90043-9
   Web of Science ®Google Scholar
• Jack, W. R. (1895). The analysis of voluntary muscular movements by certain new instruments. Journal of Anatomy and Physiology, 29(4), 473–478. doi:10.1098/rspl.1894.0178
   PubMedGoogle Scholar
• Kristensson, P.-O., & Zhai, S. (2004). SHARK2: A large vocabulary shorthand writing system for pen-based computers. Proceedings of the UIST 2004 Symposium on User Interface Software and Technology. New York, NY: ACM.
   Google Scholar
• Lacquaniti, F., Terzuolo, C., & Viviani, P. (1983). The law relating the kinematic and figural aspects of drawing movements. Acta Psychologica, 54(1–3), 115–130. doi:10.1016/0001-6918(83)90027-6
   PubMed Web of Science ®Google Scholar
• Liu, D., & Todorov, E. (2007). Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. The Journal of Neuroscience, 27(35), 9354–9368. doi:10.1523/JNEUROSCI.1110-06.2007
   PubMed Web of Science ®Google Scholar
• MacKenzie, I. S., & Soukoreff, R. W. (2002). Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction, 17(2–3), 147–198. doi:10.1080/07370024.2002.9667313
   Web of Science ®Google Scholar
• MacKenzie, I. S., & Tanaka-Ishii, K. (Eds.). (2007). Text entry systems: Mobility, accessibility, universality. San Francisco, CA: Morgan Kaufmann.
   Google Scholar
• MacKenzie, I. S., Zhang, S. X., & Soukoreff, R. W. (1999). Text entry using soft keyboards. Behaviour & Information Technology, 18(4), 235–244. doi:10.1080/014492999118995
   Web of Science ®Google Scholar
• Mankoff, J., & Abowd, G. D. (1998). Cirrin: A word-level unistroke keyboard for pen input. Proceedings of the UIST 1998 Symposium on User Interface Software and Technology. New York, NY: ACM.
   Google Scholar
• Meyer, D. E., Abrams, R. A., Kornblum, S., Wright, C. E., & Smith, J. E. K. (1988). Optimality in human motor performance: Ideal control of rapid aimed movements. Psychological Review, 95(3), 340–370. doi:10.1037/0033-295x.95.3.340
   PubMed Web of Science ®Google Scholar
• Meyer, D. E., Smith, J. E. K., Kornblum, S., Abrams, R. A., & Wright, C. E. (1990). Speed-accuracy tradeoffs in aimed movements: Toward a theory of rapid voluntary action. In M. Jeannerod (Ed.), Attention and performance XIII (pp. 173–226). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Morasso, P. (1981). Spatial control of arm movements. Experimental Brain Research, 42(2), 223–227. doi:10.1007/BF00236911
   PubMed Web of Science ®Google Scholar
• Myers, C. S., & Rabiner, L. R. (1981). A comparative study of several dynamic time-warping algorithms for connected-word recognition. The Bell System Technical Journal, 60(7), 1389–1409. doi:10.1002/j.1538-7305.1981.tb00272.x
   Google Scholar
• Nelson, W. L. (1983). Physical principles for economies of skilled movements. Biological Cybernetics, 46(2), 135–147. doi:10.1007/BF00339982
   PubMed Web of Science ®Google Scholar
• Norman, D. A. (1981). Categorization of action slips. Psychological Review, 88(1), 1–15. doi:10.1037/0033-295x.88.1.1
   Web of Science ®Google Scholar
• Pastel, R. (2006). Measuring the difficulty of steering through corners. Proceedings of the CHI 2006 Conference on Human Factors in Computer Systems. New York, NY: ACM. doi:10.1145/1124772.1124934
   Google Scholar
• Perlin, K. (1998). Quikwriting: Continuous stylus-based text entry. Proceedings of the UIST 1998 Symposium on User Interface Software and Technology. New York, NY: ACM.
   Google Scholar
• Plamondon, R., O’Reilly, C., Galbally, J., Almaksour, A., & Anquetil, E. (2014). Recent developments in the study of rapid human movements with the kinematic theory: Applications to handwriting and signature synthesis. Pattern Recognition Letters, 35(1), 225–235. doi:10.1016/j.patrec.2012.06.004
   Web of Science ®Google Scholar
• Ramsay, J. O. (2000). Functional components of variation in handwriting. Journal of the American Statistical Association, 95(449), 9–15. doi:10.1080/01621459.2000.10473894
   Web of Science ®Google Scholar
• Ramsay, J. O., & Silverman, B. W. (2002). Applied functional data analysis: Methods and case studies. New York, NY: Springer-Verlag.
   Google Scholar
• Rick, J. (2010). Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop. Proceedings of the UIST 2010 Symposium on User Interface Software and Technology. New York, NY: ACM.
   Google Scholar
• Rumelhart, D. E., & Norman, D. A. (1982). Simulating a skilled typist: A study of skilled cognitive-motor performance. Cognitive Science, 6(1), 1–36. doi:10.1207/s15516709cog0601_1
   Web of Science ®Google Scholar
• Saltzman, E. (1979). Levels of sensorimotor representation. Journal of Mathematical Psychology, 20(2), 91–163. doi:10.1016/0022-2496(79)90020-8
   Web of Science ®Google Scholar
• Schmidt, R. A., Zelaznik, H., Hawkins, B., Frank, J. S., & Quinn, J. T., Jr. (1979). Motor-output variability: A theory for the accuracy of rapid motor acts. Psychological Review, 86(5), 415–451. doi:10.1037/0033-295X.86.5.415
   Web of Science ®Google Scholar
• Sears, A., & Arora, R. (2002). Data entry for mobile devices: An empirical comparison of novice performance with Jot and Graffiti. Interacting with Computers, 14(5), 413–433. doi:10.1016/S0953-5438(01)00060-1
   Web of Science ®Google Scholar
• Smith, B. A., Bi, X., & Zhai, S. (2015). Optimizing touchscreen keyboards for gesture typing. Proceedings of the CHI 2015 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Tanaka, H., Krakauer, J. W., & Qian, N. (2006). An optimization principle for determining movement duration. Journal of Neurophysiology, 95(6), 3875–3886. doi:10.1152/jn.00751.2005
   PubMed Web of Science ®Google Scholar
• Tappert, C. C. (1982). Cursive script recognition by elastic matching. IBM Journal of Research and Development, 26(6), 765–771. doi:10.1147/rd.266.0765
   Web of Science ®Google Scholar
• Todorov, E. (2004). Optimality principles in sensorimotor control. Nature Neuroscience, 7(9), 907–915. doi:10.1038/nn1309
   PubMed Web of Science ®Google Scholar
• Todorov, E. (2005). Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural Computation, 17(5), 1084–1108. doi:10.1162/0899766053491887
   PubMed Web of Science ®Google Scholar
• Todorov, E., & Jordan, M. I. (1998). Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. Journal of Neurophysiology, 80(2), 696–714.
   PubMed Web of Science ®Google Scholar
• Todorov, E., & Jordan, M. I. (2002). Optimal feedback control as a theory of motor coordination. Nature Neuroscience, 5(11), 1226–1235. doi:10.1038/nn963
   PubMed Web of Science ®Google Scholar
• Uno, Y., Kawato, M., & Suzuki, R. (1989). Formation and control of optimal trajectory in human multijoint arm movement. Biological Cybernetics, 61(2), 89–101. doi:10.1007/BF00204593
   PubMed Web of Science ®Google Scholar
• Vatavu, R.-D., Vogel, D., Casiez, G., & Grisoni, L. (2011). Estimating the perceived difficulty of pen gestures. In P. Campos, N. Graham, J. Jorge, N. Nunes, P. Palanque, & M. Winckler (Eds), Human–computer interaction – INTERACT 2011 (Vol. 6947, pp. 89–106). Berlin, Germany: Springer. doi:10.1007/978-3-642-23771-3_9
   Google Scholar
• Viviani, P., & Cenzato, M. (1985). Segmentation and coupling in complex movements. Journal of Experimental Psychology: Human Perception and Performance, 11(6), 828–845. doi:10.1037/0096-1523.11.6.828
   PubMed Web of Science ®Google Scholar
• Viviani, P., & Flash, T. (1995). Minimum-jerk, two-thirds power law, and isochrony: Converging approaches to movement planning. Journal of Experimental Psychology: Human Perception and Performance, 21(1), 32–53. doi:10.1037/0096-1523.21.1.32
   PubMed Web of Science ®Google Scholar
• Viviani, P., & McCollum, G. (1983). The relation between linear extent and velocity in drawing movements. Neuroscience, 10(1), 211–218. doi:10.1016/0306-4522(83)90094-5
   PubMed Web of Science ®Google Scholar
• Viviani, P., & Schneider, R. (1991). A developmental study of the relationship between geometry and kinematics in drawing movements. Journal of Experimental Psychology:Human Perception and Performance, 17(1), 198–218. doi:10.1037/0096-1523.17.1.198
   PubMed Web of Science ®Google Scholar
• Viviani, P., & Terzuolo, C. (1982). Trajectory determines movement dynamics. Neuroscience, 7(2), 431–437. doi:10.1016/0306-4522(82)90277-9
   PubMed Web of Science ®Google Scholar
• Wada, Y., & Kawato, M. (1995). A theory for cursive handwriting based on the minimization principle. Biological Cybernetics, 73(1), 3–13. doi:10.1007/BF00199051
   PubMed Web of Science ®Google Scholar
• Wann, J., Nimmo-Smith, I., & Wing, A. M. (1988). Relation between velocity and curvature in movement: Equivalence and divergence between a power law and a minimum-jerk model. Journal of Experimental Psychology: Human Perception and Performance, 14(4), 622–637. doi:10.1037/0096-1523.14.4.622
   PubMed Web of Science ®Google Scholar
• Weir, D., Pohl, H., Rogers, S., Vertanen, K., & Kristensson, P. O. (2014). Uncertain text entry on mobile devices. Proceedings of the CHI 2014 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Weir, D., Rogers, S., Murray-Smith, R., & Löchtefeld, M. (2012). A user-specific machine learning approach for improving touch accuracy on mobile devices. Proceedings of the UIST 2012 Symposium on User Interface Software and Technology. New York, NY: ACM.
   Google Scholar
• Welford, A. T. (1968). Fundamentals of skill. New York, NY: Methuen.
   Google Scholar
• Wobbrock, J. O., Cutrell, E., Harada, S., & MacKenzie, I. S. (2008). An error model for pointing based on Fitts’ law. Proceedings of the CHI 2008 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Wolpert, D. M. (1997). Computational approaches to motor control. Trends in Cognitive Sciences, 1(6), 209–216. doi:10.1016/S1364-6613(97)01070-X
   PubMed Web of Science ®Google Scholar
• Woodworth, R. S. (1899). The accuracy of voluntary movement [Monograph]. Psychological Review, 3(2), 1–114. doi:10.1037/h0092992
   Google Scholar
• Yashin-Flash, T. (1983). Organizing principles underlying the formation of arm trajectories ( Unpublished doctoral dissertation). Cambridge, MA: MIT Press.
   Google Scholar
• Zhai, S., Hunter, M., & Smith, B. A. (2002). Performance optimization of virtual keyboards. Human-Computer Interaction, 17(2–3), 229–269. doi:10.1080/07370024.2002.9667315
   Web of Science ®Google Scholar
• Zhai, S., & Kristensson, P.-O. (2003). Shorthand writing on stylus keyboard. Proceedings of the CHI 2003 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Zhai, S., & Kristensson, P. O. (2007). Introduction to shape writing. In I. S. MacKenzie & K. Tanaka-Ishii (Eds.), Text entry systems: Mobility, accessibility, universality (pp. 139–158). San Francisco, CA: Morgan Kaufmann.
   Google Scholar
• Zhai, S., & Kristensson, P. O. (2012). The word-gesture keyboard: Reimagining keyboard interaction. Communications of the ACM, 55(9), 91–101. doi:10.1145/2330667.2330689
   Web of Science ®Google Scholar
• Zhai, S., Kristensson, P. O., Appert, C., Andersen, T. H., & Cao, X. (2011). Foundational issues in touch-surface stroke gesture design – an integrative review. Foundations and Trends in Human-Computer Interaction, 5(2), 97–205. doi:10.1561/1100000012
   Google Scholar