HapticProxy: Providing Positional Vibrotactile Feedback on a Physical Proxy for Virtual-Real Interaction in Augmented Reality

References

• Abtahi, P., & Follmer, S. (2018). Visuo-haptic illusions for improving the perceived performance of shape displays. In Proceedings of the 2018 CHI conference on human factors in computing systems, CHI ’18 (pp. 150:1–150:13). ACM.
   Google Scholar
• Adcock, M., Hutchins, M., & Gunn, C. (2003). Augmented reality haptics: using artoolkit for display of haptic applications. In 2003 IEEE international augmented reality toolkit workshop (pp. 1–2). IEEE.
   Google Scholar
• Aleotti, J., Micconi, G., & Caselli, S. (2016). Object interaction and task programming by demonstration in visuo-haptic augmented reality. Multimedia Systems, 22(6), 675–691. https://doi.org/10.1007/s00530-015-0488-z
   Web of Science ®Google Scholar
• Allen, P. K. (1988). Integrating vision and touch for object recognition tasks. The International Journal of Robotics Research, 7(6), 15–33. https://doi.org/10.1177/027836498800700603
   Web of Science ®Google Scholar
• Azmandian, M., Hancock, M., Benko, H., Ofek, E., & Wilson, A. D. (2016). Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. In Proceedings of the 2016 CHI conference on human factors in computing systems, CHI ’16 (pp. 1968–1979). ACM.
   Google Scholar
• Benko, H., Holz, C., Sinclair, M., & Ofek, E. (2016). Normaltouch and texturetouch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers. In Proceedings of the 29th annual symposium on user interface software and technology, UIST ’16 (pp. 717–728). ACM.
   Google Scholar
• Carter, T., Seah, S. A., Long, B., Drinkwater, B., & Subramanian, S. (2013). Ultrahaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on user interface software and technology, UIST ’13 (pp. 505–514). ACM.
   Google Scholar
• Cheng, L.-P., Chang, L., Marwecki, S., & Baudisch, P. (2018). iturk: Turning passive haptics into active haptics by making users reconfigure props in virtual reality. In Proceedings of the 2018 CHI conference on human factors in computing systems, CHI ’18 (pp. 89:1–89:10). ACM.
   Google Scholar
• Cheng, L.-P., Ofek, E., Holz, C., Benko, H., & Wilson, A. D. (2017). Sparse haptic proxy: Touch feedback in virtual environments using a general passive prop. In Proceedings of the 2017 CHI conference on human factors in computing systems, CHI ’17 (pp. 3718–3728). ACM.
   Google Scholar
• Chinello, F., Pacchierotti, C., Bimbo, J., Tsagarakis, N. G., & Prattichizzo, D. (2018). Design and evaluation of a wearable skin stretch device for haptic guidance. IEEE Robotics and Automation Letters, 3(1), 524–531. https://doi.org/10.1109/LRA.2017.2766244
   Web of Science ®Google Scholar
• Chittka, L., Skorupski, P., & Raine, N. E. (2009). Speed-accuracy tradeoffs in animal decision making. Trends in Ecology & Evolution, 24(7), 400–407. https://doi.org/10.1016/j.tree.2009.02.010
   PubMed Web of Science ®Google Scholar
• Choi, I., Ofek, E., Benko, H., Sinclair, M., & Holz, C. (2018). Claw: A multifunctional handheld haptic controller for grasping, touching, and triggering in virtual reality. In Proceedings of the 2018 CHI conference on human factors in computing systems, CHI ’18 (pp. 654:1–654:13). ACM.
   Google Scholar
• Delazio, A., Nakagaki, K., Klatzky, R. L., Hudson, S. E., Lehman, J. F., & Sample, A. P. (2018). Force jacket: Pneumatically-actuated jacket for embodied haptic experiences. In Proceedings of the 2018 CHI conference on human factors in computing systems, CHI ’18 (pp. 320:1–320:12). ACM.
   Google Scholar
• Dipietro, L., Sabatini, A. M., & Dario, P. (2008). A survey of glove-based systems and their applications. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 38(4), 461–482. https://doi.org/10.1109/TSMCC.2008.923862
   Web of Science ®Google Scholar
• Duţu, L., Mauris, G., Bolon, P., Dabic, S., Tissot, J. (2013). A fuzzy model relating vibrotactile signal characteristics to haptic sensory evaluations. In 2013 IEEE international conference on computational intelligence and virtual environments for measurement systems and applications (CIVEMSA) (pp. 49–54). IEEE.
   Google Scholar
• Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429–433. https://doi.org/10.1038/415429a
   PubMed Web of Science ®Google Scholar
• Gourishetti, R., Isaac, J. H. R., Manivannan, M. (2018). Passive probing perception: Effect of latency in visual-haptic feedback. In International conference on human haptic sensing and touch enabled computer applications (pp. 186–198). Springer.
   Google Scholar
• Gupta, A., Pietrzak, T., Roussel, N., & Balakrishnan, R. (2016). Direct manipulation in tactile displays. In Proceedings of the 2016 CHI conference on human factors in computing systems, CHI ’16 (pp. 3683–3693). ACM. https://doi.org/10.1145/2858036.2858161
   Google Scholar
• Gupta, K., Lee, G. A., & Billinghurst, M. (2016). Do you see what I see? The effect of gaze tracking on task space remote collaboration. IEEE Transactions on Visualization and Computer Graphics, 22(11), 2413–2422. https://doi.org/10.1109/TVCG.2016.2593778
   PubMed Web of Science ®Google Scholar
• Hayward, V., Astley, O. R., Cruz- Hernandez, M., Grant, D., & Robles- De- La- Torre, G. (2004). Haptic interfaces and devices. Sensor Review, 24(1), 16–29. https://doi.org/10.1108/02602280410515770
   Google Scholar
• Heo, S., Chung, C., Lee, G., & Wigdor, D. (2018). Thor’s hammer: An ungrounded force feedback device utilizing propeller-induced propulsive force. In Extended abstracts of the 2018 CHI conference on human factors in computing systems, CHI EA ’18 (pp. D110:1–D110:4). ACM.
   Google Scholar
• Heo, S., Lee, J., & Wigdor, D. (2019). Pseudobend: Producing haptic illusions of stretching, bending, and twisting using grain vibrations. In Proceedings of the 32nd annual ACM symposium on user interface software and technology, UIST ’19 (pp. 803–813). Association for Computing Machinery. https://doi.org/10.1145/3332165.3347941
   Google Scholar
• Hettiarachchi, A., & Wigdor, D. (2016). Annexing reality: Enabling opportunistic use of everyday objects as tangible proxies in augmented reality. In Proceedings of the 2016 CHI conference on human factors in computing systems, CHI ’16 (pp. 1957–1967). Association for Computing Machinery.
   Google Scholar
• Hinckley, K., Pausch, R., Goble, J. C., & Kassell, N. F. (1994). Passive real-world interface props for neurosurgical visualization. In Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’94 (pp. 452–458). ACM.
   Google Scholar
• Hong, J., Pradhan, A., Froehlich, J. E., & Findlater, L. (2017). Evaluating wrist-based haptic feedback for non-visual target finding and path tracing on a 2d surface. In Proceedings of the 19th international ACM SIGACCESS conference on computers and accessibility, ASSETS ’17 (pp. 210–219). ACM. https://doi.org/10.1145/3132525.3132538
   Google Scholar
• Jay, C., & Hubbold, R. (2005). World haptics conference, delayed visual and haptic feedback in a reciprocal tapping task. In First joint Eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems (pp. 655–656). IEEE. https://doi.org/10.1109/WHC.2005.29
   Google Scholar
• Jayathilaka, W. A. D. M., Qi, K., Qin, Y., Chinnappan, A., Serrano-García, W., Baskar, C., Wang, H., He, J., Cui, S., Thomas, S. W., & Ramakrishna, S. (2019). Significance of nanomaterials in wearables: A review on wearable actuators and sensors. Advanced Materials, 31(7), 1805921. https://doi.org/10.1002/adma.201805921
   Web of Science ®Google Scholar
• Kim, S., Lee, G., Sakata, N., & Billinghurst, M. (2014). Improving co-presence with augmented visual communication cues for sharing experience through video conference. In 2014 IEEE international symposium on mixed and augmented reality (ISMAR) (pp. 83–92). https://doi.org/10.1109/ISMAR.2014.6948412
   Google Scholar
• Knierim, P., Kosch, T., Schwind, V., Funk, M., Kiss, F., Schneegass, S., & Henze, N. (2017). Tactile drones - providing immersive tactile feedback in virtual reality through quadcopters. In Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, CHI EA ’17 (pp. 433–436). ACM. https://doi.org/10.1145/3027063.3050426
   Google Scholar
• Knoerlein, B., Székely, G., & Harders, M. (2007). Visuo-haptic collaborative augmented reality ping-pong. In Proceedings of the international conference on advances in computer entertainment technology, ACE ’07 (pp. 91–94). ACM.
   Google Scholar
• Lazar, J., Feng, J. H., & Hochheiser, H. (2017). Research methods in human-computer interaction. Morgan Kaufmann.
   Google Scholar
• Lécuyer, A. (2009). Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence: Teleoperators and Virtual Environments, 18(1), 39–53. https://doi.org/10.1162/pres.18.1.39
   Web of Science ®Google Scholar
• Lopes, P., You, S., Cheng, L.-P., Marwecki, S., & Baudisch, P. (2017). Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI conference on human factors in computing systems, CHI ’17 (pp. 1471–1482). Association for Computing Machinery. https://doi.org/10.1145/3025453.3025600
   Google Scholar
• Low, K.-L., Welch, G., Lastra, A., & Fuchs, H. (2001). Life-sized projector-based dioramas. In Proceedings of the ACM symposium on virtual reality software and technology, VRST ’01 (pp. 93–101). ACM.
   Google Scholar
• Niwa, M., Lindeman, R. W., Itoh, Y., & Kishino, F. (2009). Determining appropriate parameters to elicit linear and circular apparent motion using vibrotactile cues. In World haptics 2009 – Third joint EuroHaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems (pp. 75–78). IEEE. https://doi.org/10.1109/WHC.2009.4810856
   Google Scholar
• Oron-Gilad, T., Downs, J. L., Gilson, R. D., & Hancock, P. A. (2007). Vibrotactile guidance cues for target acquisition. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 37(5), 993–1004. https://doi.org/10.1109/TSMCC.2007.900646
   PubMed Web of Science ®Google Scholar
• Pacchierotti, C., Salvietti, G., Hussain, I., Meli, L., & Prattichizzo, D. (2016). The hring: A wearable haptic device to avoid occlusions in hand tracking. In 2016 IEEE Haptics Symposium (HAPTICS) (pp. 134–139). https://doi.org/10.1109/HAPTICS.2016.7463167
   Google Scholar
• Pacchierotti, C., Sinclair, S., Solazzi, M., Frisoli, A., Hayward, V., & Prattichizzo, D. (2017). Wearable haptic systems for the fingertip and the hand: Taxonomy, review, and perspectives. IEEE Transactions on Haptics, 10(4), 580–600. https://doi.org/10.1109/TOH.2017.2689006
   PubMed Web of Science ®Google Scholar
• Pair, J., Neumann, U., Piepol, D., & Swartout, B. (2003). Flatworld: Combining Hollywood set-design techniques with VR. IEEE Computer Graphics and Applications, 23(1), 12–15. https://doi.org/10.1109/MCG.2003.1159607
   Web of Science ®Google Scholar
• Park, C., Park, J., Oh, S., & Choi, S. (2019). Realistic haptic rendering of collision effects using multimodal vibrotactile and impact feedback. In 2019 IEEE world haptics conference (WHC) (pp. 449–454). IEEE. https://doi.org/10.1109/WHC.2019.8816116
   Google Scholar
• Romano, J. M., & Kuchenbecker, K. J. (2012). Creating realistic virtual textures from contact acceleration data. IEEE Transactions on Haptics, 5(2), 109–119. https://doi.org/10.1109/TOH.2011.38
   PubMed Web of Science ®Google Scholar
• Roy, N., Choudhury, R. R., & Gowda, M. K. (2017). Communicating through physical vibration. US Patent 9,608,848.
   Google Scholar
• Schönauer, C., Fukushi, K., Olwal, A., Kaufmann, H., & Raskar, R. (2012). Multimodal motion guidance: Techniques for adaptive and dynamic feedback. In Proceedings of the 14th ACM international conference on multimodal interaction, ICMI ’12 (pp. 133–140). ACM.
   Google Scholar
• Sodhi, R., Glisson, M., & Poupyrev, I. (2013). Aireal: Tactile gaming experiences in free air. In ACM SIGGRAPH 2013 emerging technologies, SIGGRAPH ’13 (pp. 2:1–2:1). ACM.
   Google Scholar
• Stanley, A. A., & Kuchenbecker, K. J. (2012). Evaluation of tactile feedback methods for wrist rotation guidance. IEEE Transactions on Haptics, 5(3), 240–251. https://doi.org/10.1109/TOH.2012.33
   PubMed Web of Science ®Google Scholar
• Strohmeier, P., Boring, S., & Hornbaek, K. (2018). From pulse trains to “coloring with vibrations”: Motion mappings for mid-air haptic textures. In Proceedings of the 2018 CHI conference on human factors in computing systems, CHI ’18 (pp. 65:1–65:13). ACM.
   Google Scholar
• Sun, M., He, W., Zhang, L., Wang, P., Wang, S., & Bai, X. (2019). Haptic compass: Active vibrotactile feedback of physical object for path guidance. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 1171–1172). IEEE. https://doi.org/10.1109/VR.2019.8797956
   Google Scholar
• Swindells, C., Unden, A., & Sang, T. (2003). Torquebar: An ungrounded haptic feedback device. In Proceedings of the 5th international conference on multimodal interfaces, ICMI ’03 (pp. 52–59). ACM.
   Google Scholar
• Welford, A. T. (1980). Choice reaction time: Basic concepts. Reaction Times.
   Google Scholar
• Wentink, E. C., Mulder, A., Rietman, J. S., & Veltink, P. H. (2011). Vibrotactile stimulation of the upper leg: Effects of location, stimulation method and habituation. In 2011 Annual international conference of the IEEE engineering in medicine and biology society (pp. 1668–1671). IEEE.
   Google Scholar
• Wheatland, N., Wang, Y., Song, H., Neff, M., Zordan, V., & Jörg, S. (2015). State of the art in hand and finger modeling and animation. Computer Graphics Forum, 34(2), 735–760. https://doi.org/10.1111/cgf.12595
   Web of Science ®Google Scholar
• Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240. https://doi.org/10.1162/105474698565686
   Web of Science ®Google Scholar
• Yang, G., Ryu, D., Kang, S. (2009). Vibrotactile display for hand-held input device providing spatial and directional information. In World Haptics 2009 - Third Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (pp. 79–84). IEEE.
   Google Scholar
• Zhang, L., He, W., Sun, M., Bai, X., & Wang, S. (2019). A multidirectional haptic feedback prototype for experiencing collisions between virtual and real objects. In 2019 IEEE conference on virtual reality and 3D user interfaces (VR) (pp. 1267–1268). IEEE. https://doi.org/10.1109/VR.2019.8797878
   Google Scholar