Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction

References

• An, S.-G., Kim, Y., Lee, J. H., & Bae, S.-H. (2017). Collaborative experience prototyping of automotive interior in VR with 3D sketching and haptic helpers. Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications (pp. 183–192). Oldenburg, Germany: ACM.
   Google Scholar
• Anton, D., Kurillo, G., & Bajcsy, R. (2017a). User experience and interaction performance in 2D/3D telecollaboration. Future Generation Computing Systems, 82, 77–88.
   Web of Science ®Google Scholar
• Anton, D., Kurillo, G., Yang, A. Y., & Bajcsy, R. (2017b). Augmented telemedicine platform for real-time remote medical consultation (pp. 77–89). Springer International Publishing.
   Google Scholar
• Arora, R., Kazi, R. H., Anderson, F., Grossman, T., Singh, K., & Fitzmaurice, G. W. G.B.T.-C.C. on H.F. in C.S. (2017). Experimental evaluation of sketching on surfaces in VR, Proceedings of the 2017 CHI conference on human factors in computing systems. Denver, CO: ACM.
   Google Scholar
• Benko, H., Holz, C., Sinclair, M., & Ofek, E. (2016). NormalTouch and TextureTouch: High-fidelity 3D haptic shape rendering on handheld virtual reality controllers 717–728. doi:10.1145/2984511.2984526
   Google Scholar
• Brooke, J. (1996). SUS – A quick and dirty usability scale. Usability Evaluation in Industry, 189 (194), 4–7.
   Google Scholar
• Chang, Y. S., Nuernberger, B., Luan, B., Hollerer, T., & O’donovan, J. (2017). Evaluating gesture-based augmented reality annotation 2017 IEEE symposium on 3D user interfaces (3DUI) (pp. 182–185). doi:10.1109/VR.2017.7892383
   Google Scholar
• Clark, H. H., & Brennan, S. E. (1991). Grounding in communication.pdf. Perspectives on Socially Shared Cognition, 13, 127–149.
   Google Scholar
• De Pace, F., Manuri, F., Sanna, A., & Zappia, D. (2019). A comparison between two different approaches for a collaborative mixed-virtual environment in industrial maintenance. Frontiers in Robotics AI, 6, 18. doi:10.3389/frobt.2019.00018
   PubMed Web of Science ®Google Scholar
• Dey, A., Chen, H., Hayati, A., Billinghurst, M., & Lindeman, R. W. (2019). Sharing manipulated heart rate feedback in collaborative virtual environments(pp. 376–385). doi:10.1109/ISMAR.2019.00051
   Google Scholar
• Fakourfar, O., Ta, K., Tang, R., Bateman, S., & Tang, A. (2016). Stabilized annotations for mobile remote assistance. Proceedings of the 2016 CHI conference on human factors in computing systems (pp. 1548–1560). San Jose, CA: ACM.
   Google Scholar
• Fussell, S. R., Setlock, L. D., Yang, J., Ou, J., Mauer, E., & Kramer, A. D. I. (2004). Gestures over video streams to support remote collaboration on physical tasks. Human-computer Interact, 19, 273–309. doi:10.1207/s15327051hci1903_3
   Web of Science ®Google Scholar
• Gurevich, P., Lanir, J., & Cohen, B. (2015). Design and implementation of teleadvisor: A projection-based augmented reality system for remote collaboration. Computer Supported Cooperative Work, 24, 527–562. doi:10.1007/s10606-015-9232-7
   Web of Science ®Google Scholar
• Gurevich, P., Lanir, J., Cohen, B., & Ran, S. (2012). TeleAdvisor:a versatile augmented reality tool for remote assistance. Proceedings of the SIGCHI conference on human factors in computing systems (pp. 619–622). Austin, TX.
   Google Scholar
• Huang, W., Alem, L., Tecchia, F., & Duh, B. L. (2018). Augmented 3D hands: A gesture-based mixed reality system for distributed collaboration. Journal on Multimodal User Interfaces, 12, 77–89.
   Web of Science ®Google Scholar
• Huang, W., Kim, S., Billinghurst, M., & Alem, L. (2019). Sharing hand gesture and sketch cues in remote collaboration. Journal of Visual Communication and Image Representation, 58, 428–438. doi:10.1016/j.jvcir.2018.12.010
   Web of Science ®Google Scholar
• Ishii, H. (2008). The tangible user interface and its evolution. Communication of the ACM, 51, 32. doi:10.1145/1349026
   Web of Science ®Google Scholar
• Israel, J. H., Wiese, E., Mateescu, M., Zöllner, C., & Stark, R. (2009). Investigating three-dimensional sketching for early conceptual design—Results from expert discussions and user studies. Computers & Graphics, 33, 462–473. doi:10.1016/j.cag.2009.05.005
   Web of Science ®Google Scholar
• Kim, S., Billinghurst, M., & Lee, G. (2018). The effect of collaboration styles and view independence on video-mediated remote collaboration. Computer Supported Cooperative Work, 1–39.
   Web of Science ®Google Scholar
• Kim, S., Lee, G., Huang, W., Kim, H., Woo, W., & Billinghurst, M. (2019). Evaluating the combination of visual communication cues for HMD-based mixed reality remote collaboration. Proceedings of the 2019 CHI conference on human factors in computing systems (p. 173). Glasgow, Scotland: ACM.
   Google Scholar
• Kim, S., Lee, G., Sakata, N., & Billinghurst, M. (2014). Improving co-presence with augmented visual communication cues for sharing experience through video conference. IEEE International Symposium on Mixed and Augmented Reality (ISMAR). Munich, Germany.
   Google Scholar
• Kim, S., Lee, G. A., Ha, S., Sakata, N., & Billinghurst, M. (2015). Automatically freezing live video for annotation during remote collaboration. In Proceedings of the 33rd annual acm conference extended abstracts on human factors in computing systems (pp. 1669–1674). Seoul, Republic of Korea: ACM.
   Google Scholar
• Kim, S., Lee, G. A., & Sakata, N. (2013). Comparing pointing and drawing for remote collaboration. 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 1–6). Adelaide, Australia: IEEE.
   Google Scholar
• Kirk, D., Crabtree, A., & Rodden, T. (2005, September 18–22). Ways of the hands. In Proceedings of the Ninth European Conference on Computer-Supported Cooperative Work, Paris, France (pp. 1–22). Netherlands: Springer.
   Google Scholar
• Kirk, D., Rodden, T., & Fraser, D. S. (2007). Turn it this way: Groundingcollaborative action with remote gestures. Conference on human factors in computing systems (pp. 1039–1048). San Jose, CA.
   Google Scholar
• Knopp, S., Lorenz, M., Pelliccia, L., & Klimant, P. (2018). Using industrial robots as haptic devices for VR-training. 2018 IEEE conference on virtual reality and 3D user interfaces (VR) (pp. 607–608). Reutlingen, Germany: IEEE.
   Google Scholar
• Leithinger, D., Follmer, S., Olwal, A., & Ishii, H. (2014). Physical telepresence: Shape capture and display for embodied, computer-mediated remote collaboration. Proceedings of the 27th annual ACM symposium on user interface software and technology (pp. 461–470). Honolulu, HI: ACM.
   Google Scholar
• Lewis, D. (2008). Convention Aphilosophical study. John Wiley & Sons. doi:10.1002/9780470693711
   Google Scholar
• Lin, C., Andersen, D., Popescu, V., Rojas-Munoz, E., Cabrera, M. E., Mullis, B., … Wachs, J. (2018). A first-person mentee second-person mentor AR interface for surgical telementoring. 2018 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct) pp. 3–8. Munich, Germany: IEEE.
   Google Scholar
• Mohanty, R. R., Bohari, U. H., & Ragan, E. (2018). Kinesthetically augmented mid-air sketching of multi-planar 3D curve-soups. In ASME 2018 international design engineering technical conferences and computers and information in engineering conference (pp. V01BT02A031–V01BT02A031). American Society of Mechanical Engineers.
   Google Scholar
• Nonnis, A., & Bryan-Kinns, N. (2019). Mazi: Tangible technologies as a channel for collaborative play. Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 440). Glasgow, Scotland: ACM.
   Google Scholar
• Piumsomboon, T., Dey, A., Ens, B., Lee, G., & Billinghurst, M. (2019a). The effects of sharing awareness cues in collaborative mixed reality. Frontiers in Robotics AI, 6, 5–6. doi:10.3389/frobt.2019.00005
   PubMed Web of Science ®Google Scholar
• Piumsomboon, T., Lee, G. A., Irlitti, A., Ens, B., Thomas, B. H., & Billinghurst, M. (2019b). On the shoulder of the giant: A multi-scale mixed reality collaboration with 360 video sharing and tangible interaction. Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 228). Glasgow, Scotland: ACM.
   Google Scholar
• Poelman, R., Akman, O., Lukosch, S., & Jonker, P. (2012). As if being there: MediatedReality for Crime Scene Investigation (p. 1267). doi:10.1145/2145204.2145394
   Google Scholar
• Siu, A. F., Yuan, S., Pham, H., Gonzalez, E., Kim, L. H., Le Goc, M., & Follmer, S. (2018). Investigating tangible collaboration for design towards augmented physical telepresence. In Design thinking research (pp. 131–145). Springer.
   Google Scholar
• Sun, H., Liu, Y., Zhang, Z., Liu, X., & Wang, Y. (2018). Employing different viewpoints for remote guidance in a collaborative augmented environment. Proceedings of the sixth international symposium of Chinese CHI (pp. 64–70). Montreal, QC: ACM.
   Google Scholar
• Teo, T., Lawrence, L., Lee, G. A., Billinghurst, M., & Adcock, M. (2019). Mixed reality remote collaboration combining 360 video and 3D reconstruction. Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 201). Glasgow, Scotland: ACM.
   Google Scholar
• Wang, P., Bai, X., Billinghurst, M., Han, D., Zhang, S., He, W., … Yan, Y. (2019a). I’m tired of demos: An adaptive MR remote collaborative platform 17–18. The 12th ACM Siggraph Asia. doi:10.1145/3355355.3361878
   Google Scholar
• Wang, P., Bai, X., Billinqhurst, M., Zhang, S., Han, D., Lv, H., … Min, H. (2019b). An MR remote collaborative platform based on 3D CAD models for training in industry. 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 6–5). Beijing, China.
   Google Scholar
• Wang, P., Zhang, S., Bai, X., Billinghurst, M., He, W., Sun, M., … Ji, H. (2019c). 2.5 DHANDS: A gesture-based MR remote collaborative platform. International Journal of Advanced Manufacturing Technology, 102(5–8), 1339–1353.
   Web of Science ®Google Scholar
• Wang, P., Zhang, S., Bai, X., Billinghurst, M., He, W., Wang, S., … Chen, Y. (2019d). Head pointer or eye gaze: which helps more in MR remote collaboration. 2019 IEEE conference on virtual reality and 3D user interfaces (VR) (pp. 1–2). Osaka, Japan.
   Google Scholar
• Wang, P., Zhang, S., Bai, X., Billinghurst, M., He, W., Zhang, L., … Wang, S. (2018). Do you know what i mean an MR-based collaborative platform. 16th IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR 2018) (pp. 1–2). Munich, Germany.
   Google Scholar
• Wang, P., Zhang, S., Bai, X., Billinghurst, M., Zhang, L., Wang, S., … Yan, Y. (2019e). A gesture- and head-based multimodal interaction platform for MR remote collaboration. International Journal of Advanced Manufacturing Technology, 105, 3031–3043. doi:10.1007/s00170-019-04434-2
   Web of Science ®Google Scholar
• Wang, P., Zhang, S., Billinghurst, M., Bai, X., He, W., Wang, S., … Zhang, X. (2019f). A comprehensive survey of AR/MR-based co-design in manufacturing. Engineering on Computers, 2019, 1–24.
   Web of Science ®Google Scholar
• Wang, S., Parsons, M., Stone-Mclean, J., Rogers, P., Boyd, S., Hoover, K., … Smith, A. (2017). Augmented reality as a telemedicine platform for remote procedural training. Sensors, 17, 2294. doi:10.3390/s17102294
   PubMed Web of Science ®Google Scholar
• Whitmire, E., Benko, H., Holz, C., Ofek, E., & Sinclair, M. (2018). Haptic revolver touch, shear, texture, and shape rendering on a reconfigurable Virtual reality controller. CHI Conference on Human Factors in Computing Systems, 42, 54–60. doi:10.1093/indlaw/dws040
   Google Scholar
• Xia, H., Herscher, S., Perlin, K., & Wigdor, D. (2018). SpaceTime: Enabling fluid individual and collaborative editing in virtual reality. UIST 2018 – Proceedings of the 31st annual ACM symposium on user interface software and technology (pp. 853–866). doi:10.1145/3242587.3242597
   Google Scholar
• Zhu, K., Chen, T., Han, F., & Wu, Y. (2019). HapTwist: Creating interactive haptic proxies in virtual reality using low-cost twistable artefacts. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–13). Glasgow, Scotland.
   Google Scholar