Providing Dual Awareness using Multimodal Cues for Collaborative Manipulation in Virtual Environments

References

• Allmendinger, K. (2010). Social presence in synchronous virtual learning situations: The role of nonverbal signals displayed by avatars. Educational Psychology Review, 22(1), 41–56. https://doi.org/10.1007/s10648-010-9117-8
   Web of Science ®Google Scholar
• Ardissono, L., & Bosio, G. (2012). Context-dependent awareness support in open collaboration environments. User Modeling and User-Adapted Interaction, 22(3), 223–254. https://doi.org/10.1007/s11257-011-9100-1
   Web of Science ®Google Scholar
• Ariza, O., Bruder, G., Katzakis, N., & Steinicke, F. (2018). Analysis of proximity-based multi modal feedback for 3D selection in immersive virtual environments. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 327–334). https://doi.org/10.1109/VR.2018.8446317
   Google Scholar
• Bowman, D. A., & Hodges, L. F. (1999). Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. Journal of Visual Languages & Computing, 10(1), 37–53. https://doi.org/10.1006/jvlc.1998.0111
   Web of Science ®Google Scholar
• Churchill, E. F., & Snowdon, D. (1998). Collaborative virtual environments: An introductory review of issues and systems. Virtual Reality, 3(1), 3–15. https://doi.org/10.1007/BF01409793
   Google Scholar
• Cooper, N., Milella, F., Pinto, C., Cant, I., White, M., & Meyer, G. (2018). The effects of substitute multisensory feedback on task performance and the sense of presence in a virtual reality environment. PLOS One, 13(2), e0191846. https://doi.org/10.1371/journal.pone.0191846
   PubMed Web of Science ®Google Scholar
• de Belen, R. A. J., Nguyen, H., Filonik, D., Del Favero, D., & Bednarz, T. (2019). A systematic review of the current state of collaborative mixed reality technologies: 2013–2018. AIMS Electronics and Electrical Engineering, 3(2), 181–223. https://doi.org/10.3934/ElectrEng.2019.2.181
   Google Scholar
• De Oliveira, T. V., & Pinho, M. S. (2017). Usage of tactile feedback to assist cooperative object manipulations in virtual environments. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2367–2372).
   Google Scholar
• Desai, K., Belmonte, U. H. H., Jin, R., Prabhakaran, B., Diehl, P., Ramirez, V. A., & Gans, M. (2017). Experiences with multi-modal collaborative virtual laboratory (MMCVL). In 2017 IEEE Third International Conference on Multimedia Big Data (BIGMM) (pp. 376–383). https://doi.org/10.1109/BigMM.2017.62
   Google Scholar
• Doumanis, I., Economou, D., Sim, G. R., & Porter, S. (2019). The impact of multimodal collaborative virtual environments on learning: A gamified online debate. Computers & Education, 130, 121–138. https://doi.org/10.1016/j.compedu.2018.09.017
   Web of Science ®Google Scholar
• Dourish, P., & Bellotti, V. (1992). Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work (pp. 107–114). https://doi.org/10.1145/143457.143468
   Google Scholar
• Duval, T., Lécuyer, A., & Thomas, S. (2006). Skewer: A 3D interaction technique for 2- user collaborative manipulation of objects in virtual environments. In 3D User Interfaces (3DUI’06) (pp. 69–72).
   Google Scholar
• Duval, T., Nguyen, T. T. H., Fleury, C., Chauffaut, A., Dumont, G., & Gouranton, V. (2014). Improving awareness for 3D virtual collaboration by embedding the features of users’ physical environments and by augmenting interaction tools with cognitive feedback cues. Journal on Multimodal User Interfaces, 8(2), 187–197. https://doi.org/10.1007/s12193-013-0134-z
   Web of Science ®Google Scholar
• Duval, T., & Zammar, C. (2006). Managing network troubles while interacting within collaborative virtual environments. In CSAC (pp. 85–94).
   Google Scholar
• García, A. S., Molina, J. P., González, P., Martínez, D., & Martínez, J. (2009). An experimental study of collaborative interaction tasks supported by awareness and multimodal feedback. In Proceedings of the 8th International Conference on Virtual Reality Continuum and Its Applications in Industry (pp. 77–82). https://doi.org/10.1145/1670252.1670270
   Google Scholar
• García, A. S., Molina, J. P., Martínez, D., & González, P. (2008). Enhancing collaborative manipulation through the use of feedback and awareness in CVEs. In Proceedings of the 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry (pp. 1–5). https://doi.org/10.1145/1477862.1477904
   Google Scholar
• Grandi, J. G., Debarba, H. G., Nedel, L., & Maciel, A. (2017). Design and evaluation of a handheld-based 3D user interface for collaborative object manipulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 5881–5891). https://doi.org/10.1145/3025453.3025935
   Google Scholar
• Harrison, S., & Dourish, P. (1996). Re-place-ing space: The roles of place and space in collaborative systems. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (pp. 67–76). https://doi.org/10.1145/240080.240193
   Google Scholar
• Jensen, K. (1997). A brief introduction to coloured Petri nets. In International Workshop on Tools and Algorithms for the Construction and Analysis of Systems (pp. 203–208).
   Google Scholar
• Kim, J.-S., & Park, J.-M. (2016). Direct and realistic handover of a virtual object. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 994–999). https://doi.org/10.1109/IROS.2016.7759170
   Google Scholar
• LaViola, J. J. Jr., Kruijff, E., McMahan, R. P., Bowman, D., & Poupyrev, I. P. (2017). 3D user interfaces: Theory and practice. Addison-Wesley Professional.
   Google Scholar
• Le Chénéchal, M., Arnaldi, B., Duval, T., Gouranton, V., & Royan, J. (2014). From 3D bimanual toward distant collaborative interaction techniques: An awareness issue. In 2014 International Workshop on Collaborative Virtual Environments (3DCVE) (pp. 1–8). https://doi.org/10.1109/3DCVE.2014.7160929
   Google Scholar
• Lopez, G., & Guerrero, L. A. (2017). Awareness supporting technologies used in collaborative systems: A systematic literature review. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 808–820).
   Google Scholar
• Nguyen, T. T. H., & Duval, T. (2014). A survey of communication and awareness in collaborative virtual environments. In 2014 International Workshop on Collaborative Virtual Environments (3DCVE) (pp. 1–8). https://doi.org/10.1109/3DCVE.2014.7160928
   Google Scholar
• Olson, G. M., & Olson, J. S. (2000). Distance matters. Human–Computer Interaction, 15(2–3), 139–178. https://doi.org/10.1207/S15327051HCI1523_4
   Web of Science ®Google Scholar
• Oyekan, J. O., Hutabarat, W., Tiwari, A., Grech, R., Aung, M. H., Mariani, M. P., López-Dávalos, L., Ricaud, T., Singh, S., & Dupuis, C. (2019). The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans. Robotics and Computer-Integrated Manufacturing, 55, 41–54. https://doi.org/10.1016/j.rcim.2018.07.006
   Web of Science ®Google Scholar
• Pinho, M. S., Bowman, D. A., & Freitas, C. M. (2002). Cooperative object manipulation in immersive virtual environments: Framework and techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (pp. 171–178).
   Google Scholar
• Pinho, M. S., Bowman, D. A., & Freitas, C. M. (2008). Cooperative object manipulation in collaborative virtual environments. Journal of the Brazilian Computer Society, 14(2), 53–67. https://doi.org/10.1007/BF03192559
   Google Scholar
• Ruddle, R. A., Savage, J. C., & Jones, D. M. (2002). Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments. ACM Transactions on Computer–Human Interaction, 9(4), 285–308. https://doi.org/10.1145/586081.586084
   Google Scholar
• Schmidt, K. (2002). The problem with ‘Awareness’: Introductory remarks on ‘Awareness in CSCW’. Computer Supported Cooperative Work, 11(3–4), 285–298. https://doi.org/10.1023/A:1021272909573
   Google Scholar
• Shah, C. (2013). Effects of awareness on coordination in collaborative information seeking. Journal of the American Society for Information Science and Technology, 64(6), 1122–1143. https://doi.org/10.1002/asi.22819
   Web of Science ®Google Scholar
• Sharma, S., Bodempudi, S.-T., Arrolla, M., & Upadhyay, A. (2019). Collaborative virtual assembly environment for product design. In 2019 International Conference on Computational Science and Computational Intelligence (CSCI) (pp. 606–611). https://doi.org/10.1109/CSCI49370.2019.00114
   Google Scholar
• Steptoe, W., Wolff, R., Murgia, A., Guimaraes, E., Rae, J., Sharkey, P., & Steed, A. (2008). Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (pp. 197–200). https://doi.org/10.1145/1460563.1460593
   Google Scholar
• Ullah, S. (2011). Multi-modal assistance for collaborative 3D interaction: Study and analysis of performance in collaborative work. Human–Computer Interaction.
   Google Scholar
• Wickens, C., Boles, D., Tsang, P., & Carswell, M. (1984). The limits of multiple resource theory in display formatting: Effects of task integration (Tech. Rep.). Illinois University at Urbana-Champaign.
   Google Scholar
• Yin, G., Otis, M. J.-D., Fortin, P. E., & Cooperstock, J. R. (2019). Evaluating multimodal feedback for assembly tasks in a virtual environment. Proceedings of the ACM on Human–Computer Interaction, 3(EICS), 1–11. https://doi.org/10.1145/3331163
   PubMedGoogle Scholar