A modular visuo-haptic mixed reality (VHMR) aided prototype technique for in-vehicle human-machine interaction (HMI) evaluations

References

• Abrahamse, Elger L, Rob H.J. Van Der Lubbe, and Willem B. Verwey. 2008. “Asymmetrical Learning Between a Tactile and Visual Serial RT Task.” Quarterly Journal of Experimental Psychology 61 (2): 210–217. doi:10.1080/17470210701566739.
   Web of Science ®Google Scholar
• Adilkhanov, Adilzhan, Matteo Rubagotti, and Zhanat Kappassov. 2022. “Haptic Devices: Wearability-Based Taxonomy and Literature Review.” IEEE 10: 91923–91947.
   Google Scholar
• Aggarwal, Rajesh, and Ara Darzi. 2006. “Technical-Skills Training in the 21st Century.” New England Journal of Medicine 355 (25): 2695–2696. doi:10.1056/nejme068179.
   PubMed Web of Science ®Google Scholar
• Altarteer, Samar, and Vassilis Charissis. 2019. “Technology Acceptance Model for 3D Virtual Reality System in Luxury Brands Online Stores.” IEEE Access 7: 64053–64062. doi:10.1109/Access.6287639.
   Web of Science ®Google Scholar
• Ansar, Adnan, Denilson Rodrigues, Jaydev P. Desai, Kostas Daniilidis, Vijay Kumar, and Mario F.M. Campos. 2001. “Visual and Haptic Collaborative Tele-Presence.” Computers and Graphics (Pergamon) 25 (5): 789–798. doi:10.1016/S0097-8493(01)00121-2.
   Web of Science ®Google Scholar
• Aspell, Jane E., Tom Lavanchy, Bigna Lenggenhager, and Olaf Blanke. 2010. “Seeing the Body Modulates Audiotactile Integration.” European Journal of Neuroscience 31 (10): 1868–1873. doi:10.1111/j.1460-9568.2010.07210.x.
   PubMed Web of Science ®Google Scholar
• Ban, Yuki, Takashi Kajinami, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2012. “Modifying an Identified Curved Surface Shape Using Pseudo-Haptic Effect.” Haptics Symposium 2012, HAPTICS 2012 - Proceedings. Vol. 0. doi:10.1109/HAPTIC.2012.6183793.
   Google Scholar
• Barreiro, H., S. Sinclair, and M. A. Otaduy. 2020. “Path Routing Optimization for STM Ultrasound Rendering.” IEEE Transactions on Haptics 13(1) : 45-51. doi:10.1109/TOH.2019.2963647.
   Google Scholar
• Bassolino, Michela, Andrea Serino, Silvia Ubaldi, and Elisabetta Làdavas. 2010. “Everyday Use of the Computer Mouse Extends Peripersonal Space Representation.” Neuropsychologia 48 (3): 803–811. doi:10.1016/j.neuropsychologia.2009.11.009.
   PubMed Web of Science ®Google Scholar
• Bauer, R. A. 1967. “Consumer Behavior as Risk Taking.” In Risk Taking and Information Handling in Consumer Behavior, edited by D. Cox, 23–33. Boston: Harvard University Press.
   Google Scholar
• Behandish, Morad, and Horea T Ilieş. 2015. “Peg-in-Hole Revisited: A Generic Force Model for Haptic Assembly.” Journal of Computing and Information Science in Engineering 15 (4): 041004 (11 pages). doi:10.1115/1.4030749.
   Web of Science ®Google Scholar
• Bernardo, Antonio, Mark C. Preul, Joseph M. Zabramski, Robert F. Spetzler, Juha Jääskeläinen, Peter Mc L. Black, Mark A Spicer, John Diaz Day, and Patrick J. Kelly. 2003. “A Three-Dimensional Interactive Virtual Dissection Model to Simulate Transpetrous Surgical Avenues.” Neurosurgery 52 (3): 499–505. doi:10.1227/01.NEU.0000047813.32607.68.
   PubMed Web of Science ®Google Scholar
• Bordegoni, Monica, and Francesco Ferrise. 2013. “Designing Interaction with Consumer Products in a Multisensory Virtual Reality Environment: This Paper Shows How Virtual Reality Technology Can Be Used Instead of Physical Artifacts or Mock-Ups for the New Product and Evaluation of Its Usage.” Virtual and Physical Prototyping 8 (1): Taylor & Francis 51–64. doi:10.1080/17452759.2012.762612
   Google Scholar
• Bouzit, Mourad, Grigore Burdea, George Popescu, and Rares Boian. 2002. “The Rutgers Master II - New Design Force-Feedback Glove.” IEEE/ASME Transactions on Mechatronics 7, doi:10.1109/TMECH.2002.1011262.
   Web of Science ®Google Scholar
• Brown, Timothy, Gary Milavetz, and Daryl J Murry. 2013. “Alcohol, Drugs and Driving: Implications for Evaluating Driver Impairment.” Annals of Advances in Automotive Medicine 57: 23–32. PMID: 24406943; PMCID: PMC3861813.
   PubMedGoogle Scholar
• Brown, Brady, Daniel Park, Brenna Sheehan, Shaina Shikoff, Jeffrey Solomon, Jonathan Yang, and Inki Kim. 2018. “Assessment of Human Driver Safety at Dilemma Zones with Automated Vehicles through a Virtual Reality Environment.” In 2018 Systems and Information Engineering Design Symposium (SIEDS), 185–90. IEEE.
   Google Scholar
• Cai, Y. Y., C. K. Chui, X. Ye, J. H. Anderson, K. M. Liew, and I. Sakuma. 2004. “Simulation-Based Virtual Prototyping of Customized Catheterization Devices.” Journal of Computing and Information Science in Engineering 4, doi:10.1115/1.1705667.
   Web of Science ®Google Scholar
• Carter, Tom, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. “UltraHaptics: Multi-Point Mid-Air Haptic Feedback for Touch Surfaces.” In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, edited by Shahram Izadi and Aaron Quigley, 505–514. New York, NY, USA: Association for Computing Machinery. UIST ‘13. doi:10.1145/2501988.2502018.
   Google Scholar
• Castleberry, Ashley. 2014. “NVivo 10 [Software Program].” American Journal of Pharmaceutical Education 78 (1): 1–3. American Association of Colleges of Pharmacy: doi:10.5688/ajpe7811
   PubMedGoogle Scholar
• Chen, Chaomei. 2014. “The Citespace Manual.” College of Computing and Informatics 1 (1). Drexel University Philadelphia, PA, USA: 1–84.
   Google Scholar
• Choi, Inrak, Elliot W. Hawkes, David L. Christensen, Christopher J. Ploch, and Sean Follmer. 2016. “Wolverine: A Wearable Haptic Interface for Grasping in Virtual Reality.” IEEE international Conference on Intelligent Robots and Systems. Vol. 2016-Novem. doi:10.1109/IROS.2016.7759169.
   Google Scholar
• Davis, F. D. 1989. “Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology.” MIS Quarterly 13 (3): 319–340. doi:10.2307/249008.
   Web of Science ®Google Scholar
• Devine, Scott, Karen Rafferty, and Stuart Ferguson. 2017. “HapticVive’-a Point Contact Encounter Haptic Solution with the HTC VIVE and Baxter Robot.” In 25th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, WSCG 2017, 17–24. Plzeň, Czech Republic: University of West Bohemia.
   Google Scholar
• Ernst, Marc, O. Banks, and S. Martin. 2002. “Humans Integrate Visual and Haptic Information in a Statistically Optimal Fashion.” Nature 415 (6870): 429–433. doi:10.1038/415429a.
   PubMed Web of Science ®Google Scholar
• Escobar-Castillejos, D., J. Noguez, L. Neri, A. Magana, and B. Benes. 2016. “A Review of Simulators with Haptic Devices for Medical Training.” Journal of Medical Systems 40 (4): 104. doi:10.1007/s10916-016-0459-8
   PubMed Web of Science ®Google Scholar
• Fang, Te-Yung, Pa-Chun Wang, Chih-Hsien Liu, Mu-Chun Su, and Shih-Ching Yeh. 2014. “Evaluation of a Haptics-Based Virtual Reality Temporal Bone Simulator for Anatomy and Surgery Training.” Computer Methods and Programs in Biomedicine 113 (2): 674–681. https://doi.org/10.1016/j.cmpb.2013.11.005.
   PubMed Web of Science ®Google Scholar
• Gemperle, F., N. Ota, and D. Siewiorek. 2001. “Design of a Wearable Tactile Display.” In Proceedings Fifth International Symposium on Wearable Computers, 5–12. doi:10.1109/ISWC.2001.962082.
   Google Scholar
• Gentile, Giovanni, Arvid Guterstam, Claudio Brozzoli, and H. Henrik Ehrsson. 2013. “Disintegration of Multisensory Signals from the Real Hand Reduces Default Limb Self-Attribution: An FMRI Study.” Journal of Neuroscience 33 (33): 13350–13366. doi:10.1523/JNEUROSCI.1363-13.2013.
   PubMed Web of Science ®Google Scholar
• Gregoriades, Andreas, and Alistair Sutcliffe. 2018. “Simulation-Based Evaluation of an in-Vehicle Smart Situation Awareness Enhancement System.” Ergonomics 61 (7): 947–965. Taylor & Francis doi:10.1080/00140139.2018.1427803
   PubMed Web of Science ®Google Scholar
• Han, Ping Hsuan, Chiaoen Hsieh, Yangsheng Chen, Juichun Hsiao, Kongchang Lee, Shengfu Ko, Kuanwen Chen, Chien Hsing Chou, and Yi Ping Hung. 2017. “AoEs: Enhancing Teleportation Experience in Immersive Environment with Mid-Air Haptics”.
   Google Scholar
• Keizer, Anouk. Monique Aldegonda Maria Smeets, Hendrik Christiaan Dijkerman, Marcel van den Hout, Irene Klugkist, Annemarie van Elburg, and Albert Postma. 2011. “Tactile Body Image Disturbance in Anorexia Nervosa.” Psychiatry Research 190 (1): 115–120. doi:10.1016/j.psychres.2011.04.031.
   PubMed Web of Science ®Google Scholar
• Kim, Mingyu, Changyu Jeon, and Jinmo Kim. 2017. “A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality.” Sensors (Basel, Switzerland) 17 (5): 0. doi:10.3390/s17051141.
   Web of Science ®Google Scholar
• Kleinberg, J. 2002. “Bursty and hierarchical structure in streams.” In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, 91–101. Edmonton Alberta Canada.
   Google Scholar
• Lee, Junghyo, Junghun Kim, and Jae Young Choi. 2019. “The Adoption of Virtual Reality Devices: The Technology Acceptance Model Integrating Enjoyment, Social Interaction, and Strength of the Social Ties.” Telematics and Informatics 39: 37–48. doi:10.1016/j.tele.2018.12.006.
   Web of Science ®Google Scholar
• Leonardis, Daniele, Massimiliano Solazzi, Ilaria Bortone, and Antonio Frisoli. 2017. “A 3-RSR Haptic Wearable Device for Rendering Fingertip Contact Forces.” IEEE Transactions on Haptics 10 (3): 305–316. doi:10.1109/TOH.2016.2640291.
   PubMed Web of Science ®Google Scholar
• Li, Xiaomeng, Atiyeh Vaezipour, Andry Rakotonirainy, Sébastien Demmel, and Oscar Oviedo-Trespalacios. 2020. “Exploring Drivers’ Mental Workload and Visual Demand While Using an in-Vehicle HMI for Eco-Safe Driving.” Accident Analysis & Prevention 146: 105756. doi:10.1016/j.aap.2020.105756
   PubMed Web of Science ®Google Scholar
• Lim, Youn-kyung, Apurva Pangam, Subashini Periyasami, and Shweta Aneja. 2006. “Comparative Analysis of High-and Low-Fidelity Prototypes for More Valid Usability Evaluations of Mobile Devices.” Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles, 291–300.
   Google Scholar
• Loehmann, S., M. Knobel, M. Lamara, and A. Butz. 2013. “Culturally Independent Gestures for In-Car Interactions.” In Human-Computer Interaction - INTERACT 2013. INTERACT 2013. Vol. 8119, edited by P. Kotzé, G. Marsden, G. Lindgaard, J. Wesson, and M. Winckler. Berlin, Heidelberg: Springer.
   Google Scholar
• Maselli, Antonella, and Mel Slater. 2013. “The Building Blocks of the Full Body Ownership Illusion.” Frontiers in Human Neuroscience 7: 0. doi:10.3389/fnhum.2013.00083.
   Web of Science ®Google Scholar
• Maurya, Santosh, Céline Mougenot, and Yukio Takeda. 2021. “Impact of Mixed Reality Implementation on Early-Stage Interactive Product Design Process.” Journal of Engineering Design 32 (1): 1–27. Taylor & Francis: doi:10.1080/09544828.2020.1851662
   Web of Science ®Google Scholar
• Mimura, Yasuhiro, Fumiaki Obayashi, Tsuyoshi Ono, Syuhei Nakatani, Ryosuke Ando, Kazuhiro Kozuka, and Shinji Ozawa. 2017. “Effects of Intelligent Speed Adaptation on Elderly Drivers’ Driving Behaviors and Mental Workloads.” International Journal of Intelligent Transportation Systems Research 15 (2): 63–72. doi:10.1007/s13177-015-0121-8
   Google Scholar
• Pacchierotti, Claudio, Francesco Chinello, Monica Malvezzi, Leonardo Meli, and Domenico Prattichizzo. 2012. “Two Finger Grasping Simulation with Cutaneous and Kinesthetic Force Feedback.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 7282: LNCS. doi:10.1007/978-3-642-31401-8_34.
   Google Scholar
• Pan, Xiao Yang, and Xiao Jia Wei. 2014. “Virtual Reality Technology Applied In Automobile Modeling Design.” In Applied Mechanics and Materials . Peng Sheng Wei, 154–157. Trans Tech Publications, Ltd. doi:10.4028/www.scientific.net/AMM.620.154.
   Google Scholar
• Schorr, Samuel B., and Allison M. Okamura. 2017. “Fingertip Tactile Devices for Virtual Object Manipulation and Exploration.” Conference on Human Factors in Computing Systems - Proceedings. Vol. 2017-May. doi:10.1145/3025453.3025744.
   Google Scholar
• Son, Hyoung Il, Tapomayukh Bhattacharjee, and Hideki Hashimoto. 2011. “Effect of Impedance-Shaping on Perception of Soft Tissues in Macro-Micro Teleoperation.” IEEE Transactions on Industrial Electronics 59 (8): 3273–3285. doi:10.1109/TIE.2011.2148672.
   Web of Science ®Google Scholar
• Stamer, Mareike, Joseph Michaels, and Johannes Tümler. 2020. “Investigating the Benefits of Haptic Feedback During In-Car Interactions in Virtual Reality.” International conference on human-computer interaction, 404–416. Springer.
   Google Scholar
• Stunt, J. J., P. H. Wulms, G. M. Kerkhoffs, J. Dankelman, C. N. van Dijk, and G. J. M. Tuijthof. 2014. “How Valid Are Commercially Available Medical Simulators?” Advances in Medical Education and Practice 5. doi:10.2147/AMEP.S63435.
   PubMedGoogle Scholar
• Tian, Yuan, Suraj Raghuraman, Thiru Annaswamy, Aleksander Borresen, Klara Nahrstedt, and Balakrishnan Prabhakaran. 2017. “H-TIME: Haptic-Enabled Tele-Immersive Musculoskeletal Examination.” Proceedings of the 25th ACM International Conference on Multimedia, 137–145. MM ‘17. New York, NY, USA: Association for Computing Machinery. doi:10.1145/3123266.3123395.
   Google Scholar
• Tiwana, Mohsin I., Stephen J. Redmond, and Nigel H. Lovell. 2012. “A Review of Tactile Sensing Technologies with Applications in Biomedical Engineering.” Sensors and Actuators, A: Physical 179: 17–31. doi:10.1016/j.sna.2012.02.051.
   Web of Science ®Google Scholar
• Tong, Q., Z. Yuan, X. Liao, M. Zheng, T. Yuan, and J. Zhao. 2017. “Magnetic Levitation Haptic Augmentation for Virtual Tissue Stiffness Perception.” IEEE Transactions on Visualization and Computer Graphics 24 (12): 3123–3136. doi: 10.1109/TVCG.2017.2772236.
   PubMed Web of Science ®Google Scholar
• Ullrich, S, and T. Kuhlen. 2012. “Haptic Palpation for Medical Simulation in Virtual Environments.” IEEE Transactions on Visualization and Computer Graphics 18 (4): 617–625. doi:10.1109/TVCG.2012.46.
   PubMed Web of Science ®Google Scholar
• Vaezipour, Atiyeh, Andry Rakotonirainy, Narelle Haworth, and Patricia Delhomme. 2018. “A Simulator Evaluation of In-Vehicle Human Machine Interfaces for Eco-Safe Driving.” Transportation Research Part A: Policy and Practice 118:Elsevier: 696–713. doi:10.1016/j.tra.2018.10.022
   Web of Science ®Google Scholar
• Wang, D., Y. Guo, S. Liu, Y. Zhang, and J. Xiao. 2019. “Haptic Display for Virtual Reality: Progress and Challenges.” Virtual Reality & Intelligent Hardware 1 (2). doi:10.3724/SP.J.2096-5796.2019.0008
   Google Scholar
• Weinberg, Garrett, and Bret Harsham. 2009. “Developing a Low-Cost Driving Simulator for the Evaluation of in-Vehicle Technologies.” Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 51–54.
   Google Scholar
• Wulf, Gabriele, Suzete Chiviacowsky, and Ricardo Drews. 2015. “External focus and autonomy support: Two important factors in motor learning have additive benefits.” Human Movement Science 40: 176–184. doi:10.1016/j.humov.2014.11.015.
   PubMed Web of Science ®Google Scholar
• Xiao, R., J. Schwarz, N. Throm, A. D. Wilson, and H. Benko. 2018. “MRTouch: Adding Touch Input to Head-Mounted Mixed Reality.” IEEE Transactions on Visualization and Computer Graphics 24 (4): 1653–1660. doi:10.1109/TVCG.2018.2794222
   PubMed Web of Science ®Google Scholar
• Yao-Bin, L., D. Zhong-Chun, and Y. Jian-hong. 2006. “A Study on Evaluation items and its Application for B2C e-commerce Trust.” In 2006 International Conference on Management Science and Engineering, 13–18. IEEE.
   Google Scholar