Effects of a color gradient and emoji in AR-HUD warning interfaces in autonomous vehicles on takeover performance and driver emotions

References

• Bark K, Tran C, Fujimura K, Ng-Thow-Hing V. 2014. Personal Navi: benefits of an augmented reality navigational aid using a see-thru 3D volumetric HUD. Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications; September 17–19; Seattle, WA, USA. ACM; p. 1–8. doi:10.1145/2667317.2667329.
   Google Scholar
• Cai H, Lin Y. 2011. Modeling of operators’ emotion and task performance in a virtual driving environment. Int J Hum Comput Stud. 69(9):571–586. doi:10.1016/j.ijhcs.2011.05.003.
   Web of Science ®Google Scholar
• Calvi A, D'Amico F, Ferrante C, Bianchini Ciampoli L. 2020. Effectiveness of augmented reality warnings on driving behaviour whilst approaching pedestrian crossings: a driving simulator study. Accid Anal Prev. 147:105760. doi:10.1016/j.aap.2020.105760.
   PubMed Web of Science ®Google Scholar
• Charissis V, Papanastasiou S, Mackenzie L, Arafat S. 2011. Evaluation of collision avoidance prototype head-up display interface for older drivers. In: Human-Computer Interaction. Towards Mobile and Intelligent Interaction Environments. HCI; July 9–14; Orlando, FL, USA. Springer; p. 367–375. doi:10.1007/978-3-642-21616-9_41.
   Google Scholar
• Chen Y, Yang X, Howman H, Filik R. 2024. Individual differences in emoji comprehension: gender, age, and culture. PLOS One. 19(2):e0297379. doi:10.1371/journal.pone.0297379.
   PubMed Web of Science ®Google Scholar
• de Clercq K, Dietrich A, Núñez Velasco JP, de Winter J, Happee R. 2019. External human-machine interfaces on automated vehicles: effects on pedestrian crossing decisions. Hum Factors. 61(8):1353–1370. doi:10.1177/0018720819836343.
   PubMed Web of Science ®Google Scholar
• Du N, Zhou F, Pulver EM, Tilbury DM, Robert LP, Pradhan AK, Yang XJ. 2020. Examining the effects of emotional valence and arousal on takeover performance in conditionally automated driving. Transp Res Part C Emerg Technol. 112:78–87. doi:10.1016/j.trc.2020.01.006.
   Web of Science ®Google Scholar
• Eherenfreund-Hager A, Taubman–Ben-Ari O, Toledo T, Farah H. 2017. The effect of positive and negative emotions on young drivers: a simulator study. Transp Res Part F Traffic Psychol Behav. 49:236–243. doi:10.1016/j.trf.2017.07.002.
   Web of Science ®Google Scholar
• Erle TM, Schmid K, Goslar SH, Martin JD. 2022. Emojis as social information in digital communication. Emotion. 22(7):1529–1543. doi:10.1037/emo0000992.
   PubMed Web of Science ®Google Scholar
• Ganster T, Eimler SC, Krämer NC. 2012. Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychol Behav Soc Netw. 15(4):226–230. doi:10.1089/cyber.2011.0179.
   PubMed Web of Science ®Google Scholar
• Guéguen N, Eyssartier C, Meineri S. 2016. A pedestrian’s smile and drivers’ behavior: when a smile increases careful driving. J Safety Res. 56:83–88. doi:10.1016/j.jsr.2015.12.005.
   PubMed Web of Science ®Google Scholar
• Guilford JP, Smith PC. 1959. A system of color-preferences. Am J Psychol. 72(4):487. doi:10.2307/1419491.
   PubMed Web of Science ®Google Scholar
• Hanada M. 2018. Correspondence analysis of color–emotion associations. Color Res Appl. 43(2):224–237. doi:10.1002/col.22171.
   Web of Science ®Google Scholar
• Hatfield E, Cacioppo JT, Rapson RL. 1994. Emotional contagion. Cambridge: Cambridge University Press.
   Google Scholar
• He L, Qi H, Zaretzki R. 2015. Image color transfer to evoke different emotions based on color combinations. SIViP. 9(8):1965–1973. doi:10.1007/s11760-014-0691-y.
   Google Scholar
• Izard CE. 2013. Patterns of emotions: a new analysis of anxiety and depression. New York: Academic Press.
   Google Scholar
• Jacobs KW, Hustmyer FE. 1974. Effects of four psychological primary colors on GSR, heart rate and respiration rate. Percept Mot Skills. 38(3):763–766. doi:10.2466/pms.1974.38.3.763.
   PubMed Web of Science ®Google Scholar
• Jeon M, Walker BN, Yim J-B. 2014. Effects of specific emotions on subjective judgment, driving performance, and perceived workload. Transp Res Part F Traffic Psychol Behav. 24:197–209. doi:10.1016/j.trf.2014.04.003.
   Web of Science ®Google Scholar
• Jing C, Bryan-Kinns N, Yang S, Zhi J, Zhang J. 2021. The influence of mobile phone location and screen orientation on driving safety and the usability of car-sharing software in-car use. Int J Ind Ergon. 84:103168. doi:10.1016/j.ergon.2021.103168.
   Web of Science ®Google Scholar
• Jing C, Dai H, Yao X, Du D, Yu K, Yu D, Zhi J. 2022. Influence of multi-modal warning interface on takeover efficiency of autonomous high-speed train. Int J Environ Res Public Health. 20(1):322. doi:10.3390/ijerph20010322.
   PubMed Web of Science ®Google Scholar
• Jing C, Shang C, Yu D, Chen Y, Zhi J. 2022. The impact of different AR-HUD virtual warning interfaces on the takeover performance and visual characteristics of autonomous vehicles. Traffic Inj Prev. 23(5):277–282. doi:10.1080/15389588.2022.2055752.
   PubMed Web of Science ®Google Scholar
• Jing C, Zhi J, Yang S, Wang W. 2021. Impact of driver age and experience in software usage on driving safety and usability of car-sharing software. J Adv Transp. 2021:1–14. doi:10.1155/2021/6633379.
   Web of Science ®Google Scholar
• Kaye LK, Rodriguez-Cuadrado S, Malone SA, Wall HJ, Gaunt E, Mulvey AL, Graham C. 2021. How emotional are emoji?: Exploring the effect of emotional valence on the processing of emoji stimuli. Comput Human Behav. 116:106648. doi:10.1016/j.chb.2020.106648.
   Web of Science ®Google Scholar
• Kim H, Isleib JD, Gabbard JL. 2016. Virtual shadow: making cross traffic dynamics visible through augmented reality head up display. Proc Hum Factors Ergon Soc Annu Meet. 60(1):2093–2097. doi:10.1177/1541931213601474.
   Google Scholar
• Kim T, Kim Y, Jeon H, Choi C-S, Suk H-J. 2021. Emotional response to in-car dynamic lighting. Int J Automot Technol. 22(4):1035–1043. doi:10.1007/s12239-021-0093-4.
   Web of Science ®Google Scholar
• Kuehn M, Vogelpohl T, Vollrath M. 2017. Takeover times in highly automated driving (level 3). 25th International Technical Conference on the Enhanced Safety of Vehicles (ESV); June 5–8; Detroit, MI, USA. National Highway Traffic Safety Administration (NHTSA); p. 1–11.
   Google Scholar
• Kunze A, Summerskill SJ, Marshall R, Filtness AJ. 2018. Augmented reality displays for communicating uncertainty information in automated driving. Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications; September 23–25; Toronto, ON, Canada. ACM; p. 164–175. doi:10.1145/3239060.3239074.
   Google Scholar
• Kutsuzawa G, Umemura H, Eto K, Kobayashi Y. 2022. Classification of 74 facial emoji’s emotional states on the valence-arousal axes. Sci Rep. 12(1):398. doi:10.1038/s41598-021-04357-7.
   PubMed Web of Science ®Google Scholar
• Liu S, Pei M. 2018. Texture-aware emotional color transfer between images. IEEE Access. 6:31375–31386. doi:10.1109/ACCESS.2018.2844540.
   Web of Science ®Google Scholar
• Miranda-Correa JA, Abadi MK, Sebe N, Patras I. 2021. AMIGOS: a dataset for affect, personality and mood research on individuals and groups. IEEE Trans Affective Comput. 12(2):479–493. doi:10.1109/TAFFC.2018.2884461.
   Web of Science ®Google Scholar
• Palmer SE, Schloss KB, Xu Z, Prado-León LR. 2013. Music-color associations are mediated by emotion. Proc Natl Acad Sci USA. 110(22):8836–8841. doi:10.1073/pnas.1212562110.
   PubMed Web of Science ®Google Scholar
• Park B-J, Lee J-W, Yoon C, Kim K-H. 2016. A study on augmented reality of a vehicle Information using head-up display. 2016 6th International Conference on IT Convergence and Security (ICITCS); September 26; Prague, Czech Republic. IEEE; p. 1–2. doi:10.1109/ICITCS.2016.7740308.
   Google Scholar
• Rasouli A, Tsotsos JK. 2020. Autonomous vehicles that interact with pedestrians: a survey of theory and practice. IEEE Trans Intell Transport Syst. 21(3):900–918. doi:10.1109/TITS.2019.2901817.
   Web of Science ®Google Scholar
• Rodrigues D, Prada M, Gaspar R, Garrido MV, Lopes D. 2018. Lisbon Emoji and Emoticon Database (LEED): norms for emoji and emoticons in seven evaluative dimensions. Behav Res Methods. 50(1):392–405. doi:10.3758/s13428-017-0878-6.
   PubMed Web of Science ®Google Scholar
• Sakashita N, Jadram N, Sripian P, Laohakangvalvit T, Sugaya M. 2022. Evaluation on comfortable arousal in autonomous driving using physiological indexes. Artificial Intelligence in HCI. HCII 2022; June 26–July 1; Virtual Event. Springer; p. 305–316. doi:10.1007/978-3-031-05643-7_20.
   Google Scholar
• Schwarz F, Fastenmeier W. 2018. Visual advisory warnings about hidden dangers: effects of specific symbols and spatial referencing on necessary and unnecessary warnings. Appl Ergon. 72:25–36. doi:10.1016/j.apergo.2018.05.001.
   PubMed Web of Science ®Google Scholar
• Steinhauser K, Leist F, Maier K, Michel V, Pärsch N, Rigley P, Wurm F, Steinhauser M. 2018. Effects of emotions on driving behavior. Transp Res Part F Traffic Psychol Behav. 59:150–163. doi:10.1016/j.trf.2018.08.012.
   Web of Science ®Google Scholar
• Tang N, Dong Z, Liu L. 2018. Expressing mixed emotions via gradient color: an interactive online chat interface design based on affective recognition. Human-Computer Interaction. Interaction Technologies. HCI; July 15–20; Vegas, NV, USA. Springer; p. 190–199. doi:10.1007/978-3-319-91250-9_15.
   Google Scholar
• Tran C, Bark K, Ng-Thow-Hing V. 2013. A left-turn driving aid using projected oncoming vehicle paths with augmented reality. Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications; October 28–30; Eindhoven, Netherlands. ACM; p. 300–307. doi:10.1145/2516540.2516581.
   Google Scholar
• Wang X, Liu Y, Wang F, Wang J, Liu L, Wang J. 2019. Feature extraction and dynamic identification of drivers’ emotions. Transp Res Part F Traffic Psychol Behav. 62:175–191. doi:10.1016/j.trf.2019.01.002.
   Web of Science ®Google Scholar
• Wolffsohn JS, McBrien NA, Edgar GK, Stout T. 1998. The influence of cognition and age on accommodation, detection rate and response times when using a car head-up display (HUD). Ophthal Physiol Optic. 18(3):243–253. doi:10.1046/j.1475-1313.1998.00350.x.
   PubMed Web of Science ®Google Scholar
• Xie X, Cai J, Fang H, Wang B, He H, Zhou Y, Xiao Y, Yamanaka T, Li X. 2023. Affective impressions recognition under different colored lights based on physiological signals and subjective evaluation method. Sensors. 23(11):5322. doi:10.3390/s23115322.
   PubMed Web of Science ®Google Scholar
• Yoon SH, Lee SC, Ji YG. 2021. Modeling takeover time based on non-driving-related task attributes in highly automated driving. Appl Ergon. 92:103343. doi:10.1016/j.apergo.2020.103343.
   PubMed Web of Science ®Google Scholar
• Zeng Z, Pantic M, Roisman GI, Huang TS. 2009. A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell. 31(1):39–58. doi:10.1109/tpami.2008.52.
   PubMed Web of Science ®Google Scholar
• Zhang Q, Qu W, Ge Y. 2022. The effect of anger on pedestrian avoidance in a simulated driving task. Accid Anal Prev. 171:106664. doi:10.1016/j.aap.2022.106664.
   PubMed Web of Science ®Google Scholar
• Zhao M, Beurier G, Wang H, Wang X. 2021. Driver posture monitoring in highly automated vehicles using pressure measurement. Traffic Inj Prev. 22(4):278–283. doi:10.1080/15389588.2021.1892087.
   PubMed Web of Science ®Google Scholar