Usability testing of three visual HMIs for assisted driving: How design impacts driver distraction and mental models

References

• Abbasi, E, and Y. Li. 2021. “A Comprehensive Review of Driver’s Attention and the Evaluation Methods.” Computational Research Progress in Applied Science & ENGINEERING 7 (3): 1–4. doi:10.52547/crpase.7.3.2392.
   Google Scholar
• Arledge, C. P. 2014. “Filled-in vs. Outline Icons: The Impact of Icon Style on Usability.” Masters’ Thesis., University of North Carolina at Chapel Hill. doi:10.17615/jqx8-3d26.
   Google Scholar
• Arregle, J.-L., L. Hébert, and P. W. Beamish. 2006. “Mode of International Entry: The Advantages of Multilevel Methods.” Management International Review 46 (5): 597–618.
   Google Scholar
• Bates, D., M. Mächler, B. Bolker, and S. Walker. 2015. “Fitting Linear Mixed-Effects Models Using lme4.” Journal of Statistical Software 67 (1): . 67.i01 doi:10.18637/jss.v067.i01.
   Web of Science ®Google Scholar
• Beggiato, M., F. Hartwich, K. Schleinitz, J. Krems, I. Othersen, and I. Petermann-Stock. 2015. “What Would Drivers like to Know during Automated Driving? Information Needs at Different Levels of Automation.” Proceedings of the 7th Conference on Driver Assistance. doi:10.13140/RG.2.1.2462.6007.
   Google Scholar
• Bevan, N. 2009. “What is the Difference between the Purpose of Usability and User Experience Evaluation Methods ?.” Proceedings of the Workshop UXEM, 9(1), 1–4.
   Google Scholar
• Brooke, J. 1986. “SUS – A Quick and Dirty Usability Scale.” In Usability Evaluation in Industry, edited by P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland, 189–194. Milton Park: Taylor & Francis Ltd. https://cui.unige.ch/isi/icle-wiki/_media/ipm:test-suschapt.pdf.
   Google Scholar
• Carrasco, M. 2011. “Visual Attention: The past 25 Years.” Vision Research 51 (13): 1484–1525. doi:10.1016/j.visres.2011.04.012.
   PubMed Web of Science ®Google Scholar
• Carsten, O. M. J. 2013. “Early Theories of Behavioural Adaptation.” In Behavioural Adaptation and Road Safety: Theory, Evidence and Action, edited by C. Rudin-Brown and S. L. Jamson, 23–35 Milton Park: Taylor & Francis Ltd. doi:10.1201/b14931.
   Google Scholar
• Carsten, O. M. J, and M. H. Martens. 2019. “How Can Humans Understand Their Automated Cars? HMI Principles, Problems and Solutions.” Cognition, Technology & Work 21 (1): 3–20. doi:10.1007/s10111-018-0484-0.
   Web of Science ®Google Scholar
• Dumas, J. S, and M. C. Salzman. 2006. “Usability Assessment Methods.” Reviews of Human Factors and Ergonomics 2 (1): 109–140. doi:10.1177/1557234X0600200105.
   Google Scholar
• François, M., P. Crave, F. Osiurak, A. Fort, and J. Navarro. 2017. “Digital, Analogue, or Redundant Speedometers for Truck Driving: Impact on Visual Distraction, Efficiency and Usability.” Applied Ergonomics 65: 12–22. doi:10.1016/j.apergo.2017.05.013.
   PubMed Web of Science ®Google Scholar
• François, M., A. Fort, P. Crave, F. Osiurak, and J. Navarro. 2019. “Gauges Design for a Digital Instrument Cluster: Efficiency, Visual Capture, and Satisfaction Assessment for Truck Driving.” International Journal of Industrial Ergonomics 72 (January): 290–297. doi:10.1016/j.ergon.2019.06.004.
   Web of Science ®Google Scholar
• Geraci, M. 2014. “Linear Quantile Mixed Models: The Lqmm Package for Laplace Quantile Regression.” Journal of Statistical Software 57 (13): 1–29. doi:10.18637/jss.v057.i13.
   PubMed Web of Science ®Google Scholar
• Gibson, J. J. 1979. “The Ecological Approach to Visual Perception.” In The Ecological Approach to Visual Perception. New York, NY: Psychology Press. doi:10.4324/9781315740218.
   Google Scholar
• Hart, S. G, and L. E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” In Advances in Psychology 52 (C): 139–183. doi:10.1016/S0166-4115(08)62386-9.
   Google Scholar
• Harvey, C., N. A. Stanton, C. A. Pickering, M. McDonald, and P. Zheng. 2011. “Context of Use as a Factor in Determining the Usability of in-Vehicle Devices.” Theoretical Issues in Ergonomics Science 12 (4): 318–338. doi:10.1080/14639221003717024.
   Google Scholar
• Hu, C. 2019. “On the Comparison of Methods in Analyzing Bounded Outcome Score Data.” The AAPS Journal 21 (6): 102. doi:10.1208/s12248-019-0370-6.
   PubMed Web of Science ®Google Scholar
• ISO. 2010. “Part 210: Human-Centred Design for Interactive Systems.” In Ergonomics of Human–System Interaction — ISO 9241-210,1–40. doi:10.5100/jje.30.1.
   Google Scholar
• John, O. O. 2015. “Robustness of Quantile Regression to Outliers.” American Journal of Applied Mathematics and Statistics 3 (2): 86–88. doi:10.12691/ajams-3-2-8.
   Google Scholar
• Judd, C. M., J. Westfall, and D. A. Kenny. 2012. “Treating Stimuli as a Random Factor in Social Psychology: A New and Comprehensive Solution to a Pervasive but Largely Ignored Problem.” Journal of Personality and Social Psychology 103 (1): 54–69. doi:10.1037/a0028347.
   PubMed Web of Science ®Google Scholar
• Kalra, N, and D. G. Groves. 2017. “RAND Model of Automated Vehicle Safety (MAVS).” RAND Corporation. 2017:57. doi:10.7249/RR1902.
   Google Scholar
• Kim, S., A. K. Dey, J. Lee, and J. Forlizzi. 2011. “Usability of Car Dashboard Displays for Elder Drivers.” Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems – CHI ’11, 493. doi:10.1145/1978942.1979011.
   Google Scholar
• Klauer, S. G., F. Guo, J. D. Sudweeks, and T. a Dingus. 2010. An Analysis of Driver Inattention Using a Case-Crossover Approach on 100-Car Data : Final Report. U.S. Department of Transportation: National Highway Traffic Safety Administration, May 148.
   Google Scholar
• Kuhn, M. 2021. lme4cens: Simple Linear Mixed Effect Models for Censored Data (R package version 0.1.13), Dresden, Germany.
   Google Scholar
• Lee, J. D. 2008. “Fifty Years of Driving Safety Research.” Human Factors 50 (3): 521–528. doi:10.1518/001872008X288376.
   PubMed Web of Science ®Google Scholar
• Lewis, J. R. 2018. “The System Usability Scale: Past, Present, and Future.” International Journal of Human–Computer Interaction 34 (7): 577–590. doi:10.1080/10447318.2018.1455307.
   Web of Science ®Google Scholar
• Lindberg, T, and R. Näsänen. 2003. “The Effect of Icon Spacing and Size on the Speed of Icon Processing in the Human Visual System.” Displays 24 (3): 111–120. doi:10.1016/S0141-9382(03)00035-0.
   Web of Science ®Google Scholar
• Matuschek, H., R. Kliegl, S. Vasishth, H. Baayen, and D. Bates. 2017. “Balancing Type I Error and Power in Linear Mixed Models.” Journal of Memory and Language 94: 305–315. doi:10.1016/j.jml.2017.01.001.
   Web of Science ®Google Scholar
• McDougall, S. J. P., O. de Bruijn, and M. B. Curry. 2000. “Exploring the Effects of Icon Characteristics on User Performance: The Role of Icon Concreteness, Complexity, and Distinctiveness.” Journal of Experimental Psychology 6 (4): 291–306. doi:10.1037/1076-898X.6.4.291.
   Google Scholar
• Monsaingeon, N., L. Caroux, A. Mouginé, S. Langlois, and C. Lemercier. 2021. “Impact of Interface Design on Drivers’ Behavior in Partially Automated Cars: An on-Road Study.” Transportation Research Part F 81: 508–521. doi:10.1016/j.trf.2021.06.019.
   Google Scholar
• NHTSA. 2013. “Visual-Manual NHTSA Driver Distraction Guidelines for in-Vehicle Electronic Devices.” In Docket No. NHTSA-2010-0053 http://awsassets.wwfnz.panda.org/downloads/earth_summit_2012_v3.pdf%0Ahttp://hdl.handle.net/10239/131%0Ahttps://www.uam.es/gruposinv/meva/publicacionesjesus/capitulos_espanyol_jesus/2005_motivacionparaelaprendizajePerspectivaalumnos.pdf%0Ahttps://ww.
   Google Scholar
• NHTSA. 2014. “Visual-Manual NHTSA Driver Distraction Guidelines for in-Vehicle Electronic Devices.” Docket No. NHTSA-2014–0088 79:179. ( https://www.regulations.gov/document/NHTSA-2014-0088-0001.
   Google Scholar
• Nielsen, J. 1994. “Usability Engineering.” In Journal of Chemical Information and Modeling. San Francisco: Morgan Kaufmann Publishers Inc.
   Google Scholar
• Nordhoff, S., M. Kyriakidis, B. van Arem, and R. Happee. 2019. “A Multi-Level Model on Automated Vehicle Acceptance (MAVA): A Review-Based Study.” Theoretical Issues in Ergonomics Science 20 (6): 682–710. doi:10.1080/1463922X.2019.1621406.
   Web of Science ®Google Scholar
• Norman, D. A. 1983. “Some Observations on Mental Methods.” In Mental Models, edited by D. Gentner & A. L. Stevens, 1st ed., 7–14. New York, NY: Psychology Press.
   Google Scholar
• Norman, D. A. 1999. “Affordance, Conventions, and Design.” Interactions 6 (3): 38–43. doi:10.1145/301153.301168.
   Google Scholar
• Norman, D. A. 2013. The Design of Everyday Things: Revised and Expanded Edition (Revised). New York: Basic Books.
   Google Scholar
• Obana, Y. 1997. “Vertical or Horizontal ? Reading Directions in Japanese.” Bulletin of the School of Oriental and African Studies 60 (1): 86–94. doi:10.1017/S0041977X0002958X.
   Google Scholar
• Perrier, M. J. R., Louw, T. L. and Carsten, O. M. J. 2021. “User-Centred Design Evaluation of Symbols for Adaptive Cruise Control (ACC) and Lane-Keeping Assistance (LKA).” Cognition, Technology & Work 23 (4): 685–703. doi:10.1007/s10111-021-00673-0.
   Web of Science ®Google Scholar
• Perrier, M. J. R., T. L. Louw, R. C. Gonçalves, and O. M. J. Carsten. 2019. “How Do Drivers Design Symbols for ACC & LCA? A Participatory Design Workshop.” AutomotiveUI ’19 Adjunct, September 21–25, 2019, Utrecht, Netherlands. doi:10.13140/RG.2.2.32273.79201/1.
   Google Scholar
• Preacher, K. J., Z. Zhang, and M. J. Zyphu. 2011. “Alternative Methods for Assessing Mediation in Multilevel Data: The Advantages of Multilevel Sem.” Structural Equation Modeling: A Multidisciplinary Journal 18 (2): 161–182. doi:10.1080/10705511.2011.557329.
   Web of Science ®Google Scholar
• R Core Team. 2020. R: A Language and Environment for Statistical Computing. https://www.r-project.org/.
   Google Scholar
• Regan, M. A., and C. Hallett. 2011. “Driver Distraction: Definition, Mechanisms, Effects, and Mitigation.” In Handbook of Traffic Psychology, edited by B. E. Porter, First Edit, 275–286. Amsterdam: Elsevier.
   Google Scholar
• SAE International. 2018. J3016 Taxonomy and Definitions for Terms Related to Driving Automation Systems for on-Road Motor Vehicles. Warrendale: SAE.
   Google Scholar
• Saffarian, M., J. C. F. de Winter, and R. Happee. 2013. “Enhancing Driver Car-Following Performance with a Distance and Acceleration Display.” IEEE Transactions on Human-Machine Systems 43 (1): 8–16. doi:10.1109/TSMCA.2012.2207105.
   Web of Science ®Google Scholar
• Sarter, N. B, and D. D. Woods. 1995. “How in the World Did we Ever Get into That Mode? Mode Error and Awareness in Supervisory Control.” Human Factors: The Journal of the Human Factors and Ergonomics Society 37 (1): 5–19. doi:10.1518/001872095779049516.
   Web of Science ®Google Scholar
• Sarter, N. B., D. D. Woods, and C. E. Billings. 1997. “Automation Surprises.” In Handbook of Human Factors & Ergonomics, edited by G. Salvendy, 2nd ed., 1926–1943. New York: John Wiley & Sons Ltd.
   Google Scholar
• Sauro, J. 2015. “SUPR-Q: A Comprehensive Measure of the Quality of the Website User Experience.” Journal of Usability Studies 10 (2): 68–86. http://www.upassoc.org.
   Web of Science ®Google Scholar
• Sauro, J, and J. S. Dumas. 2009. “Comparison of Three One-Question, Post-Task Usability Questionnaires.” Proceedings of the 27th International Conference on Human Factors in Computing Systems – CHI 09, 1599–1608. doi:10.1145/1518701.1518946.
   Google Scholar
• Schuetz, I., T. S. Murdison, K. J. MacKenzie, and M. Zannoli. 2019. “An Explanation of Fitts’ Law-like Performance in Gaze-Based Selection Tasks Using a Psychophysics Approach.” Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–13. doi:10.1145/3290605.3300765.
   Google Scholar
• Seppelt, B. D, and J. D. Lee. 2007. “Making Adaptive Cruise Control (ACC) Limits Visible.” International Journal of Human-Computer Studies 65 (3): 192–205. doi:10.1016/j.ijhcs.2006.10.001.
   Web of Science ®Google Scholar
• Seppelt, B. D, and J. D. Lee. 2019. “Keeping the Driver in the Loop: Dynamic Feedback to Support Appropriate Use of Imperfect Vehicle Control Automation.” International Journal of Human-Computer Studies 125: 66–80. doi:10.1016/j.ijhcs.2018.12.009.
   Web of Science ®Google Scholar
• Sheridan, T. B, and R. Parasuraman. 2005. “Human-Automation Interaction.” Reviews of Human Factors and Ergonomics 1 (1): 89–129. doi:10.1518/155723405783703082.
   Google Scholar
• Sivak, M. 1996. “The Information That Drivers Use: Is It Indeed 90% Visual?” Perception 25 (9): 1081–1089. doi:10.1068/p251081.
   PubMed Web of Science ®Google Scholar
• Vertegaal, R. 2008. “A Fitts Law Comparison of Eye-Tracking and Manual Input in the Selection of Visual Targets.” Proceedings of the 10th International Conference on Multimodal Interfaces – IMCI ’08, 241. doi:10.1145/1452392.1452443.
   Google Scholar
• Young, K. L, and M. A. Regan. 2007. “Driver Distraction : A Review of the Literature.” In Distracted Driving, edited by I. J. Faulks, M. A. Regan, M. Stevenson, J. Brown, A. Porter, & J. D. Irwin, 379–405. Sydney, NSW: Australasian College of Road Safety.
   Google Scholar
• Zijlstra, F. R. 1993. Efficiency in Work Behaviour: A Design Approach for Modern Tools.” Ph.D. Thesis [Ph.D. Thesis]., Delft University Press. Delft University of Technology.
   Google Scholar