Tactical-Level Explanation is Not Enough: Effect of Explaining AV’s Lane-Changing Decisions on Drivers’ Decision-Making, Trust, and Emotional Experience

References

• Abraham, H., Lee, C., Brady, S., Fitzgerald, C., Mehler, B., Reimer, B., & Coughlin, J. F. (2017). Autonomous vehicles and alternatives to driving: Trust, preferences, and effects of age. In Proceedings of the Transportation Research Board 96th Annual Meeting (pp. 8–12). Transportation Research Board.
   Google Scholar
• Albrecht, S. V., Brewitt, C., Wilhelm, J., Gyevnar, B., Eiras, F., Dobre, M., & Ramamoorthy, S. (2021). Interpretable goal-based prediction and planning for autonomous driving. In 2021 IEEE International Conference on Robotics and Automation (ICRA) (pp. 1043–1049). IEEE. https://doi.org/10.1109/icra48506.2021.9560849
   Google Scholar
• Allaire, J. (2012). Rstudio: Integrated development environment for R, Boston, MA (vol. 770, issue no. 394, pp. 165–171).
   Google Scholar
• Atakishiyev, S., Salameh, M., Yao, H., & Goebel, R. (2021). Explainable artificial intelligence for autonomous driving: A comprehensive overview and field guide for future research directions. arXiv preprint arXiv:2112.11561
   Google Scholar
• Banks, V. A., Plant, K. L., & Stanton, N. A. (2018). Driver error or designer error: Using the Perceptual Cycle Model to explore the circumstances surrounding the fatal Tesla crash on 7th May 2016. Safety Science, 108, 278–285. https://doi.org/10.1016/j.ssci.2017.12.023
   Web of Science ®Google Scholar
• Ben-Younes, H., Zablocki, É., Pérez, P., & Cord, M. (2022). Driving behavior explanation with multi-level fusion. Pattern Recognition, 123, 108421. https://doi.org/10.1016/j.patcog.2021.108421
   Web of Science ®Google Scholar
• Brechtel, S., Gindele, T., & Dillmann, R. (2014). Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs [Paper presentation]. In 17th International IEEE Conference on Intelligent Transportation Systems (ITSC) (pp. 392–399). IEEE. https://doi.org/10.1109/itsc.2014.6957722
   Google Scholar
• Carsten, O., Lai, F. C. H., Barnard, Y., Jamson, A. H., & Merat, N. (2012, October). Control task substitution in semiautomated driving: Does it matter what aspects are automated? Human Factors, 54(5), 747–761. https://doi.org/10.1177/0018720812460246
   PubMed Web of Science ®Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555
   Web of Science ®Google Scholar
• Du, N., Haspiel, J., Zhang, Q., Tilbury, D., Pradhan, A. K., Yang, X. J., & Robert, L. P. (2019). Look who’s talking now: Implications of AV’s explanations on driver’s trust, AV preference, anxiety and mental workload. Transportation Research Part C: Emerging Technologies, 104, 428–442. https://doi.org/10.1016/j.trc.2019.05.025
   Web of Science ®Google Scholar
• Endsley, M. R. (2017). Toward a theory of situation awareness in dynamic systems. In Situational awareness (pp. 9–42). Routledge.
   Google Scholar
• Endsley, M. R. (2018). Situation awareness in future autonomous vehicles: Beware of the unexpected. In Congress of the International Ergonomics Association (pp. 303–309). Springer. https://doi.org/10.1007/978-3-319-96071-5_32
   Google Scholar
• Endsley, M. R. (2019). A systematic review and meta-analysis of direct objective measures of situation awareness: A comparison of Sagat and spam. Human Factors, 63(1), 124–150. https://doi.org/10.1177/0018720819875376
   PubMed Web of Science ®Google Scholar
• Eriksson, A., Petermeijer, S. M., Zimmermann, M., De Winter, J. C., Bengler, K. J., & Stanton, N. A. (2019). Rolling out the red (and green) carpet: Supporting driver decision making in automation-to-manual transitions. IEEE Transactions on Human-Machine Systems, 49(1), 20–31. https://doi.org/10.1109/THMS.2018.2883862
   Web of Science ®Google Scholar
• Forster, Y., Naujoks, F., & Neukum, A. (2017). Increasing anthropomorphism and trust in automated driving functions by adding speech output. In 2017 IEEE intelligent vehicles symposium (IV) (pp. 365–372). IEEE. https://doi.org/10.1109/ivs.2017.7995746
   Google Scholar
• Frey, B. B. (2018). The SAGE encyclopedia of educational research, measurement, and evaluation. Sage Publications.
   Google Scholar
• Frison, A.-K., Wintersberger, P., Liu, T., & Riener, A. (2019). Why do you like to drive automated? A context-dependent analysis of highly automated driving to elaborate requirements for intelligent user interfaces [Paper presentation]. In Proceedings of the 24th International Conference on Intelligent User Interfaces (pp. 528–537). ACM. https://doi.org/10.1145/3301275.3302331
   Google Scholar
• Gilpin, L. H., Penubarthi, V., & Kagal, L. (2021). Explaining multimodal errors in autonomous vehicles [Paper presentation]. In 2021 IEEE 8th International Conference on Data Science and Advanced Analytics (DSAA) (pp. 1–10). IEEE. https://doi.org/10.1109/dsaa53316.2021.9564178
   Google Scholar
• Gold, C., Happee, R., & Bengler, K. (2018). Modeling take-over performance in level 3 conditionally automated vehicles. Accident; Analysis and Prevention, 116, 3–13. https://doi.org/10.1016/j.aap.2017.11.009
   PubMed Web of Science ®Google Scholar
• Gold, C., Naujoks, F., Radlmayr, J., Bellem, H., Jarosch, O. (2017). Testing scenarios for human factors research in level 3 automated vehicles. In International Conference on Applied Human Factors and Ergonomics (pp. 551–559). Springer. https://doi.org/10.1007/978-3-319-60441-1_54
   Google Scholar
• Hoff, K. A., & Bashir, M. (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57(3), 407–434. https://doi.org/10.1177/0018720814547570
   PubMed Web of Science ®Google Scholar
• Holthausen, B. E., Wintersberger, P., Walker, B. N., & Riener, A. (2020). Situational trust scale for automated driving (STS-AD ): Development and initial validation [Paper presentation]. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 40–47). ACM. https://doi.org/10.1145/3409120.3410637
   Google Scholar
• Inagaki, T., & Sheridan, T. B. (2019). A critique of the sae conditional driving automation definition, and analyses of options for improvement. Cognition, Technology & Work, 21(4), 569–578. https://doi.org/10.1007/s10111-018-0471-5
   Web of Science ®Google Scholar
• Kamezaki, M., Hayashi, H., Manawadu, U. E., & Sugano, S. (2020). Human-centered intervention based on tactical-level input in unscheduled takeover scenarios for highly-automated vehicles. International Journal of Intelligent Transportation Systems Research, 18(3), 451–460. https://doi.org/10.1007/s13177-019-00217-x
   Web of Science ®Google Scholar
• Kim, J., Rohrbach, A., Darrell, T., Canny, J., Akata, Z. (2018). Textual explanations for self-driving vehicles. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 563–578). Springer.
   Google Scholar
• Koo, J., Kwac, J., Ju, W., Steinert, M., Leifer, L., & Nass, C. (2015). Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing, 9(4), 269–275. https://doi.org/10.1007/s12008-014-0227-2
   Google Scholar
• Koo, J., Shin, D., Steinert, M., & Leifer, L. (2016). Understanding driver responses to voice alerts of autonomous car operations. International Journal of Vehicle Design, 70(4), 377. https://doi.org/10.1504/IJVD.2016.076740
   Web of Science ®Google Scholar
• Körber, M., Prasch, L., & Bengler, K. (2018). Why do I have to drive now? Post hoc explanations of takeover requests. Human Factors, 60(3), 305–323. https://doi.org/10.1177/0018720817747730
   PubMed Web of Science ®Google Scholar
• Kunishige, M., Fukuda, H., Iida, T., Kawabata, N., Ishizuki, C., & MIyaguchi, H. (2019). Spatial navigation ability and gaze switching in older drivers: A driving simulator study. Hong Kong Journal of Occupational Therapy, 32(1), 22–31. https://doi.org/10.1177/1569186118823872
   PubMed Web of Science ®Google Scholar
• Linehan, C., Murphy, G., Hicks, K., Gerling, K., & Morrissey, K. (2019). Handing over the keys: A qualitative study of the experience of automation in driving. International Journal of Human–Computer Interaction, 35(18), 1681–1692. https://doi.org/10.1080/10447318.2019.1565482
   Web of Science ®Google Scholar
• Lorenz, L., Kerschbaum, P., Schumann, J. (2014). Designing take over scenarios for automated driving: How does augmented reality support the driver to get back into the loop? In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 58, pp. 1681–1685). Sage Publications. https://doi.org/10.1177/1541931214581351
   Google Scholar
• Matthews, M. L., Bryant, D. J., Webb, R. D., & Harbluk, J. L. (2001). Model for situation awareness and driving: Application to analysis and research for intelligent transportation systems. Transportation Research Record, 1779(1), 26–32. https://doi.org/10.3141/1779-04
   Google Scholar
• Michon, J. A. (1985). A critical view of driver behavior models: what do we know, what should we do? In L. Evans & R. C. Schwing (Eds.), Human behavior and traffic safety (pp. 485–524). Springer. https://doi.org/10.1007/978-1-4613-2173-6_19
   Google Scholar
• Muir, B. M. (1987). Trust between humans and machines, and the design of decision aids. International Journal of Man-Machine Studies, 27(5–6), 527–539. https://doi.org/10.1016/S0020-7373(87)80013-5
   Google Scholar
• NIO. (2020, October). A quick look at NIO’s navigate on pilot. https://www.nio.com/blog/quick-look-nios-navigate-pilot
   Google Scholar
• Omeiza, D., Webb, H., Jirotka, M., & Kunze, L. (2021). Explanations in autonomous driving: A survey. IEEE Transactions on Intelligent Transportation Systems, 1–21. https://doi.org/10.1109/TITS.2021.3122865
   Google Scholar
• Ossig, J., & Cramer, S. (2020). Tactical decisions for lane changes or lane following? development of a study design for automated driving [Paper presentation]. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 23–26). ACM. https://doi.org/10.1145/3409251.3411714
   Google Scholar
• Parasuraman, R., Masalonis, A. J., & Hancock, P. A. (2000). Fuzzy signal detection theory: Basic postulates and formulas for analyzing human and machine performance. Human Factors, 42(4), 636–659. https://doi.org/10.1518/001872000779697980
   PubMed Web of Science ®Google Scholar
• Parasuraman, R., Molloy, R., & Singh, I. L. (1993). Performance consequences of automation-induced’complacency. The International Journal of Aviation Psychology, 3(1), 1–23. https://doi.org/10.1207/s15327108ijap0301_1
   Google Scholar
• Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans, 30(3), 286–297. https://doi.org/10.1109/3468.844354
   PubMed Web of Science ®Google Scholar
• Park, S. Y., Moore, D. J., & Sirkin, D. (2020). What a driver wants: User preferences in semi-autonomous vehicle decision-making [Paper presentation]. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–13). ACM. https://doi.org/10.1145/3313831.3376644
   Google Scholar
• Petermeijer, S., Bazilinskyy, P., Bengler, K., & De Winter, J. (2017). Take-over again: Investigating multimodal and directional tors to get the driver back into the loop. Applied Ergonomics, 62, 204–215. https://doi.org/10.1016/j.apergo.2017.02.023
   PubMed Web of Science ®Google Scholar
• Rezvani, T., Driggs-Campbell, K., & Bajcsy, R. (2017). Optimizing interaction between humans and autonomy via information constraints on interface design [Paper presentation]. In 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC) (pp. 1–6). IEEE. https://doi.org/10.1109/itsc.2017.8317686
   Google Scholar
• Ruijten, P. A., Terken, J., & Chandramouli, S. N. (2018). Enhancing trust in autonomous vehicles through intelligent user interfaces that mimic human behavior. Multimodal Technologies and Interaction, 2(4), 62. https://doi.org/10.3390/mti2040062
   Google Scholar
• Russell, S. M., Atwood, J., McLaughlin, S. B. (2021). Driver expectations for system control errors, driver engagement, and crash avoidance in level 2 driving automation systems (Report No. DOT HS 812 982). Department of Transportation, National Highway Traffic Safety Administration, United States.
   Google Scholar
• SAE. (2021a). J3016C: Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles – international. https://www.sae.org/standards/content/j3016202104/
   Google Scholar
• SAE. (2021b, June). SAE revises levels of driving automation. https://www.sae.org/site/news/2021/06/sae-revises-levels-of-driving-automation
   Google Scholar
• Shabanpour, R., Golshani, N., Shamshiripour, A., & Mohammadian, A. K. (2018). Eliciting preferences for adoption of fully automated vehicles using best-worst analysis. Transportation Research Part C: Emerging Technologies, 93, 463–478. https://doi.org/10.1016/j.trc.2018.06.014
   Web of Science ®Google Scholar
• Shen, Y., Jiang, S., Chen, Y., Yang, E., Jin, X., Fan, Y., et al. (2020). To explain or not to explain: A study on the necessity of explanations for autonomous vehicles. arXiv preprint arXiv:2006.11684
   Google Scholar
• Sirkin, D., Martelaro, N., Johns, M., & Ju, W. (2017). Toward measurement of situation awareness in autonomous vehicles [Paper presentation]. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 405–415). ACM. https://doi.org/10.1145/3025453.3025822
   Google Scholar
• Skitka, L. J., Mosier, K. L., & Burdick, M. (1999). Does automation bias decision-making? International Journal of Human-Computer Studies, 51(5), 991–1006. https://doi.org/10.1006/ijhc.1999.0252
   Web of Science ®Google Scholar
• Tesla (2019, February). Autopilot and full self-driving capability. https://www.tesla.com/support/autopilot
   Google Scholar
• Ulbrich, S., Maurer, M. (2015). Towards tactical lane change behavior planning for automated vehicles. In 2015 IEEE 18th International Conference on Intelligent Transportation Systems (pp. 989–995). IEEE. https://doi.org/10.1109/itsc.2015.165
   Google Scholar
• Wang, C. (2019, September). A framework of the non-critical spontaneous intervention in highly automated driving scenarios [Paper presentation]. Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (pp. 421–426). New York, NY, USA: Association for Computing Machinery.
   Google Scholar
• Wang, M., Lyckvi, S. L., Chen, C., Dahlstedt, P., & Chen, F. (2017, May). Using advisory 3D sound cues to improve drivers’ performance and situation awareness [Paper presentation]. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 2814–2825). New York, NY, USA: Association for Computing Machinery.
   Google Scholar
• Wickham, H. (2011). ggplot2. Wiley Interdisciplinary Reviews: Computational Statistics, 3(2), 180–185. https://doi.org/10.1002/wics.147
   Google Scholar
• Wiegand, G., Schmidmaier, M., Weber, T., Liu, Y., & Hussmann, H. (2019). I drive-you trust: Explaining driving behavior of autonomous cars. In Extended Abstracts of the 2019 Chi Conference on Human Factors in Computing Systems (pp. 1–6). ACM. https://doi.org/10.1145/3290607.3312817
   Google Scholar
• Yan, F., Karaosmanoglu, S., Demir, A., & Baumann, M. (2019). Spatial visualization of sensor information for automated vehicles [Paper presentation]. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (pp. 265–270). ACM. https://doi.org/10.1145/3349263.3351311
   Google Scholar
• Yu, H., Tseng, H. E., & Langari, R. (2018). A human-like game theory-based controller for automatic lane changing. Transportation Research Part C: Emerging Technologies, 88, 140–158. https://doi.org/10.1016/j.trc.2018.01.016
   Web of Science ®Google Scholar
• Zeeb, K., Buchner, A., & Schrauf, M. (2015). What determines the take-over time? an integrated model approach of driver take-over after automated driving. Accident; Analysis and Prevention, 78, 212–221. https://doi.org/10.1016/j.aap.2015.02.023
   PubMed Web of Science ®Google Scholar
• Zhang, S., Deng, W., Zhao, Q., Sun, H., Litkouhi, B. (2013). Dynamic trajectory planning for vehicle autonomous driving. In 2013 IEEE International Conference on Systems, Man, and Cybernetics (pp. 4161–4166). IEEE. https://doi.org/10.1109/smc.2013.709
   Google Scholar
• Zhou, F., Yang, X. J., & Zhang, X. (2020). Takeover transition in autonomous vehicles: A Youtube study. International Journal of Human–Computer Interaction, 36(3), 295–306. https://doi.org/10.1080/10447318.2019.1634317
   Web of Science ®Google Scholar
• Zimmermann, M., Bauer, S., Lütteken, N., Rothkirch, I. M., & Bengler, K. J. (2014). Acting together by mutual control: Evaluation of a multimodal interaction concept for cooperative driving [Paper presentation]. In 2014 International Conference on Collaboration Technologies and Systems (CTS) (pp. 227–235). IEEE. https://doi.org/10.1109/cts.2014.6867569
   Google Scholar