1,238
Views
2
CrossRef citations to date
0
Altmetric
Research Articles

Explainable AI: The Effect of Contradictory Decisions and Explanations on Users’ Acceptance of AI Systems

, &
Pages 1807-1826 | Received 31 Oct 2021, Accepted 06 Sep 2022, Published online: 14 Oct 2022
 

Abstract

Providing explanations of an artificial intelligence (AI) system has been suggested as a means to increase users’ acceptance during the decision-making process. However, little research has been done to examine the psychological mechanism of how these explanations cause a positive or negative reaction in the user. To address this gap, we investigate the effect on user acceptance if decisions and the associated provided explanations contradict between an AI system and the user. An interdisciplinary research model was derived and validated by an experiment with 78 participants. Findings suggest that in decision situations with cognitive misfit users experience negative mood significantly more often and have a negative evaluation of the AI system’s support. Therefore, the following article provides further guidance regarding new interdisciplinary approaches for dealing with human-AI interaction during the decision-making process and sheds some light on how explainable AI can increase users’ acceptance of such systems.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Carolin Ebermann

Carolin Ebermann is a research associate at PFH Private University of Applied Sciences Göttingen, Germany. Before she was a User Experience Consultant at eresult GmbH. Carolin studied Psychology at the TU Braunschweig. Afterwards, she completed her PhD in business informatics at the Georg-August-University of Göttingen.

Matthias Selisky

Matthias Selisky is a UX Designer at generic.de software technologies AG. Before he was a research associate at PFH Private University of Applied Sciences Göttingen. Matthias earned a Master of Science in Neuropsychology from Oldenburg University, and a Bachelor of Science degree in Cognitive Science from Osnabrück University.

Stephan Weibelzahl

Stephan Weibelzahl is a professor of business psychology at PFH Private University of Applied Sciences Göttingen, Germany. He received a PhD from University of Trier, headed a research team at Fraunhofer IESE, Kaiserslautern and worked as lecturer at National College of Ireland, Dublin.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 306.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.