1,061
Views
0
CrossRef citations to date
0
Altmetric
Articles

Transparent-AI Blueprint: Developing a Conceptual Tool to Support the Design of Transparent AI Agents

, , &
Pages 1846-1873 | Received 16 Apr 2021, Accepted 11 Apr 2022, Published online: 17 Jul 2022
 

Abstract

With the increasing prevalence of artificial intelligence (AI) agents, the transparency of agents has become vital in addressing interaction issues (e.g., trust, usefulness, and understandability). However, determining the transparency of AI agents requires a systematic consideration of complex related factors, including stakeholders, algorithms, context, etc. Thus, in our study, we presented an overview of studies on the transparency of AI agents through multiple-stage bibliometric analysis, and identified an ontological framework of the key concepts relevant to transparent AI. We then built a Transparent-AI Blueprint prototype which is a diagram that visualizes the ontological framework of design concepts. In the subsequent pilot test, we updated Blueprint to the final version, and validated it in a workshop. Our work structurally summarized the design concepts related to the transparency of AI agents, and proposed a useful and practical conceptual design tool that effectively guides designers to operationalize the transparency of AI agents.

Acknowledgement

The authors would like to thank Weitao You and Zejian Li from Zhejiang University for their helpful comments. Besides, the authors would like to thank Liu Yanzhen and Lou Shanghua for their work on the literature review and the analysis process.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This is paper is funded by National Key R&D Program of China [2018AAA0100703], the Provincial Key Research and Development Plan of Zhejiang Province [No. 2019C03137], and the National Natural Science Foundation of China [No. 62006208 and No. 62107035].

Notes on contributors

Zhibin Zhou

Zhibin Zhou is a Ph.D. candidate attached to the International Design Institute of Zhejiang University. With a background in user experience design and AI, his PhD research focuses on capturing the interaction between humans and AI and gaining an increased understanding of AI as a design material.

Zhuoshu Li

Zhuoshu Li is a master candidate of the International Design Institute of Zhejiang University. Stemming from her background in user experience design and interests in AI, she is dedicated in addressing the interaction design challenges brought by AI as well as exploring novel tools and methods for designing human-AI interaction.

Yuyang Zhang

Yuyang Zhang is a UX researcher with a background in interaction design. She is currently a master fellow of the International Design Institute of Zhejiang University. She is interested in AI and Design, exploring how to address the issues of designing AI-empowered products.

Lingyun Sun

Lingyun Sun is a professor at Zhejiang University. He is the Deputy Director of the International Design Institute, Ng Teng Fong Chaired Professor and the director of ZJU-SUTD Innovation, Design and Entrepreneurship Alliance. His research interests include Design Intelligence, Innovation and Design, and Information and Interaction Design.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.