Abstract
With the increasing prevalence of artificial intelligence (AI) agents, the transparency of agents has become vital in addressing interaction issues (e.g., trust, usefulness, and understandability). However, determining the transparency of AI agents requires a systematic consideration of complex related factors, including stakeholders, algorithms, context, etc. Thus, in our study, we presented an overview of studies on the transparency of AI agents through multiple-stage bibliometric analysis, and identified an ontological framework of the key concepts relevant to transparent AI. We then built a Transparent-AI Blueprint prototype which is a diagram that visualizes the ontological framework of design concepts. In the subsequent pilot test, we updated Blueprint to the final version, and validated it in a workshop. Our work structurally summarized the design concepts related to the transparency of AI agents, and proposed a useful and practical conceptual design tool that effectively guides designers to operationalize the transparency of AI agents.
Acknowledgement
The authors would like to thank Weitao You and Zejian Li from Zhejiang University for their helpful comments. Besides, the authors would like to thank Liu Yanzhen and Lou Shanghua for their work on the literature review and the analysis process.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Funding
Notes on contributors
Zhibin Zhou
Zhibin Zhou is a Ph.D. candidate attached to the International Design Institute of Zhejiang University. With a background in user experience design and AI, his PhD research focuses on capturing the interaction between humans and AI and gaining an increased understanding of AI as a design material.
Zhuoshu Li
Zhuoshu Li is a master candidate of the International Design Institute of Zhejiang University. Stemming from her background in user experience design and interests in AI, she is dedicated in addressing the interaction design challenges brought by AI as well as exploring novel tools and methods for designing human-AI interaction.
Yuyang Zhang
Yuyang Zhang is a UX researcher with a background in interaction design. She is currently a master fellow of the International Design Institute of Zhejiang University. She is interested in AI and Design, exploring how to address the issues of designing AI-empowered products.
Lingyun Sun
Lingyun Sun is a professor at Zhejiang University. He is the Deputy Director of the International Design Institute, Ng Teng Fong Chaired Professor and the director of ZJU-SUTD Innovation, Design and Entrepreneurship Alliance. His research interests include Design Intelligence, Innovation and Design, and Information and Interaction Design.