Abstract
The application of artificial intelligence (AI) systems has surged in the high-risk area of medicine, and these systems must explain their decisions to different users. However, existing explainable AI (XAI) design practices in the medical domain are mostly focused on domain experts, such as physicians, and there is a lack of XAI design practices for consumer users. Therefore, we developed a library of XAI user needs in the medical domain, which can be used as an auxiliary tool for the development of user-centered XAI design solutions in this domain. Moreover, through empirical research, based on our XAI user Needs Library, we designed an XAI-based electrocardiogram diagnostic system prototype for consumer users and conducted a user evaluation. The results provide the empirical experience of the design space of XAI and promote consumer user-centered XAI practices.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Notes on contributors
Xin He
Xin He is a designer and lecturer at the School of Mechanical Science and Engineering at Huazhong University of Science and Technology, China. She received an MA from the Royal College of Art, UK, a BA from Tsinghua University, China. Her area of expertise is user experience of intelligent systems.
Yeyi Hong
Yeyi Hong is a researcher at the School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China. Her research covers human-centered explainable artificial intelligence, user experience, and interactive design.
Xi Zheng
Xi Zheng is a researcher at the School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China. Her research interests include human-computer interaction, user experience of intelligent systems, and interactive design.
Yong Zhang
Yong Zhang is a professor at the School of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan, China. He received a PhD from Huazhong University of Science and Technology. His areas of expertise are artificial intelligence and its applications in medical and industrial domains.