Design Thinking Framework for Integration of Transparency Measures in Time-Critical Decision Support

Abstract

The integration of artificial intelligence transparency in time-critical decision support is complex and requires consideration of the impact on human-machine teaming. The relationships between transparency, trust, workload, and situational awareness are key to understanding this impact on performance. We detail the development of a novel design framework for transparency integration in Decision Support Systems. We selected the design thinking approach as the baseline for our framework as this focuses on developing empathy with users and rapid design iteration. We adapted this framework by introducing the concept of empathy for both human and machine agents. In this situation, “empathy” is providing a deep understanding of the model, its purpose and the underlying data for AI. We developed a structured problem definition focused on understanding the relationships between constructs and established solution themes to guide the designer. We demonstrate this transparency integration framework on a Transfer of Care Decision Support System.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Paul Stone

Paul Stone earned a B.Eng in Engineering Design from the University of Huddersfield in 1999 and an M.S. in Industrial and Human Factors Engineering from Wright State University in 2019. He is currently on the Industrial and Human Factors Engineering Ph.D. program researching human-machine teaming and explainable AI.

Sarah A. Jessup

Sarah A. Jessup earned a B.S. in Psychology and M.S. in Human Factors and Industrial/Organizational Psychology from Wright State University in 2015 and 2018, respectively. She is currently pursuing a Ph.D. in Human Factors and Industrial/Organizational Psychology. Her research interests include human-robot interaction, trust, individual differences, and social neuroscience

Subhashini Ganapathy

Subhashini Ganapathy, is an associate professor and chair in the Department of Biomedical, Industrial and Human Factors Engineering at Wright State University. She directs the Interactions Design and Modeling Lab. Her research work spans core areas of mobile computing, cognitive modeling, decision-making, user-experience, and human factors engineering. Email [email protected]

Assaf Harel

Assaf Harel is an Associate Professor in the Human Factors program at Wright State University’s Psychology Department. He is a cognitive neuroscientist employing neuroscience techniques (EEG, fMRI, and eye-tracking) to augment training and performance and establish how visual recognition occurs in the real world.