Cognitive Artifacts in Support of Medical Shift Handover: An In Use, In Situ Evaluation

Abstract

Technologies introduced to support complex and critical work practices merit rigorous and effective evaluation. However, evaluation strategies often fall short of evaluating real use by practitioners in the workplace and thereby miss an opportunity to gauge the true impact of the technology on the work. This article reports an in use, in situ evaluation of 2 cognitive artifacts that support the everyday work of handover in a healthcare setting. The evaluation drew inspiration from the theoretical viewpoint offered by distributed cognition, focusing on the information content, representational media, and context of use of the artifacts. The article discusses how this approach led to insights about the artifacts and their support of the work that could not have been obtained with more traditional evaluation techniques. Specifically, the argument is made that the ubiquitous approach of user testing with its reliance on think-alouds and observations of interaction is inadequate in this context and set an initial agenda for issues that should be addressed by in use, in situ evaluations.

Notes

¹We use the term handover summary to refer to either of these artifacts.