Design and implementation of the Competency Assessment Tool (CAT): user experience usability study

ABSTRACT

The decision on patients’ competency to manage their affairs and take care of themselves requires a rigorous evaluation process and consistency among practice settings. Research indicates there is a lack of resources to guide healthcare and social service professionals in the interprofessional decision-making process that such an evaluation requires. A web-based tool, the Competency Assessment Tool (CAT), was designed to assist professionals in that process. The authors conducted a usability study with a beta version of the CAT. The objectives of this study were to: (1) explore what is needed to support its use in community-based and specialized settings; and (2) identify barriers to and facilitators of implementation. A major concern was the perceived onerous nature of the tool. Participants indicated a need for different versions of the tool, depending on the complexity of the evaluation. They want to be directed to areas in the tool based on their field of expertise and want adjustments to functionalities related to collaborative work. This study highlights the importance of the awareness of User Experience (UX) considerations at the outset of the design process, to limit the impact of required modifications and facilitate implementation in the workplace.

KEYWORDS:

• Competency assessment
• usability study
• user experience
• CAT
• web-based tool

Acknowledgments

The authors would like to acknowledge the support of the Centre de recherche sur les soins et les services de première ligne de l’Université Laval (CERSSPL-UL), the Quebec Network for Research on Aging (RQRV), and the contribution of the Centre d’excellence sur le vieillissement de Québec (CEVQ) where this study was conducted.

Disclosure statement

All authors have no conflict of interest to declare. Financial support for this study was provided entirely by grants from the Centre de recherche sur les soins et services de première ligne de l’Université Laval and Reseau Québécois de Recherche sur le Vieillissement de Québec. The funding agreement ensured all authors’ independence in designing the study, interpreting the data, writing, and publishing the report. The study was carried out at the Centre d’Excellence sur le Vieillissement du CHU de Québec (CEVQ).