A Systematic and Generalizable Approach to the Heuristic Evaluation of User Interfaces

ABSTRACT

Heuristic evaluation is one of the most actively used techniques for analyzing usability, as it is quick and inexpensive. This technique is based on following a given set of heuristics, which are typically defined as broad rules of thumb. In this paper, we propose a systematic and generalizable approach to this type of evaluation based on using comprehensive taxonomies as a source for the heuristics. This approach contrasts with other typical approaches, such as following (or adapting) Jakob Nielsen’s heuristics or creating ad hoc heuristics (formally or informally). The usefulness of our approach is investigated in two ways. Firstly, we carry out an actual heuristic evaluation of a mobile app in this manner, which we describe in detail. Secondly, we compare our approach and Nielsen’s. Additionally, we identify some limitations in Nielsen’s heuristics and some inconsistencies between them and established usability models, including Nielsen’s own.

KEYWORDS:

• Case study
• context-of-use taxonomy
• Heuristic evaluation
• mobile apps
• Nielsen’s heuristics
• usability taxonomy

Acknowledgments

This work has been supported by Xunta de Galicia (Spain) under project GRC2014/035. Also financial support from the Xunta de Galicia (Centro singular de investigación de Galicia accreditation 2016-2019, REF. ED431G/01) and the European Union (European Regional Development Fund—ERDF) is gratefully acknowledged.