Usability engineering laboratories: limitations and challenges toward a unifying tools/practices environment

Abstract

This article discusses the limitations and challenges surrounding the present usability engineering (UE) labs. Usability laboratories include hardware and software tools to observe users, collect and analyse diverse data about the users' interactions, behaviours, actions, and reactions including their raw feedback regarding their experiences. Using statistical analysis and data mining software, these qualitative and quantitative data are transformed into design insights and recommendations for future usability improvements. First, we survey the existing stationary, portable, and remote laboratories. We then review the current usability tools while highlighting the gap between the existing tools/labs and the UE practices. We will show how this gap can be closed via a roadmap using a computer-assisted usability engineering environment (CAUTE). A CAUTE provides a unifying user interface that exploits a process-sensitive architecture for integrating the large variety of the existing tools into the best UE practices. Beyond the technical problems, there is also a need to address research issues including determining the interest of the CAUTE approach in comparison with the current usability labs.

Keywords:

• usability testing
• testing lab
• tools
• computer-assisted usability engineering
• integration
• user acceptance tests