Abstract
Existing perceived usability questionnaires detect the appearance of usability issues rather than the underlying design generating those issues. This limits the capability of existing instruments to directly inform design recommendations. To address this problem, a usability questionnaire structured around the analytical composition of the design was created and validated. A four-stage process was followed. First, 3 usability experts refined 54 questions from highly cited usability questionnaires and structured them around 6 design dimensions. Second, 12 raters scored the questions by their relevance to assess usability. Third, questions and dimensions were then improved through exploratory and confirmatory factor analysis (N = 196) and, fourth, further enhanced through confirmatory factor analysis (N = 362). The result is DEEP, a 19-question usability questionnaire based on 5 main design dimensions (content, information architecture, navigation, layout, and visual guidance). DEEP can be used to capture detailed usability feedback that more directly relates to specific aspects of design requirements.
Acknowledgments
We sincerely thank all the study participants for their time and valuable feedback. We are also grateful to the reviewers for their insightful and constructive comments on previous versions of the manuscript. This research material is partially based on work supported by the National Science Foundation under NSF grant # 1018054.
Notes
1The Online Field Test Environment., or OFTEN, is available online in two formats: the full process (http://discern.uits.iu.edu:8670/often/Consent.php) and direct access to the first task screen (http://discern.uits.iu.edu:8670/often/Inter_1.php). The actual test website was replaced with a placeholder to protect the university's image.