The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale

REFERENCES

• Andre, A., & Wickens, C. (1995). When users want what’s not best for them. Ergonomics in Design: The Quarterly of Human Factors Applications, 3(4), 10–14.
   Google Scholar
• Bangor, A., Kortum, P., & Miller, J. T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human-Computer Interaction, 6, 574–594.
   Web of Science ®Google Scholar
• Borsci, S., Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processing, 10, 193–197.
   PubMed Web of Science ®Google Scholar
• Brooke, J. (1996). SUS: A quick and dirty usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & I. L. McClelland ( Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
   Google Scholar
• Card, S. K., Moran, T. P., & Newell, A. (1980). The keystroke-level model for user performance time with interactive systems. Communications of the ACM, 23, 396–410.
   Web of Science ®Google Scholar
• Choy, J. Y., Lam, S. Y., & Lee, T. C. (2012). Service quality, customer satisfaction and behavioral intentions: review of the literature and conceptual model development. International Journal of Academic Research, 4(3), 5–17.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
   Google Scholar
• Everett, S. P., Byrne, M. D., & Greene, K. K. (2006). Measuring the usability of paper ballots: Efficiency, effectiveness, and satisfaction. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50, 2547–2551.
   Google Scholar
• Frøkjær, E., Hertzum, M., & Hornbæk, K. (2000). Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? Proceedings of the SIGCHI conference on Human factors in computing systems, 345–352.
   Google Scholar
• Giese, J. L., & Cote, J. A. (2000). Defining consumer satisfaction. Academy of Marketing Science Review, 1, 1–22.
   Google Scholar
• Goodwin, N. C. (1987) Functionality and Usability. Communications of the ACM, 30, 229–233.
   Web of Science ®Google Scholar
• Horan, T. A., Abhichandani, T., & Rayalu, R. (2006). Assessing user satisfaction of e-government services: Development and testing of quality-in-use satisfaction with advanced traveler information systems (ATIS). System Sciences, 2006. HICSS’06. Proceedings of the 39th Annual Hawaii International Conference, 4, 83b.
   Google Scholar
• Hornbæk, J., & Law, E. L (2007). Meta-Analysis of correlations among usability measures. Proceedings of the ACM Conference on Human Factors in Computing Systems CHI 2007, 617–626.
   Google Scholar
• ISO. (1998). Ergonomic requirements for office work with visual display terminal (VDT’s)–Part 11: Guidance on usability (ISO 9241-11(E)) . Geneva, Switzerland.
   Google Scholar
• Jones, A. A. (2012). The Impact of website navigational usability characteristics on user frustration and performance metrics. (Unpublished doctoral dissertation). Athens, Ohio: Ohio University.
   Google Scholar
• Kieras, D., & John, B. (1994). The GOMS family of analysis techniques: Tools for design and evaluation (CMU-HCII-94-106). Pittsburgh, PA: Carnegie-Mellon University.
   Google Scholar
• Kirakowski, J., & Corbett, M. (1993). SUMI: The Software Measurement Inventory. British Journal of Educational Technology, 24, 210–212.
   Web of Science ®Google Scholar
• Kirakowski, J., Claridge, N., & Whitehand, R. (1998). Human centered measures of success in web design. Proceedings of the 4th Conference on Human Factors and the Web. Retrieved from http://www.research.att.com/conf/hfweb/proceedings/kirakowski/index.html
   Google Scholar
• Kortum, P. & Acemyan, C.Z. (2013). How low can you go? Is the System Usability Scale range restricted? Journal of Usability Studies, 9, 14–24.
   Google Scholar
• Kortum, P., & Bangor, A. (2013). Usability ratings for everyday products measured with the System Usability Scale (SUS). International Journal of Human–Computer Interaction, 29, 1–10.
   Web of Science ®Google Scholar
• Kortum, P., & Johnson, M. (2013). The relationship between levels of user experience with a product and perceived system usability. Proceedings of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
   Google Scholar
• Lewis, J. (1995). IBM Computer Satisfaction Questionnaires: Psychometric evaluation and instructions for use. International Journal of Human–Computer Interaction, 7, 57–78.
   Web of Science ®Google Scholar
• Lewis, J. R., & Sauro, J. (2009). The factor structure of the System Usability Scale. Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009 (94–103). San Diego, CA: HCI International.
   Google Scholar
• Lund, A. (2001). Measuring usability with the USE Questionnaire. Usability Interface: The usability SIG newsletter of the Society for Technical Communications, 8. Retrieved from http://www.stcsig.org/usability/newsletter/0110_measuring_with_use.html
   Google Scholar
• Nakamichi, N., Shima, K., Sakai, M., & Matsumoto, K. I. (2006). Detecting low usability web pages using quantitative data of users’ behavior. In Proceedings of the 28th International Conference on Software Engineering, 569–576.
   Google Scholar
• Nielsen, J. (2001). Success rate: The simplest usability metric. Usability Alertbox. http://www.nngroup.com/articles/success-rate-the-simplest-usability-metric/
   Google Scholar
• Nielsen, J., & Levy, J. (1994). Measuring usability: Preference vs. performance. Communications of the ACM, 37(4), 66–75.
   Web of Science ®Google Scholar
• Peterson, R. A., & Wilson, W. R. (1992). Measuring customer satisfaction: Fact and artifact. Journal of the Academy of Marketing Science, 20, 61–71.
   Google Scholar
• Sauro, J. (2011). A practical guide to the System Usability Scale. Denver, CO: CreateSpace.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1609–1618.
   Google Scholar
• Sonderegger, A., & Sauer, J. (2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied Ergonomics 41, 403–410.
   PubMed Web of Science ®Google Scholar
• Vatrapu, R., & Pérez-Quiñones, M. A. (2006). Culture and usability evaluation: The effects of culture in structured interviews. Journal of Usability Studies, 1, 156–170.
   Google Scholar
• Venkatesh, V., & Morris, M. G. (2000). Why don’t men ever stop to ask for directions? Gender, social influence, and their role in technology acceptance and usage behavior. MIS Quarterly, 24, 115–139.
   Web of Science ®Google Scholar
• Yeo, A. (1998). Cultural effects in usability assessment. CHI 98 Conference Summary on Human Factors in Computing Systems, 74–75.
   Google Scholar