Measuring Perceived Usability: SUS, UMUX, and CSUQ Ratings for Four Everyday Products

References

• Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24, 574–594. doi:10.1080/10447310802205776
   Web of Science ®Google Scholar
• Bangor, A., Kortum, P. T., & Miller, J. T. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies., 4(3), 114–123.
   Google Scholar
• Berkman, M. I., & Karahoca, D. (2016). Re-assessing the Usability Metric for User Experience (UMUX) scale. Journal of Usability Studies, 11(3), 89–109.
   Web of Science ®Google Scholar
• Borsci, S., Federici, S., Gnaldi, M., Bacci, S., & Bartolucci, F. (2015). Assessing user satisfaction in the era of user experience: An exploratory analysis of SUS, UMUX and UMUX-LITE. International Journal of Human-Computer Interaction., 31, 484–495. doi:10.1080/10447318.2015.1064648
   Web of Science ®Google Scholar
• Borsci, S., Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processes, 10, 193–197. doi:10.1007/s10339-009-0268-9
   PubMed Web of Science ®Google Scholar
• Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. Jordan, B. Thomas, & B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
   Google Scholar
• Brooke, J. (2013). SUS: A retrospective. Journal of Usability Studies, 8(2), 29–40.
   Google Scholar
• Chin, J. P., Diehl, V. A., & Norman, K. L. (1988). Development of an instrument measuring user satisfaction of the human–Computer interface. In E. Soloway, D. Frye, & S. B. Sheppard (Eds.), Proceedings of CHI 1988 (pp. 213–218). Washington, DC: Association for Computing Machinery.
   Google Scholar
• Davis, D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319–339. doi:10.2307/249008
   Web of Science ®Google Scholar
• Diefenbach, S., Kolb, N., & Hassenzahl, M. (2014). The “Hedonic” in human-computer interaction: History, contributions, and future research directions. In Proceedings of the 2014 Conference on Designing Interactive Systems - DIS 14 (pp. 305–314). New York, NY: Association for Computing Machinery.
   Google Scholar
• Erdinç, O., & Lewis, J. R. (2013). Psychometric evaluation of the T-CSUQ: The Turkish version of the Computer System Usability Questionnaire. International Journal of Human-Computer Interaction, 29(5), 319–326. doi:10.1080/10447318.2012.711702
   Web of Science ®Google Scholar
• Finstad, K. (2006). The System Usability Scale and non-native English speakers. Journal of Usability Studies, 1(4), 185–188.
   Google Scholar
• Finstad, K. (2010). The usability metric for user experience. Interacting with Computers, 22, 323–327. doi:10.1016/j.intcom.2010.04.004
   Web of Science ®Google Scholar
• Finstad, K. (2013). Response to commentaries on “The Usability Metric for User Experience”. Interacting with Computers, 25, 327–330. doi:10.1093/iwc/iwt005
   Web of Science ®Google Scholar
• Grier, R. A., Bangor, A., Kortum, P. T., & Peres, S. C. (2013). The System Usability Scale: Beyond standard usability testing. In Proceedings of the Human Factors and Ergonomics Society (pp. 187–191). Santa Monica, CA: Human Factors and Ergonomics Society.
   Google Scholar
• ISO. (1998). Ergonomic requirements for office work with visual display terminals (VDTs), Part 11, Guidance on usability (ISO 9241-11:1998E). Geneva, Switzerland: Author.
   Google Scholar
• Kirakowski, J., & Dillon, A. (1988). The Computer User Satisfaction Inventory (CUSI): Manual and scoring key. Cork, Ireland: Human Factors Research Group, University College of Cork.
   Google Scholar
• Kortum, P., & Bangor, A. (2013). Usability ratings for everyday products measured with the System Usability Scale. International Journal of Human-Computer Interaction, 29, 67–76. doi:10.1080/10447318.2012.681221
   Web of Science ®Google Scholar
• Kortum, P., & Sorber, M. (2015). Measuring the usability of mobile applications for phones and tablets. International Journal of Human-Computer Interaction, 31(8), 518–529. doi:10.1080/10447318.2015.1064658
   Web of Science ®Google Scholar
• Lewis, J. R. (1990). Psychometric evaluation of a post-study system usability questionnaire: The PSSUQ (Tech. Report 54.535). Boca Raton, FL: International Business Machines Corp.
   Google Scholar
• Lewis, J. R. (1992). Psychometric evaluation of the Post-Study System Usability Questionnaire: The PSSUQ. In Proceedings of the Human Factors Society 36th Annual Meeting (pp. 1259–1263). Santa Monica, CA: Human Factors Society.
   Google Scholar
• Lewis, J. R. (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 57–78. doi:10.1080/10447319509526110
   Web of Science ®Google Scholar
• Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14, 463–488.
   Web of Science ®Google Scholar
• Lewis, J. R. (2012). Usability testing. In G. Salvendy (Ed.), Handbook of human factors and ergonomics (4th ed., pp. 1267–1312). New York, NY: John Wiley.
   Google Scholar
• Lewis, J. R. (2014). Usability: Lessons learned… and yet to be learned. International Journal of Human-Computer Interaction, 30, 663–684. doi:10.1080/10447318.2014.930311
   Web of Science ®Google Scholar
• Lewis, J. R. (2018a). Measuring perceived usability: The CSUQ, SUS, and UMUX. International Journal of Human-Computer Interaction, 34, 1148–1156. doi:10.1080/10447318.2017.1418805
   Web of Science ®Google Scholar
• Lewis, J. R. (2018b). The System Usability Scale: Past, present, and future. International Journal of Human-Computer Interaction, 34, 577–590. doi:10.1080/10447318.2018.1455307
   Web of Science ®Google Scholar
• Lewis, J. R., Brown, J., & Mayes, D. K. (2015). Psychometric evaluation of the EMO and the SUS in the context of a large-sample unmoderated usability study. International Journal of Human-Computer Interaction, 31(8), 545–553. doi:10.1080/10447318.2015.1064665
   Web of Science ®Google Scholar
• Lewis, J. R., & Sauro, J. (2009). The factor structure of the System Usability Scale. In M. Kurosu (Ed.), Human centered design (pp. 94–103). Heidelberg, Germany: Springer-Verlag.
   Google Scholar
• Lewis, J. R., & Sauro, J. (2017). Revisiting the factor structure of the System Usability Scale. Journal of Usability Studies, 12(4), 183–192.
   Web of Science ®Google Scholar
• Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013). UMUX-LITE—When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: Association for Computing Machinery.
   Google Scholar
• Lewis, J. R., Utesch, B. S., & Maher, D. E. (2015). Measuring perceived usability: The SUS, UMUX-LITE, and AltUsability. International Journal of Human-Computer Interaction, 31(8), 496–505. doi:10.1080/10447318.2015.1064654
   Web of Science ®Google Scholar
• Nunnally, J. C. (1978). Psychometric theory. New York, NY: McGraw-Hill.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of CHI 2009 (pp. 1609–1618). Boston, MA: Association for Computing Machinery.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2011). When designing usability questionnaires, does it hurt to be positive? In Proceedings of CHI 2011 (pp. 2215–2223). Vancouver, Canada: ACM.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2016). Quantifying the user experience: Practical statistics for user research (2nd ed.). Cambridge, MA: Morgan Kaufmann.
   Google Scholar
• Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350–353. doi:10.1037/1040-3590.8.4.350
   Web of Science ®Google Scholar
• Tullis, T. S., & Albert, B. (2008). Measuring the user experience: Collecting, analyzing, and presenting usability metrics. Burlington, MA: Morgan Kaufmann.
   Google Scholar
• Tullis, T. S., & Stetson, J. N. (2004). A comparison of questionnaires for assessing website usability. Paper presented at the Usability Professionals Association Annual Conference. Minneapolis, MN: UPA. Retrieved September 13, 2017, from https://www.researchgate.net/publication/228609327_A_Comparison_of_Questionnaires_for_Assessing_Website_Usability.
   Google Scholar
• Whiteside, J., Bennett, J., & Holtzblatt, K. (1988). Usability engineering: Our experience and evolution. In M. Helander (Ed.), Handbook of human-computer interaction (pp. 791–817). Amsterdam, Netherlands: North-Holland.
   Google Scholar