Psychometric Evaluation of the EMO and the SUS in the Context of a Large-Sample Unmoderated Usability Study

REFERENCES

• Albert, B., Tullis, T., & Tedesco, D. (2010). Beyond the usability lab: Conducting large-scale online user experience studies. Burlington, MA: Morgan Kaufmann.
   Google Scholar
• Andreasen, M. S., Nielsen, H. V., Schrøder, S. O., & Stage, J. (2007). What happened to remote usability testing? An empirical study of three methods. In Proceedings of CHI 2007 (pp. 1405–1414). San Jose, CA: Association for Computing Machinery.
   Google Scholar
• Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24, 574–594.
   Web of Science ®Google Scholar
• Borsci, S., Federici, S., Gnaldi, M., Bacci, S., & Bartolucci, F. (this issue). Assessing user satisfaction in the era of user experience: An exploratory analysis of SUS, UMUX and UMUX-LITE. International Journal of Human–Computer Interaction, XX, xx–xx.
   Google Scholar
• Borsci, S., Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processes, 10, 193–197.
   PubMed Web of Science ®Google Scholar
• Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. Jordan, B. Thomas, & B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
   Google Scholar
• Kortum, P., & Peres, S. C. (2014). The relationship between system effectiveness and subjective usability scores using the System Usability Scale. International Journal of Human–Computer Interaction, 30, 575–584.
   Web of Science ®Google Scholar
• Lewis, J. R. (2012). Usability testing. In G. Salvendy (Ed.), Handbook of human factors and ergonomics (pp. 1267–1312). New York, NY: Wiley.
   Google Scholar
• Lewis, J. R. (2014). Usability: Lessons learned … and yet to be learned. International Journal of Human–Computer Interaction, 30, 663–684.
   Web of Science ®Google Scholar
• Lewis, J. R., & Mayes, D. K. (2014). Development and psychometric evaluation of the Emotional Metric Outcomes (EMO) questionnaire. International Journal of Human–Computer Interaction, 30, 685–702.
   Web of Science ®Google Scholar
• Lewis, J. R., & Sauro, J. (2009). The factor structure of the System Usability Scale. In M. Kurosu (Ed.), Human centered design (pp. 94–103). Heidelberg, Germany: Springer-Verlag.
   Google Scholar
• Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013). UMUX-LITE—When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: Association for Computing Machinery.
   Google Scholar
• McFadden, E., Hager, D. R., Elie, C. J., & Blackwell, J. M. (2002). Remote usability evaluation: Overview and case studies. International Journal of Human–Computer Interaction, 14, 489–502.
   Web of Science ®Google Scholar
• Nunnally, J. C. (1978). Psychometric theory. New York, NY: McGraw-Hill.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of CHI 2009 (pp. 1609–1618). Boston, MA: Association for Computing Machinery.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2011). When designing usability questionnaires, does it hurt to be positive? In Proceedings of CHI 2011 (pp. 2215–2223). Vancouver, Canada: Association for Computing Machinery.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2012). Quantifying the user experience: Practical statistics for user research. Waltham, MA: Morgan Kaufmann.
   Google Scholar
• Tullis, T., Fleischman, S., McNulty, M., Cianchette, C., & Bergel, M. (2002). An empirical comparison of lab and remote usability testing of web sites. In Proceedings of the Usability Professionals Association (pp. 1–8). Chicago, IL: Usability Professionals Association.
   Google Scholar
• West, R., & Lehman, K. R. (2006). Automated summative usability studies: An empirical evaluation. In Proceedings of CHI 2006 (pp. 631–639). Montreal, Canada: Association for Computing Machinery.
   Google Scholar
• Zviran, M., Glezer, C., & Avni, I. (2006). User satisfaction from commercial web sites: The effect of design and use. Information Management, 43, 157–178.
   Google Scholar