ABSTRACT
This research continued previous investigation of the relationships among measures of perceived usability: the System Usability Scale (SUS), three metrics derived from the Usability Metric for User Experience (UMUX), and the Computer System Usability Questionnaire (CSUQ), this time with ratings of four everyday products (Excel, Word, Amazon, and Gmail). SUS ratings of these products were generally consistent with previous reports. Significant differences in SUS means across studies could be due to differences in frequency of use, with implications for using these data as usability benchmarks. Correspondence among the various measures of perceived usability was also consistent with previous research. Considering frequency of use, mean differences ranged from -2.0 to 1.8 (average shift in Sauro-Lewis grade range from -0.6 to 0.8). When SUS scores were above average, the range restriction of the UMUX-LITEr led to relatively large discrepancies with SUS, suggesting it might not always be better than unadjusted UMUXLITE.
Acknowledgments
Many thanks to members of the IBM User Experience Panel who participated in this study.
Additional information
Notes on contributors
James R. Lewis
James R. Lewis is a senior human factors engineer at IBM, currently focusing on the design/evaluation of conversational applications. He has published influential papers in the areas of usability testing and measurement, including the books Practical Speech User Interface Design and (with Jeff Sauro) Quantifying the User Experience.