2,724
Views
79
CrossRef citations to date
0
Altmetric
Original Articles

Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience

, , , &

Keep up to date with the latest research on this topic with citation updates for this article.

Read on this site (24)

Walter T. Nakamura, Leonardo C. Marques, David Redmiles, Elaine H. T. de Oliveira & Tayana Conte. (2023) Investigating the Influence of Different Factors on the UX Evaluation of a Mobile Application. International Journal of Human–Computer Interaction 39:20, pages 3948-3968.
Read now
Hattie Wilczewski, Evan Mulfinger, Frederick L. Oswald & Philip Kortum. (2023) The Role of Personality and Cognitive Ability in the Measurement of Usability. International Journal of Human–Computer Interaction 0:0, pages 1-8.
Read now
Diana Castilla, Irene Jaen, Carlos Suso-Ribera, Gemma Garcia-Soriano, Irene Zaragoza, Juani Breton-Lopez, Adriana Mira, Amanda Diaz-Garcia & Azucena Garcia-Palacios. (2023) Psychometric Properties of the Spanish Full and Short Forms of the System Usability Scale (SUS): Detecting the Effect of Negatively Worded Items. International Journal of Human–Computer Interaction 0:0, pages 1-7.
Read now
Mehmet İlker Berkman & Şafak Şahin. (2022) Exploring Usability as a Formative Construct through UMUX: A Multi-Language Approach for Turkish Adaptation. International Journal of Human–Computer Interaction 0:0, pages 1-25.
Read now
Yuhui Wang, Yiyang Zhang & Yanying Chen. (2022) A Longitudinal Study of Children’s Perceived Usability: Methodology and Measurements. International Journal of Human–Computer Interaction 0:0, pages 1-16.
Read now
Yonghan Zhu, Marijn Janssen, Rui Wang & Yang Liu. (2022) It Is Me, Chatbot: Working to Address the COVID-19 Outbreak-Related Mental Health Issues in China. User Experience, Satisfaction, and Influencing Factors. International Journal of Human–Computer Interaction 38:12, pages 1182-1194.
Read now
Yuhui Wang & Hairong Wang. (2022) Measuring Perceived Usability in Chinese Questionnaires: mTAM, SUS, and UMUX. International Journal of Human–Computer Interaction 38:11, pages 1052-1063.
Read now
Kennedy Edson Silva de Souza, Igor Leonardo de Aviz, Harold Dias de Mello, Karla Figueiredo, Marley Maria Bernardes Rebuzzi Vellasco, Fernando Augusto Ribeiro Costa & Marcos César da Rocha Seruffo. (2022) An Evaluation Framework for User Experience Using Eye Tracking, Mouse Tracking, Keyboard Input, and Artificial Intelligence: A Case Study. International Journal of Human–Computer Interaction 38:7, pages 646-660.
Read now
Yuhui Wang, Jing Chai & Tian Lei. (2021) Chinese UMUX: Cross-Cultural Adaptation for Perceived Usability Measurement. International Journal of Human–Computer Interaction 37:16, pages 1538-1550.
Read now
Nicholas Clark, Matthew Dabkowski, Patrick J. Driscoll, Dereck Kennedy, Ian Kloo & Heidy Shi. (2021) Empirical Decision Rules for Improving the Uncertainty Reporting of Small Sample System Usability Scale Scores. International Journal of Human–Computer Interaction 37:13, pages 1191-1206.
Read now
Obead Alhadreti. (2021) Assessing Academics’ Perceptions of Blackboard Usability Using SUS and CSUQ: A Case Study during the COVID-19 Pandemic. International Journal of Human–Computer Interaction 37:11, pages 1003-1015.
Read now
Meiyuzi Gao, Philip Kortum & Frederick L. Oswald. (2020) Multi-Language Toolkit for the System Usability Scale. International Journal of Human–Computer Interaction 36:20, pages 1883-1901.
Read now
Stefano Federici, Maria Laura de Filippis, Maria Laura Mele, Simone Borsci, Marco Bracalenti, Giancarlo Gaudino, Antonello Cocco, Massimo Amendola & Emilio Simonetti. (2020) Inside pandora’s box: a systematic review of the assessment of the perceived quality of chatbots for people with disabilities or special needs. Disability and Rehabilitation: Assistive Technology 15:7, pages 832-837.
Read now
Urška Lah, James R. Lewis & Boštjan Šumak. (2020) Perceived Usability and the Modified Technology Acceptance Model. International Journal of Human–Computer Interaction 36:13, pages 1216-1230.
Read now
Khalid S. Al-Tahat. (2020) An Arabic Adaptation of the Usability Metric for User Experience (UMUX). International Journal of Human–Computer Interaction 36:11, pages 1050-1055.
Read now
Yuhui Wang, Tian Lei & Xinxiong Liu. (2020) Chinese System Usability Scale: Translation, Revision, Psychological Measurement. International Journal of Human–Computer Interaction 36:10, pages 953-963.
Read now
James R. Lewis. (2019) Measuring Perceived Usability: SUS, UMUX, and CSUQ Ratings for Four Everyday Products. International Journal of Human–Computer Interaction 35:15, pages 1404-1419.
Read now
Simone Borsci, Stefano Federici, Alessio Malizia & Maria Laura De Filippis. (2019) Shaking the usability tree: why usability is not a dead end, and a constructive way forward. Behaviour & Information Technology 38:5, pages 519-532.
Read now
James R. Lewis. (2018) Measuring Perceived Usability: The CSUQ, SUS, and UMUX. International Journal of Human–Computer Interaction 34:12, pages 1148-1156.
Read now
Yi-Sheng Wang. (2018) Addiction by Design: Using Netnography for User Experiences in Female Online Gambling Game. International Journal of Human–Computer Interaction 34:8, pages 774-785.
Read now
James R. Lewis. (2018) The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction 34:7, pages 577-590.
Read now
Philip Kortum & Frederick L. Oswald. (2018) The Impact of Personality on the Subjective Assessment of Usability. International Journal of Human–Computer Interaction 34:2, pages 177-186.
Read now
Simone Borsci, Ijeoma Uchegbu, Peter Buckle, Zhifang Ni, Simon Walne & George B. Hanna. (2018) Designing medical technology for resilience: integrating health economics and human factors approaches. Expert Review of Medical Devices 15:1, pages 15-26.
Read now
Mehmet İlker Berkman, Dilek Karahoca & Adem Karahoca. (2018) A Measurement and Structural Model for Usability Evaluation of Shared Workspace Groupware. International Journal of Human–Computer Interaction 34:1, pages 35-56.
Read now

Articles from other publishers (55)

Álvaro Saavedra, Raquel Chocarro, Mónica Cortiñas & Natalia Rubio. (2023) Impact of process and outcome quality on intention for continued use of voice assistants. Spanish Journal of Marketing - ESIC.
Crossref
Juergen Baumgartner, Andreas Sonderegger & Juergen Sauer. (2023) Questionnaire experience of the pictorial usability inventory (PUI) – a comparison of pictorial and hybrid usability scales. International Journal of Human-Computer Studies 179, pages 103116.
Crossref
Simone Borsci, Elisa Prati, Alessio Malizia, Martin Schmettow, Alan Chamberlain & Stefano Federici. (2023) Ciao AI: the Italian adaptation and validation of the Chatbot Usability Scale. Personal and Ubiquitous Computing.
Crossref
Simone Borsci, Martin Schmettow, Alessio Malizia, Alan Chamberlain & Frank van der Velde. (2022) A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation. Personal and Ubiquitous Computing 27:2, pages 317-330.
Crossref
Kristen Shear, Hannah Rice, Pamela M. Garabedian, Ragnhildur Bjarnadottir, Nancy Lathum, Ann L. Horgas, Christopher A. Harle, Patricia C. Dykes & Robert Lucero. (2023) Usability Testing of an Interoperable Computerized Clinical Decision Support Tool for Fall Risk Management in Primary Care. Applied Clinical Informatics 14:02, pages 212-226.
Crossref
Stefano Federici, Giovanni Bifolchi, Marco Bracalenti, Alessandro Ansani, Agnese Napoletti, Rosa Lanzillotti, Giuseppe Desolda, Maria Laura Mele, Simone Borsci, Maria Laura de Filippis, Giancarlo Gaudino, Massimo Amendola, Antonello Cocco, Aldo Doria & Emilio Simonetti. 2023. Human-Computer Interaction. Human-Computer Interaction 64 79 .
Francesco Sovrano & Fabio Vitali. (2022) Generating User-Centred Explanations via Illocutionary Question Answering: From Philosophy to Interfaces. ACM Transactions on Interactive Intelligent Systems 12:4, pages 1-32.
Crossref
Alexandra Wright-Hughes, Thomas A. Willis, Stephanie Wilson, Ana Weller, Fabiana Lorencatto, Mohamed Althaf, Valentine Seymour, Amanda J. Farrin, Jillian Francis, Jamie Brehaut, Noah Ivers, Sarah L. Alderson, Benjamin C. Brown, Richard G. Feltbower, Chris P. Gale, Simon J. Stanworth, Suzanne Hartley, Heather Colquhoun, Justin Presseau, Rebecca Walwyn & Robbie Foy. (2022) A randomised fractional factorial screening experiment to predict effective features of audit and feedback. Implementation Science 17:1.
Crossref
Sang-Hyeak Yoon, Ga-Yun Park & Hee-Woong Kim. (2022) Unraveling the relationship between the dimensions of user experience and user satisfaction: A smart speaker case. Technology in Society 71, pages 102067.
Crossref
Mohd Kamal Othman, Altynai Nogoibaeva, Lai San Leong & Mohamad Hardyman Barawi. (2021) Usability evaluation of a virtual reality smartphone app for a living museum. Universal Access in the Information Society 21:4, pages 995-1012.
Crossref
Kitti Koonsanit, Daiki Hiruma, Vibol Yem & Nobuyuki Nishiuchi. (2022) Using Random Ordering in User Experience Testing to Predict Final User Satisfaction. Informatics 9:4, pages 85.
Crossref
Kalpana Shankhwar, Tung-Jui Chuang, Yao-Yang Tsai & Shana Smith. (2022) A visuo-haptic extended reality–based training system for hands-on manual metal arc welding training. The International Journal of Advanced Manufacturing Technology 121:1-2, pages 249-265.
Crossref
Thomas A Willis, Alexandra Wright-Hughes, Ana Weller, Sarah L Alderson, Stephanie Wilson, Rebecca Walwyn, Su Wood, Fabiana Lorencatto, Amanda Farrin, Suzanne Hartley, Jillian Francis, Valentine Seymour, Jamie Brehaut, Heather Colquhoun, Jeremy Grimshaw, Noah Ivers, Richard Feltbower, Justin Keen, Benjamin C Brown, Justin Presseau, Chris P Gale, Simon J Stanworth & Robbie Foy. (2022) Interventions to optimise the outputs of national clinical audits to improve the quality of health care: a multi-method study including RCT. Health and Social Care Delivery Research 10:15, pages 1-284.
Crossref
A.A. Gede Yudhi Paramartha, Ketut Agus Seputra, Fauzan Azima, Dio Pramudia Putra, Eva Dwi & Kadek Yota Ernanda Aryanto. (2022) Usability Evaluation of an Interactive Educational Mobile Application. Usability Evaluation of an Interactive Educational Mobile Application.
Simone Borsci, Alessio Malizia, Martin Schmettow, Frank van der Velde, Gunay Tariverdiyeva, Divyaa Balaji & Alan Chamberlain. (2021) The Chatbot Usability Scale: the Design and Pilot of a Usability Scale for Interaction with AI-Based Conversational Agents. Personal and Ubiquitous Computing 26:1, pages 95-119.
Crossref
Marcia J. Scherer & Stefano Federici. 2022. HCI International 2022 Posters. HCI International 2022 Posters 597 602 .
Márcio Martins, Francisco Godinho, Pedro Gonçalves & Ramiro Gonçalves. 2022. Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies. Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies 59 78 .
Elisa Prati, Valeria Villani, Margherita Peruzzini & Lorenzo Sabattini. (2021) An Approach Based on VR to Design Industrial Human-Robot Collaborative Workstations. Applied Sciences 11:24, pages 11773.
Crossref
Aysar Qasrawi, Stephanny VicunaPolo & Radwan Qasrawi. (2021) User Experience and Performance Evaluation of Palestinian Universities Websites. User Experience and Performance Evaluation of Palestinian Universities Websites.
James R. Lewis & Jeff Sauro. 2021. HANDBOOK OF HUMAN FACTORS AND ERGONOMICS. HANDBOOK OF HUMAN FACTORS AND ERGONOMICS 972 1015 .
Fangmin Cheng, Suihuai Yu, Shengfeng Qin, Jianjie Chu & Jian Chen. (2021) User experience evaluation method based on online product reviews. Journal of Intelligent & Fuzzy Systems 41:1, pages 1791-1805.
Crossref
Khalid Krayz Allah, Nor Azman Ismail & Hisham Elrobaa. (2021) Empathy Map Instrument for Analyzing Human-Computer Interaction in Using Web Search UI by Elderly Users. Empathy Map Instrument for Analyzing Human-Computer Interaction in Using Web Search UI by Elderly Users.
Maryam Ahmadi, mahdieh karimi & Tourandokht Baluchnejad Mojarad. (2021) Developing a Dashboard for Alzheimer's Disease Registry System. Journal of Health Administration 24:2, pages 70-82.
Crossref
Walter Takashi Nakamura, Iftekhar Ahmed, David Redmiles, Edson Oliveira, David Fernandes, Elaine H. T. de Oliveira & Tayana Conte. (2021) Are UX Evaluation Methods Providing the Same Big Picture?. Sensors 21:10, pages 3480.
Crossref
Yuhui Wang. (2021) Gaps Between Continuous Measurement Methods: A Longitudinal Study of Perceived Usability. Interacting with Computers 33:3, pages 223-237.
Crossref
Emanuele Marino, Loris Barbieri, Biagio Colacino, Anna Kum Fleri & Fabio Bruno. (2021) An Augmented Reality inspection tool to support workers in Industry 4.0 environments. Computers in Industry 127, pages 103412.
Crossref
Laia Albo & Davinia Hernandez-Leo. (2021) edCrumble, a Data-Enriched Visual Authoring Design Tool for Blended Learning. IEEE Transactions on Learning Technologies 14:1, pages 55-68.
Crossref
W Wahiddin, A R Syulistyo & M N Shoumi. (2021) Usability measurement for Sistem Proyek Akhir Manajemen Rekayasa Konstruksi (SIPROK-MRK) measured with the system usability scale. IOP Conference Series: Materials Science and Engineering 1073:1, pages 012015.
Crossref
Alexandre Loureiro Faria, Anne Carolinne Bezerra Perdigão, Edgar Marçal, Marcos Kubrusly, Raquel Autran Coelho Peixoto & Arnaldo Aires Peixoto Junior. (2021) OSCE 3D: a virtual clinical skills assessment tool for coronavirus pandemic times. Revista Brasileira de Educação Médica 45:2.
Crossref
Alexandre Loureiro Faria, Anne Carolinne Bezerra Perdigão, Edgar Marçal, Marcos Kubrusly, Raquel Autran Coelho Peixoto & Arnaldo Aires Peixoto Junior. (2021) OSCE 3D: uma ferramenta virtual de avaliação de habilidades clínicas para tempos de pandemia de coronavírus. Revista Brasileira de Educação Médica 45:2.
Crossref
Steffen Moritz, Christoph Schlüter & Benjamin Wagner vom Berg. 2021. Advances in Visual Computing. Advances in Visual Computing 500 511 .
Mayke Mol, Anneke van Schaik, Els Dozeman, Jeroen Ruwaard, Christiaan Vis, David D. Ebert, Anne Etzelmueller, Kim Mathiasen, Bárbara Moles, Teresa Mora, Claus D. Pedersen, Mette Maria Skjøth, Luisa Peleteiro Pensado, Jordi Piera-Jimenez, Didem Gokcay, Burçin Ünlü Ince, Alessio Russi, Ylenia Sacco, Enrico Zanalda, Ane Fullaondo Zabala, Heleen Riper & Jan H. Smit. (2020) Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis. BMC Psychiatry 20:1.
Crossref
Dilawar Shah Zwakman, Debajyoti Pal, Tuul Triyason & Vajirasak Vanijja. (2020) Usability of Voice-based Intelligent Personal Assistants. Usability of Voice-based Intelligent Personal Assistants.
Sanja Pekovic & Sylvie Rolland. (2020) Recipes for achieving customer loyalty: A qualitative comparative analysis of the dimensions of customer experience. Journal of Retailing and Consumer Services 56, pages 102171.
Crossref
Dimas Setiawan, Suluh Langgeng Wicaksono & Naufal Rafianto. (2020) Evaluasi Usability e-Learning Moodle dan Google Classroom menggunakan SUS Quisionnare. JAMI: Jurnal Ahli Muda Indonesia 1:1, pages 55-64.
Crossref
Simone Borsci, Peter Buckle & Simon Walne. (2020) Is the LITE version of the usability metric for user experience (UMUX-LITE) a reliable tool to support rapid assessment of new healthcare technology?. Applied Ergonomics 84, pages 103007.
Crossref
Maria Laura de Filippis, Stefano Federici, Maria Laura Mele, Simone Borsci, Marco Bracalenti, Giancarlo Gaudino, Antonello Cocco, Massimo Amendola & Emilio Simonetti. 2020. Computers Helping People with Special Needs. Computers Helping People with Special Needs 250 257 .
Giuseppe Fico, Liss Hernanzez, Jorge Cancela, Arianna Dagliati, Lucia Sacchi, Antonio Martinez-Millana, Jorge Posada, Lidia Manero, Jose Verdú, Andrea Facchinetti, Manuel Ottaviano, Konstantia Zarkogianni, Konstantina Nikita, Leif Groop, Rafael Gabriel-Sanchez, Luca Chiovato, Vicente Traver, Juan Francisco Merino-Torres, Claudio Cobelli, Riccardo Bellazzi & Maria Teresa Arredondo. (2019) What do healthcare professionals need to turn risk models for type 2 diabetes into usable computerized clinical decision support systems? Lessons learned from the MOSAIC project. BMC Medical Informatics and Decision Making 19:1.
Crossref
Ronggang Zhou, Xiaorui Wang, Yuhan Shi, Renqian Zhang, Leyuan Zhang & Haiyan Guo. (2018) Measuring e-service quality and its importance to customer satisfaction and loyalty: an empirical study in a telecom setting. Electronic Commerce Research 19:3, pages 477-499.
Crossref
Richelle A. C. M. Olde Keizer, Lex van Velsen, Mathieu Moncharmont, Brigitte Riche, Nadir Ammour, Susanna Del Signore, Gianluca Zia, Hermie Hermens & Aurèle N’Dja. (2019) Using socially assistive robots for monitoring and preventing frailty among older adults: a study on usability and user experience challenges. Health and Technology 9:4, pages 595-605.
Crossref
Francisco J. García-Peñalvo, Andrea Vázquez-Ingelmo, Alicia García-Holgado & Antonio M. Seoane-Pardo. (2019) Analyzing the usability of the WYRED Platform with undergraduate students to improve its features. Universal Access in the Information Society 18:3, pages 455-468.
Crossref
Wang Yuhui, Li Chunfu, Lei Tian & Huang Qin. (2019) Longitudinal Study on Retrospective Assessment of Perceived Usability: A New Method and Perspectives. Interacting with Computers 31:4, pages 393-412.
Crossref
Ji Yeong Soh, Se Uk Lee, Inpyo Lee, Ki Sang Yoon, Changho Song, Nam Hun Kim, Tae Sung Sohn, Jae Moon Bae, Dong Kyung Chang & Won Chul Cha. (2019) A Mobile Phone–Based Self-Monitoring Tool for Perioperative Gastric Cancer Patients With Incentive Spirometer: Randomized Controlled Trial. JMIR mHealth and uHealth 7:2, pages e12204.
Crossref
Laura R. Rabbitt, Jacob A. Hasselgren, Cynthia Cook & Yevgeniy B. Sirotin. (2018) Measuring Satisfaction With Standard Survey Instruments and Single-Button Responses on Kiosks. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 62:1, pages 1429-1433.
Crossref
Jakob Grue Simonsen. 2018. The Wiley Handbook of Human Computer Interaction. The Wiley Handbook of Human Computer Interaction 191 206 .
Stefano Federici, Maria Laura Mele, Rosa Lanzilotti, Giuseppe Desolda, Marco Bracalenti, Fabio Meloni, Giancarlo Gaudino, Antonello Cocco & Massimo Amendola. 2018. Human-Computer Interaction. Theories, Methods, and Human Issues. Human-Computer Interaction. Theories, Methods, and Human Issues 55 67 .
Sabina Baraković & Lea Skorin-Kapov. (2017) Survey of research on Quality of Experience modelling for web browsing. Quality and User Experience 2:1.
Crossref
Simone Borsci, Peter Buckle, Jeremy Huddy, Zenia Alaestante, Zhifang Ni & George B. Hanna. (2017) Usability study of pH strips for nasogastric tube placement. PLOS ONE 12:11, pages e0189013.
Crossref
Julian Hamm, Arthur Money & Anita Atwal. (2017) Fall Prevention Self-Assessments Via Mobile 3D Visualization Technologies: Community Dwelling Older Adults’ Perceptions of Opportunities and Challenges. JMIR Human Factors 4:2, pages e15.
Crossref
Remko van Lieshout, Martijn F. Pisters, Benedicte Vanwanseele, Rob A. de Bie, Eveline J. Wouters & Mirelle J. Stukstette. (2016) Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient’s and Physical Therapist’s Perspective. PLOS ONE 11:10, pages e0165199.
Crossref
Simone Borsci, Glyn Lawson, Bhavna Jha, Mark Burges & Davide Salanitri. (2016) Effectiveness of a multidevice 3D virtual environment application to train car service maintenance procedures. Virtual Reality 20:1, pages 41-55.
Crossref
Rakefet Ackerman, Avi Parush, Fareda Nassar & Avraham Shtub. (2016) Metacognition and system usability: Incorporating metacognitive research paradigm into usability testing. Computers in Human Behavior 54, pages 101-113.
Crossref
Jeff Sauro & James R. Lewis. 2016. Quantifying the User Experience. Quantifying the User Experience 185 248 .
Ming-I Brandon Lin, Ruei-Hong Hong, Jer-Hao Chang & Xin-Min Ke. (2015) Usage Position and Virtual Keyboard Design Affect Upper-Body Kinematics, Discomfort, and Usability during Prolonged Tablet Typing. PLOS ONE 10:12, pages e0143585.
Crossref
Cristina Cachero Cachero, Santiago Meliá & Sergio Luján-Mora. (2022) Impact of Gender as a Confounding Factor in Perceived Usability: A Family of Observational Studies. SSRN Electronic Journal.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.