This article describes recent research in subjective usability measurement at IBM, focused on evaluating the psychometric properties of questionnaires designed for use in scenario‐based usability evaluation. The questionnaires address evaluation at both a global overall system level and at a more detailed scenario level. The primary goals of this article are to (a) discuss the psychometric characteristics of IBM questionnaires that measure user satisfaction with computer system usability, and (b) provide the questionnaires, with administration and scoring instructions. For scenario‐level measurement, the 3‐item After‐Scenario Questionnaire (ASQ) has excellent internal consistency, with coefficient alphas across a set of scenarios ranging from .90 to .96. For more global assessment, the Post‐Study System Usability Questionnaire (PSSUQ) also has excellent internal consistency, with an overall coefficient alpha of .97. Preliminary principal factor analysis of 48 PSSUQ questionnaires suggested the presence of three factors named, after varimax rotation, System Usefulness, Information Quality, and Interface Quality, with corresponding coefficient alphas of .96, .91, and .91. Evaluation of 377 PSSUQ questionnaires (modified to allow mailing to respondents in their offices and referred to as the Computer System Usability Questionnaire, or CSUQ) confirmed the structure of the preliminary principal factor analysis. Consequently, usability practitioners can use these questionnaires to help them measure users’ satisfaction with the usability of computer systems in the context of scenario‐based usability studies.
International Journal of Human–Computer Interaction
Volume 7, 1995 - Issue 1
![Sample our Engineering & Technology journals, sign in here to start your access, latest two full volumes FREE to you for 14 days]({"type":"image" , "src" : "/sda/5933/TOC-Subject-Sample-2021-Engineering-Tech.jpg"})
Reprints and Corporate Permissions
Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?
To request a reprint or corporate permissions for this article, please click on the relevant link below:
Academic Permissions
Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?
Obtain permissions instantly via Rightslink by clicking on the button below:
If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.
Related Research Data
the ASQ
Source:
Association for Computing Machinery (ACM)
An Empirical Evaluation of the System Usability Scale
Source:
Informa UK Limited
Capitalizing on new forms of academic library’s intellectual assets: a new library mobile application proposition
Source:
Springer Science and Business Media LLC
Are integrated portfolio systems the answer? An evaluation of a web-based portfolio system to improve preservice teachers’ reflective thinking skills
Source:
Springer Science and Business Media LLC
Development and Usability Evaluation of a Desktop Software Application for Pain Assessment in Infants
Source:
Informa UK Limited
Unidimensional Scaling
Source:
SAGE Publications, Inc.
Family history assessment for colorectal cancer (CRC) risk analysis - comparison of diagram- and questionnaire-based web interfaces.
Source:
Springer Nature
Measuring e-service quality and its importance to customer satisfaction and loyalty: an empirical study in a telecom setting
Source:
Springer Science and Business Media LLC
Anesthesiology Control Tower-Feasibility Assessment to Support Translation (ACTFAST): Mixed-Methods Study of a Novel Telemedicine-Based Support System for the Operating Room.
Source:
JMIR Publications Inc.
Using augmented virtuality for remote collaboration
Source:
MIT Press - Journals
IVAN: An Interactive Herlofson’s Nomogram Visualizer for Local Weather Forecast
Source:
Multidisciplinary Digital Publishing Institute
An integrated framework for design perception and brand equity
Source:
Springer Science and Business Media LLC
LOOKER: a mobile, personalized recommender system in the tourism domain based on social media user-generated content
Source:
Springer Science and Business Media LLC
An E-Learning Adaptation of an Evidence-Based Media Literacy Curriculum to Prevent Youth Substance Use in Community Groups: Development and Feasibility of REAL Media.
Source:
JMIR Publications Inc.
Virtual Object Manipulation by Combining Touch and Head Interactions for Mobile Augmented Reality
Source:
MDPI AG
The System Usability Scale: Past, Present, and Future
Source:
Informa UK Limited
Measurements of computer satisfaction, literacy, and aptitudes: A review
Source:
Informa UK Limited
Improved Memory Elicitation in Virtual Reality: New Experimental Results and Insights
Source:
Springer International Publishing
An Augmented Reality-Based Application Relying on the Use of Tangible User Interfaces for English Teaching to Children Between 10 and 12 Years
Source:
Springer International Publishing
A Brain-Computer Interface Based Cognitive Training System for Healthy Elderly: A Randomized Control Pilot Study for Usability and Preliminary Efficacy
Source:
Public Library of Science (PLoS)
Impact of an Electronic App on Resident Responses to Simulated In-Flight Medical Emergencies: Randomized Controlled Trial.
Source:
JMIR Publications Inc.
The Remote Food Photography Method and SmartIntake App for the Assessment of Alcohol Use in Young Adults: Feasibility Study and Comparison to Standard Assessment Methodology
Source:
JMIR Publications Inc.
Measuring Perceived Usability: SUS, UMUX, and CSUQ Ratings for Four Everyday Products
Source:
Informa UK Limited
Meta-analysis of correlations among usability measures
Source:
Association for Computing Machinery (ACM)
Health Student Using Google Classroom: Satisfaction Analysis
Source:
Springer International Publishing
Study on Usefulness of Smartphone Applications for the People with Parkinson’s
Source:
Springer International Publishing
Changes in perceived usability and aesthetics with repetitive use in the first use session
Source:
Wiley
Evaluating a handheld decision support device in pediatric intensive care settings.
Source:
Oxford University Press (OUP)
Usability of an Atrial Fibrillation Anticoagulation Decision-Support Tool:
Source:
SAGE Publications
Expressive and classical aesthetics: two distinct concepts with highly similar effect patterns in user–artefact interaction
Source:
Informa UK Limited
The Influence of Product Aesthetics and User State in Usability Testing
Source:
Informa UK Limited
A Comparison of Direct and Indirect Multi-touch Input for Large Surfaces
Source:
Springer Berlin Heidelberg
Designing and Deploying 3D Collaborative Games in Education
Source:
IGI Global
An Investigation of the Usability of Image-based CAPTCHAs
Source:
SAGE Publications
Learning the harmonic analysis: is visualization an effective approach?
Source:
Springer Science and Business Media LLC
A Decision Support Tool for Assessing the Impact of Climate Change on Multiple Ecosystem Services
Source:
MDPI
Mobile health app usability and quality rating scales: a systematic review.
Source:
Taylor & Francis
The Usability Metric for User Experience
Source:
Oxford University Press (OUP)
Towards a Merged Interaction Design Pattern Focused on University Prospective Students: Results from a Pretest–Posttest Intervention Study
Source:
Springer International Publishing
Using Virtual Reality Tools for Teaching Foreign Languages
Source:
Springer International Publishing
BIM-Based AR Maintenance System (BARMS) as an Intelligent Instruction Platform for Complex Plumbing Facilities
Source:
MDPI AG
OPPCAT: Ontology population from tabular data:
Source:
SAGE Publications
The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale
Source:
Informa UK Limited
Introduction: Current Issues in Usability Evaluation
Source:
Informa UK Limited
Usability: Adoption, Measurement, Value.
Source:
SAGE Publications
The Impact of Cognitive Style on User Preference Based on Usability and Aesthetics for Computer-Based Systems
Source:
Informa UK Limited
Cardiorespiratory Improvements Achieved by American College of Sports Medicine's Exercise Prescription Implemented on a Mobile App.
Source:
JMIR Publications Inc.
Considering context : the role of mental workload and operator control in users' perceptions of usability
Source:
Informa UK Limited
Verification of a Portable Motion Tracking System for Remote Management of Physical Rehabilitation of the Knee.
Source:
MDPI AG
An Investigation of the Effectiveness of Navigational Aids in a Virtual Environment
Source:
SAGE Publications
Health Figures: An Open Source JavaScript Library for Health Data Visualization
Source:
Springer Nature
A Randomized Feasibility Trial of a Novel, Integrative, and Intensive Virtual Rehabilitation Program for Service Members Post-Acquired Brain Injury.
Source:
Oxford University Press (OUP)
Usability measures in mobile-based augmented reality learning applications: a systematic review
Source:
MDPI AG
Utilizing a user-centered approach to develop and assess pharmacogenomic clinical decision support for thiopurine methyltransferase
Source:
Springer Science and Business Media LLC
Facilitating the Development of IoT Applications in Smart City Platforms
Source:
Springer International Publishing
Usability Study of Mainstream Wearable Fitness Devices: Feature Analysis and System Usability Scale Evaluation
Source:
JMIR Publications Inc.
Using User-Feedback to Develop a Website: MyT1DHope, for Parents of Children with T1D.
Source:
Informa UK Limited
Participant Experience Using GPS Devices in a Food Environment and Nutrition Study
Source:
Taylor & Francis
The Usability Construct: A Dead End?
Source:
Informa UK Limited
The Factor Structure of the System Usability Scale
Source:
Springer Berlin Heidelberg
A Web-Based Treatment Decision Support Tool for Patients With Advanced Knee Arthritis: Evaluation of User Interface and Content Design.
Source:
JMIR Publications Inc.
A Shared Decision-Making Tool to Prevent Substance Abuse: Protocol for a Randomized Controlled Trial.
Source:
JMIR Publications Inc.
Gesture-Based Interaction for Virtual Reality Environments Through User-Defined Commands
Source:
Springer International Publishing
Evaluating data discoverability, accessibility, and reusability from a stakeholders’ perspective
Source:
Emerald
A Slovene Translation of the System Usability Scale: The SUS-SI
Source:
Informa UK Limited
Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity:
Source:
SAGE Publications
Pilot feasibility of an mHealth system for conducting ecological momentary assessment of mood-related symptoms following traumatic brain injury.
Source:
Informa UK Limited
AugmentedBook: A Collaborative E-Learning Augmented Reality Platform
Source:
Springer International Publishing
A web-based intervention to increase weight loss treatment initiation: results of a cluster randomized feasibility and acceptability trial.
Source:
Oxford University Press (OUP)
Cross-Media Document Linking and Navigation
Source:
Association for Computing Machinery (ACM)
Images of Usability
Source:
Informa UK Limited
Measuring the Usability of Mobile Applications for Phones and Tablets
Source:
Informa UK Limited
Systematic Review Protocol to Assess the Effectiveness of Usability Questionnaires in mHealth App Studies
Source:
(:unav)
Unconscious Physiological Effects of Search Latency on Users and Their Click Behaviour
Source:
Association for Computing Machinery (ACM)
Improvement of usability in user interfaces for massive data analysis: an empirical study
Source:
Springer Science and Business Media LLC
Virtual Environment for Remote Control of UGVs Using a Haptic Device
Source:
Springer Singapore
HealthMpowerment.org: feasibility and acceptability of delivering an internet intervention to young Black men who have sex with men.
Source:
Informa UK Limited
Examining the Effectiveness of Gamification in Human Computation
Source:
Informa UK Limited
A Mobile App for Measuring and Comparing Questionnaire-Based Usability Assessments
Source:
Association for Computing Machinery
Context relevance assessment and exploitation in mobile recommender systems
Source:
Springer Science and Business Media LLC
Stairstep recognition and counting in a serious Game for increasing users' physical activity
Source:
Springer Science and Business Media LLC
User-friendly web mapping: lessons from a citizen science website
Source:
Informa UK Limited
An Investigation of the Usability Issues of a Family Health History Compiling Application
Source:
SAGE Publications
Sensory navigation guide for visually impaired sea kayakers
Source:
HAL CCSD
Analyse des Umgangs älterer Internetnutzer mit unerwarteten Situationen
Source:
Springer Science and Business Media LLC
A System for the Measurement of the Subjective Visual Vertical using a Virtual Reality Device
Source:
Springer Science and Business Media LLC
Determining the Number of Common Factors in Factor Analysis: A Review and Program
Source:
SAGE Publications
A Framework to Design, Develop, and Evaluate Immersive and Collaborative Serious Games in Cultural Heritage
Source:
Association for Computing Machinery (ACM)
Psychometric Evaluation of the Post-Study System Usability Questionnaire: The PSSUQ:
Source:
SAGE Publications
A comparison of usability factors of four mobile devices for accessing healthcare information by adolescents
Source:
Georg Thieme Verlag KG
Using a Serious Game to Assess Spatial Memory in Children and Adults
Source:
Springer International Publishing
A Web-Based Training Resource for Therapists to Deliver an Evidence-Based Exercise Program for Rheumatoid Arthritis of the Hand (iSARAH): Design, Development, and Usability Testing
Source:
JMIR Publications Inc.
Experienced mental workload, perception of usability, their interaction and impact on task performance.
Source:
Public Library of Science (PLoS)
"Kiss myAsthma": Using a participatory design approach to develop a self-management app with young people with asthma.
Source:
Taylor & Francis
Smartphone-based self-monitoring in bipolar disorder: evaluation of usability and feasibility of two systems.
Source:
Springer Science and Business Media LLC
Collaborative immersive authoring tool for real-time creation of multisensory VR experiences
Source:
Springer Science and Business Media LLC
A framework for evaluating usability of clinical monitoring technology.
Source:
Springer Science and Business Media LLC
An augmented reality tool to detect and annotate design variations in an Industry 4.0 approach
Source:
Springer Science and Business Media LLC
ESISTE: Supporting Inclusion of Students with Special Needs in Mainstream Classrooms
Source:
Springer International Publishing
Usability Ratings for Everyday Products Measured With the System Usability Scale
Source:
Informa UK Limited
Location-aware music recommendation
Source:
Springer Science and Business Media LLC
The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study
Source:
JMIR Publications Inc.
A case study for block-based linked data generation: Recipes as jigsaw puzzles:
Source:
SAGE Publications Ltd
Measuring Perceived Usability: The CSUQ, SUS, and UMUX
Source:
Informa UK Limited
Exploring Relationships Between Eye Tracking and Traditional Usability Testing Data
Source:
Informa UK Limited
Gesture Elicitation and Usability Testing for an Armband Interacting with Netflix and Spotify
Source:
Álvaro Rocha, Carlos Ferrás, Manolo Paredes
Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
Source:
JMIR Publications
Does It Matter?
Source:
SAGE Publications
Integrating BIM and Panorama to Create a Semi-Augmented-Reality Experience of a Construction Site
Source:
Informa UK Limited
A generic model for evaluating the usability of learning management systems
Source:
Association for Computing Machinery (ACM)
Is Web-Based Computer-Aided Translation (CAT) Software Usable for Blind Translators?
Source:
Springer (Cham)
Pre-testing of Polish Translation of System Usability Scale (SUS)
Source:
Springer International Publishing
The Internet-Based Cognitive Assessment Tool: System Design and Feasibility Study.
Source:
JMIR Publications Inc.
Communicability of traditional interfaces VS chatbots in healthcare and smart home domains
Source:
Informa UK Limited
eyetracking based experiential transcoding: a study with mobile users
Source:
Association for Computing Machinery (ACM)
The Impact of Personality on the Subjective Assessment of Usability
Source:
Informa UK Limited
How to Help Older Adults Move the Focus on a Smart TV? Exploring the Effects of Arrow Hints and Element Size Consistency
Source:
Informa UK Limited
Understanding user preferences based on usability and aesthetics before and after actual use
Source:
Oxford University Press (OUP)
The HOMER UIMS for dual user interface development: Fusing visual and non-visual interactions
Source:
Oxford University Press (OUP)
Linking provided by
