6,177
Views
28
CrossRef citations to date
0
Altmetric
Articles

Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review

& ORCID Icon
Pages 392-409 | Received 10 Aug 2020, Accepted 19 Dec 2020, Published online: 23 Feb 2021
 

Abstract

This article presents the findings of a systematic review of perceived usability of educational technology systems. The research was conducted after studying, organizing, and analyzing the results of 104 research papers evaluating perceived usability of educational technologies using the System Usability Scale (SUS). The results were organized on the basis of (a) the usability score obtained when using the SUS, (b) the type of educational technology used, (c) the subject being learned, (d) the level of education, (e) the type of participant, (f) the age, and (g) the number of participants in each survey. Statistical analysis in all surveys (N = 170) demonstrated a good level of usability but with some issues (M = 70.09, SD = 12.98). The categories of Internet platforms (M = 66.25, SD = 12.42), university websites (M = 63.82, SD = 16.52) and affective tutoring systems (ATS) (M = 68.87, SD = 7.30) seem to have a good usability level according to SUS, preceded by mobile applications (M = 73.62, SD = 13.49) and multimedia (M = 76.43, SD = 9.45). Moreover, SUS scores were not found to be significantly related with participants’ age (r = 0.017, p = 0.931, ns), stage of education (p = 0.539, ns), or the type of participants (p = 0.639, ns). Furthermore, the subject being learned (p = 0.038, s) and the number of participants in each survey (r = −0.259, p = 0.001, s) seem to relate to the obtained SUS scores. Α slight, statistically insignificant improvement is noted in the perceived usability over the years (p = 0.182, ns). The findings of this review will serve as a useful reference guide for educational technology designers, practitioners, and teachers.

Additional information

Notes on contributors

Prokopia Vlachogianni

Prokopia Vlachogianni is a PhD student in the Department of Educational Sciences and Early Childhood Education at the University of Patras in Greece. She holds a Master's degree in Natural Sciences, Mathematics and ICT didactics from the University of Patras, a Master's degree in Special Education from the University of Macedonia, and a Bachelor's degree in Primary Education from Aristotle University in Thessaloniki, Greece. Her main research interests are on Educational Technology, e-learning, Usability, Personality Traits and Learning Analytics.

Nikolaos Tselios

Nikolaos Tselios is an Associate Professor in the Department of Educational Sciences and Early Childhood Education at the University of Patras in Greece. He holds a PhD (2002) in Usability Engineering of Educational Software and a Diploma (1997) from the Electrical and Computer Engineering Department, University of Patras, Greece. His main research interests are Educational Technology, Human Computer Interaction, user interface design and evaluation of educational software, usability evaluation methodologies, e-learning, user/student modelling and intelligent user interfaces. He has over 110 publications in international and national journals and conferences and 2 patents, with at least 2400 known citations and h-index = 24.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.