Abstract
This article presents the findings of a systematic review of perceived usability of educational technology systems. The research was conducted after studying, organizing, and analyzing the results of 104 research papers evaluating perceived usability of educational technologies using the System Usability Scale (SUS). The results were organized on the basis of (a) the usability score obtained when using the SUS, (b) the type of educational technology used, (c) the subject being learned, (d) the level of education, (e) the type of participant, (f) the age, and (g) the number of participants in each survey. Statistical analysis in all surveys (N = 170) demonstrated a good level of usability but with some issues (M = 70.09, SD = 12.98). The categories of Internet platforms (M = 66.25, SD = 12.42), university websites (M = 63.82, SD = 16.52) and affective tutoring systems (ATS) (M = 68.87, SD = 7.30) seem to have a good usability level according to SUS, preceded by mobile applications (M = 73.62, SD = 13.49) and multimedia (M = 76.43, SD = 9.45). Moreover, SUS scores were not found to be significantly related with participants’ age (r = 0.017, p = 0.931, ns), stage of education (p = 0.539, ns), or the type of participants (p = 0.639, ns). Furthermore, the subject being learned (p = 0.038, s) and the number of participants in each survey (r = −0.259, p = 0.001, s) seem to relate to the obtained SUS scores. Α slight, statistically insignificant improvement is noted in the perceived usability over the years (p = 0.182, ns). The findings of this review will serve as a useful reference guide for educational technology designers, practitioners, and teachers.
Additional information
Notes on contributors
Prokopia Vlachogianni
Prokopia Vlachogianni is a PhD student in the Department of Educational Sciences and Early Childhood Education at the University of Patras in Greece. She holds a Master's degree in Natural Sciences, Mathematics and ICT didactics from the University of Patras, a Master's degree in Special Education from the University of Macedonia, and a Bachelor's degree in Primary Education from Aristotle University in Thessaloniki, Greece. Her main research interests are on Educational Technology, e-learning, Usability, Personality Traits and Learning Analytics.
Nikolaos Tselios
Nikolaos Tselios is an Associate Professor in the Department of Educational Sciences and Early Childhood Education at the University of Patras in Greece. He holds a PhD (2002) in Usability Engineering of Educational Software and a Diploma (1997) from the Electrical and Computer Engineering Department, University of Patras, Greece. His main research interests are Educational Technology, Human Computer Interaction, user interface design and evaluation of educational software, usability evaluation methodologies, e-learning, user/student modelling and intelligent user interfaces. He has over 110 publications in international and national journals and conferences and 2 patents, with at least 2400 known citations and h-index = 24.