Usability Requirements for Learning Management Systems in Open Distance Electronic Learning Environments: Considering Lecturers’ Views on Students’ Needs

References

• Adedoyin, O. B., & Soykan, E. (2020). Covid-19 pandemic and online learning: The challenges and opportunities. Interactive Learning Environments, 0(0), 1–13. https://doi.org/10.1080/10494820.2020.1813180
   Google Scholar
• Adhiambo, B., Okeyo, G., & Cheruiyot, W. (2017). Framework for improving usability of learning management systems by integrating pedagogical agent. International Journal of Computer Applications, 166(8), 7–16. https://doi.org/10.5120/ijca2017914087
   Google Scholar
• Ahmad, N. A. N., Hamid, N. I. M., & Lokman, A. M. (2021). Performing usability evaluation on multi-platform based application for efficiency, effectiveness and satisfaction enhancement. International Journal of Interactive Mobile Technologies, 15(10), 103–117. https://doi.org/10.3991/ijim.v15i10.20429
   Google Scholar
• Ahmad, N. A. N., & Hussaini, M. (2021). A usability testing of a higher education mobile application among postgraduate and undergraduate students. International Journal of Interactive Mobile Technologies, 15(09), 88–102. https://doi.org/10.3991/ijim.v15i09.19943
   Google Scholar
• Alghamdi, A. S., Al-badi, A. H., Alroobaea, R., & Mayhew, P. J. (2013). A comparative study of synchronous and asynchronous remote usability testing methods. International Review of Basic and Applied Sciences, 1(3), 61–97. https://www.researchgate.net/publication/261557037_A_Comparative_Study_of_Synchronous_and_Asynchronous_Remote_Usability_Testing_Methods.
   Google Scholar
• Alhadreti, O. (2021). Assessing academics’ perceptions of blackboard usability using SUS and CSUQ: A case study during the COVID-19 pandemic. International Journal of Human-Computer Interaction, 37(11), 1003–1015. https://doi.org/10.1080/10447318.2020.1861766
   Web of Science ®Google Scholar
• Alharbi, S., & Drew, S. (2014). Using the Technology Acceptance Model in understanding academics’ behavioural intention to use learning management systems. International Journal of Advanced Computer Science and Applications, 5(1), 143–155. https://doi.org/10.14569/IJACSA.2014.050120
   Google Scholar
• Ali, L, The Department of Information Technology, College of Engineering and Information Technology, University of Science and Technology of Fujairah, P.O. Box: 2202, Fujairah, United Arab Emirates. (2021). The shift to online education paradigm due to COVID-19: A study of student’s behavior in UAE universities environment. International Journal of Information and Education Technology, 11(3), 131–136. https://doi.org/10.18178/ijiet.2021.11.3.1501
   Google Scholar
• Almarashdeh, I., Elias, N. F., Sahari, N., & Zain, N. A. M. (2013). Development of an interactive learning management system for Malaysian distance learning institutions. Middle East Journal of Scientific Research, 14(11), 1471–1479. https://doi.org/10.5829/idosi.mejsr.2013.14.11.2339
   Google Scholar
• Arinto, P. B. (2016). Issues and challenges in open and distance e-learning: Perspectives from the Philippines. International Review of Research in Open and Distributed Learning, 17(2), 162–180. https://doi.org/10.19173/irrodl.v17i2.1913
   Web of Science ®Google Scholar
• Bernstein, C., & Osman, R. (2012). Graduateness as a contested idea: Navigating expectations between higher education, employers and graduates. In M. Coetzee, J. A. Botha, N. Eccles, H. Nienaber, & N. Holtzhausen (Eds.), Developing student graduateness and employability: Issues, provocations, theory and practical guidelines (pp. 45–64). Knowres Publishing.
   Google Scholar
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
   Google Scholar
• Çelik, S. (2012). Development of usability criteria for e-learning content development software. Turkish Online Journal of Distance Education, 13(2), 336–345. https://dergipark.org.tr/en/pub/tojde/issue/16900/176164
   Google Scholar
• Conley, Q., Earnshaw, Y., & Mcwatters, G. (2019). Examining course layouts in Blackboard: Using eye-tracking to evaluate usability in a learning management system. International Journal of Human–Computer Interaction, 35(20), 1–13. https://doi.org/10.1080/10447318.2019.1644841
   Google Scholar
• Dagli, G., Altinay, F., Altinay, Z., & Altinay, M. (2021). Evaluation of higher education services: Social media learning. International Journal of Information and Learning Technology, 38(1), 147–159. https://doi.org/10.1108/IJILT-03-2020-0032
   Web of Science ®Google Scholar
• De Kock, E., Van Biljon, J., & Botha, A. (2016). User experience of Academic staff in the use of a learning management system tool [Paper presentation]. SAICSIT’16 (pp. 1–10). ACM.
   Google Scholar
• Djamasbi, S, Worcester Polytechnic Institute. (2014). Eye tracking and web experience. AIS Transactions on Human-Computer Interaction, 6(2), 37–54. https://doi.org/10.17705/1thci.00060
   Google Scholar
• du Toit, M., & Bothma, C. (2009). Evaluating the usability of an academic marketing department’s website from a marketing student’s perspective. Africa, 5(1), 25–38. http://hdl.handle.net/10500/3031.
   Google Scholar
• Ertürk, A., & Önaçan, M. B. K. (2016). Usability evaluation of learning management system in a higher education Institution: A scale development study. Journal of Global Strategic Management, 2(10), 73–73. https://doi.org/10.20460/jgsm.20161024357
   Google Scholar
• Fischer, G., Lundin, J., & Lindberg, J. O. (2020). Rethinking and reinventing learning, education and collaboration in the digital age—from creating technologies to transforming cultures. The International Journal of Information and Learning Technology, 37(5), 241–252. https://doi.org/10.1108/IJILT-04-2020-0051
   Web of Science ®Google Scholar
• Freire, L. L., Arezes, P. M., & Campos, J. C. (2012). A literature review about usability evaluation methods for e-learning platforms. Work, 41(2012), 1038–1044. https://doi.org/10.3233/WOR-2012-0281-1038
   PubMedGoogle Scholar
• García-Peñalvo, F. J., Conde, M. Á., Alier Forment, M., & Casany, M. J. (2011). Opening learning management systems to personal learning environments. Journal of Universal Computer Science, 17(9), 1222–1240. https://doi.org/10.3217/jucs-017-09-1222
   Web of Science ®Google Scholar
• Hammad, M., Alnabhan, M., Doush, I. A., Alsalem, G. M., Al-Alem, F. A., & Al-Awadi, M. M. (2020). Evaluating usability and content accessibility for e-learning websites in the Middle East. International Journal of Technology and Human Interaction, 16(1), 54–62. https://doi.org/10.4018/IJTHI.2020010104
   Web of Science ®Google Scholar
• Harris, H. S., & Greer, M. (2017). Over, under, or through: Design strategies to supplement the LMS and enhance interaction in online writing courses. Communication Design Quarterly, 4(4), 46–54. https://doi.org/10.1145/3071088.3071093
   Google Scholar
• Hinderks, A., Schrepp, M., Mayo, F. J. D., Escalona, M. J., & Thomaschewski, J. (2019). Developing a UX KPI based on the user experience questionnaire. Computer Standards & Interfaces, 65, 38–44. https://doi.org/10.1016/j.csi.2019.01.007
   Web of Science ®Google Scholar
• Horton, W. (2011). e-Learning by design. John Wiley & Sons, Inc.
   Google Scholar
• Hwang, W., & Salvendy, G. (2010). Number of people required for usability evaluation: The 10 ± 2 rule. Communications of the ACM, 53(5), 130–133. https://doi.org/10.1145/1735223.1735255
   Web of Science ®Google Scholar
• ISO. (2018). 9241-11: 2018: Ergonomics of human-system interaction – part 11: Usability definitions and concepts. In International Organization for Standardization (ISO) – The British Standards Institution (pp. 1–38). https://www.iso.org/standard/63500.html.
   Google Scholar
• Jakovljevic, M., Buckley, S., & Bushney, M. (2014). Well-designed communities of practice (CoPs) in the ODeL environment: Students’perspective. The Independent Journal of Teaching and Learning, 9(1), 44–62. https://hdl.handle.net/10520/EJC161433.
   Google Scholar
• Kant, N., Prasad, K. D., & Anjali, K. (2021). Selecting an appropriate learning management system in open and distance learning: A strategic approach. Asian Association of Open Universities Journal, 16(1), 79–97. https://doi.org/10.1108/AAOUJ-09-2020-0075
   Google Scholar
• Kraleva, R., Sabani, M., & Kralev, V. (2019). An analysis of some learning management systems. International Journal on Advanced Science, Engineering and Information Technology, 9(4), 1190–1198. https://doi.org/10.18517/ijaseit.9.4.9437
   Google Scholar
• Kurosu, M. (2019). Nigel Bevan and concepts of usability, UX, and satisfaction. Journal of Usability Studies, 14(3), 156–163. https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Kurosu_May2019.pdf.
   Web of Science ®Google Scholar
• Lehong, S., Van Biljon, J., & Sanders, I. (2019). Open-distance electronic learning environments: Supervisors’ views on usability [Paper presentation]. 2019 Conference on Information Communications Technology and Society (ICTAS). https://doi.org/10.1109/ICTAS.2019.8703605
   Google Scholar
• Lewis, J. (1994). Sample sizes for usability studies: Additional considerations. Human Factors, 36(2), 368–378. https://doi.org/10.1177/001872089403600215
   PubMed Web of Science ®Google Scholar
• Lewis, J. R. (2018). Measuring perceived usability: The CSUQ, SUS, and UMUX. International Journal of Human–Computer Interaction, 34(12), 1148–1156. https://doi.org/10.1080/10447318.2017.1418805
   Web of Science ®Google Scholar
• Maboe, K. A. (2017). Use of online interactive tools in an open distance learning context: Health Studies students’ perspective. Health SA Gesondheid, 22(1), 221–227. https://doi.org/10.1016/j.hsag.2017.02.001
   Google Scholar
• Maboe, K. A., Nkosi, Z. Z., & Makoe, M. (2013). Prospects and challenges of learners on-line discussion forum interaction in an ODL (open distance learning) institution. Journal of Health Science, 1(1), 12–20. http://www.davidpublisher.com/Public/uploads/Contribute/55668683386d5.pdf.
   Google Scholar
• Maguire, M., & Delahunt, B. (2017). Doing a thematic analysis: A practical, step-by-step guide for learning and teaching scholars. AISHE-J – The All Ireland Journal of Teaching and Learning in Higher Education, 9(3), 3351–3354. http://ojs.aishe.org/index.php/aishe-j/article/view/335.
   Google Scholar
• Maphosa, C., & Bhebhe, S. (2019). Digital literacy: A must for open distance and e-learning (ODeL) students. European Journal of Education Studies, 5(10), 186–199. https://doi.org/10.5281/zenodo.2560085
   Google Scholar
• Medina-Flores, R., & Morales-Gamboa, R. (2015). Usability evaluation by experts of a learning management system. IEEE Revista Iberoamericana de Tecnologias Del Aprendizaje, 10(4), 197–203. https://doi.org/10.1109/RITA.2015.2486298
   Google Scholar
• Mehta, R., & Aguilera, E. (2020). A critical approach to humanizing pedagogies in online teaching and learning. The International Journal of Information and Learning Technology, 37(3), 109–120. https://doi.org/10.1108/IJILT-10-2019-0099
   Web of Science ®Google Scholar
• Merčun, T., & Žumer, M. (2017). Exploring the influences on pragmatic and hedonic aspects of user experience. Information Research, 22(1), 1–14. http://InformationR.net/ir/22-1/colis/colis1621.html.
   Web of Science ®Google Scholar
• Mershad, K., & Wakim, P. (2018). A learning management system enhanced with internet of things applications. Journal of Education and Learning, 7(3), 23–40. https://doi.org/10.5539/jel.v7n3p23
   Google Scholar
• Minge, M., & Thüring, M. (2018). Hedonic and pragmatic halo effects at early stages of user experience. International Journal of Human-Computer Studies, 109, 13–25. https://doi.org/10.1016/j.ijhcs.2017.07.007
   Web of Science ®Google Scholar
• Mtebe, J. S. (2015). Learning management system success: Increasing learning management system usage in higher education in sub-Saharan Africa. International Journal of Education and Development Using Information and Communication Technology, 11(2), 51–64. https://www.learntechlib.org/p/151846/.
   Google Scholar
• Mtebe, J. S., & Kissaka, M. M. (2015). Heuristics for evaluating usability of learning management systems in Africa [Paper presentation]. 2015 IST-Africa Conference. https://doi.org/10.1109/ISTAFRICA.2015.7190521
   Google Scholar
• Nakamura, W., Oliviera, E., & Conte, T. (2017). Usability and user experience evaluation of learning management systems – a systematic mapping study [Paper presentation]. Proceedings of the 19th International Conference on Enterprise Information Systems (ICEIS 2017). https://doi.org/10.5220/0006363100970108
   Google Scholar
• Ngubane-Mokiwa, S. (2017). Implications of the University of South Africa’s (UNISA) shift to open distance e-learning on teacher education. Australian Journal of Teacher Education, 42(9), 111–124. https://doi.org/10.14221/ajte.2017v42n9.7
   Web of Science ®Google Scholar
• Ngubane-Mokiwa, S., & Letseka, M. (2015). Shift from open distance learning to open distance e-learning. In M. Letseka (Ed.), Open distance learning (ODL) in South Africa (pp. 1–14) Nova Publishers.
   Google Scholar
• Nyang’or, J., De Villiers, R., & Ssemugabi, S. (2013). A framework for usability evaluation of an offline e-learning tutorial and its application in usability testing. In J. Herrington, A. Couros, & V. Irvine (Eds.), Proceedings of EdMedia 2013-World Conference on Educational Media and Technology. https://www.learntechlib.org/primary/p/112097/.
   Google Scholar
• Olaniran, S. O., Duma, M. A. N., & Nzima, D. R. (2017). Assessing the utilization level of e-learning resources among ODL-based pre-service teacher trainees. Electronic Journal of E-Learning, 15(5), 384–394. https://files.eric.ed.gov/fulltext/EJ1157949.pdf.
   Web of Science ®Google Scholar
• Oliveira, P. C., Cunha, C. J. C., & Nakayama, M. K, Universidade Federal de Santa Catarina (UFSC). (2016). Learning management systems (LMS) and e-learning management: An integrative review and research agenda. Journal of Information Systems and Technology Management, 13(2), 157–180. https://doi.org/10.4301/s1807-17752016000200001
   Google Scholar
• Pan, Y., Coleman, L., Manago, S., & Goodof, D. (2019). Effects of social media usage on social integration of university students. International Journal of Technology in Teaching and Learning, 15(1), 1–17. https://doi.org/10.37120/ijttl.2019.15.1.01
   Google Scholar
• Pangestu, H., & Karsen, M. (2016). Evaluation of usability in online learning [Paper presentation]. Proceedings of 2016 International Conference on Information Management and Technology, ICIMTech, 2016. https://doi.org/10.1109/ICIMTech.2016.7930342
   Google Scholar
• Preece, J., Rogers, Y., & Sharp, H. (2002). Interaction design: Beyond human-computer interaction. John Wiley & Sons Inc.
   Google Scholar
• Roto, V., Law, E., Vermeeren, A., Hoonhout, J. (2011). User experience white paper: Binging clarity to the concept of user experience. http://www.allaboutux.org/files/UX-WhitePaper.pdf.
   Google Scholar
• Ruth, S. (2018). Faculty opposition to online learning: Challenges and opportunities. Journal of Technology in Teaching and Learning, 14(1), 12–23. https://doi.org/10.37120/ijttl.2018.14.1.02
   Google Scholar
• Sabri, N. M., Mohamed, H., Soon, G. Y., & Yusof, Y. H. M. (2013). A quantitative approach in the usability evaluation of a courseware. Journal of Next Generation Information Technology, 4(2), 29–38. https://doi.org/10.4156/jnit.vol4.issue2.4
   Google Scholar
• Sarstedt, M., Bengart, P., Shaltoni, A. M., & Lehmann, S. (2018). The use of sampling methods in advertising research: A gap between theory and practice. International Journal of Advertising, 37(4), 650–663. https://doi.org/10.1080/02650487.2017.1348329
   Web of Science ®Google Scholar
• Sharp, H., Preece, J., & Rogers, Y. (2019). 4 Cognitive aspects. Interaction design: Beyond human-computer interaction (5th ed., pp.101–134). Wiley.
   Google Scholar
• Somyürek, S., Brusilovsky, P., Çebi, A., Akhüseyinoğlu, K., & Güyer, T. (2020). How do students perceive their own and their peers’ progress in e-learning? The International Journal of Information and Learning Technology, 38(1), 49–74. https://doi.org/10.1108/IJILT-05-2020-0073
   Web of Science ®Google Scholar
• Ssemugabi, S., & De Villiers, M. R. (2010). Effectiveness of heuristic evaluation in usability evaluation of e-learning applications in higher education. South African Computer Journal, 45(2010), 26–39. https://doi.org/10.18489/sacj.v45i0.37
   Google Scholar
• Taherdoost, H. (2016). Sampling methods in research methodology: How to choose a sampling technique for research. SSRN Electronic Journal, 5(2), 18–27. https://doi.org/10.2139/ssrn.3205035
   Google Scholar
• Tullis, T., & Albert, B. (2013). Measuring the user experience: Collecting, analysing and presenting usability metrics (2nd ed.). Morgan Kaufmann.
   Google Scholar
• Usability Evaluation Website. (2012). Usability evaluation methods. https://www.usabilityhome.com/.
   Google Scholar
• Valsamidis, S., Kazanidis, I., Kontogiannis, S., & Karakos, A. (2012). An approach for LMS assessment. International Journal of Technology Enhanced Learning, 4(3/4), 265–283. https://doi.org/10.1504/IJTEL.2012.051544
   Google Scholar
• Virzi, R. A. (1992). Refining the test phase of usability evaluation: How many subjects is enough? Human Factors: The Journal of the Human Factors and Ergonomics Society, 34(4), 457–468. https://doi.org/10.1177/001872089203400407
   Web of Science ®Google Scholar
• Wang, J., Antonenko, P., Celepkolu, M., Jimenez, Y., Fieldman, E., & Fieldman, A. (2019). Exploring relationships between eye tracking and traditional usability testing data. International Journal of Human–Computer Interaction, 35(6), 483–494. https://doi.org/10.1080/10447318.2018.1464776
   Web of Science ®Google Scholar