UNSCALE: A Fuzzy-based Multi-criteria Usability Evaluation Framework for Measuring and Evaluating Library Websites

ABSTRACT

Usability evaluation of websites has been one of the most important activities to determine user acceptance and to enrich the overall quality of the website. This research, drawing upon above concept, investigates the issues of website usability and proposes a fuzzy-based framework for measuring and evaluating the usability of websites, particularly library websites. The findings of the usability criteria elicitation, expert reviews, survey, and statistical analysis resulted in a comprehensive list of seven usability dimensions along with 20 measuring items which formed the basis of the evaluation framework abbreviate UNSCALE. The inputs of experts in the related field were used to probe weights of key dimensions and measuring items with the motive of examining their level of contribution to the usability index system. The study employed fuzzy theories along with the extent analysis, fuzzy analytic hierarchy process method with the expectation of scrutinizing the relative weightings. The framework was developed including eight cyclical steps for measuring and evaluating website usability by employing the fuzzy comprehensive evaluation method. It can be used to evaluate the overall usability score and also scores regarding each evaluation dimension. The framework was tested for its applicability and practicality on university library websites in Sri Lanka, a developing country with fast-growing internet accessibility. The findings of this research indicate that the proposed framework is useful for librarians in developing more useful library websites. On the other hand, it will provide vital insights to better appraise the outcomes of website usability for the scholars and researchers.

KEYWORDS:

• Website usability
• Library website
• Fuzzy AHP
• Fuzzy comprehensive evaluation
• Usability evaluation
• User satisfaction
• Human–computer interaction

ACKNOWLEDGEMENT

The authors would like to convey their sincere gratitude to all those who have significantly contributed towards the completion of this research paper.

SUPPLEMENTAL DATA

Supplemental data for this article can be accessed at https://doi.org/10.1080/02564602.2018.1498032

ORCID

Kokila Harshan Ramanayaka http://orcid.org/0000-0002-6784-1686

Additional information

Notes on contributors

Kokila Harshan Ramanayaka

Kokila Harshan Ramanayaka received the BSc degree from University of Ruhuna, Sri Lanka in 2001 and MSc degree in library and information sciences from University of Kelaniya, Sri Lanka in 2014. Currently, he is studying for his PhD degree in the School of Computer Science and Technology, Wuhan University of Technology, P R China. His main research directions include web mining, human-computer interaction, and software engineering.

Xianqiao Chen

Xianqiao Chen, PhD, is currently a professor in the School of Computer Science and Technology and the director in the Institute of Internet of Things at the Wuhan University of Technology, P.R. China. His main research directions include image processing, pattern recognition, simulation, communications and control, internet of things, GIS and software engineering. Email: [email protected].

Bing Shi

Bing Shi, PhD, associate professor in the School of Computer Science and Technology, Wuhan University of Technology, P.R. China. His main research directions include artificial intelligence, multi-agent systems, software engineering and so on. Email: [email protected].