UNSCALE: A Fuzzy-based Multi-criteria Usability Evaluation Framework for Measuring and Evaluating Library Websites

REFERENCES

• L. Vaughan and M. Thelwall, “A modeling approach to uncover hyperlink patterns: The case of Canadian universities,” Inf. Process. Manag., Vol. 41, no. 2, pp. 347–59, 2005.
   Web of Science ®Google Scholar
• P. Shadpour, B. Teimourpour, and R. Asadi, “Webometrics-based analysis and ranking of Iranian hospital websites,” Int J Hosp Res, Vol. 2, no. 2, pp. 77–84, 2013.
   Google Scholar
• Y. Lee and K. A. Kozar, “Understanding of website usability: Specifying and measuring constructs and their relationships,” Decis. Support Syst., Vol. 52, no. 2, pp. 450–63, 2012.
   Web of Science ®Google Scholar
• J. Nielsen, “Usability 101: Introduction to Usability,” 2012. [Online]. Available: https://www.nngroup.com/articles/usability-101-introduction-to-usability/.
   Google Scholar
• S. A. Becker and F. E. Mottay, “A global perspective on web site usability,” IEEE Softw., Vol. 18, no. 1, pp. 54–61, 2001.
   Web of Science ®Google Scholar
• R. Nagpal, D. Mehrotra, P. Kumar Bhatia, and A. Sharma, “Rank university websites using fuzzy AHP and fuzzy TOPSIS approach on usability,” Int. J. Inf. Eng. Electron. Bus., Vol. 7, no. 1, pp. 29–36, 2015.
   Google Scholar
• P. Booth, An Introduction to Human Computer Interaction. London: Lawrence Erlbaum Associates, 1989.
   Google Scholar
• J. Nielsen, “Report From a 1994 Web Usability Study,” Nielsen Norman Group, 1994. [Online]. Available: https://www.nngroup.com/articles/1994-web-usability-report/. [Accessed: 10-Nov-2016].
   Google Scholar
• S. Roy, P. K. Pattnaik, and R. Mall, “Quality assurance of academic websites using usability testing: an experimental study with AHP,” Int. J. Syst. Assur. Eng. Manag., Vol. 8, no. 1, pp. 1–11, 2017.
   Web of Science ®Google Scholar
• R. Nagpal, D. Mehrotra, P. K. Bhatia, and A. Sharma, “FAHP approach to rank educational websites on usability,” Int. J. Comput. Digit. Syst., Vol. 4, no. 4, pp. 251–60, 2015.
   Google Scholar
• A. Sivaji, M. R. Abdullah, A. G. Downe, and W. F. W. Ahmad, “Hybrid Usability Methodology: Integrating Heuristic Evaluation with Laboratory Testing across the Software Development Lifecycle,” in 2013 10th International Conference on Information Technology: New Generations, 2013, pp. 375–83.
   Google Scholar
• C. W. Chang, C. R. Wu, and H. L. Lin, “Integrating fuzzy theory and hierarchy concepts to evaluate software quality,” Softw. Qual. J., Vol. 16, no. 2, pp. 263–76, 2008.
   Web of Science ®Google Scholar
• M. Sadeghi, M. ali Rashidzadeh, and M. ali Soukhakian, “Using analytic network process in a group decision-making for supplier selection,” Informatica, Vol. 23, no. 4, pp. 621–43, 2012.
   Web of Science ®Google Scholar
• J.-F. Chen, H.-N. Hsieh, and Q. H. Do, “Evaluating teaching performance based on fuzzy AHP and comprehensive evaluation approach,” Appl. Soft Comput., Vol. 28, pp. 100–8, 2015.
   Web of Science ®Google Scholar
• L. Mikhailov and P. Tsvetinov, “Evaluation of services using a fuzzy analytic hierarchy process,” Appl. Soft Comput. J., Vol. 5, no. 1, pp. 23–33, 2004.
   Web of Science ®Google Scholar
• Z. Güngör, G. Serhadlıoğlu, and S. E. Kesen, “A fuzzy AHP approach to personnel selection problem,” Appl. Soft Comput., Vol. 9, no. 2, pp. 641–6, 2009.
   Web of Science ®Google Scholar
• A. Pandey and A. Kumar, “Commentary on “Evaluating the criteria for human resource for science and technology (HRST) based on an integrated fuzzy AHP and fuzzy DEMATEL approach,” Appl. Soft Comput. J., Vol. 51, no. 1, pp. 351–2, 2017.
   Google Scholar
• O. Taylan, A. O. Bafail, R. M. S. Abdulaal, and M. R. Kabli, “Construction projects selection and risk assessment by fuzzy AHP and fuzzy TOPSIS methodologies,” Appl. Soft Comput. J., Vol. 17, pp. 105–16, 2014.
   Web of Science ®Google Scholar
• M. Sadeghi, “Identifying and prioritizing of effective constructs in readiness of knowledge management implementation by using fuzzy analytic hierarchy process (AHP),” J. Knowl. Manag., Vol. 5, no. 1, pp. 16–31, 2013.
   Google Scholar
• G. Mehralian, J. A. Nazari, H. R. Rasekh, and S. Hosseini, “TOPSIS approach to prioritize critical success factors of TQM,” TQM J., Vol. 28, no. 2, pp. 235–49, 2016.
   Google Scholar
• V. Moghimi and M. B. M. Jusan, “Priority of structural housing attribute preferences: identifying customer perception,” Int. J. Hous. Mark. Anal., Vol. 8, no. 1, pp. 36–52, 2015.
   Web of Science ®Google Scholar
• H. Liu, H.W. Xuan, and X. Cui, “Determine weights of evaluation indices for E-Commerce websites ranking,” in Electronic Engineering and Information Science, Wang, Ed. London: Taylor & Francis Group, 2015, pp. 271–4.
   Google Scholar
• K. D. Atalay and E. Eraslan, “Multi-criteria usability evaluation of electronic devices in a fuzzy environment,” Hum. Factors Ergon. Manuf. Serv. Ind., Vol. 24, no. 3, pp. 336–47, 2012.
   Web of Science ®Google Scholar
• Y. C. Erensal, T. Öncan, and M. L. Demircan, “Determining key capabilities in technology management using fuzzy analytic hierarchy process: A case study of Turkey,” Inf. Sci. (Ny)., Vol. 176, no. 18, pp. 2755–70, 2006.
   Web of Science ®Google Scholar
• V. B. Kreng and C. Y. Wu, “Evaluation of knowledge portal development tools using a fuzzy AHP approach: The case of Taiwanese stone industry,” Eur. J. Oper. Res., Vol. 176, no. 3, pp. 1795–810, 2007.
   Google Scholar
• C. K. Kwong and H. Bai, “Determining the importance weights for the customer requirements in QFD using a fuzzy AHP with an extent analysis approach,” IIE Trans., Vol. 35, pp. 619–26, 2003.
   Web of Science ®Google Scholar
• C. E. Bozdag, C. Kahraman, and D. Ruan, “Fuzzy group decision making for selection among computer integrated manufacturing systems,” Comput. Ind., Vol. 51, no. 1, pp. 13–29, 2003.
   Web of Science ®Google Scholar
• D. Singer, “A fuzzy set approach to fault tree and reliability analysis,” Fuzzy Sets Syst., Vol. 34, no. 2, pp. 145–55, 1990.
   Web of Science ®Google Scholar
• C. F. Lai, P. S. Chiu, Y. M. Huang, T. S. Chen, and T. C. Huang, “An evaluation model for digital libraries’ user interfaces using fuzzy AHP,” Electron. Libr., Vol. 32, no. 1, pp. 83–95, 2014.
   Web of Science ®Google Scholar
• N. K. Kasabov, Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering. London: A Bradford Book, 1998.
   Google Scholar
• Hepu Deng, “Multicriteria analysis with fuzzy pairwise comparison,” Int. J. Approx. Reason., Vol. 21, pp. 215–31, 1999.
   Web of Science ®Google Scholar
• D. Dubois and H. Prade, Fuzzy Sets Systems: Theory and Applications. New York: Academic Press, 1980.
   Google Scholar
• T. L. Saaty, “How to make a decision: The analytic hierarchy process,” Eur. J. Oper. Res., Vol. 48, no. 1, pp. 9–26, 1990.
   Web of Science ®Google Scholar
• W. B. Lee, H. Lau, Z. Liu, and S. Tam, “A fuzzy analytic hierarchy process approach in modular product design,” Expert Syst., Vol. 18, no. 1, pp. 32–42, 2001.
   Web of Science ®Google Scholar
• W. Ho, “Integrated analytic hierarchy process and its applications - A literature review,” Eur. J. Oper. Res., Vol. 186, no. 1, pp. 211–28, 2008.
   Web of Science ®Google Scholar
• C.F. Lai, P.-S. Chiu, Y.-M. Huang, T.-S. Chen, and T.-C. Huang, “An evaluation model for digital libraries’ user interfaces using fuzzy AHP,” Electron. Libr., Vol. 32, no. 1, pp. 83–95, 2014.
   Web of Science ®Google Scholar
• P. J. M. van Laarhoven and W. Pedrycz, “A Fuzzy Extension of Saaty’s Priority Theory,” Fuzzy Sets Syst., Vol. 11, pp. 229–41, 1983.
   Web of Science ®Google Scholar
• J. J. Buckley, “Fuzzy hierarchical analysis,” Fuzzy Sets Syst., Vol. 17, no. 3, pp. 233–47, 1985.
   Web of Science ®Google Scholar
• P. D. D. Dominic and H. Khan, “Performance Measure of Airline Websites Using Analytical Hierarchy Process & Fuzzy Analytical Hierarchy Process,” in International Conference on Control System, Computing and Engineering, 2014, pp. 28–30.
   Google Scholar
• S. Buchanan and A. Salako, “Evaluating the usability and usefulness of a digital library,” Libr. Rev., Vol. 58, no. 9, pp. 638–51, 2009.
   Google Scholar
• C. Dee and M. Allen, “A survey of the usability of digital reference services on academic health science library web sites,” J. Acad. Librariansh., Vol. 32, no. 1, pp. 69–78, 2006.
   Web of Science ®Google Scholar
• S. J. Hammill, “Usability testing at Florida international university libraries: what we learned,” Electron. J. Acad. Spec. Librariansh., Vol. 4, no. 1, pp. 6–16, 2003.
   Google Scholar
• N. Hariri and Y. Norouzi, “Determining evaluation criteria for digital libraries’ user interface: a review,” Electron. Libr., Vol. 29, no. 5, pp. 698–722, 2011.
   Web of Science ®Google Scholar
• M. Iqbal and N. F. Warraich, “Usability evaluation of an academic library website: A case of the university of the Punjab,” Pakistan J. Libr. Inf. Sci., Vol. 13, no. 13, pp. 1–11, 2012.
   Google Scholar
• J. Jeng, “Usability assessment of academic digital libraries: Effectiveness, efficiency, satisfaction, and learnability,” Libri, Vol. 55, no. 2–3, pp. 96–121, 2005.
   Web of Science ®Google Scholar
• S. Joo and J. Yeon Lee, “Measuring the usability of academic digital libraries: Instrument development and validation,” Electron. Libr., Vol. 29, no. 4, pp. 523–37, 2011.
   Web of Science ®Google Scholar
• S. Joo, S. Lin, and K. Lu, “A usability evaluation model for academic library websites: efficiency, effectiveness and learnability,” J. Libr. Inf. Stud., Vol. 9, no. 2, pp. 11–26, 2011.
   Google Scholar
• J. Kalra and R. K. Verma, “Evaluation indicators of library websites of selected research institutions in India,” Ann. Libr. Inf. Stud., Vol. 58, no. 2, pp. 139–50, 2011.
   Google Scholar
• Y. M. Kim, “Users’ perceptions of university library websites: A unifying view,” Libr. Inf. Sci. Res., Vol. 33, no. 1, pp. 63–72, 2011.
   Web of Science ®Google Scholar
• R. Kling and M. Elliott, “Digital library design for organizational usability,” ACM SIGOIS Bull., Vol. 15, no. 2, pp. 59–70, 1994.
   Google Scholar
• L. McGillis and E. G. Toms, “Usability of the academic library web site: implications for design,” Coll. Res. Libr., Vol. 62, no. 4, pp. 355–67, 2001.
   Web of Science ®Google Scholar
• R. J. Nathan and P. H. P. Yeow, “Crucial web usability factors of 36 industries for students: A large-scale empirical study,” Electron. Commer. Res., Vol. 11, no. 2, pp. 151–80, 2011.
   Web of Science ®Google Scholar
• A. Pant, “Usability evaluation of an academic library websitee: Experience with the Central Science Library, University of Delhi,” Electron. Libr., Vol. 33, no. 5, pp. 896–915, 2015.
   Web of Science ®Google Scholar
• V. Raju and N. S. Harinarayanab, “An analysis of usability features of library web sites,” Ann. Libr. Inf. Stud., Vol. 55, no. June, pp. 111–22, 2008.
   Google Scholar
• Á. Rocha, “Framework for a global quality evaluation of a website,” Online Inf. Rev., Vol. 36, no. 3, pp. 374–82, 2012.
   Web of Science ®Google Scholar
• R. Rogers and H. Preston, “Usability analysis for redesign of a Caribbean academic library web site: a case study,” OCLC Syst. Serv., Vol. 25, no. 3, pp. 200–11, 2009.
   Google Scholar
• J. L. Ward and S. Hiller, “Usability Testing, Interface Design, and Portals,” J. Libr. Adm., Vol. 43, no. 1–2, pp. 155–71, 2008.
   Google Scholar
• T. Weinhold, B. Bekavac, and S. Hamann, “BibEval-A framework for usability evaluations of online library services,” Libr. Digit. Age, Vol. 13, pp. 1–10, 2014.
   Google Scholar
• K. K. K. Wong, “Partial least squares structural equation modeling (PLS-SEM) techniques using SmartPLS,” Mark. Bull., Vol. 24, no. 1, pp. 1–32, 2013.
   Web of Science ®Google Scholar
• J. F. Hair, C. M. Ringle, and M. Sarstedt, “Partial least squares: The better approach to structural equation modeling?,” Long Range Plann., Vol. 45, no. 5–6, pp. 312–9, 2012.
   Web of Science ®Google Scholar
• J. F. Hair, C. M. Ringle, and M. Sarstedt, “PLS-SEM: Indeed a silver bullet,” J. Mark. Theory Pract., Vol. 19, no. 2, pp. 139–51, 2011.
   Google Scholar
• G. Kabir and M. H. Akhtar Hasin, “Comparative analysis of AHP and fuzzy AHP models for multicriteria inventory classification,” Int. J. Fuzzy Log. Syst., Vol. 1, no. 1, pp. 1–16, 2011.
   Google Scholar
• G. Büyüközkan, C. Kahraman, and D. Ruan, “A fuzzy multi-criteria decision approach for software development strategy selection,” Int. J. Gen. Syst., Vol. 33, no. 2–3, pp. 259–80, 2004.
   Web of Science ®Google Scholar
• D.Y. Chang, “Applications of the extent analysis method on fuzzy AHP,” Eur. J. Oper. Res., Vol. 95, no. 3, pp. 649–55, 1996.
   Web of Science ®Google Scholar
• Y. Y. Chen, Fuzzy Mathematics. Wuhan: Huazhong University of Science and Technology Press, 1984.
   Google Scholar
• K. Ying-Feng and C. Ling-Show, “Using the fuzzy synthetic decision approach to assess the performance of university teachers in Taiwan,” Int. J. … , Vol. 19, no. 4, pp. 593–604, 2002.
   Google Scholar
• A. Seffah, M. Donyaee, R. B. Kline, and H. K. Padda, “Usability measurement and metrics: A consolidated model,” Softw. Qual. J., Vol. 14, no. 2, pp. 159–78, 2006.
   Web of Science ®Google Scholar
• M. Li, Y. Ren, and Z. Zhu, “Usability Evaluation of Independent-sales B2C Fashion Website Based on Consumer’s Perspective *,” IBusiness, Vol. 5, pp. 96–9, 2013.
   Google Scholar
• M. M. Misic and K. Johnson, “Benchmarking: a toll for web site evaluation and improvement,” Internet Res. Electron. Netw. Appl. Policy, Vol. 9, no. 5, pp. 383–92, 1999.
   Web of Science ®Google Scholar
• S. J. Barnes and R. T. Vidgen, “An integrative approach to the assessment of e-commerce quality,” J. Electron. Commer. Res., Vol. 3, no. 2, pp. 114–27, 2002.
   Google Scholar
• Y. M. Ivory-Ndiaye, “An automated approach to Web evaluation,” J. Digit. Inf. Manag., Vol. 1, no. 3, pp. 75–102, 2003.
   Google Scholar
• Y. Akgul, “Quality evaluation of E-government websites of Turkey,” in Iberian Conference on Information Systems and Technologies, 2016.
   Google Scholar
• S. Kaur, K. Kaur, and P. Kaur, “Analysis of Website Usability Evaluation Methods,” in International Conference on Computing for Sustainable Global Development (INDIACom), 2016, pp. 1043–6.
   Google Scholar
• S. Hassan and F. Li, “Evaluating the usability and content usefulness of web sites: a benchmarking approach,” J. Electron. Commer. Organ., Vol. 3, no. 2, pp. 46–67, 2005.
   Google Scholar
• H. Jati and D. Dominic, “Quality Evaluation of E-Government Website Using Web Diagnostic Tools: Asian Case,” in International Conference on Information Management and Engineering, 2009, pp. 85–9.
   Google Scholar