113
Views
0
CrossRef citations to date
0
Altmetric
Research Articles

Usevalia: Managing Inspection-Based Usability Audits

, , , &
Pages 719-743 | Received 19 Aug 2021, Accepted 31 Aug 2022, Published online: 14 Sep 2022

References

  • Alhadreti, O. (2022). A comparison of synchronous and asynchronous remote usability testing methods. International Journal of Human–Computer Interaction, 38(3), 289–297. https://doi.org/10.1080/10447318.2021.1938391
  • Ardito, C., Lanzilotti, R., Buono, P., & Piccinno, A. (2006). A tool to support usability inspection. In Proceedings of the Workshop on Advanced Visual Interfaces (Vol. 2006, pp. 278–281). https://doi.org/10.1145/1133265.1133322
  • Arisholm, E., Briand, L. C., Hove, S. E., & Labiche, Y. (2006). The impact of UML documentation on software maintenance: An experimental evaluation. IEEE Transactions on Software Engineering, 32(6), 365–381. https://doi.org/10.1109/TSE.2006.59
  • Athauda, R., Skinner, G., Regan, B. (2008). A methodology to minimise excessively permissive security configurations. In Proceedings of the 8th WSEAS International Conference on Applied Computer Science (ACS’08) (pp. 187–192).
  • Bănărescu, A. (2015). Detecting and preventing fraud with data analytics. Procedia Economics and Finance, 32(15), 1827–1836. https://doi.org/10.1016/S2212-5671(15)01485-9
  • Barnum, C. (2021). Usability testing essentials: Ready, set…test! Morgan Kaufmann.
  • Basili, V. R., & Rombach, H. D. (1988). The TAME project: Towards improvement-oriented software environments. IEEE Transactions on Software Engineering, 14(6), 758–773. https://doi.org/10.1109/32.6156
  • Beecham, S., Carroll, N., & Noll, J. (2012). A decision support system for global team management: Expert evaluation. In Proceedings – 2012 IEEE 7th International Conference on Global Software Engineering Workshops, ICGSEW 2012 (pp. 12–17). https://doi.org/10.1109/ICGSEW.2012.14
  • Bird, D. K. (2009). The use of questionnaires for acquiring information on public perception of natural hazards and risk mitigation – A review of current knowledge and practice. Natural Hazards and Earth System Sciences, 9(4), 1307–1325. https://doi.org/10.5194/nhess-9-1307-2009
  • Blazek, P., Kuca, K., Krenek, J., Krejcar, O., & Nepovimova, E. (2019). Comparative evaluation of open source laboratory information and management systems. In 2018 IEEE Conference on Open Systems, ICOS 2018 (pp. 19–24). https://doi.org/10.1109/ICOS.2018.8632810
  • Brooke, J. (1996). SUS – A ‘Quick and Dirty’ usability scale. In Usability Evaluation in Industry (1st ed., p. 6). CRC Press.
  • CareerFoundry (2016). The trillion dollar UX problem: A comprehensive guide to the ROI of UX.
  • Carver, J., Jaccheri, L., Morasca, S., & Shull, F. (2003). Issues in using students in empirical studies in software engineering education. In Proceedings – International Software Metrics Symposium (pp. 239–249). https://doi.org/10.1109/METRIC.2003.1232471
  • Chamba-Eras, L., Jacome-Galarza, L., Guaman-Quinche, R., Coronel-Romero, E., & Labanda-Jaramillo, M. (2017). Analysis of usability of universities Web portals using the Prometheus tool – SIRIUS. In 2017 4th International Conference on EDemocracy and EGovernment, ICEDEG 2017 (pp. 195–199). https://doi.org/10.1109/ICEDEG.2017.7962533
  • Chau, P. Y. K., & Hu, P. J. H. (2001). Information technology acceptance by individual professionals: A model comparison approach. Decision Sciences, 32(4), 699–719. https://doi.org/10.1111/j.1540-5915.2001.tb00978.x
  • Constantinides, E., & Fountain, S. J. (2008). Web 2.0: Conceptual foundations and marketing issues. Journal of Direct, Data and Digital Marketing Practice, 9(3), 231–244. https://doi.org/10.1057/palgrave.dddmp.4350098
  • Cruz Zapata, B., Fernández-Alemán, J. L., Toval, A., & Idri, A. (2018). Reusable software usability specifications for mHealth applications. Journal of Medical Systems, 42(3), 1–9. https://doi.org/10.1007/s10916-018-0902-0
  • Cysneiros, L. M., & Yu, E. (2004). Non-functional requirements elicitation. In Perspectives on Software Requirements (pp. 115–138). Springer. https://doi.org/10.1007/978-1-4615-0465-8_6
  • Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–339. https://doi.org/10.2307/249008
  • Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1003. https://doi.org/10.1287/mnsc.35.8.982
  • Deshpande, Y., Murugesan, S., Ginige, A., Hansen, S., Schwabe, D., Gaedke, M., & White, B. (2002). Web engineering. Journal of Web Engineering, 1(1), 3–17. https://doi.org/10.4018/978-1-59904-492-7.ch001
  • Dix, A., Finlay, J., D., Abowd, & Beale, R. (2004). Human–computer interaction – Design rules. Pearson Education Limited.
  • Dumas, J., Sorce, J., & Virzi, R. (1995). Expert reviews: How many experts is enough? Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(4), 228–232. https://doi.org/10.1177/154193129503900402
  • Dutta, B., Peng, M. H., & Sun, S. L. (2018). Modeling the adoption of personal health record (PHR) among individual: The effect of health-care technology self-efficacy and gender concern. The Libyan Journal of Medicine, 13(1), 1500349. https://doi.org/10.1080/19932820.2018.1500349
  • Dzulfikar, M. F., Purwandari, B., Sensuse, D. I., Lusa, J. S., Solichah, I., Prima, P., & Wilarso, I. (2018). Personalization features on business-to-consumer e-commerce: Review and future directions. In 2018 4th International Conference on Information Management, ICIM 2018 (pp. 220–224). https://doi.org/10.1109/INFOMAN.2018.8392839
  • Fazio, R. H., Chen, J. M., McDonel, E. C., & Sherman, S. J. (1982). Attitude accessibility, attitude-behavior consistency, and the strength of the object-evaluation association. Journal of Experimental Social Psychology, 18(4), 339–357. https://doi.org/10.1016/0022-1031(82)90058-0
  • Fazio, R. H., & Zanna, M. P. (1981). Direct experience and attitude-behavior consistency. Advances in Experimental Social Psychology, 14(C), 161–202. https://doi.org/10.1016/S0065-2601(08)60372-X
  • Fitzgerald, B., & Stol, K. J. (2017). Continuous software engineering: A roadmap and agenda. Journal of Systems and Software, 123, 176–189. https://doi.org/10.1016/j.jss.2015.06.063
  • Gavrila, S. I., & Barkley, J. F. (1998). Formal specification for role based access control user/role and role/role relationship management. In Proceedings of the ACM Workshop on Role-Based Access Control (pp. 81–90). https://doi.org/10.1145/286884.286902
  • Güncan, D., & Onay Durdu, P. (2021). A user-centered behavioral software development model. Journal of Software: Evolution and Process, 33(2), 1–26. https://doi.org/10.1002/smr.2274
  • Hollingsed, T., & Novick, D. G. (2007). Usability inspection methods after 15 years of research and practice. In SIGDOC’07: Proceedings of the 25th ACM International Conference on Design of Communication (pp. 249–255). https://doi.org/10.1145/1297144.1297200
  • Hom, J. (1998). The usability methods toolbox handbook. http://www.idemployee.id.tue.nl/g.w.m.rauterberg/lecturenotes/usabilitymethodstoolboxhandbook.pdf
  • Hwang, W., & Salvendy, G. (2010). Number of people required for usability evaluation: The 10 ± 2 rule. Communications of the ACM, 53(5), 130–133. https://doi.org/10.1145/1735223.1735255
  • Intechnic (2016). User experience audit: Sample report. http://cdn2.hubspot.net/hubfs/439788/Content_Offers/UX_Design/User_Experience_Audit_-_Sample.pdf?t=1487693668325
  • Iqbal, M., Noman, M., Talpu, S. R., Manzoor, A., & Abid, M. M. (2020). An empirical study of popular content management system–Wordpress vs Drupal vs. Joomla. ICTACT Journal on Management Studies, 6(2), 1214–1219. https://doi.org/10.21917/ijms.2020.0168
  • ISO 9241 (2018). Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en
  • Ivory, M. Y., & Hearst, M. A. (2001). The state of the art in automating usability evaluation of user interfaces. ACM Computing Surveys, 33(4), 470–516. https://doi.org/10.1145/503112.503114
  • Jacoby, J., & Matell, M. S. (1971). Three-Point Likert Scales are good enough. Journal of Marketing Research, 8(4), 495–500. https://doi.org/10.2307/3150242
  • Ježovita, A., Tušek, B., & Žager, L. (2018). The state of analytical procedures in the internal auditing as a corporate governance mechanism. Management: Journal of Contemporary Management Issues, 23(2), 15–46. https://doi.org/10.30924/mjcmi/2018.23.2.15
  • Kendall, M., & Smith, B. B. (1939). The problem of m rankings. The Annals of Mathematical Statistics, 10(3), 275–287.
  • Kendall, M., & Gibbons, D. (1990). Rank correlation methods (5th ed., E. Arnold). Oxford University Press.
  • Krug, S. (2014). Don’t make me think, revisited: A common sense approach to Web usability. Pearson Education. https://doi.org/10.5860/choice.51-6218
  • Liu, I. F., Chen, M. C., Sun, Y. S., Wible, D., & Kuo, C. H. (2010). Extending the TAM model to explore the factors that affect intention to use an online learning community. Computers & Education, 54(2), 600–610. https://doi.org/10.1016/j.compedu.2009.09.009
  • Mahajan, D., Blakeney, C., & Zong, Z. (2019). Improving the energy efficiency of relational and NoSQL databases via query optimizations. Sustainable Computing: Informatics and Systems, 22, 120–133. https://doi.org/10.1016/j.suscom.2019.01.017
  • Martin-Michiellot, S., & Mendelsohn, P. (2001). Cognitive load while learning with a graphical computer interface. Journal of Computer Assisted Learning, 16(4), 284–293. https://doi.org/10.1046/j.1365-2729.2000.00141.x
  • Matera, M., Costabile, M. F., Garzotto, F., & Paolini, P. (2002). SUE inspection: An effective method for systematic usability evaluation of hypermedia. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 32(1), 93–103. https://doi.org/10.1109/3468.995532
  • Molich, R., Ede, M. R., Kaasgaard, K., & Karyukin, B. (2004). Comparative usability evaluation. Behaviour & Information Technology, 23(1), 65–74. https://doi.org/10.1080/0144929032000173951
  • Morrissey, K. (2014). A review of “universal methods of design: 100 Ways to research complex problems, develop innovative ideas, and design effective solutions”. Visitor Studies, 17(2), 222–224. https://doi.org/10.1080/10645578.2014.945354
  • Moslem, S., Ghorbanzadeh, O., Blaschke, T., & Duleba, S. (2019). Analysing stakeholder consensus for a sustainable transport development decision by the fuzzy AHP and interval AHP. Sustainability, 11(12), 3271. https://doi.org/10.3390/su11123271
  • Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. In Conference on Human Factors in Computing Systems – Proceedings (pp. 152–158). https://doi.org/10.1145/191666.191729
  • Nielsen, J., & Molich, R. (1990, April). Heuristic evaluation of user interfaces. In Conference on Human Factors in Computing Systems – Proceedings (pp. 249–256). https://doi.org/10.1145/97243.97281
  • Object Management Group (2016). Requirements Interchange Format (ReqIF) Version 1.0.1. July, 104.
  • Olson, K. (2010). An examination of questionnaire evaluation by expert reviewers. Field Methods, 22(4), 295–318. https://doi.org/10.1177/1525822X10379795
  • Richardson, B., Campbell-Yeo, M., & Smit, M. (2021). Mobile application user experience checklist: A tool to assess attention to core UX principles. International Journal of Human–Computer Interaction, 37(13), 1283–1290. https://doi.org/10.1080/10447318.2021.1876361
  • Rossi, G., Pastor, O., Schwabe, D., & Olsina, L. (2008). Web engineering: Modelling and implementing web applications. Springer.
  • Salah, D., Paige, R. F., & Cairns, P. (2014). A systematic literature review for Agile development processes and user centred design integration. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (pp. 1–10). https://doi.org/10.1145/2601248.2601276
  • Salman, I., Misirli, A. T., & Juristo, N. (2015). Are students representatives of professionals in software engineering experiments? In Proceedings – International Conference on Software Engineering (Vol. 1, pp. 666–676). https://doi.org/10.1109/ICSE.2015.82
  • Sauro, J., & Lewis, J. R. (2016). Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann.
  • Schmidt, R. C. (1997). Managing Delphi surveys using nonparametric statistical techniques. Decision Sciences, 28(3), 763–774. https://doi.org/10.1111/j.1540-5915.1997.tb01330.x
  • Silva da Silva, T., Selbach Silveira, M., Maurer, F., & Hellmann, T. (2012). User experience design and agile development: From theory to practice. Journal of Software Engineering and Applications, 5(10), 743–751. https://doi.org/10.4236/jsea.2012.510087
  • Sivaji, A., Soo, S. T., & Abdullah, M. R. (2011, August). Enhancing the effectiveness of usability evaluation by automated heuristic evaluation system. In Proceedings – 3rd International Conference on Computational Intelligence, Communication Systems and Networks, CICSyN 2011 (pp. 48–53). https://doi.org/10.1109/CICSyN.2011.23
  • Smidt, L., Ahmi, A., Steenkamp, L., der Nest, D. P., & Lubbe, D. (2019). A maturity-level assessment of generalised audit software: Internal audit functions in Australia. Australian Accounting Review, 29(3), 516–531. https://doi.org/10.1111/auar.12252
  • Smoker, W. R. K., Lehmann, T. R., Hingtgen, W. L., Spratt, K. F., Gentry, L. R., & Weinstein, J. N. (1988). Reduction of the gastrointestinal side effects of metrizamide myelography with oral dexamethasone. American Journal of Neuroradiology, 9(1), 179–185.
  • Soileau, J., Soileau, L., & Sumners, G. (2015). The evolution of analytics and internal audit. EDPACS, 51(2), 10–17. https://doi.org/10.1080/07366981.2015.1012441
  • Suarez Torrente, M. D. C., Conde Clemente, P., Martínez, A. B., & Juan, A. A. (2016). Improving web user satisfaction by ensuring usability criteria compliance: The case of an economically depressed region of Europe. Online Information Review, 40(2), 187–203. https://doi.org/10.1108/OIR-04-2015-0134
  • Tang, F., Norman, C. S., & Vendrzyk, V. P. (2017). Exploring perceptions of data analytics in the internal audit function. Behaviour & Information Technology, 36(11), 1125–1136. https://doi.org/10.1080/0144929X.2017.1355014
  • Tharindu, P. K., & Koggalage, R. (2021). Usability of E-commerce websites: State of the art and future directions e-commerce. International Research Journal of Modernization in Engineering Technology and Science, 3(February), 314–319. https://doi.org/10.5281/zenodo.4529411
  • Tory, M., & Moller, T. (2005, September–October). Evaluating visualizations: Do expert reviews work? IEEE Computer Graphics and Applications, 25(5), 8–11. https://doi.org/10.1109/mcg.2005.102
  • Venkatesh, V., & Davis, F. D. (1996). A model of the antecedents of perceived ease of use: Development and test. Decision Sciences, 27(3), 451–481. https://doi.org/10.1111/j.1540-5915.1996.tb00860.x
  • Wakode, B., & Chaudhari, D. (2013). Study of content management systems Joomla and Drupal. IJRET: International Journal of Research in Engineering and Technology, 2(12), 569–573.
  • W3C Working Group Note (2017). Developer guide for Evaluation and Report Language (EARL) 1.0. https://www.w3.org/TR/EARL10-Guide/#changes
  • WebCriteria (2002). Heuristic evalualtion – A system checklist usability analysis & design. file:///C:/Users/34631/Downloads/HeuristicEvaluationChecklist.pdf
  • Zanna, M., & Rempel, J. (2008). Attitudes: A new look at an old concept. Their Structure, Function, and Consequences.
  • Zazelenchuk, T. (2008). How to Install and Use the Usability DataLogger (v5. 0). Agedi.Ae. http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:How+to+Install+and+Use+the+Usability+DataLogger+(v5.0)#0

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.