A comparison of usability evaluation methods for evaluating e-commerce websites

References

• Altman , D. G. 1991 . Practical statistics for medical research , London : Chapman and Hall .
   Google Scholar
• Arab Advisors Group . 2008 . Over 29,000 households share ADSL subscriptions in Jordan: the percentage of Jordanian households connected to ADSL is 11.7% of total households [online] Available from: http://www.arabadvisors.com/Pressers/presser-021208.htm [Accessed 11 August 2009]
   Google Scholar
• Bach , C. and Scapin , D. L. 2010 . Comparing inspections and user testing for the evaluation of virtual environments . International Journal of Human–Computer Interaction , 26 ( 8 ) : 786 – 824 .
   Web of Science ®Google Scholar
• Bailey , B. 2001 . Heuristic evaluations vs. usability testing, part I [online] Available from: http://webusability.com/article_heuristic_evaluation_part1_2_2001.htm, [Accessed 12 January 09]
   Google Scholar
• Barnard , L. and Wesson , J. Usability issues for e-commerce in South Africa: an empirical investigation . Proceedings of SAICSIT . pp. 258 – 267 . 17–19 September, Fourways, Gauteng , South Africa : South African Institute for Computer Scientists and Information Technologists .
   Google Scholar
• Barnard , L. and Wesson , J. A trust model for e-commerce in South Africa . Proceedings of SAICSIT . pp. 23 – 32 . 4–6 October, Cape Town , South Africa : South African Institute for Computer Scientists and Information Technologists .
   Google Scholar
• Barnes , S. and Vidgen , R. 2002 . An integrative approach tothe assessment of e-commerce quality . Journal of Electronic Commerce Research , 3 ( 3 ) : 114 – 127 .
   Google Scholar
• Basu , A. Context-driven assessment of commercial web sites . Proceedings of the 36th Hawaii international conference on system sciences (HICSS'03) . 7–10 January, Hawaii, USA
   Google Scholar
• Blandford , A. 2008 . Scoping usability evaluation methods: a case study . Human Computer Interaction Journal , 23 ( 3 ) : 278 – 327 .
   Web of Science ®Google Scholar
• Brinck , T. , Gergle , D. and Wood , S. D. 2001 . Usability for the web: designing websites that work , San Francisco, CA, USA : Morgan Kaufmann Publishers .
   Google Scholar
• Cao , M. , Zhang , Q. and Seydel , J. 2005 . B2C e-commerce web site quality: an empirical examination . Industrial Management & Data Systems , 105 ( 5 ) : 645 – 661 .
   Web of Science ®Google Scholar
• Chen , S. and Macredie , R. 2005 . The assessment of usability of electronic shopping: a heuristic evaluation . International Journal of Information Management , 25 : 516 – 532 .
   Web of Science ®Google Scholar
• Cockton , G. and Woolrych , A. 2001 . “ Understanding inspection methods: lessons from an assessment of heuristic evaluation ” . In People and computers XV , Edited by: Blandford , A. and Vanderdonckt , J. 171 – 192 . Berlin : Springer-Verlag .
   Google Scholar
• Delone , W. and Mclean , E. 2003 . The DeLone and McLean of information systems success: a ten-year update . Journal of Management Information Systems , 19 ( 4 ) : 9 – 30 .
   Web of Science ®Google Scholar
• De Marsico , M. and Levialdi , S. 2004 . Evaluating web sites: exploring user's expectations . International Journal of Human Computer Studies , 60 : 381 – 416 .
   Web of Science ®Google Scholar
• Desurvire , H. , Kondziela , J. and Atwood , M. What is gained and lost when using methods other than empirical testing . Posters and short talks of the 1992 SIGCHI conference on human factors in computing systems . pp. 125 – 126 . 3–7 May, Monterey, California, USA , New York, NY, USA : ACM (Association for Computing Machinery) .
   Google Scholar
• Desurvire , H. W. , Kondziela , J. M. and Atwood , M. E. 1992b . “ What is gained and lost when using evaluation methods other than empirical testing ” . In People and computers VII , Edited by: Monk , A. , Diaper , D. and Harrison , M. D. 89 – 102 . Cambridge : Cambridge University Press .
   Google Scholar
• Desurvire , H. , Lawrence , D. and Atwood , M. 1991 . Empiricism versus judgement: comparing user interface evaluation methods on a new telephone-based interface . SIGCHI Bulletin , 23 ( 4 ) : 58 – 59 .
   Google Scholar
• Doubleday , A. , Ryan , M. , Springett , M. and Sutcliffe , A. A comparison of usability techniques for evaluating design . Proceedings of the2nd conference on designing interactive systems . pp. 101 – 110 . 18–20 August, Amsterdam, The Netherlands , New York, USA : ACM Press .
   Google Scholar
• Fisher , J. , Craig , A. and Bentley , J. Evaluating small business web sites – understanding users . Proceedings of the ECIS2002 . pp. 667 – 675 . 6–8 June, Poland , Princeton, New Jersey, USA : Citeseer .
   Google Scholar
• Freeman , M. B. and Hyland , P. 2003 . Australian online supermarket usability. Technical report [online] , Decision Systems Lab, University of Wollongong . Available from: http://www.dsl.uow.edu.au/publications/techreports/freeman03australia.pdf [Accessed 11 October 2007]
   Google Scholar
• Fu , L. , Salvendy , G. and Turley , L. 2002 . Effectiveness of user testing and heuristic evaluation as a function of performance classification . Behaviour & Information Technology , 21 ( 2 ) : 137 – 143 .
   Web of Science ®Google Scholar
• Gonzalez , F. J.M. and Palacios , T. M.B. 2004 . Quantitative evaluation of commercial web sites: an empirical study of Spanish firms . International Journal of Information Management , 24 : 313 – 328 .
   Web of Science ®Google Scholar
• Gray , W. and Salzman , C. 1998 . Damaged merchandise? A review of experiments that compare usability evaluation methods . Human–Computer Interaction , 13 : 203 – 261 .
   Web of Science ®Google Scholar
• Hartson , H. R. , Andre , T. S. and Williges , R. C. 2001 . Evaluating usability evaluation methods . International Journal of Human–Computer Interaction , 13 ( 4 ) : 373 – 410 .
   Web of Science ®Google Scholar
• Hertzum , M. and Jacobsen , N. E. 2001 . The evaluator effect: a chilling fact about usability evaluation methods . International Journal of Human–Computer Interaction , 13 ( 4 ) : 421 – 443 .
   Web of Science ®Google Scholar
• Hornbaek , K. 2010 . Dogmas in the assessment of usability evaluation methods . Behaviour & Information Technology , 29 (1) : 97 – 111 .
   Web of Science ®Google Scholar
• Huang , W. 2006 . Categorizing web features and functions to evaluate commercial web sites . Industrial Management & Data Systems , 106 ( 4 ) : 523 – 539 .
   Web of Science ®Google Scholar
• Hung , W. and McQueen , R. J. 2004 . Developing an evaluation instrument for e-commerce websites from 1stbuyer's view point . Electronic Journal of Information Systems Evaluation , 7 ( 1 ) : 31 – 42 .
   Google Scholar
• ISO 9241-11 . 1998 . International standard first edition. Ergonomic requirements for office work with visual display terminals (VDTs), Part11: Guidance on usability [online] Available from: http://www.idemployee.id.tue.nl/g.w.m.rauterberg/lecturenotes/ISO9241part11.pdf [Accessed 3 April 2007]
   Google Scholar
• Jeffries , R. and Desurvire , H. 1992 . Usability testing vs. heuristic evaluation: was there a contest? . ACM SIGCHI Bulletin , 24 ( 4 ) : 39 – 41 .
   Google Scholar
• Jeffries , R. User interface evaluation in the real world: a comparison of four techniques . Proceedings ACM CHI'91 conference . New Orleans, LA, April 28–May 2 . pp. 119 – 124 . New York, NY, USA : ACM .
   Google Scholar
• Kantner , L. and Rosenbaum , S. Usability studies of WWW sites: heuristic evaluation vs. laboratory testing . ACM 15th international conference on computer documentation . pp. 153 – 160 . 19–22 October, Salt Lake City, Utah, USA , New York, NY, USA : ACM (Association for Computing Machinery) .
   Google Scholar
• Kuniavsky , M. 2003 . Observing the user experience: a practitioner's guide to user research , San Francisco, CA; London : Morgan Kaufmann .
   Google Scholar
• Law , L. and Hvannberg , E. Complementarity and convergence of heuristic evaluation and usability test: acase study of Universal Brokerage Platform . ACM international conference proceeding series, 3, proceedings of the second Nordic conference on human–computer interaction . pp. 71 – 80 . 19–23 October, Aarhus, Denmark , New York, NY, USA : ACM Press .
   Google Scholar
• Liu , C. and Arnett , K. 2000 . Exploring the factors associated with web site success in the context of electronic commerce . Information and Management , 38 : 23 – 33 .
   Web of Science ®Google Scholar
• Mariage , C. and Vanderdonckt , J. A comparative usability study of electronic newspapers . Proceedings of int. workshop on tools for working with guidelines TFWWG'2000 [online] . Available from: http://www.isys.ucl.ac.be/bchi/ [Accessed 20 January 2008]
   Google Scholar
• Molich , R. and Dumas , J. 2008 . Comparative usability evaluation (CUE-4) . Behaviour & Information Technology , 27 ( 3 ) : 263 – 281 .
   Web of Science ®Google Scholar
• Molla , A. and Licker , S. P. 2001 . E-commerce systems success: an attempt to extend and respecify the Delone and Maclean of IS success . Journal of Electronic Commerce Research , 2 ( 4 ) : 131 – 141 .
   Google Scholar
• Nielsen , J. Finding usability problems through heuristic evaluation . Proceedings of the SIGCHI conference on human factors in computing systems . pp. 373 – 380 . 3–7 May, Monterey, California, USA , New York, NY, USA : ACM (Association for Computing Machinery) .
   Google Scholar
• Nielsen , J. 1996 . Original top ten mistakes in web design [online] Available from: http://www.useit.com/alertbox/9605a.html [Accessed 10 January 2007]
   Google Scholar
• Nielsen , J. 2000 . Designing web usability: the practice of simplicity , Indianapolis, Indiana, USA : New Riders Publishing .
   Google Scholar
• Nielsen , J. 2003 . Usability 101: Introduction to usability. Useit.com [online] Available from: http://www.useit.com/alertbox/20030825.html [Accessed 14 February 2006]
   Google Scholar
• Nielsen , J. 2006 . Quantitative studies: how many users to test? Useit.com [online] Available from: http://www.useit.com/alertbox/quantitative_testing.html [Accessed 20 November 2007]
   Google Scholar
• Nielsen J Mack R.L Usability inspection methods John Wiley & Sons New York , NY 1994
   Google Scholar
• Nielsen , J. and Phillips , V. Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared . Proceedings of the INTERACT '93 and CHI '93 conference on human factors in computing systems . pp. 214 – 221 . 24–29 April, Amsterdam, The Netherlands , New York, NY, USA : ACM .
   Google Scholar
• Obeidat , M. Consumer protection and electronic commerce in Jordan (an exploratory study) . Proceedings of the public voice in emerging market economies conference . Dubai , UAE [online] Available from: http://www.thepublicvoice.org/events/dubai01/presentations/html/m_obeidat/m.obeidatpaper.html [Accessed 12 January 2007]
   Google Scholar
• Oppenheim , C. and Ward , L. 2006 . Evaluation of websites for B2C e-commerce . Aslib Proceedings: New Information Perspectives , 58 ( 3 ) : 237 – 260 .
   Web of Science ®Google Scholar
• Pickard , A. 2007 . Research methods in information , London : Facet .
   Google Scholar
• Preece , J. , Sharp , H. and Rogers , Y. 2002 . Interaction design: beyond human–computer interaction , New York, NY, USA : John Wiley & Sons, Inc .
   Google Scholar
• Rubin , J. 1994 . Handbook of usability testing: how to plan, design, and conduct effective tests , New York, NY, USA : John Wiley & Sons, Inc .
   Google Scholar
• Sahawneh , M. 2002 . E-commerce: the Jordanian experience , Amman , Jordan : Royal Scientific Society .
   Google Scholar
• Sartzetaki , M. 2003 . An approach for usability evaluation of e-commerce sites based on design patterns and heuristics criteria [online] Available from: http://www.softlab.ntua.gr/∼retal/papers/conferences/HCICrete/Maria_EVAL/HCI2003_DEPTH_camera.pdf [Accessed 10 December 2006]
   Google Scholar
• Shneiderman , B. 1998 . Designing the user interface, strategies for effective human computer interaction , 3rd ed , Menlo Park, CA, USA : Addison Wesley .
   Google Scholar
• Simeral , E. and Branaghan , R. 1997 . A comparative analysis of heuristic and usability evaluation methods. STC Proceedings [online] Available from: http://www.stc.org/confproceed/1997/PDFs/0140.PDF [Accessed 20 April 2008]
   Google Scholar
• Singh , M. and Fisher , J. Electronic commerce issues: a discussion of two exploratory studies . Proceedings of CollEcTeR . 29 November, Wellington , NewZealand
   Google Scholar
• Singh , S. and Kotze , P. Towards a framework for e-commerce usability . Proceedings of the annual SAICSIT conference . pp. 2 – 10 . 16–18 September, Port Elizabeth, South Africa , Republic of South Africa : South African Institute for Computer Scientists and Information Technologists .
   Google Scholar
• Srivihok , A. 2000 . An assessment tool for electronic commerce: end user evaluation of web commerce sites [online] Available from: http://www.singstat.gov.sg/statsres/conferences/ecommerce/r313.pdf [Accessed 10 October 2006]
   Google Scholar
• Stone , D. 2005 . User interface design and evaluation , California : The Open University, Morgan Kaufmann .
   Google Scholar
• Sutcliffe , A. Assessing the reliability of heuristic evaluation for website attractiveness and usability . Proceedings of the 35th Hawaii international conference on system sciences (HICSS) . 7–10 January, Big Island, HI, USA , Washington, DC : IEEE Computer Society .
   Google Scholar
• Tan , W. , Liu , D. and Bishu , R. 2009 . Web evaluation: heuristic evaluation vs. user testing . International Journal of Industrial Ergonomics , 39 : 621 – 627 .
   Web of Science ®Google Scholar
• Tilson , R. Factors and principles affecting the usability of four e-commerce sites . Proceedings of the 4th conference on human factors and the web (CHFW) . 5 June, AT&TLabs , USA
   Google Scholar
• Van der Merwe , R. and Bekker , J. 2003 . A framework and methodology for evaluating e-commerce websites . Internet Research: Electronic Networking Applications and Policy , 13 ( 5 ) : 330 – 341 .
   Web of Science ®Google Scholar
• Webb , H. and Webb , L. 2004 . SiteQual: an integrated measure of web site quality . Journal of Enterprise Information Management , 17 ( 6 ) : 430 – 440 .
   Google Scholar
• Zhang , P. and von Dran , G. Expectations and ranking of website quality features: results of two studies on user perceptions . Proceedings of the 34th Hawaii international conference on system sciences . pp. 1 – 10 . 3–6, January, Maui, Hawaii, USA , Washington, DC : IEEE Computer Society .
   Google Scholar