An Improved Usability Measure Based on Novice and Expert Performance

REFERENCES

• Anderson , J. R. 1976 . Language, memory and thought , Hillsdale, NJ : Erlbaum .
   Google Scholar
• Bangor , A. , Kortum , P. T. and Miller , J. T. 2008 . An empirical evaluation of the system usability scale . International Journal of Human-Computer Interaction , 24 : 574 – 594 .
   Web of Science ®Google Scholar
• Bargh , J. A. and Chartrand , T. L. 1999 . The unbearable automaticity of being . American Psychologist , 54 : 462 – 479 .
   Web of Science ®Google Scholar
• Bessiere , K. , Newhagen , J. E. , Robinson , J. P. and Shneiderman , B. 2006 . A model for computer frustration: The role of instrumental and dispositional factors on incident, session, and post-session frustration and mood . Computers in Human Behavior , 22 : 941 – 961 .
   Google Scholar
• Brinkman , W.-P. , Haakma , R. and Bouwhuis , D. G. 2007 . Towards an empirical method of efficiency testing of system parts: A methodological study . Interacting with Computers , 19 : 342 – 356 .
   Web of Science ®Google Scholar
• Brooke , J. 1996 . “ SUS: A “quick and dirty” usability scale ” . In Usability evaluation in industry , Edited by: Jordan , P. W. , Thomas , B. , Weerdmeester , B. A. and McClelland , A. L. 189 – 194 . London : Taylor and Francis .
   Google Scholar
• Carroll , J. M. and Rosson , M. B. 1987 . “ Paradox of the active user ” . In Interfacing thought: Cognitive aspects of human-computer interaction , Edited by: Carroll , J. M. 80 – 111 . Cambridge, MA : MIT Press .
   Google Scholar
• Chin , J. P. , Diehl , V. A. and Norman , K. Development of an instrument measuring user satisfaction of the human-computer interface . Proceedings of the Sixth ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 213 – 218 . ACM Press .
   Google Scholar
• Cohen , J. 1977 . Statistical power analysis for the behavioral sciences , New York : Academic Press .
   Google Scholar
• Desurvire , H. , Lawrence , D. and Atwood , M. 1991 . Empiricism versus judgement: Comparing user interface evaluation methods on a new telephone-based interface . SIGCHI Bulletin , 23 ( 4 ) : 58 – 59 .
   Google Scholar
• Dienes , Z. and Perner , J. 1999 . A theory of implicit and explicit knowledge . Behavioral and Brain Sciences , 22 : 735 – 808 .
   PubMed Web of Science ®Google Scholar
• Dillon , A. and Song , M. 1997 . An empirical comparison of the usability for novice and expert searchers of a textual and a graphical interface to an art-resource database . Journal of Digital Information , 1 ( 1 ) Article No. 2
   Google Scholar
• Douglas , S. A. , Kirkpatrick , A. E. and MacKenzie , I. S. Testing pointing device performance and user assessment with the ISO 9241, Part 9 Standard . Proceedings of the 17th ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 215 – 222 . ACM Press .
   Google Scholar
• Faulkner , L. and Wick , D. 2005 . Cross-user analysis: Benefits of skill level comparison in usability testing . Interacting with Computers , 17 : 773 – 786 .
   Web of Science ®Google Scholar
• Global System for Mobile Communications Association. (2006, November 28). Strong global demand for MMS and mobile email http://www.gsmworld.com/newsroom/press-releases/2118.htm (http://www.gsmworld.com/newsroom/press-releases/2118.htm) (Accessed: 29 June 2009 ).
   Google Scholar
• Goonetilleke , R. S. , Shih , H. M. , On , H. K. and Fritsch , J. 2001 . Effects of training and representational characteristics in icon design . International Journal of Human-Computer Studies , 55 : 741 – 760 .
   Web of Science ®Google Scholar
• Gould , J. and Lewis , C. 1985 . Designing for usability: Key principles and what designers think . Communications of the ACM , 28 : 300 – 311 .
   Web of Science ®Google Scholar
• Gray , W. D. and Salzman , M. C. 1998 . Damaged merchandise? A review of experiments that compare usability evaluation methods . Human–Computer Interaction , 13 : 203 – 261 .
   Web of Science ®Google Scholar
• Greenwald , A. G. , Nosek , B. A. and Banaji , M. R. 2003 . Understanding and using the Implicit Association Test: I. An improved scoring algorithm . Journal of Personality and Social Psychology , 85 : 197 – 216 .
   PubMed Web of Science ®Google Scholar
• Hedges , L. V. and Olkin , I. 1985 . Statistical methods for meta-analysis , San Diego, CA : Academic Press .
   Google Scholar
• Henderson , R. , Podda , J. , Smith , M. and Varela-Alvarez , H. 1995 . An examination of four user-based software evaluation methods . Interacting with Computers , 7 : 412 – 432 .
   Web of Science ®Google Scholar
• Hertzum , M. and Jacobsen , N. E. 2003 . The evaluator effect: A chilling fact about usability evaluation methods . International Journal of Human-Computer Interaction , 15 ( 1 ) : 183 – 204 .
   Web of Science ®Google Scholar
• Hornbæk , K. and Law , E. L.-C. Meta-analysis of correlations among usability measures . Proceedings of the ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 617 – 626 . ACM Press .
   Google Scholar
• International Association for the Wireless Telecommunications Industry. (n.d.). Wireless quick facts. Washington, DC: Author http://www.ctia.org/media/industry_info/index.cfm/AID/10323 (http://www.ctia.org/media/industry_info/index.cfm/AID/10323) (Accessed: 29 June 2009 ).
   Google Scholar
• ISO 9241-11 . 1997 . Ergonomic requirements for office work with visual display terminals (VDTs), Part 11: Guidance on usability specification and measures , Geneva, , Switzerland : International Organization for Standards .
   Google Scholar
• International Telecommunication Union . 2009 . Measuring the information society: The ICT development index , Geneva, , Switzerland : Author .
   Google Scholar
• John , B. E. and Kieras , D. E. 1996 . The GOMS family of user interface analysis techniques: Comparison and contrast . ACM Transactions on Computer-Human Interaction , 3 : 320 – 351 .
   Google Scholar
• Kang , N. E. and Yoon , W. C. 2008 . Age- and experience-related user behavior differences in the use of complicated electronic devices . International Journal of Human-Computer Studies , 66 : 425 – 437 .
   Web of Science ®Google Scholar
• Kirsh , D. 1991 . “ When is information explicitly represented? In P. Hanson (Ed.) ” . In Information, thought, and content , 340 – 365 . Vancouver, , Canada : UBC Press .
   Google Scholar
• Kjeldskov , J. , Skov , M. B. and Stage , J. Does time heal? A longitudinal study of usability . Proceedings of the Australian Computer-Human Interaction Conference . Narrabundah. Edited by: Balbo , S. and Bentley , T. CHISIG of Australia .
   Google Scholar
• Kuniavsky , M. 2003 . Observing the user experience: A practitioner's guide to user research , San Francisco : Morgan-Kaufmann .
   Google Scholar
• Lewis , J. R. 1995 . IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use . International Journal of Human–Computer Interaction , 7 ( 1 ) : 57 – 78 .
   Web of Science ®Google Scholar
• Lewis , J. R. 2002 . Psychometric evaluation of the PSSUQ using data from five years of usability studies . International Journal of Human–Computer Interaction , 14 : 463 – 488 .
   Web of Science ®Google Scholar
• Lindgaard , G. and Dudek , C. 2003 . What is this evasive beast we call user satisfaction? . Interacting with Computers , 15 : 429 – 452 .
   Web of Science ®Google Scholar
• Luo , L. and John , B. Predicting task execution time on handheld devices using the keystroke-level model . Extended Abstracts of the 23rd ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 1605 – 1608 . ACM Press .
   Google Scholar
• MacDorman , K. F. , Vasudevan , S. K. and Ho , C.-C. 2009 . Does Japan really have robot mania? Comparing attitudes by implicit and explicit measures . AI & Society , 23 : 485 – 510 .
   Google Scholar
• MacKenzie , I. S. 1992 . Fitts' Law as a research and design tool in human-computer interaction . Human–Computer Interaction , 7 ( 1 ) : 91 – 139 .
   Google Scholar
• McGee , M. , Rich , A. and Dumas , J. 2004 . “ Understanding the usability construct: User-perceived usability ” . In Proceedings of the Human Factors and Ergonomics Society 48^th Annual Meeting , Vol. 48 , 907 – 911 . Santa Monica, CA : HFES .
   Google Scholar
• Molich , R. and Nielsen , J. 1990 . Improving a human–computer dialogue . Communications of the ACM , 33 : 338 – 348 .
   Web of Science ®Google Scholar
• Newell , A. and Simon , H. A. 1972 . Human problem solving , Englewood Cliffs, NJ : Prentice Hall .
   Google Scholar
• Nielsen , J. Finding usability problems through heuristic evaluation . Proceedings of the 10th ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 373 – 380 . ACM Press .
   Google Scholar
• Nielsen , J. 1994 . Usability engineering , San Francisco : Morgan Kaufmann .
   Google Scholar
• Nielsen , J. and Molich , R. Heuristic evaluation of user interfaces . Proceedings of the Eighth ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 249 – 256 . ACM Press .
   Google Scholar
• Nielsen , J. and Phillips , V. L. Estimating the relative usability of two interfaces: Heuristic, formal, and empirical methods compared . Proceedings of the INTERACT'93 and CHI'93: The 11th ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 214 – 221 . ACM Press .
   Google Scholar
• Norman , D. A. 1983 . “ Some observations on mental models ” . In Mental models , Edited by: Gentner , D. and Stevens , A. L. 7 – 14 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Norman , D. A. 1988 . The psychology of everyday things , New York : Basic Books .
   Google Scholar
• Proctor , R. W. and Van Zandt , T. 2008 . Human factors in simple and complex systems , 2nd , Boca Raton, FL : CRC Press .
   Google Scholar
• Ratcliff , R. 1993 . Methods for dealing with reaction time outliers . Psychological Bulletin , 114 : 510 – 532 .
   PubMed Web of Science ®Google Scholar
• Rogers , R. D. and Monsell , S. 1995 . Costs of a predictable switch between simple cognitive tasks . Journal of Experimental Psychology: General , 124 : 207 – 231 .
   Web of Science ®Google Scholar
• Sauro , J. and Lewis , J. R. Correlations among prototypical usability metrics: Evidence for the construct of usability . Proceedings of the 27th International ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. ACM Press .
   Google Scholar
• Silfverberg , M. , MacKenzie , I. S. and Korhonen , P. Predicting text entry speed on mobile phones . Proceedings of the ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 9 – 16 . ACM Press .
   Google Scholar
• Uehling , D. L. and Wolf , K. User action graphing effort (UsAGE) . Conference Companion on Human Factors in Computing Systems . New York. pp. 290 – 291 . ACM Press .
   Google Scholar
• Urokohara , H. , Tanaka , K. , Furuta , K. , Honda , M. and Kurosu , M. NEM: “Novice expert ratio method” A usability evaluation method to generate a new performance measure . Proceedings of the ACM/SIGCHI Conference on Human Factors in Computing Systems . New York. pp. 185 – 186 . ACM Press .
   Google Scholar