State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions

REFERENCES

• Antona , M. , Mourouzis , A. and Stephanisis , C. 2007 . Towards a walkthrough method for universal access evaluation, universal access in human computer interaction . Coping with Diversity, Lecture Notes in Computer Science , 4554 : 325 – 334 .
   Google Scholar
• Bertelsen , O. W. 2004 . The activity walkthrough: An expert review method based on activity theory . Proceedings of NordiCHI. , : 251 – 254 .
   Google Scholar
• Bastien , J. M. C. 2004 . “ L'inspection ergonomique des logiciels interactifs: Intérêts et limites. [Ergonomic inspection of interactive software: interests and limits] ” . In Psychologie ergonomique: tendances actuelles [Ergonomic Psycology: Current Texdexies] , Edited by: Hoc , J. M. and Darses , F. Paris : PUF .
   Google Scholar
• Bastien , J. M. and Scapin , D. L. 1995 . Evaluating a user interface with ergonomic criteria . International of Human–Computer Interaction , 7 : 105 – 121 .
   Web of Science ®Google Scholar
• Blackmon , M. , Polson , P. , Kitajima , M. and Lewis , C. 2002 . Cognitive walkthrough for the Web . Proceeding of CHI , : 463 – 470 .
   Google Scholar
• Bligard , L. O. 2007 . Prediction of medical device usability problems and use errors—An improved analytical methodical approach , Göteborg : Chalmers University of Technology .
   Google Scholar
• Bligard , L. O. and Osvalder , A. L. 2007 . An analytical approach for predicting and identifying use error and usability problem . HCI and Usability for Medicine and Health Care, Lecture Notes in Computer Science , 4799 : 427 – 440 .
   Google Scholar
• Card , S. K. , Moran , T. P. and Newell , A. 1983 . The psychology of human–computer interaction , Hillsdale, NJ : Erlbaum .
   Google Scholar
• Cassell , J. , Sullivan , J. , Prevost , S. and Churchill , E. 2000 . Embodied conversational agents , Cambridge, MA : MIT Press .
   Google Scholar
• Cockton , G. , Lavery , D. and Woolrych , A. 2003 . “ Inspection-based evaluations ” . In The human–computer interaction handbook , Edited by: Jacko , J. A. and Sears , A. 1118 – 1138 . Mahwah, NJ : Erlbaum .
   Google Scholar
• Cuomo , D. L. and Bowen , C. D. 1992 . Stages of user activity model as basis for user-centered interface evaluation . Proceedings of the Human Factor and Ergonomics Society 41st annual meeting , : 1254 – 1258 .
   Google Scholar
• Desurvise , H. W. , Kondziela , J. M. and Atwood , M. E. 1992 . “ What is gained and lost when using evaluation methods other than empirical testing ” . In People and computers VII: proceedings of HCI92, York, September 1992 , Edited by: Monk , A. , Diaper , D. and Harrison , M. D. 89 – 102 . Cambridge University Press .
   Google Scholar
• Dix , H. , Finlay , J. , Abowd , G. and Beale , R. 1993 . Human–computer interaction , Englewood Cliffs, NJ : Prentice Hall .
   Google Scholar
• Eden , J. June 2007 . “ Distributed cognitive walkthrough (DCW): A walkthrough-style usability evaluation method based on theories of distributed cognition ” . In Proceedings of the 6th ACM SIGCHI conference on Creativity & Cognition June , 283
   Google Scholar
• Eden , J . 2008 . The Distributed Cognitive Walkthrough: The impact of differences in cognitive theory on usability evaluation , Philadelphia, , Pennsylvania : Unpublished doctoral dissertation, Drexel University .
   Google Scholar
• Edwards , P. J. , Moloney , K. P. , Jacko , J. A. and Sainfort , F. 2008 . Evaluating usability of a commercial electronic health record: A case study . International Journal of Human–Computer Studies , 66 : 718 – 728 .
   Web of Science ®Google Scholar
• González , M. P. , Lorés , J. and Granollers , A. 2007 . Assessing usability problems in Latin-American academic Web pages with Cognitive Walkthroughs and datamining techniques, usability and internationalization . HCI and Culture, Lecture Notes in Computer Science , 4559 : 306 – 316 .
   Google Scholar
• Granollers , T. and Lorés , J. 2006 . “ Incorporation of users in the evaluation of usability by Cognitive Walkthrough ” . In HCI related papers of interacción 2004 Edited by: Navarro-Prieto , R. and Vidal , J. L. 243 – 255 .
   Google Scholar
• Gray , W. D. and Salzman , M. C. 1998 . Damaged merchandise? A review of experiments that compare usability evaluation methods . Human–Computer Interaction , 11 : 203 – 261 .
   Google Scholar
• Grislin , M. and Kolski , C. 1996 . Evaluation des interfaces homme-machine lors du développement des systèmes interactifs [Human–machine interface evaluation during interactive system development] . Technique et Science Informatiques , 15 ( 3 ) : 265 – 296 .
   Google Scholar
• Gutwin , C. and Greenberg , S. 2000 . “ The mechanics of collaboration: developping low cost usability evaluation methods for shared workspaces ” . In Proceedings of 9th IEEE WETICE 2000 98 – 103 .
   Google Scholar
• Hollan , J. , Hutchins , E. and Kirsh , D. 2000 . Distributed cognition: Toward a new foundation for human–computer interaction research . ACM Transactions on Computer–Human Interaction , 7 ( 2 ) : 174 – 196 .
   Google Scholar
• Huart , J. , Kolski , C. and Sagar , M. 2004 . Evaluation of multimedia applications using inspection methods: The cognitive walkthrough case . Interacting with Computer , 16 : 183 – 215 .
   Web of Science ®Google Scholar
• Hutchins , E. L. , Hollan , J. D. and Norman , D. A. 1985 . Direct manipulation interface . Human–Computer Interaction , 1 : 311 – 388 .
   Google Scholar
• IEC . 2004 . Medical electrical equipment—Part 1–6: General requirements for safety—Collateral standard: Usability. International Electrotechnical Commission (EIC)
   Google Scholar
• Jacobsen , N. E. and John , B. E. 2000 . Two case studies in using Cognitive Walkthrough for interface evaluation (Tech. Rep. CMU–CS-00-132/CMU-HCI-00-100) , Pittsburgh, PA : Carnegie Mellon University .
   Google Scholar
• Jaspers , M. W. M. 2008 . A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence . International Journal of Medical Informatics , 78 ( 5 ) : 340 – 353 .
   PubMedGoogle Scholar
• Jeffries , M. , Miller , J. R. , Wharton , C. and Uyeda , K. M. 1991 . “ User interface evaluation in real world: A comparison of four techniques ” . In Proceeding of ACM Computer–Human Interaction 119 – 124 .
   Google Scholar
• John , B. E. and Packer , H. Learning and using the Cognitive Walkthrough Method: A case study approach . Proceedings of CHI, 1995 . May 7–11 1995 , Denver, Colorado. pp. 429 – 436 . New York : ACM .
   Google Scholar
• John , E. B. and Marks , S. J. 1997 . Tracking the effectiveness of usability evaluation methods . Behaviour & Information Technology , 16 ( 4/5 ) : 188 – 202 .
   Web of Science ®Google Scholar
• Kaptelinin , V. 1996 . “ Computer-mediated activity : Functional organs in social and developmental contexts ” . In Context and consciousness: Activity theory and human–computer interaction , Edited by: Nardi , B. 45 – 68 . Cambridge, MA : MIT Press .
   Google Scholar
• Karat , C. M. , Cambell , R. and Fiegel , T. 1992 . “ Comparison of empirical testing and walkthrough methods in user interface evaluation ” . In Proceedings of ACM CHI 397 – 404 .
   Google Scholar
• Kato , T. and Hori , M. 2005 . “ Articulating the cognitive walkthrough based on an extended model of HCI ” . In Proceedings of HCI International, Las Vegas, July, 2005
   Google Scholar
• Kato , T. and Hori , M. 2006 . Beyond perceivability: Critical requirements for universal design of information . 8th Annual ACM Conference on Assistive Technologies , : 287 – 288 .
   Google Scholar
• Kieras , D. 1985 . An approach to the formal analysis of user complexity . International Journal of Human–Computer Studies , 22 : 365 – 394 .
   Google Scholar
• Kintsch , W. 1988 . The role of knowledge in discourse comprehension: A construction-integration model . Psychological Review , 95 ( 2 ) : 63 – 182 .
   Google Scholar
• Kitajima , M. 2006 . “ Cognitive Walkthrough for the Web ” . In International encyclopedia of ergonomics and human factors , 2nd , 1044 – 1046 . CRC Press . chap. 216
   Google Scholar
• Kitajjma , M. , Blackmon , M. H. and Polson , P. 2000 . “ A comprehension-based model of Web navigation and its application to Web usability analysis ” . In People and Computer XIV 357 – 373 .
   Google Scholar
• Kitajima , M. and Polson , P. G. 1997 . A comprehension based model of comprehension . Human–Computer Interaction , 12 : 345 – 389 .
   Web of Science ®Google Scholar
• Landauer , T. K. and Dumas , S. T. 1997 . A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge . Psychological Review , 104 : 211 – 240 .
   Web of Science ®Google Scholar
• Lewis , C. 1986 . “ A model of mental model construction ” . In Proceeding of ACM Computer–Human Interaction 306 – 313 .
   Google Scholar
• Lewis , C. 1988 . Why and how to learn why: Analysis-based generalization of procedure . Cognitive Science , 12 : 211 – 225 .
   Web of Science ®Google Scholar
• Lewis , C. , Polson , P. , Wharton , C. and Rieman , J. 1990 . “ Testing a walkthrough methodology for theory-based design of walk-up and-use interface ” . In Proceeding of ACM Computer-Human Interaction 235 – 242 .
   Google Scholar
• Mack , R. L. and Nielsen , J. 1994 . “ Executive summary ” . In Usability inspection methods , Edited by: Nielsen , J. and Mack , R. L. 4 – 23 . Amsterdam : Elsevier .
   Google Scholar
• Mahatody , T. , Kolski , C. and Sagar , M. 2009 . “ CWE: Assistance environment for evaluation operating a set of variations of cognitive walkthrough ergonomic inspection method ” . In Engineering Psychology and Cognitive Ergonomics, HCII 2009, LNAI 5639 , Edited by: Harris , D. 52 – 61 . Springer-Verlag .
   Google Scholar
• Mahatody , T. , Sagar , M. and Kolski , C. 2007a . “ Cognitive Walkthrough for HCI evaluation: Basic concepts, evolutions and variants, research issues ” . In Proceedings EAM'07 European Annual Conference on Human-Decision Making and Manual Control June, 2007 , Lyngby : Technical University of Danemark .
   Google Scholar
• Mahatody , T. , Sagar , M. and Kolski , C. 2007b . “ Cognitive Walkthrough pour l'évaluation des IHM: Synthèse des extensions et évolutions conceptuelles, méthodologiques et technologiques [Cognitive walkthrough for HCI evaluation: Synthesis of extensions and conceptual, methodological and technological extensions] ” . In Proceedings of IHM 2007, 19ème Conférence de l'Association Francophone d'Interaction Homme–Machine , 143 – 150 . Paris : International Conference Proceedings Series, ACM Press .
   Google Scholar
• Monk , A. 1998 . Cyclic interaction: a unitary approach to intention, action and the environment . Cognition , 68 ( 2 ) : 95 – 110 .
   PubMed Web of Science ®Google Scholar
• Nardi , B. A. 1996 . Context and consciousness: Activity theory and human–computer interaction , Cambridge, MA : MIT Press .
   Google Scholar
• Niculescu , A. 2008 . Affordances in conversational interactions with multimodal QA systems . HCI and Usability for Education and Work, Lecture Notes in Computer Science , 5298 : 221 – 236 .
   Google Scholar
• Nielsen , J. 1992 . “ Finding usability problems through heuristic evaluation ” . In Proceedings of ACM CHI 373 – 380 .
   Google Scholar
• Nielsen , J. and Mack , R. 1994 . Usability inspection methods , New York : Wiley & Sons .
   Google Scholar
• Nielsen , J. and Molich , R. 1990 . “ Heuristic evaluation of user interfaces ” . In Proceedings of CHI Conference on Human Factors in Computing System 249 – 256 .
   Google Scholar
• Norman , D. A. 1986 . “ Cognitive engineering ” . In User centered systems design: New perspectives in human–computer interaction , Edited by: Norman , D. A. and Draper , S. W. 31 – 61 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Norman , D.A. 1988 . The psychology of everyday things , New York : Basic Books .
   Google Scholar
• Norman , D.A. 1999 . Affordances conventions and design . interactions , 6 ( 3 ) : 38 – 42 .
   Google Scholar
• Pinelle , D. and Gutwin , C. 2002 . “ Groupware walkthrough: Adding context to groupware usability ” . In Proceedings of ACM CHI 455 – 462 .
   Google Scholar
• Polson , P. G. and Lewis , C. H. 1990 . Theory-based design for easily learned interfaces . Human-Computer Interaction , 5 ( 5 ) : 191 – 220 .
   Google Scholar
• Polson , P. , Lewis , C. , Rieman , J. and Wharton , C. 1992 . Cognitive Walkthrough: A method for theory-based evaluation of user interface . International Journal of Man-Machine Studies , 36 : 741 – 773 .
   Google Scholar
• Rieman , J. , Davies , S. , Hair , D. C. , Esemplare , M. , Polson , P. and Lewis , C. 1991 . “ An automated walkthrough: Description and evaluation ” . In Proceeding of ACM Computer–Human Interaction 427 – 428 .
   Google Scholar
• Riihiaho , S. 2000 . Experiencies with usability evaluation methods , Helsinki, , Finland : Licentiate's thesis, Helsinki University of Technology, Laboratory of Information Processing Science .
   Google Scholar
• Rizzo , A. , Mandrigiani , E. and Andreadis , A. 1997 . “ The AVANTI Project: Prototyping and evaluation with a Cognitive Walkthrough based on the Norman's Model of Action ” . In Proceeding of Designing Interactive Systems: Processes, Practices, Methods, & Techniques 305 – 309 .
   Google Scholar
• Rowley , D. E. and Rhoades , D. G. 1992 . “ The Cognitive Jogthrough : A fast-paced user interface evaluation procedure ” . In Proceeding of ACM Computer–Human Interaction 395 – 398 .
   Google Scholar
• Ruttkay , Z. and Akker , R. 2008 . Affordances and Cognitive Walkthrough for analyzing human–virtual human interaction . Verbal and Nonverbal Features of Human–Human and Human–Machine Interaction, Lecture Notes in Computer Science , 5042 : 90 – 106 .
   Google Scholar
• Ryu , H. 2008 . Collective Web Usability analysis: Cognitive and activity walkthroughs . International Journal of Web Engineering and Technology , 4 ( 3 ) : 286 – 312 .
   Google Scholar
• Ryu , H. and Monk , A. 2004 . Analysing interaction problems with cyclic interaction theory: Low-level Interaction Walkthrough . Psychology Journal , 2 ( 3 ) : 304 – 330 .
   Google Scholar
• Sears , A. 1997 . Heuristic Walkthroughs: Finding the problems without the noise . International Journal of Human–Computer Interaction , 9 : 213 – 234 .
   Web of Science ®Google Scholar
• Sears , A. 2003 . “ Testing and evaluation ” . In The human–computer interaction handbook , Edited by: Jacko , J. A. and Sears , A. 1091 – 1092 . Mahwah, NJ : Erlbaum .
   Google Scholar
• Sears , A. and Hess , D. J. 1999 . Cognitive Walkthroughs: Understanding the effect of task-description detail on evaluator performance . International Journal of Human–Computer Interaction , 11 ( 3 ) : 185 – 200 .
   Web of Science ®Google Scholar
• Spencer , R . 2000 . “ The Streamlined Cognitive Walkthrough method, working around social constraints encountered in a software development company ” . In Proceeding of ACM CHI 353 – 359 .
   Google Scholar
• Sweeney , M. , Maguire , M. and Shackel , B. 1993 . Evaluating user–computer interaction: A framework . International Journal of Man–Machine Studies , 38 : 689 – 711 .
   Google Scholar
• Van der Veer , G. C. , Lenting , B. F. and Bergevoet , B. A. J . 1996 . GTA: Groupware Task Analysis—Modeling complexity . Acta Psychologica , 91 : 297 – 322 .
   Web of Science ®Google Scholar
• Van der Veer , G. C. and van Velie , M. 2000 . Task-based groupware design: Putting theory into practice . Proceedings of DIS'2000 , : 326 – 337 .
   Google Scholar
• Virzi , R. A. 1997 . “ Usability inspection methods ” . In Handbook of human–computer interaction , Edited by: Helander , M. , Landauer , T. K. and Prablhu , P. 705 – 715 . Amsterdam : Elsevier .
   Google Scholar
• Wang , X. 2008 . Design and evaluation of intelligent menu interface through Cognitive Walkthrough procedure and automated logging for management information system . Computer Supported Cooperative Work in Design IV, Lecture Notes in Computer Science , 5236 : 408 – 418 .
   Google Scholar
• Wharton , C. , Bradford , J. , Jeffrey , R. and Franzke , M. 1992 . “ Applying Cognitive Walkthrough to more complex user interfaces: Experiences, issues, and recommendations ” . In Proceedings of Computer–Human Interaction 381 – 388 .
   Google Scholar
• Wharton , C. , Rieman , J. , Lewis , C. and Polson , P. 1994 . “ The Cognitive Walkthrough method: A practitioner's guide ” . In Usability inspection methods , Edited by: Nielsen , J. and Mack , R. L. 105 – 140 . New York : Wiley & Sons .
   Google Scholar
• Zhang , J. and Norman , D. A. 1994 . Representations in distributed cognitive tasks . Cognitive Science , 18 : 87 – 122 .
   Web of Science ®Google Scholar