Usability Problem Reports for Comparative Studies: Consistency and Inspectability

REFERENCES

• Barendregt , W. and Bekker , M. M. 2006 . Developing a coding scheme for detecting usability and fun problems in computer games for young children. . Behavior Research Methods , 38 : 382 – 389 .
   Google Scholar
• Cockton , G. , Lavery , D. and Woolrych , A. 2002 . “ Inspection-based evaluations. ” . In The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications , Edited by: Jacko , J. and Sears , A. 1118 – 1138 . Mahwah, NJ : Erlbaum .
   Google Scholar
• Daams, B., & Hariandja, J. (2006). Cross-cultural usability, testing a food processor in Indonesia and the Netherlands. Proceedings of IEA2006: 16th World Congress on Ergonomics IEA2006. Amsterdam: Elsevier.
   Google Scholar
• Guba , E. G. and Lincoln , Y. S. 1989 . Fourth generation evaluation , London : Sage .
   Google Scholar
• Hartson , H. R. 2003 . Cognitive, physical, sensory and functional affordances in interaction design. . Behaviour & Information Technology , 22 ( 5 ) : 315 – 338 .
   Web of Science ®Google Scholar
• Hartson , H. R. , Andre , T. S. and Williges , R. C. 2001 . Criteria for evaluating usability evaluation methods. . International Journal of Human-Computer Interaction , 13 ( 4 ) : 373 – 410 .
   Web of Science ®Google Scholar
• Hertzum , M. and Jacobsen , N. E. 2001 . The evaluator effect: A chilling fact about usability evaluation methods. . International Journal of Human-Computer Interaction , 13 ( 4 ) : 421 – 443 .
   Web of Science ®Google Scholar
• Hertzum , M. , Jacobsen , N. E. and Molich , R. Usability inspections by groups of specialists: Perceived agreement in spite of disparate observations. Extended Abstracts of the ACM CHI 2002 Conference. New York : ACM .
   Google Scholar
• Hoenderdos , R. , Vermeeren , A. P. O. S. , Bekker , M. M. and Pierik , A. Design for experience: The “Look, mama!” experience. Proceedings of Interaction Design and Children Conference 2002 . Maastricht, , the Netherlands : Shaker Publishing BV .
   Google Scholar
• Jacobsen , N. E. , Hertzum , M. and John , B. E. The evaluator effect in usability tests. Proceedings of the CHI'98 Conference on Human Factors in Computing Systems (Summary) . New York : ACM .
   Google Scholar
• Kanis , H. 1993 . “ Reliability in ergonomics/human factors. ” . In Contemporary ergonomics: Ergonomics and energy , Edited by: Lovesey , E. J. 91 – 96 . London : Taylor & Francis .
   Google Scholar
• Lavery , D. , Cockton , G. and Atkinson , M. 1997 . Comparison of evaluation methods using structured usability reports. . Behaviour & Information Technology , 16 ( 4 ) : 246 – 266 .
   Google Scholar
• Law , E. L.-C. and Hvannberg , E. T. Analysis of combinatorial user effect in international usability tests. Proceedings of ACM CHI 2004 Conference on Human Factors in Computing Systems . New York : ACM .
   Google Scholar
• Molich , R. , Ede , M. R. , Kaasgaard , K. and Karyukin , B. 2004 . Comparative usability evaluation. . Behaviour & Information Technology , 23 ( 1 ) : 65 – 74 .
   Web of Science ®Google Scholar
• Noiwan , J. and Norcio , A. F. 2006 . Cultural differences on attention and perceived usability: Investigating color combinations of animated graphics . International Journal of Human-Computer Studies , 64 ( 2 ) : 103 – 122 .
   Google Scholar
• Park , K. S. and Lim , C. H. 1999 . A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. . International Journal of Industrial Ergonomics , 23 : 379 – 389 .
   Web of Science ®Google Scholar
• Vermeeren , A. P. O. S. 1999 . “ Designing scenarios and tasks for user trials for home electronic devices. ” . In Human factors in product design: Current practice and future trends , Edited by: Green , W. S. and Jordan , P. W. 47 – 55 . London : Taylor & Francis .
   Google Scholar
• Vermeeren, A. P. O. S. (2003). The DEVAN checklist for detecting problems in interactions: User manual (Checklist Ver. 1.1; Tech. Rep.). Delft, the Netherlands: Delft University of Technology, Faculty of Industrial Design Engineering.
   Google Scholar
• Vermeeren , A. P. O. S. 2004 . “ Structured video analysis of user test data, using the DEVAN tool. ” . In Usability testing: Methods, experiences, achievements , Edited by: Erbuğ , Ç. 123 – 140 . Ankara, , Turkey : Middle East Technical University, Faculty of Architecture .
   Google Scholar
• Vermeeren , A. P. O. S. , Bekker , M. M. , van Kesteren , I. E. H. and de Ridder , H. Experiences with structured interviewing of children during usability tests. Proceedings of HCI 2007, The 21st British HCI Group Annual Conference . Swindon, , UK : BCS .
   Google Scholar
• Vermeeren , A. P. O. S. , den Bouwmeester , K. , Aasman , J. and de Ridder , H. 2002 . DEVAN: A tool for detailed video analysis of user test data. . Behaviour & Information Technology , 21 ( 6 ) : 403 – 423 .
   Web of Science ®Google Scholar
• Vermeeren , A. P. O. S. , Koenderink-van Doorn , A. J. and de Ridder , H. Reliability of a checklist-based user test data analysis procedure. Proceedings IEA 2006 Congress: Meeting Diversity in Ergonomics . Amsterdam : Elsevier .
   Google Scholar
• Vermeeren , A. P. O. S. , van Kesteren , I. E. H. and Bekker , M. M. Managing the evaluator effect in user testing. Proceedings of INTERACT'03 . Amsterdam : IOS Press .
   Google Scholar