Advanced search
Publication Cover
Behaviour & Information Technology Volume 22, 2003 - Issue 5
Submit an article Journal homepage
3,356
Views
269
CrossRef citations to date
0
Altmetric
Original Articles

Retrospective vs. concurrent think-aloud protocols: Testing the usability of an online library catalogue

Maaike van den Haak Department of Communication Studies, University of Twente Institute for Behavioural Research, P.O. Box 217, Enschede, 7500 AE, The Netherlands E-mail: [email protected]
,
Menno De Jong Department of Communication Studies, University of Twente Institute for Behavioural Research, P.O. Box 217, Enschede, 7500 AE, The Netherlands
&
Peter Jan Schellens Department of Communication Studies, University of Twente Institute for Behavioural Research, P.O. Box 217, Enschede, 7500 AE, The Netherlands
Pages 339-351 | Published online: 08 Nov 2010

  • ALLWOOD , C. M. and KALEN , T. 1997 . Evaluating and improving the usability of a user manual . Behaviour & Information Technology , 16 : 43 – 57 .
  • BARNUM , C. M. 2002 . Usability Testing and Research , New York : Longman .
  • BATTLESON , B. , BOOTH , A. and WEINTROP , J. 2001 . Usability testing of an academic library web site: a case study . Journal of Academic Librarianship , 237 : 188 – 198 .
  • BOLTON , R. L. 1993 . Pretesting questionnaires: content analyses of respondents' concurrent verbal protocols . Marketing Science , 12 : 280 – 303 .
  • BOREN , M. T. and RAMEY , J. 2000 . Thinking aloud: reconciling theory and practice . IEEE Transactions on Professional Communication , 43 : 261 – 278 .
  • BOWERS , V. A. and SNYDER , H. L. Concurrent versus retrospective verbal protocols for comparing window usability . Human Factors Society 34th Meeting . October 8-12 1990 , Santa Monica. pp. 1270 – 1274 . HFES .
  • BRANCH , J. L. 2000 . Investigating the information-seeking processes of adolescents: The value of using think alouds and think afters . Library & Information Science Research , 22 : 371 – 392 .
  • CAMPBELL , N. , ed. 2001 . Usability Assessment of LibraryRelated Web Sites: Methods and Case Studies. , Chicago : LITA .
  • CAULTON , D. A. 2001 . Relaxing the homogeneity assumption in usability testing . Behaviour & Information Technology , 20 : 1 – 7 .
  • DE JONG , M. and SCHELLENS , P. J. 2000 . Toward a document evaluation methodology: what does research tell us about the validity and reliability of methods? . IEEE Transactions on Professional Communication , 43 : 242 – 260 .
  • DIELI , M. 1986 . Designing Successful Documents: An Investigation of Document Evaluation Methods , Pittsburgh, PA : Carnegie Mellon University . (Dissertation
  • DUMAS , J. S. and REDISH , J. C. 1999 . A Practical Guide to Usability Testing, , Revised edition , Exeter : Intellect .
  • ERICSSON , K. A. and SIMON , H. A. 1993 . Protocol Analysis: Verbal Reports as Data , Cambridge, MA : MIT Press .
  • GRAY , W. D. and SALZMAN , M. C. 1998 . Damaged merchandise? A review of experiments that compare usability evaluation methods . Human-Computer Interaction , 13 : 203 – 261 .
  • HASSENZAHL , M. 2000 . Prioritizing usability problems: datadriven and judgement-driven severity estimates . Behaviour & Information Technology , 19 : 29 – 42 .
  • HENDERSON , R. D. , SMITH , M. C. , PODD , J. and VARELAALVAREZ , H. 1995 . A comparison of the four prominent user-based methods for evaluating the usability of computer software . Ergonomics , 38 : 2030 – 2044 .
  • Hoc , J. M. and LEPLAT , J. 1983 . Evaluation of different modalities of verbalization in a sorting task . International Journal of Man-Machine Studies , 18 : 283 – 306 .
  • JANSEN , C. and STEEHOUDER , M. 1992 . Forms as a source of communication problems . Journal of Technical Writing and Communication , 22 : 179 – 194 .
  • JOHN , B. E. and MARKS , S. J. 1997 . Tracking the effectiveness of usability evaluation methods . Behaviour & Information Technology , 16 : 188 – 202 .
  • KUUSELA , H. and PAUL , P. 2000 . A comparison of concurrent and retrospective verbal protocol analysis . American Journal of Psychology , 113 : 387 – 404 .
  • LAVERY , D. , COCKTON , G. and ATKINSON , M.P. 1997 . Comparison of evaluation methods using structured usability problem reports . Behaviour & Information Technology , 16 : 246 – 266 .
  • LEWIS , J.R. 1994 . Sample sizes for usability studies: additional considerations . Human Factors , 36 : 369 – 378 .
  • LOXTERMAN , J. A. , BECK , I. L. and McKEOWN , M. G. 1994 . The effects of thinking aloud during reading on students' comprehension of more or less coherent text . Reading Research Quarterly , 29 : 353 – 367 .
  • NIELSEN , J. 1993 . Usability Engineering , Boston, MA : Academic Press .
  • NIELSEN , J. 1994 . Estimating the number of subjects needed for a thinking aloud test . International Journal of HumanComputer Studies , 41 : 385 – 397 .
  • NORLIN , E. and WINTERS , C. M. I. 2002 . Usability testing for library websites: a hands-on guide , Chicago : American Library Association .
  • RUBIN , J. 1994 . Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , New York : Wiley .
  • Russo , J. E. , JOHNSON , E. J. and STEPHENS , D. L. 1989 . The validity of verbal protocols . Memory & Cognition , 17 : 759 – 769 .
  • SCHRIVER , K.A. 1997 . Dynamics in Document Design; Creating Text for Readers , New York : Wiley .
  • SIENOT , M. 1997 . Pretesting web sites; a comparison between the plus-minus method and the think-aloud method for the World Wide Web . Journal of Business and Technical Communication , 11 : 469 – 482 .
  • SMILOWITZ , E. D. , DARNELL , M. J. and BENSON , A. E. 1994 . Are we overlooking some usability testing methods? A comparison of lab, beta, and forum tests . Behaviour & Information Technology , 13 : 183 – 190 .
  • TAYLOR , K. L. and DIONNE , J. P. 2000 . Accessing problemsolving strategy knowledge: The complementary use of concurrent verbal protocols and retrospective debriefing . Journal of Educational Psychology , 29 : 413 – 425 .
  • TEAOUE , R. , DE JESUS , K. and NUNES-UENO , M. Concurrent vs. post-task usability test ratings . Conference on Human Factors and Computing Systems . 31 March-5 April 2001 , Seattle, WA. pp. 289 – 290 . ACM SIGCHI .
  • VIRZI , R. A. 1992 . Refining the test phase of usability evaluation: how many subjects is enough? . Human Factors , 34 : 457 – 468 .
  • WRIOHT , P. C. and MONK , A. F. 1991 . A cost-effective evaluation method for use by designers . International Journal of Man-Machine Studies , 36 : 544 – 565 .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.