Use and Usability of a Discovery Tool in an Academic Library

Abstract

In order to assess the use and usability of a new discovery tool, staff at the University of Kansas Libraries conducted usability tests with 27 users and analyzed three semesters of the tool's usage as measured by custom event tracking implemented in Google Analytics and usage statistics drawn from the discovery tool and server logs. An initial study with sixteen users was conducted prior to launching the new tool, and a subsequent study with eleven users was conducted a semester after the launch. This article describes test participants’ success using the new tool to complete basic library research tasks, details the specific features they used in their attempts (e.g., facets, “did you mean” suggestions), and identifies areas where changes were made to address problems identified in the studies, including changes outside the tool itself. In addition, comparisons between feature use in the discovery system as observed in usability testing and feature use as measured by event tracking and log analysis are discussed, including implications for the design of future tests.

KEYWORDS:

• usability
• Web analytics
• Web-scale discovery
• academic libraries