Evaluation of a Resource Discovery Service: FindIt@Bham

Abstract

In autumn 2012, the University of Birmingham launched FindIt@Bham, a Primo-based Resource Discovery Service, after a series of focus groups with students and staff to help determine its initial configuration and customization. This article presents the results from a large-scale online survey and focus groups that were conducted to poll users’ attitudes to the service over twelve months later, adding to a small body of research on user satisfaction with established resource discovery services. From the survey the overall level of appreciation was high with 71.13% rating FindIt@Bham to be “Good” or “Very Good.” The level of appreciation was compared across undergraduates, postgraduates (taught and research), and academic staff which revealed that undergraduates are the group of users most happy with the service with academic staff being least satisfied. The reasons for this discrepancy are considered, along with users’ behavior and a discussion of their perceptions of individual functional areas. The survey results led to focus group activities tailored to extract deeper information on system usage and satisfaction. From these combined activities, future customizations and developments to FindIt@Bham such as tuning of result relevancy, improved online help, and additional functionality can be prioritized.

KEYWORDS:

• resource discovery
• web-scale discovery
• user experience
• user behavior
• academic library
• primo
• evaluation
• staff
• students
• survey
• focus groups