Introducing a design framework for reputation systems in multi-tier production communities

Abstract

Reputation systems are an important part of online production communities, for they provide both users and machine with proper metrics to assess the truthfulness and reliability of users, and their generated content. In multi-tier communities, in which users can be promoted to higher ranks, reputation systems are given a new role, which is helping the community to have a more meritocratic promotion process. This paper provides a design framework for reputation systems and promotion processes in the context of multi-tier production communities (MPCs). An apt promotion process based on a well-designed reputation system can be deemed as a valid practice to motivate users, enhance their level of trust and satisfaction, and increase the quantity and quality of contributions. We address different aspects and design elements of reputation systems and their association with and their impact on user participation in production communities, particularly those with a multi-tier structure.

Keywords:

• online communities
• multi-tier production communities
• reputation systems
• participation
• promotion

Acknowledgements

We would like to thank Ivo Blohm and Jan Marco Leimeister for their valuable feedback and insight. Also special thanks to the reviewers of this paper for their detailed comments that helped us enhance the quality of this paper.

Notes

In this paper, the term ‘community’ is used as a short form of ‘online community’, unless otherwise stated.

The effect of leaderboards may vary depending on the lifecycle of a community. For example, Lerman (2007) argues that eliminating user top list (leaderboard) of Digg.com in its maturity phase did not seem to have any negative effect on participation.