How Do One's Peers on a Leaderboard Affect Oneself?

Abstract

Leaderboards are a workhorse within the gamification literature. While the effect of a leaderboard has been well studied, there is much less evidence how one's peer group affects the treatment effect of a leaderboard. Through a pre-registered field experiment involving more than 1000 users on an online movie recommender system, we expose users to leaderboards, but different sets of users are exposed to different peer groups. Contrary to what a standard behavioral model would predict, we find that a user's contribution increases when their peer's scores are more dispersed. We also find that decreasing average peer contributions motivates a user to contribute more. Moreover, these effects are themselves mediated by group size. This suggests that existing theories of motivation and demotivation with regards to leaderboards may need revision, and also illustrates the potential of using personalized leaderboards to increase contributions.

When Gamification Spoils Your Learning: A Qualitative Case Study of Gamification Misuse in a Language-Learning App

“…For example, an unsatisfied user has commented, "I think it's pretty unfair for someone who is at level 23 in Spanish [lessons] to be competing with someone at level 5." The extant literature of gamification also states that leaderboards can be less motivating (or even off-putting) to users if they do not give all users a fair chance to compete or become successful in the gamified aspects of the app [75].…”