Crowdsourcing systems call a crowd of users to collaborate on solving real-life problems. One key issue for the success of such systems is to guarantee users' participation. A strategy that has been used to promote user participation is the use of game design techniques, since games have successful strategies to grant enjoyable user experience. However, most gamification methods and guidelines are too generic, do not emphasize the collaboration aspects and focus on introducing rewarding elements into the application, instead of designing player-centric applications. Reward-based design is dangerous, specially for collaborative systems, because it may put points gathering as the primary purpose of the application instead of the collaboration goal. This paper presents G.A.M.E., a conceptual framework to guide the design of gamification in crowdsourcingbased systems. The framework provides a flexible step-by-step guideline that combines knowledge from software engineering, collaborative systems, game design and interaction design. To evaluate our proposal, we instantiated G.A.M.E. into two applications in the domain of public transportation. The influence of gamification in those applications were evaluated through controlled navigation tests in a crowdsourcing usability testing platform. Our findings showed us that gamification improved user interfaces of collaboration activities by 16% on usability and were more trustworthy in 80% the cases.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.