Using game mechanics for field evaluation of prototype social applications: a novel methodology

Abstract

This paper describes a novel methodology to evaluate a social media application in its formative phase of design. Taking advantage of the experiences developed in the Alternate Reality Games, we propose to insert game mechanics in the test setting of a formative evaluation of a prototypical social system. As a use case, we present the evaluation of WantEat, a prototypical social mobile application in the gastronomical domain. The evaluation highlighted how the gamification of a field trial can yield good results when evaluating social applications in prototypical status. From a methodological point of view, gamifying a field trial overcomes the cold start problem, caused by the absence of active communities, which can prevent the participation of users and therefore the collection of reliable data. Our experience showed that the gamification of a field evaluation is feasible and can likely increase the quantity of both browsing actions and social actions performed by users. Based on these results, we then are able to provide a set of guidelines to gamify the evaluation session of an interactive system.

Game‐XP: Action Games as Experimental Paradigms for Cognitive Science

“…Attempts to identify the elements that make games challenging, motivating, and enjoyable with the goal of altering the elements of traditionally nongame activities or instruction “to afford … [the] motivating, enjoyable experiences” characteristic of gameplay (Deterding, ) (see also, Mayer, ; Rapp, Cena, Gena, Marcengo, & Console, ; Wikipedia, ).…”

Socialification: Social Software Elements Analysis and Design

“…More specifically, students will test and demonstrate their social software elements. Reading: [51] Due: Written reflection on the learning experience (10%) W13 -Demo presentations This last lecture is entirely reserved to the group projects presentations. Due: Presentations (5%) and assessment of the group projects (final product and documentation (20%)).…”

Alternative Authentication in the Wild

“…These incentives could potentially influence frequency of use and mask the acceptance of an authentication mechanism. If we avoid incentives we have to ensure that the primary task is persuasive enough to motivate consumers to return to the application by offering actual benefits [39]. The barrier to their receiving such benefits is the experimental authentication mechanism.…”

“…• Persuasive primary task The application should offer benefits and avoid perverse incentives that could influence behaviour [39], i.e. course credit and monetary rewards are significant benefits, potentially worth the cost of complex authentication.…”