2016-11-03T14:11:40

Abstract.A serious video game was created to teach players about cognitive bias and encourage mitigation of both confirmation bias and the fundamental attribution error. Multiplayer and single-player versions of the game were created to test the effect of different feedback sources on bias mitigation performance. A total of 626 participants were randomly assigned to play the single player/multiplayer game once or repeatedly. The results indicate the single player game was superior at reducing confirmation bias and that repeated plays and plays of longer duration were more effective at mitigating both biases than a control condition where participants watched a training video.

One of the benefits of using digital games for education is that games can provide feedback for learners to assess their situation and correct their mistakes. We conducted two studies to examine the effectiveness of different feedback design (timing, duration, repeats, and feedback source) in a serious game designed to teach learners about cognitive biases. We also compared the digital game-based learning condition to a professional training video. Overall, the digital game was significantly more effective than the video condition. Longer durations and repeats improve the effects on bias-mitigation. Surprisingly, there was no significant difference between just-in-time feedback and delayed feedback, and computer-generated feedback was more effective than feedback from other players.

This paper describes the process of rapid iterative prototyping used by a research team developing a training video game for the Sirius program funded by the Intelligence Advanced Research Projects Activity (IARPA). Described are three stages of development, including a paper prototype, and builds for alpha and beta testing. Game development is documented, and the process of playtesting is reviewed with a focus on the challenges and lessons-learned. Advances made in the development of the game through the playtesting process are discussed along with implications of the rapid iterative prototyping approach.

No abstract