Challenge Balancing for Personalised Game SpacesBakkes, S.C.J.; Whiteson, S.A.; Li, G.; Viniuc, G.V.; Charitos, E.; Heijne, N.; Swellengrebel, A.
General rightsIt is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), other than for strictly personal, individual use, unless the work is under an open content license (like Creative Commons).
Disclaimer/Complaints regulationsIf you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library: http://uba.uva.nl/en/contact, or a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible. Abstract-In this paper we propose an approach for personalising the space in which a game is played (i.e., levels) -to the end of tailoring the experienced challenge to the individual user during actual play of the game. Our approach specifically considers two design challenges, namely implicit user feedback and high risk of user abandonment. We contribute an approach that acknowledges that for effective online game personalisation, one needs to (1) offline learn a policy that is appropriate in expectation across users -to be used for initialising the online game, (2) offline learn a mapping from gameplay observations to the player experience -to be used for guiding the online game personalisation, and (3) rapidly converge to an appropriate policy for the individual user in online gameplay -employing the learned feedback model and a straightforward model of user abandonment. User studies that validate the approach to online game personalisation in the actual video game INFINITE MARIO BROS. indicate that it provides an effective basis for automatically balancing the game's challenge level to the individual human player.