Passive Profiling and Natural Interaction Metaphors for Personalized Multimedia Museum Experiences

Abstract

Museums must balance the amount of information given on individual pieces or exhibitions in order to provide sufficient information to aid visitor understanding. At the same time they must avoid cluttering the environment and reducing the enjoyment of the exhibit. Moreover, each visitor has different interests and each might prefer more (or less) information on different artworks depending on their individual profile of interest. Finally, visiting a museum should not be a closed experience but a door opened onto a broader context of related artworks, authors, artistic trends, etc. In this paper we describe the MNEMOSYNE system that attempts to provide such a museum experience. Based on passive observation of visitors, the system builds a profile of the artworks of interest for each visitor. These profiles of interest are then used to personalize content delivery on an interactive table. The natural user interface on the interactive table uses the visitor's profile, a museum content ontology and a recommendation system to personalize the user's exploration of available multimedia content. At the end of their visit, the visitor can take home a personalized summary of their visit on a custom mobile application. In this article we describe each component of our approach as well as the first field trials of our prototype system built and deployed at our permanent exhibition space at Le Murate 1 in the city of Florence.

Recommending multimedia visiting paths in cultural heritage applications

“…In [10], the authors describe the latest approaches related to how we can model and represent the users in the context of cultural heritage applications and how we can use those models to reason with regard to the available information. All these approaches are useful to perform a personalization of the services [33,37,52,1,18].…”

Culture Management: Strategy and Marketing Aspects

“…The website features a booklet about the adventures of the characters, an animated series about their greatest blunders, as well as unique games, thanks to which young opera lovers will find that the Grand Theater can be very interesting for them as well. (Sparacino 2004, Scott 2011, Karaman et al 2013, Barrera eta al. 2013, Jones 2016, Rialti et al 2016.…”

A cognition-centered personalization framework for cultural-heritage applications

“…Based on such human factors, several frameworks have been proposed, which mainly focus on user models that exploit visitors' preferences and interests through either active interaction [Pechenizkiy and Calders 2007] or passive observation [Karaman et al 2013] in either individual or group level [Hong et al 2017]. Both implicit and explicit visitor modeling is supported, providing adaptive interventions of varying characteristics, such as storytelling [Pujol et al 2013] and tag annotations [Carmagnola et al 2008].…”