Gamified Mobile Sensing Storytelling Application for Enhancing Remote Cultural Experience and Engagement

Mobile AR Interaction Design Patterns for Storytelling in Cultural Heritage: A Systematic Review

“…Since the primary focus of this AR design pattern is to present AR content, the users tend to act as viewers, and, consequently, this might result in limited provided interactions. Tan and Ng (2022) [71] have introduced an interactive AR activity in their mobile game that asks users to virtually place white candles in their surroundings, while keeping a distance between them, in order to simulate a ritual for the festivals of the Kristang community.…”

“…This design pattern might also involve simulation techniques for realistic object manipulation behavior (e.g., physics). The types of AR content that can be manipulated range from small-scale items, like digitized exhibits and cultural heritage items [17,38,47,56] embalmed animals [53], and 3D traditional food assets [71] to 3D reconstructions of historical buildings [43,45,60]. Regarding the latter, human-scale representations of buildings are chosen to be presented via AR to achieve a better user experience during manipulation.…”

“…Instead of written answers, an AR quiz accepts visual input from a live camera feed as the user's responses as depicted in Figure 10. In the work by Tan & Ng (2022) [71], users have to guess the meaning of a word in the Kristang language that describes an everyday object (e.g., a bottle) and answer by taking a photo of the actual object in their physical surroundings. Paliokas et al (2020) [56] have implemented a treasure-hunt-like AR quiz to encourage the visitors of a silversmithing museum to self-assess their gained knowledge.…”

“…In this case, the virtual content possesses inherent value; thus, it does not rely on reality for contextualization. For example, in the work by Tan and Ng (2022) [71], users can view 3D-scanned traditional food dishes via AR, while, in another interactive AR activity, they can simulate a 3D scene of a ritual for the festivals of the Kristang community in their own space. Similarly, users of the mobile AR app designed by Sabie et al (2023) [62] can perform various cultural rituals around everyday objects via AR.…”

“…DefinitionUsers interact with virtual objects overlaid in the real environment with touch-based single-hand interactionsUse casesObject-specific manipulation in AR scene Manipulation cases for 3D objects: food dishes, porcelain vases, monuments, buildings, exhibits References[17,38,43,45,47,53,54,56,60,62,71] …”