VitaZ: Gamified Mixed Reality Multisensorial lnteractions

Abstract

This paper presents multiple Mixed Reality 3D interaction, manipulation and simulation techniques in the context of the 2019 3DUI contest of the IEEE VR conference. The proposed schemes provide smart, seamless transition from the real to the virtual world and demonstrate passive haptics, mid-air haptics, object manipulation and abstract entities (time) manipulation. All techniques are integrated in the context of a mixed reality escape-room or treasure-hunt game, where information from both the real and the virtual world is necessary to solve the puzzle. The paper concludes with a discussion on the extensibility and translational application of the approaches in practical problem solving.