A Framework for Cypher-Physical Human-robot Collaborative Immersive MR Interaction – Beaux Arts Ball 4.0

Abstract

In this paper, we presented a human-robot collaborative mixed reality application – Beaux Arts Ball 4.0, in which a real-time interactive hybrid and physical architectural environment were designed and experienced through the tools and techniques of mixed reality, cypher-physical, teleoperation, telepresence, and automation. The application engaged the user and observer in a continuous loop of architectural transformation during the experience, where every type of sensory was blurred between physical and digital perception.