Towards Metaverse: Utilizing Extended Reality and Digital Twins to Control Robotic Systems

Abstract

Digitalization shapes the ways of learning, working, and entertainment. The Internet, which enables us to connect and socialize is evolving to become the metaverse, a post-reality universe, enabling virtual life parallel to reality. In addition to gaming and entertainment, industry and academia have noticed the metaverse’s benefits and possibilities. For industry, the metaverse is the enabler of the future digital workplace, and for academia, digital learning spaces enable realistic virtual training environments. A connection bridging the virtual world with physical production systems is required to enable digital workplaces and digital learning spaces. In this publication, extended reality–digital twin to real use cases are presented. The presented use cases utilize extended reality as high-level user interfaces and digital twins to create a bridge between virtual environments and robotic systems in industry, academia, and underwater exploration.

Future Service Robot Scenarios in South Korea

“…Battery and telecommunication technology development make existing service robots, such as telepresence and patient mobility robots, more effective [72]. People can use digital twins in virtual environments to control service robots [73]. However, there is no common robot use platform [74].…”

Designing an Educational Metaverse: A Case Study of NTUniverse

“…Previously implemented designs of digital twins and applications of the metaverse in the healthcare industry and medical training are well reported; these aim to transform healthcare domains [7], including breast cancer monitoring and the training of new doctors [8]. Designs based on the Unity 3D development engine, which are used in a variety of industry verticals including automotive, manufacturing, energy, and aerospace [9], are discussed in terms of different applications, such as smart cities [10], robotics control [11], and guided tour [12].…”