TwinXR: Method for using digital twin descriptions in industrial eXtended reality applications

Abstract

Digital twins (DTs) and eXtended Reality (XR) are two core technological enablers for engineering in the Metaverse that can accelerate the human-centric Industry 5.0 transformation. The digital twin technology provides a digital representation of a physical asset with data linkages for inspection, monitoring, and prediction of complex processes or systems, while eXtended reality offers real-and-virtual combined environments for human users to interact with machines. However, the synergies between digital twins and eXtended reality remain understudied. This work addresses this research gap by introducing a novel method “TwinXR” that leverages ontology-based descriptions of Digital twins, i.e., digital twin documents, in industrial eXtended reality applications. To ease the use of the TwinXR method, we publish a Unity package that allows data flow and conversion between eXtended reality applications and digital twin documents on the server. Finally, the work applies the TwinXR method in two industrial eXtended reality applications involving overhead cranes and a robot arm to demonstrate the use and indicate the validity of the method. We conclude that the TwinXR method is a promising way to advance the synergies between digital twins and eXtended reality: For eXtended reality, TwinXR enables efficient and scalable eXtended reality development; For digital twins, TwinXR unlocks and demonstrates the potential of digital twins for data interchange and system interoperation. Future work includes introducing more detailed principles of Semantic Web and Knowledge Graph, as well as developing factory-level TwinXR-compatible applications.

Digital Twin-Enabled Internet of Vehicles Applications

“…This layer enables real-time visual monitoring of the system's operational status, thus serving as a critical touchpoint for users. The Visualization Layer also incorporates advanced immersive technologies like VR, AR, and Hybrid Reality, collectively known as Extended Reality (XR) [117,118]. XR technologies offer a seamless integration between the physical and virtual worlds, creating a visually compelling, immersive, interactive experience for users.…”

Comparisons of Emotional Responses, Flow Experiences, and Operational Performances in Traditional Parametric Computer-Aided Design Modeling and Virtual-Reality Free-Form Modeling

“…The use of VR and extended reality (XR, representing all technologies that merge the physical and virtual worlds) has been widely investigated across various sectors, notably in Industry 5.0, Architecture, Engineering, and Construction (AEC), and education. Tu et al (2023) emphasized the role of digital twins (DTs) and XR in accelerating the human-centric Industry 5.0 transformation, highlighting their ability to provide digital representations of physical assets and offer interactive environments for humans and machines [10]. Alizadehsalehi et al (2020) demonstrated the value of XR in simulating multidimensional digital models of construction projects [11], while Bellalouna (2019) discussed the potential of VR for cognitive design-review and failure modes and effects analysis (FMEA) in industrial engineering [12].…”

Tutoring in the metaverse. Study on student-teachers’ and tutors’ perceptions about NPC tutor

“…Finally, mixed or "hybrid" reality is defined as the mixing of physical and digital reality (Pimentel and Teixeira, 1993;Wu et al, 2013;Di Tore et al, 2020). Thanks to the integrated use of emerging technologies (digital twins, block chain, holography, IoT) (Center for Journalism Studies of Tsinghua University, 2021; Kang, 2021;Lv et al, 2022;Park and Kim, 2022;Prieto et al, 2022), the metaverse is nowadays assumed as extended reality (XR), that effectively integrates and overcome the simple sum of augmented, mixed and virtual reality technologies (Park and Kim, 2022;Tu et al, 2023 -see Figure 1). Specifically, in the metaverse interaction performance, evaluation and user emotional responses would be made more vivid by an interaction-feedback system guided and mediated by artificial intelligence that analyzes numerous data in real time (Hennig-Thurau et al, 2023) -see Figure 2.…”