A state-of-the-art survey on Augmented Reality-assisted Digital Twin for futuristic human-centric industry transformation

Yin, Yue; Zheng, Pai; Li, Chengxi; Wang, Lihui

doi:10.1016/j.rcim.2022.102515

Cited by 132 publications

(28 citation statements)

References 90 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Its main features include real-time monitoring, reprogramming, offline simulation, virtual test bench for optimization, and operator training, improving traditional methods because more accurate data and timely responses to dynamic process events can be obtained. AR and DT are tools that facilitate the fusion of the virtual and the physical and have shown a growing interest in the area of research and industry under the wave of the human-centered concept such as Industry 5.0, being one of the enabling technologies that can positively influence the man-machine relationship [16].…”

Section: Introductionmentioning

confidence: 99%

Digital Twin to Control and Monitor an Industrial Cyber-Physical Environment Supported by Augmented Reality

Caiza

Sanz

2023

Applied Sciences

View full text Add to dashboard Cite

Increasing industrial development and digital transformations have given rise to a technology called Digital Twin (DT) that has the potential to break the barrier between physical and cyberspace. DT is a virtual and dynamic model enabled through a bidirectional data flow that creates high-reliability models with interconnection and fusion between the physical and digital systems for full integration. In smart manufacturing, this technology is increasingly used in research and industry. However, the studies conducted do not provide a definition or a single integrally connected model. To develop the Digital Twin shown in this research, the literature was reviewed to learn about the enabling technologies and architectures used at the industrial level. Then, a methodology was used to obtain the physical process information, create the digital environment, communicate the physical environment, apply simulation models in the digital environment, and parameterize the simulation environment with the physical process in real-time to obtain the digital twin supported with augmented reality. The system was implemented in the MPS-500 modular production station that has industrial sensors and actuators. The virtual environment was designed with Blender and Vuforia to create the augmented reality environment. In the proposed methodology, robust devices (field and control level) and low-cost embedded systems were used for the creation and communication of the virtual environment (monitoring and control); for the joint work of these technologies, they were carried out through the use of the following protocols: Open Platform Communications United Architecture (OPC UA), Ethernet, and machine to machine (M2M), with which a communication was achieved between the different levels of the automation pyramid. The results show that the proposed methodology for the implementation of the DT allows bidirectional communication between the physical and virtual environment and can also be visualized with the support of AR, thus providing its characteristics to the proposed DT. Digital Twin is an essential factor in creating virtual environments and improving applications between the real and digital world, establishing a bidirectional communication through the Ethernet protocol, with a communication time of approximately 100 ms. This technology interacts with the virtual environment and performs mappings, thus achieving timely and dynamic adjustment. This improves data management and production and incorporates process simulation and physical control in real-time, allowing to execute and trigger actions in the physical equipment simultaneously.

show abstract

Section: Introductionmentioning

confidence: 99%

Digital Twin to Control and Monitor an Industrial Cyber-Physical Environment Supported by Augmented Reality

Caiza

Sanz

2023

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Although, such simulations cannot be performed in real-time, machine learning models based on the synthetic data can be useful 91 . The capabilities of digital twin are sometimes enhanced with the Virtual and Augmented Reality technologies 92 that enable human–machine interactions 93 , 94 . For example, Perez et al 95 presented and validated a VR-enhanced DT for designing the automated process of a multi-robot manufacturing setup as well as its enhanced implementation and in-operando monitoring.…”

Section: The Meta-verse Of Composites Manufacturingmentioning

confidence: 99%

Graphene nanoparticles as data generating digital materials in industry 4.0

Ali

Irfan

Khan

et al. 2023

Sci Rep

View full text Add to dashboard Cite

One of the potential applications of 2D materials is to enhance multi-functionality of structures and components used in aerospace, automotive, civil and defense industries. These multi-functional attributes include sensing, energy storage, EMI shielding and property enhancement. In this article, we have explored the potential of using graphene and its variants as data generating sensory elements in Industry 4.0. We have presented a complete roadmap to cover three emerging technologies i.e. advance materials, artificial intelligence and block-chain technology. The utility of 2D materials such as graphene nanoparticles is yet to be explored as an interface for digitalization of a modern smart factory i.e. “factory-of-the-future”. In this article, we have explored how 2D material enhanced composites can act as an interface between physical and cyber spaces. An overview of employing graphene-based smart embedded sensors at various stages of composites manufacturing processes and their application in real-time structural health monitoring is presented. The technical challenges associated with interfacing graphene-based sensing networks with digital space are discussed. Additionally, an overview of the integration of associated tools such as artificial intelligence, machine learning and block-chain technology with graphene-based devices and structures is also presented.

show abstract

“…Depending on the context of its usage, MR might function similarly to AR, serve as the transitional experience between AR and VR, or simulate virtual scenarios that closely mirror real‐world conditions. [ 75 ]…”

Section: Interfacementioning

confidence: 99%

“…Common AR devices encompass tablets, AR HMD, head‐up display, and projectors. [ 75 ] AR‐enabled tablets such as the iPad Pro (https://www.apple.com/hk/en/ipad‐pro/) and Samsung Galaxy Tab S (https://www.samsung.com/hk_en/tablets/galaxy‐tab‐s/), coupled with software platforms like ARKit for iOS and ARCore for Android, enable rudimentary yet essential AR interaction within HRC. [ 79 ] AR HMDs, including Microsoft Hololens 2 (https://www.microsoft.com/en‐hk/hololens) and Magic Leap One (https://www.magicleap.com/en‐us/), are frequently adopted in HRC to bolster user experience and productivity.…”

Section: Interfacementioning

confidence: 99%

Multimodal Human–Robot Interaction for Human‐Centric Smart Manufacturing: A Survey

Wang,

Zheng,

et al. 2023

Advanced Intelligent Systems

Self Cite

View full text Add to dashboard Cite

Human–robot interaction (HRI) has escalated in notability in recent years, and multimodal communication and control strategies are necessitated to guarantee a secure, efficient, and intelligent HRI experience. In spite of the considerable focus on multimodal HRI, comprehensive disquisitions delineating various modalities and intricately analyzing their combinations remain elusive, consequently limiting holistic understanding and future advancements. This article aspires to bridge this inadequacy by conducting a profound exploration of multimodal HRI, predominantly concentrating on four principal modalities: vision, auditory and language, haptics, and physiological sensing. An extensive review encapsulating algorithmic dissection, interface devices, and applicative dimensions forms part of this discourse. This manuscript distinctively combines multimodal HRI with cognitive science, deeply probing into the three dimensions, perception, cognition, and action, thereby demystifying algorithms intrinsic to multimodal HRI. Finally, it accentuates the empirical challenges and contours preemptive trajectories for multimodal HRI in human‐centric smart manufacturing.

show abstract

A state-of-the-art survey on Augmented Reality-assisted Digital Twin for futuristic human-centric industry transformation

Cited by 132 publications

References 90 publications

Digital Twin to Control and Monitor an Industrial Cyber-Physical Environment Supported by Augmented Reality

Digital Twin to Control and Monitor an Industrial Cyber-Physical Environment Supported by Augmented Reality

Graphene nanoparticles as data generating digital materials in industry 4.0

Multimodal Human–Robot Interaction for Human‐Centric Smart Manufacturing: A Survey

Contact Info

Product

Resources

About