A Real-Time Distance Measurement System for a Digital Twin Using Mixed Reality Goggles

Abstract

This paper presents a new system architecture for controlling industrial devices using Mixed Reality (MR) applications and a new method based upon them for measuring the distance between real and virtual points. The research has been carried out using a physical robot and its Digital Twin (DT). The possibility of controlling them using gestures recognized by Mixed Reality goggles has been presented. The extension of the robot’s environment with a 3D model capable of following its movements and positions was also analyzed. The system was supervised by an industrial Programmable Logic Controller (PLC) serving as an end point for the data sent by the goggles and controlling the movements of the real robot by activating the corresponding control. The results of the preliminary measurements presented here concerned the responsiveness of the system and showing the influence of system parameters in the accuracy of distance estimation between measured points.

Demonstrator of a Digital Twin for Education and Training Purposes as a Web Application

“…Sensor (4) switches off the conveyor (1), and sensor (5) switches on the conveyor (6). Sensor (7) switches off the conveyors (2) and ( 6). The conveyor (1) and sensor (2) were connected to the fi rst instance of the PLC simulator, while the other components were connected to the second instance.…”

“…The application of virtual and augmented reality tools in DT design offers many possibilities. It allows a new approach to controlling industrial equipment and making measurements in a modified image of the world, for example, distance measurement for positioning an object in space, Lalik, Flaga [7] or automation of vision-based quality control -Oborski, Wysocki [8], Gaska et al [9]. DT technology provides new opportunities in the field of robot programming; the concept of hybrid robot programming was presented by Kuts et al [10].…”

Shaping the role of the digital twins for human‐robot dyad: Connotations, scenarios, and future perspectives

“…Therefore, real-time remote control, visualisation, and simulation can be performed for the entire dyad's systems counterparts (i.e. humans, robots, and their environment) by using a scaled hologram of the physical entity [58].…”

Optimization of Industry 4.0 Implementation Selection Process towards Enhancement of a Manual Assembly Line

“…Noted recent research about the usage of AR technology for manufacturing purposes are papers of Zhu et al [64], Schroeder et al [65], Sepasgozar et al [66] and Lalik et el. [67]. Zhu et al [64] and Schroeder et al [65] discussed the usage of AR technology as a tool that visualizes the Digital twin data, thus enabling the display of real-time information to the users.…”

“…Zhu et al [64] and Schroeder et al [65] discussed the usage of AR technology as a tool that visualizes the Digital twin data, thus enabling the display of real-time information to the users. Sepasgozar et al [66] presents the research about the application of the different AR technologies coupled with the Digital Twin for the virtual learning purposes while Lalik et al [67] focus on the usage of AR technology together with the Digital Twin for the development of new system architecture for control of the industrial devices. Therefore, all of the mentioned technologies have the potential to improve the decision-making process and work procedure of the workers providing them with real-time information.…”