A Comparison Between Two Different Approaches for a Collaborative Mixed-Virtual Environment in Industrial Maintenance

Abstract

Nowadays the market is becoming increasingly competitive, factories are required not only to enhance the product quality but also to reduce manufacturing and maintenance times. In an industrial context, modern factories are composed by many automated systems, such as industrial robots, which can perform different tasks. Although industrial robots are becoming more powerful and efficient, human workers are still required to accomplish different operations, such as training and maintenance procedures. The proposed research aims to assess a remote interaction system in an industrial training collaborative mixed-reality (CMR) environment. A remote expert user is capable of explaining a training procedure to an unskilled local user. Remote and local users interact using different interaction systems: the remote operator gives assistance using an immersive Virtual Reality (VR) device, whereas the local user interacts using a wearable Augmented Reality (AR) device. A comparison between an interaction based on the presence of a virtual human and one based on the use of abstract icons is proposed. In the first case, a virtual 3D representation of the remote technician is shown to the local user by using AR: the remote technician can pinpoint the components involved in the training procedure and the local user can visualize the instructions through some animations of the virtual avatar. In the second case, the local user cannot see a 3D representation of the remote technician; on the other hand, different 3D models, such as animated icons, are displayed to the local operator through AR depending on the component pinpointed by the remote technician in the virtual environment. Each 3D icon should suggest to the local user which component has to be manipulated at the current step of the procedure. Preliminary results suggest that the interface that requires less resources to be developed and managed should be preferred. Although in no audio condition the virtual avatar may improve the sense of presence of the remote technician, the use of abstract metaphors seems to be of primary importance to successfully complete an industrial task.

A Smart Factory in a Smart City: Virtual and Augmented Reality in a Smart Assembly Line

“…Therefore, we currently recommend using AR rather for maintenance as described e.g. in [39] or [40]. After overcoming the hardware issues, AR smart glasses will be a promising candidate as an everyday tool in a future Smart factory.…”

A Review on Augmented Reality Tracking Methods for Maintenance of Robots

“…De Pace et al [34] proposed a system to assist in an assembly task of a 3D printed simplified end effector to an industrial robot. The tracking method used is also marker based and is deployed on a HMD (Microsoft Hololens).…”

Scalable Extended Reality: A Future Research Agenda

“…For instance, collaborators may not be able to see or hear each other, which may impede natural interaction among them. To overcome these barriers, previous research proposed several features to support communication and coordination in co-located [12,13] or distributed [14][15][16][17][18][19][20][21][22] scenarios, using HHDs [12,13], HMDs [14][15][16][17][18][20][21][22], or both [19,23].…”