An Augmented Reality Framework for Supporting and Monitoring Operators during Maintenance Tasks

Re, Guido Maria; Bordegoni, Monica

doi:10.1007/978-3-319-07464-1_41

Cited by 22 publications

(12 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One promising application for AR guidance and training is in maintenance and assembly; also termed AR instructions (Re and Bordegoni, 2014 ), AR-based job aid (Anastassova et al, 2005 ), AR-assisted maintenance system and AR-based assembly guidance (Ong et al, 2008 ). AR guidance means that instructions are given to the user in textual, and/or visual format, augmented on the target objects.…”

Section: Introductionmentioning

confidence: 99%

User Experience of Augmented Reality System for Astronaut's Manual Work Support

Helin

Kuula

Vizzi³

et al. 2018

Front. Robot. AI

View full text Add to dashboard Cite

This paper introduces Augmented Reality (AR) system to support an astronaut's manual work, it has been developed in two phases. The first phase was developed in Europeans Space Agency's (ESA) project called "EdcAR-Augmented Reality for Assembly, Integration, Testing and Verification, and Operations" and the second phase was developed and evaluated within the Horizon 2020 project "WEKIT-Wearable Experience for Knowledge Intensive Training." The main aim is to create an AR based technological platform for high knowledge manual work support, in the aerospace industry with reasonable user experience. The AR system was designed for the Microsoft HoloLens mixed reality platform, and it was implemented based on a modular architecture. The purpose of the evaluation of the AR system is to prove that reasonable user experience of augmented reality can reduce performance errors while executing a procedure, increase memorability, and improve cost, and time efficiency of the training. The main purpose of the first phase evaluation was to observe and get feedback from the AR system, from user experience point-of-view for the future development. The use case was a filter change in International Space Station (ISS)-Columbus mock-up in the ESA's European Astronaut Centre (EAC). The test group of 14 subjects it included an experienced astronaut, EAC trainers, other EAC personnel, and a student group. The second phase the experiment consisted of an in-situ trial and evaluation process. The augmented reality system was tested at ALTEC facilities in Turin, Italy, where 39 participants were performing an actual real astronaut's procedure, the installation of Temporary Stowage Rack (TSR) on a physical mock-up of an ISS module. User experience evaluation was assessed using comprehensive questionnaires, and interviews, gathering an in-depth feedback on their experience with a platform. This focused on technology acceptance, system usability, smart glasses user satisfaction, user interaction satisfaction, and interviews, gathering an in-depth feedback on their experience with a platform. The analysis of the questionnaires and interviews showed that the scores obtained for user experience, usability, user satisfaction, and technology acceptance were near the desired average. Specifically, The System Usability Scale (SUS) score was 68 indicating that the system usability is already nearly acceptable in the augmented reality platform.

show abstract

Section: Introductionmentioning

confidence: 99%

User Experience of Augmented Reality System for Astronaut's Manual Work Support

Helin

Kuula

Vizzi³

et al. 2018

Front. Robot. AI

View full text Add to dashboard Cite

show abstract

“…AR contents were either inserted on frames captured from the video feed and sent back to the operator [40], directly provided on the video feed without the need to exchange images [5], or attached onto real objects using 6-DOF positional tracking, e.g., by leveraging marker detection [5]. Although with markers it is possible to obtain robust and precise tracking, using this technology alone requires to always frame at least one marker to correctly estimate the camera position and anchor contents [37]. Alternative marker-less technologies for anchoring AR contents were therefore investigated [11,14].…”

Section: Related Workmentioning

confidence: 99%

Improving AR-powered remote assistance: a new approach aimed to foster operator’s autonomy and optimize the use of skilled resources

Calandra

Cannavò

Lamberti

2021

Int J Adv Manuf Technol

View full text Add to dashboard Cite

Augmented reality (AR) has a number of applications in industry, but remote assistance represents one of the most prominent and widely studied use cases. Notwithstanding, although the set of functionalities supporting the communication between remote experts and on-site operators grew over time, the way in which remote assistance is delivered has not evolved yet to unleash the full potential of AR technology. The expert typically guides the operator step-by-step, and basically uses AR-based hints to visually support voice instructions. With this approach, skilled human resources may go under-utilized, as the time an expert invests in the assistance corresponds to the time needed by the operator to execute the requested operations. The goal of this work is to introduce a new approach to remote assistance that takes advantage of AR functionalities separately proposed in academic works and commercial products to re-organize the guidance workflow, with the aim to increase the operator’s autonomy and, thus, optimize the use of expert’s time. An AR-powered remote assistance platform able to support the devised approach is also presented. By means of a user study, this approach was compared to traditional step-by-step guidance, with the aim to estimate what is the potential of AR that is still unexploited. Results showed that with the new approach it is possible to reduce the time investment for the expert, allowing the operator to autonomously complete the assigned tasks in a time comparable to step-by-step guidance with a negligible need for further support.

show abstract

“…Third, providing a better interface is another solution, and it includes two steps: 1) monitoring or tracking collaborator's activities, and 2) properly notifying the tracked collaborator's activities to a user. Some researchers focused on the first step studying training systems [2,6,7,8,40], and investigated what activities a system needs to track after. Other researchers focused on the second step.…”

Section: Awareness and Notificationmentioning

confidence: 99%

“…With Augmented Reality (AR) technology, researchers can add virtual objects in the real world to present context-sensitive information [1]. One of the main purpose of it is providing information to solve a physical task, especially for supporting training [2,3,4,5,6,7,8] and improving remote collaboration [9]. In this paper, we study real-time remote collaboration between local and remote users, and how AR visual cues can be used to improve collaboration.…”

Section: Introductionmentioning

confidence: 99%

Using Freeze Frame and Visual Notifications in an Annotation Drawing Interface for Remote Collaboration

Kim¹,

Billinghurst²,

Lee³

et al. 2018

KSII TIIS

View full text Add to dashboard Cite

This paper describes two user studies in remote collaboration between two users with a video conferencing system where a remote user can draw annotations on the live video of the local user's workspace. In these two studies, the local user had the control of the view when sharing the first-person view, but our interfaces provided instant control of the shared view to the remote users. The first study investigates methods for assisting drawing annotations. The auto-freeze method, a novel solution for drawing annotations, is compared to a prior solution (manual freeze method) and a baseline (non-freeze) condition. Results show that both local and remote users preferred the auto-freeze method, which is easy to use and allows users to quickly draw annotations. The manual-freeze method supported precise drawing, but was less preferred because of the need for manual input. The second study explores visual notification for better local user awareness. We propose two designs: the red-box and both-freeze notifications, and compare these to the baseline, no notification condition. Users preferred the less obtrusive red-box notification that improved awareness of when annotations were made by remote users, and had a significantly lower level of interruption compared to the both-freeze condition.

show abstract

An Augmented Reality Framework for Supporting and Monitoring Operators during Maintenance Tasks

Cited by 22 publications

References 15 publications

User Experience of Augmented Reality System for Astronaut's Manual Work Support

User Experience of Augmented Reality System for Astronaut's Manual Work Support

Improving AR-powered remote assistance: a new approach aimed to foster operator’s autonomy and optimize the use of skilled resources

Using Freeze Frame and Visual Notifications in an Annotation Drawing Interface for Remote Collaboration

Contact Info

Product

Resources

About