User-centered design and evaluation of an integrated AR-VR system for tele-maintenance

Kleiber, Michał; Alexander, Thomas; Winkelholz, Carsten; Schlick, Christopher

doi:10.1109/icsmc.2012.6377938

Cited by 9 publications

(4 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Experts could navigate a virtual model of a real object and share useful information to support maintenance and repair operations. The same approach was adopted in [26], where VR and AR were used to remotely support technicians as well as trainees. The German Federal Ministry of Education and Research (BMBF) sponsored the ARVIKA project [27], which was aimed to the design and implementation of a head-worn AR-based user-centered tool to support the development, production, and servicing of complex technical products and systems.…”

Section: Introductionmentioning

confidence: 99%

Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance

Lamberti

Manuri

Sanna

et al. 2014

IEEE Trans. Emerg. Topics Comput.

View full text Add to dashboard Cite

Augmented reality (AR) is a well-known technology that can be exploited to provide mass-market users an effective and customizable support in a large spectrum of personal applications, by overlapping computer-generated hints to the real world. Mobile devices, such as smartphones and tablets, are playing a key role in the exponential growth of this kind of solutions. Nonetheless, there exists some application domains that just started to take advantage from the AR systems. Maintenance, repair, and assembly have been considered as strategic fields for the application of the AR technology from the 1990s, but often only specialists using ad hoc hardware were involved in limited experimental tests. Nowadays, AR-based maintenance and repair procedures are available also for end-users on consumer electronics devices. This paper aims to explore new challenges and opportunities of this technology, by also presenting the software framework that is being developed in the EASE-R 3 project by exploiting reconfigurable AR procedures and tele-assistance to overcome some of the limitations of current solutions.

show abstract

Section: Introductionmentioning

confidence: 99%

Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance

Lamberti

Manuri

Sanna

et al. 2014

IEEE Trans. Emerg. Topics Comput.

View full text Add to dashboard Cite

show abstract

“…Porcelli et al [12] proposed a selection model with the aim of guiding managers in selecting the AR solution most suitable for their field service context. Kleiber et al [13] described a mechanic which used an AR system which is connected to the VR system of a remote expert. The expert interactively created 3D instructions on his VR system that were displayed on a hand-held tablet computer of the mechanic.…”

Section: Related Workmentioning

confidence: 99%

An augmented reality based system for remote collaborative maintenance instruction of complex products

Wang

Feng

Zeng

et al. 2014

2014 IEEE International Conference on Automation Science and Engineering (CASE)

View full text Add to dashboard Cite

Product maintenance is a knowledge intensive task. With the increasing complexity of modern large scale products, the maintenance process usually is carried out collaboratively by onsite technicians and remote experts. Augmented reality provides a novel interactive way for collaborative maintenance work. In an augmented instruction scene, the real maintenance product is combined with visual information and thus helps the technician to understand the process, which will be more efficient than traditional maintenance manual or oral words. In order to reduce the data quantity transferred between the local technician site and remote expert site, a framework of augmented reality based collaborative maintenance real-time instruction platform under network environment is proposed to achieve efficiently guidance from remote expert. The augmented information for maintenance process instruction is classified and their visualization methods are realized. During the collaborative maintenance process, the instruction information is shared based on different patterns. A prototyping system is developed for onsite technician and remote expert. The augmented collaborative maintenance process instruction is illustrated by replacing an air filter of an auto engine.

show abstract

“…The Etälä project [17] proposed tele-assistance and AR to establish a communication channel between local maintainers and remote experts. A similar approach was adopted in [18], where AR and VR were used to remotely support both trainees and technicians. In [19], a collaborative framework solution is proposed to train technicians in assembly tasks of complex systems such as aircraft engines.…”

Section: State Of the Artmentioning

confidence: 99%

A State Validation System for Augmented Reality Based Maintenance Procedures

2019

View full text Add to dashboard Cite

Maintenance has been one of the most important domains for augmented reality (AR) since its inception. AR applications enable technicians to receive visual and audio computer-generated aids while performing different activities, such as assembling, repairing, or maintenance procedures. These procedures are usually organized as a sequence of steps, each one involving an elementary action to be performed by the user. However, since it is not possible to automatically validate the users actions, they might incorrectly execute or miss some steps. Thus, a relevant open problem is to provide users with some sort of automated verification tool. This paper presents a system, used to support maintenance procedures through AR, which tries to address the validation problem. The novel technology consists of a computer vision algorithm able to evaluate, at each step of a maintenance procedure, if the user correctly completed the assigned task or not. The validation occurs by comparing an image of the final status of the machinery, after the user has performed the task, and a virtual 3D representation of the expected final status. Moreover, in order to avoid false positives, the system can identify both motions in the scene and changes in the camera’s zoom and/or position, thus enhancing the robustness of the validation phase. Tests demonstrate that the proposed system can effectively help the user in detecting and avoiding errors during the maintenance process.

show abstract

User-centered design and evaluation of an integrated AR-VR system for tele-maintenance

Cited by 9 publications

References 10 publications

Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance

Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance

An augmented reality based system for remote collaborative maintenance instruction of complex products

A State Validation System for Augmented Reality Based Maintenance Procedures

Contact Info

Product

Resources

About