A new AR interaction paradigm for collaborative teleassistance system: the POA

Abstract

In this paper, we propose a prototype of a (collaborative) teleassistance system for mechanical repairs based on Augmented Reality (AR). This technology is generally used to implement specific assistance applications for users, which consist of providing all the information, known as augmentations, required to perform a task. For teletransmission applications, operators are equipped with a wearable computer and a technical support expert can accurately visualize what the operator sees thanks to the teletransmission of the corresponding video stream. Within the framework of remote communication, our aim is to foster collaboration, especially informal collaboration, between the operator and the expert in order to make teleassistance easier and more efficient. To do this we rely on classical repair technologies and on collaborative systems to introduce a new human-machine interaction: the Picking Outlining Adding interaction (POA interaction). With this new interaction paradigm, technical information is provided by directly Picking, Outlining and Adding information to an item in an operator's video stream.

Mobile Augmented Reality: Applications and Specific Technical Issues

“…In [17][6] we proposed a general definition of augmented reality as being the combination of physical spaces with digital spaces in semantically linked contexts. We can say that augmented reality is the combination of physical spaces with digital spaces in semantically linked contexts for which the objects of associations lie in the real world.…”

Intelligent Systems for Science and Information

“…In [6] , [17], we proposed a general definition of augmented reality as being the combination of physical and digital spaces in semantically linked contexts especially for the objects of associations lie in the real world. On the contrary, augmented virtuality can be defined as the combination of physical with digital spaces in semantically linked contexts, but where the task's objects lie in the world of computing, states that the systems considered aim to make interaction more realistic.…”

T.A.C

“…Furthermore, we must take into account how the situation is seen by the expert who must effectively apprehend the operator's environment as if he or she were there in person. In [5] we presented our visualization system carried by the operator and which is responsible for providing an exact vision of part of what is seen to the expert. This specific HMD, known as MOVST (Monocular Orthoscopic Video See-Through) satisfies the criteria of our application.…”

“…In [5] we presented a new interaction paradigm based on the ability of a person to assist another in a task. Generally, when physically present together, the expert shows how to carry out the task before the operator in turn attempts to do so (learning through experience).…”