Remote Collaboration using a Shoulder-Worn Active Camera/Laser

Kurata, Takeshi; Sakata, Nobuchika; Kourogi, Masakatsu; Kuzuoka, Hideaki; Billinghurst, Mark

doi:10.1109/iswc.2004.37

Cited by 65 publications

(46 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…An interesting addition to our system would be using a real ray such as a laser pointer to illuminate selected physical objects in the remote workspace similarly to the work by Kurata et al [21]. Additional future work includes extending the current dual-user system and user interface to support several users, carrying out a more comprehensive user evaluation, and experimenting with techniques requiring less accurate eye tracking but offering a larger working volume.…”

Section: Discussionmentioning

confidence: 99%

Cascading Hand and Eye Movement for Augmented Reality Videoconferencing

Barakonyi

Prendinger

Schmalstieg

et al. 2007

2007 IEEE Symposium on 3D User Interfaces

View full text Add to dashboard Cite

We have implemented an augmented reality videoconferencing system that inserts virtual graphics overlays into the live video stream of remote conference participants. The virtual objects are manipulated using a novel interaction technique cascading bimanual tangible interaction and eye tracking. User studies prove that our user interface enriches remote collaboration by offering hitherto unexplored ways for collaborative object manipulation such as gaze controlled raypicking of remote physical and virtual objects. We have created an augmented reality-based videoconferencing tool that allows users to discuss and manipulate real and virtual objects over great distances while preserving non-verbal communication and part of the conference parties' physical environment. We have experimented with user interface techniques that make communication and interaction smoother while discussing real and virtual objects with a remote videoconference party. Physical objects are pose-tracked with handheld fiducial markers and virtual objects are assigned to tracked physical placeholders. In our application scenario videoconference parties use both hands to carry out object manipulation and interaction tasks such as translation, rotation or selection with fiducial markers. While two-handed tangible interaction may rely solely on complex 2D and 3D gestures aided by traditional input devices such as mouse and keyboard, we have found that exploiting the human eye as a natural input device during bimanual object manipulation yields faster, richer and more intuitive communication between partners in remote collaboration tasks. To support this statement, we have implemented and evaluated an interaction technique cascading bimanual tangible interaction and eye tracking. Figure 1 shows a schema of our AR videoconferencing system enhanced by eye tracking. This paper first discusses how tangible augmented reality and non-intrusive eye tracking enhance remote collaboration while comparing our system with related work, then presents our application scenario and interaction technique with implementation details. We conclude our paper with the results of our user study. REMOTE COLLABORATION IN ARUsers of AR applications can see the real world, which provides a reference frame for their actions. They can see themselves and their collaborators, enabling smooth communication with nonverbal cues during collaborative work. Moreover, a virtual space with synthetic objects is aligned with and superimposed onto the real world and shared among the users. Thus changes made to manipulated objects during the collaborative session are distributed and immediately visible to all participants. Unfortunately, this form of shared AR requires that the collaborators are sharing the same physical space, making it incompatible with remote collaboration over greater distances. State-of-the-art remote collaboration tools include audio/video conferencing and application sharing to help bridge the distance by displaying the remote parties' real environments. Ap...

show abstract

Section: Discussionmentioning

confidence: 99%

Cascading Hand and Eye Movement for Augmented Reality Videoconferencing

Barakonyi

Prendinger

Schmalstieg

et al. 2007

2007 IEEE Symposium on 3D User Interfaces

View full text Add to dashboard Cite

show abstract

“…Kurata et al [12,13] developed the WACL system that involves the worker wearing a steerable camera/laser head. WACL allows the remote instructor not only to independently look into the worker's task space, but also to point to real objects in the task space with the laser spot.…”

Section: Systems For Remote Guidancementioning

confidence: 99%

“…Therefore, the instructor can observe around the worker, independently of the worker's motion, and can clearly and naturally instruct the worker in tasks. Previous work in the area of remote guiding of mobile workers has mostly focused on supporting pointing to remote objects, using a projection based approach such as the laser pointing system in WACL [12,13], or using a see through based approach such as in REAL [17] (see Fig. 2).…”

Section: Systems For Remote Guidancementioning

confidence: 99%

“…MixedEcology aims to promote mutual awareness between participants, by supporting the remote guiding through a mixed reality surface in which the remote helper's hands are overlaid on top of the local worker's hands. Kurata et al [12,13] developed a Wearable Active Camera with a Laser pointer system (WACL). In this system, the worker wears a steerable camera/laser head.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Supporting the Changing Roles of Maintenance Operators in Mining: A Human Factors Perspective

Alem¹

2011

TOERGJ

View full text Add to dashboard Cite

Rapid advances in networking and hardware have made it possible for remotely located individuals to perform physical tasks. Recently a number of systems have been developed with each supporting a different scenario of remote collaboration. Of particular interest to us is to explore the value of these technologies in the context of mining. As automation is being introduced in mines, more and more skilled operators are operating remotely. As a result, onsite operators' job becomes more complex and requires input from remote skilled operators. The productivity of the future mine relies on the effective delivery, just in time, of remote guidance. This paper presents a remote guiding system called HandsOnVideo, which is developed as part of our Human System Integration project within the CSIRO's Minerals Down Under (MDU), a National Research Flagship. Our aim is to design and develop a system that supports a remote helper guiding a mobile local worker in maintaining complex equipment in mine sites. The system is developed following a participatory design approach and the results of a usability study with real users indicate that the system is useful and effective.

show abstract

“…This latter can only provide audio indications. Sakata and Kurata (Sakata et al, 2003), (Kurata et al, 2004) developed the Wearable Active Camera/Laser (WACL) which allows the remote instructor not only to independently look into the worker's task space, but also to point to real objects in the task space with the laser spot (Alem et al, 2011). In (Bottecchia et al, 2010) a maintenance collaborative system entitled CAMEKA is described, which enables the expert to give visual indications to an operator with an AR display device fitted with a camera.…”

Section: Introductionmentioning

confidence: 99%