Speech-enabled augmented reality supporting mobile industrial maintenance

Goose, Stuart; Sudarsky, Sandra; Zhang, Xiang; Navab, Nassir

doi:10.1109/mprv.2003.1186727

Cited by 59 publications

(25 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In (Navab et al, 1999aNavab, 2002, 2002a), we presented a series of theoretical and practical results on calibration and reconstruction from combinations of perspective and orthographic views of the environment. These resulted not only in new calibration and reconstruction methods, but also in new augmented reality visualization results for easy and direct access to virtual objects in the environment (Goose et al, 2003), see Fig. 10.…”

Section: Resultsmentioning

confidence: 99%

Canonical Representation and Multi-View Geometry of Cylinders

Navab¹,

Appel

2006

Int J Comput Vision

View full text Add to dashboard Cite

This paper first introduces a canonical representation for cylinders. The canonical representation introduced here is closely related to the Plücker line representation. In this paper, we show that this representation is an appropriate one for computer vision applications. In particular, it allows us to easily develop a series of mathematical methods for pose estimation, 3D reconstruction, and motion estimation.One of the major novelties in this paper is the introduction of the main equations dominating the three view geometry of cylinders. We show the relationship between cylinders' three-view geometry and that of lines (Spetsakis and Aloimonos, 1990;Weng et al., 1993) and points (Shashua, 1995) defined by the trilinear tensor (Hartley, 1997), and propose a linear method, which uses the correspondences between six cylinders across three views in order to recover the motion and structure.Cylindrical pipes and containers are the main components in the majority of chemical, water treatment and power plants, oil platforms, refineries and many other industrial installations. We have developed a professional software, called CyliCon, which allows efficient as-built reconstruction of such installations from a series of pre-calibrated images. Markers are used for this pre-calibration process. The theoretical and practical results in this paper represent the first steps towards marker-less calibration and reconstruction of such industrial sites. Here, the experimental results take advantage of the two-view and three-view geometry of cylinders introduced in this paper to provide initial camera calibration results.

show abstract

Section: Resultsmentioning

confidence: 99%

Canonical Representation and Multi-View Geometry of Cylinders

Navab¹,

Appel

2006

Int J Comput Vision

View full text Add to dashboard Cite

show abstract

“…Also, some studies have shown that creating a real-time AVSR system is possible [48]. Text-toSpeech Synthesis (TTS) is one of the systems that is used to convert text and create a spoken sound version of the text into a computer in real-time [50]. TTS converts the information, such as text files into the speech inputs.…”

Section: Speech Recognitionmentioning

confidence: 99%

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Ismail

Billinghurst

Sunar

2015

Proceedings of the 8th International Symposium on Visual Information Communication and Interaction

View full text Add to dashboard Cite

Although many progresses have been accomplished in multimodal interaction, most researchers still treat each modality such as vision and speech, separately. They integrate the results at the application stage. This is because the roles of multiple modalities and their interactions continue to be quantified and precisely understood. However, there are many remaining issues in combining each modality individually. This paper will highlight the main vision problems based on our review for multimodal applications. This review paper will give an overview of the Augmented Reality (AR) technologies which are contributing in most of recent multimodal applications. We cluster vision techniques according to the natural human senses such as face, gesture, and speech that are frequently used in multimodal applications. The main contribution of this paper is to consolidate some of the main issues and approaches in vision-based technique, and to study some of the applications in AR that have been developed within the context of multimodal interaction. We conclude this paper with the future directions.

show abstract

“…In cases where the use of mobile devices have been studied, this work has mainly centered on designing and implementing wearable and embodied computing systems [9,2,8,6]. These types of systems include for example wrist computers or head-mounted screens, which are not commonly used in industrial settings at present.…”

Section: Related Workmentioning

confidence: 99%

Challenges of using mobile devices in process industry

Vartiainen¹,

Ralph²,

Björndal³

2013

Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

View full text Add to dashboard Cite

Almost everyone today owns some type of mobile device that is not only being used for routine tasks such as making phone calls, but also for more advanced tasks such as social networking. Advances in hardware technology have seen the cost of mobile devices reduce considerably. However, even with the advanced capabilities and relatively low cost, there is still limited use of these devices in industrial environments. In this paper we discuss observations made from several field studies conducted that examine the challenges faced by personnel working in three different process industry environments. We then present design directions for how mobile devices could be used more effectively to enhance their work practice. This paper therefore provides both a rare glimpse for other researchers into industrial working conditions which are often difficult to gain access to, and a possible way forward for how mobile devices could effectively enhance users working experiences.

show abstract

Speech-enabled augmented reality supporting mobile industrial maintenance

Cited by 59 publications

References 18 publications

Canonical Representation and Multi-View Geometry of Cylinders

Canonical Representation and Multi-View Geometry of Cylinders

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Challenges of using mobile devices in process industry

Contact Info

Product

Resources

About