Multimodal interface for a virtual reality based computer aided design system

Chu, Chi-Wei; Dani, Tushar H.; Gadh, Rajit

doi:10.1109/robot.1997.614321

Cited by 15 publications

(8 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In VR, several studies have found that people much desire to use multiple-action modalities for virtual object manipulation tasks [14], [15]. Such studies were based on the "Wizard of Oz" experiments, where the role of a multimodal computer is played by a human [15].…”

Section: Multimodal In Armentioning

confidence: 99%

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Ismail

Billinghurst

Sunar

2015

Proceedings of the 8th International Symposium on Visual Information Communication and Interaction

View full text Add to dashboard Cite

Although many progresses have been accomplished in multimodal interaction, most researchers still treat each modality such as vision and speech, separately. They integrate the results at the application stage. This is because the roles of multiple modalities and their interactions continue to be quantified and precisely understood. However, there are many remaining issues in combining each modality individually. This paper will highlight the main vision problems based on our review for multimodal applications. This review paper will give an overview of the Augmented Reality (AR) technologies which are contributing in most of recent multimodal applications. We cluster vision techniques according to the natural human senses such as face, gesture, and speech that are frequently used in multimodal applications. The main contribution of this paper is to consolidate some of the main issues and approaches in vision-based technique, and to study some of the applications in AR that have been developed within the context of multimodal interaction. We conclude this paper with the future directions.

show abstract

Section: Multimodal In Armentioning

confidence: 99%

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Ismail

Billinghurst

Sunar

2015

Proceedings of the 8th International Symposium on Visual Information Communication and Interaction

View full text Add to dashboard Cite

show abstract

“…al. [4] developed a multimodal interface for a Virtual Reality design application, while others have shown speech and gesture can be used to navigate through virtual worlds [8]. The main benefit of combining speech and gesture in this way is that they can be used to express different but complimentary types of input [5].…”

Section: Related Workmentioning

confidence: 99%

Hands and speech in space

Billinghurst

2013

Proceedings of the 15th ACM on International Conference on Multimodal Interaction

View full text Add to dashboard Cite

Augmented Reality (AR) is technology that allows virtual imagery to be seamlessly integrated into the real world. Although first developed in the 1960's it has only been recently that AR has become widely available, through platforms such as the web and mobile phones. However most AR interfaces have very simple interaction, such as using touch on phone screens or camera tracking from real images. New depth sensing and gesture tracking technologies such as Microsoft Kinect or Leap Motion have made is easier than ever before to track hands in space. Combined with speech recognition and AR tracking and viewing software it is possible to create interfaces that allow users to manipulate 3D graphics in space through a natural combination of speech and gesture. In this paper I will review previous research in multimodal AR interfaces and give an overview of the significant research questions that need to be addressed before speech and gesture interaction can become commonplace.

show abstract

“…Moreover, VR-based CAD systems also support alternative methods of user input and output, such as voice commands, hand gestures and haptic interactions. Examples of these systems included COVIRDS (Chu et al 1997), JDCAD (Liang and Green 1994), HK VR-CAD (Zheng et al 1999), ErgoSketch (Forsberg et al 1998), VDVAS (Wan et al 1999), DesignSpace (Chapin et al 1994), 3-Draw (Sachs et al 1991), CUP (Anthony et al 2001) and CDS (Bowman 1996).…”

Section: Related Workmentioning

confidence: 99%

Supporting conceptual design with multiple VR based interfaces

Campbell

2006

Virtual and Physical Prototyping

View full text Add to dashboard Cite

Conventional computer aided design (CAD) systems have not provided enough support for conceptual design partly due to the lack of natural and intuitive human Ácomputer interaction. Currently emerging virtual reality (VR) based techniques offer new ways to overcome these obstacles. In this paper, new CAD user interfaces including two-handed operation, haptic interaction, stereoscopic display and auditory feedback are investigated. The contribution of this work is to develop a new direct, natural and intuitive interaction paradigm required to support conceptual design. This paradigm enables designers to take fuller advantage of their visual, auditory and tactile sensorial channels to create, view, touch, hold, manipulate and listen to computer-generated virtual models. This is done more easily and freely in a more realistic three-dimensional (3D) environment through convenient interface device operation. A new conceptual design system called the LUCID system that fully integrates and implements these VR-based innovative interfaces into one design application is presented. As an approach to the next generation of human Á computer interfaces for use in the design activity, the LUCID system has shown particular human computer interface benefits to designers during conceptual design based on the outcome from the user evaluation test.

show abstract

Multimodal interface for a virtual reality based computer aided design system

Cited by 15 publications

References 5 publications

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Hands and speech in space

Supporting conceptual design with multiple VR based interfaces

Contact Info

Product

Resources

About