Human Computer Interaction with Hand Gestures in Virtual Environment

Abstract

Abstract. With the ever increasing and flourishing phenomena of growth in virtual environments based upon computer systems; demands for new kind of interaction devices have emerged. The present used devices like keyboard, mouse and pen are cumbrousome within these promising applications. The developments of user interfaces influence the changes in the Human-Computer Interaction (HCI). This paper focuses to design an application using computer vision and gesture recognition techniques which develop a relatively economic input device of interacting with virtual games using hand gestures. The architecture of the gesture recognition system comprises of different image processing techniques like camshift, and Lucas Kanade technique for tracking of hands and its gestures. Haar like features locates the position of the hand and recognizes the gesture being made by such located hand image. The modeling of gestures has been done for recognition through matching the feature of defects present in the hand with the assigned gestures. The virtual game is created using Open GL library. The application uses seven gestures for manipulating the virtual game. This main connotation of this hand gesture recognition system is providing a substitute for input devices while making interaction during the virtual games. Hence instead of making effort to develop a new vocabulary of hand gesture we have matched control instruction set of mouse to subset of most discriminating hand gestures, so that we get a robust interface.

Implications of Similarities in Instructional Design, Learner Interface Design and User Interface Design in Designing a User-Friendly Online Module

“…It could also be a gazedbased user interface (Stellmach & Dachselt, 2012). The operator could also be a gestural interface (Lü, & Li, 2011;Rautaray, Kumar & Agrawal, 2012). Figure 4 shows different hand motions in front of a gestural interface.…”

Implications of Similarities in Instructional Design, Learner Interface Design and User Interface Design in Designing a User-Friendly Online Module

“…It could also be a gazedbased user interface (Stellmach & Dachselt, 2012). The operator could also be a gestural interface (Lü, & Li, 2011;Rautaray, Kumar & Agrawal, 2012). Figure 4 shows different hand motions in front of a gestural interface.…”

Empirically measuring control quality of gesture input

“…Wachs et al argued that hand gestures enable a broad range of applications in environments such as virtual reality and interactive gaming [13]. Rautaray et al used hand gesture recognition techniques as a substitute for cumbersome input devices such as keyboard, mouse and pen to make interactions during the games [9]. They conclude that the hand gestures provide quicker and more natural interaction for users than those traditional input devices.…”