Eye Tracking for Avatar Eye Gaze Control During Object-Focused Multiparty Interaction in Immersive Collaborative Virtual Environments

Steptoe, William; Oyekoya, Oyewole; Murgia, Alessio; Wolff, Robin; Rae, John; Guimaraes, Estefania; Roberts, David; Steed, Anthony

doi:10.1109/vr.2009.4811003

Cited by 39 publications

(19 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, the model automatically adjusts to the control method. Hence, if gaze is driven by an eye tracker in real-time as presented in Steptoe et al 36 , the model will respond according to the wearer's gaze behaviour, which is likely to reflect their current emotional or mood state: increased and rapid eye saccades will be matched with lively lid saccades, thereby communicating vital nonverbal information to an observer or interactional partner in avatar-mediated communication. Similarly, negative or submissive traits of avoiding eye contact and frequently looking downwards is likely to be exaggerated by the corresponding model-generated lid saccades, which naturally display the closed-state of the eyes.…”

Section: Discussionmentioning

confidence: 99%

Eyelid kinematics for virtual characters

Steptoe

Oyekoya²,

Steed³

2010

Computer Animation & Virtual

View full text Add to dashboard Cite

When compared to gaze, animation of the eyelids has been largely overlooked in the computer graphics literature. Eyelid movement plays an important part both in conveying accurate gaze direction and in improving the visual appearance of virtual characters. Eyelids have two major motion components: lid saccades that follow the vertical rotation the eyes, and blinking. Derived from literature in ophthalmology and psychology, this paper presents parametric models for both motion types, and emphasizes their dynamic temporal behaviour. Experimental validation classifies model-generated animation as similar to that encoded from expensive motion captured data, and significantly exceeding linearly interpolated animation. Lid saccades are bilateral shifts of the eyelids initiated by changes in the vertical rotation of the eyes, so that the eyelids follow the direction of gaze to ensure they do not obscure the pupils 2 . Blinking is the act of extremely brief closure of the eyelids, and may be voluntary or involuntary 3 . Physiologically, the eyelids serve to protect the eye from debris and rays of harmful intensity , and also to regularly spread the tears and other secretion on the eye surface to keep it continually moist 2 . Hence, eyelid movement is a ubiquitous element of human behaviour.As both real-time and offline character animation advance, there is an ever-growing need to consider the broad scope of what gives rise to visual and behavioural realism. Increasingly sophisticated geometrical and behavioural models of humans and components of humans have been presented for a applications including games, film and embodied conversational agents. When looking at a photograph or painting of a human, one typically spends 60% of the time looking at the eyes and 15% at the mouth 4 . It is no surprise then, that much of this research has focussed on the face 5 , and in particular the eyes 6 . Lee et al. 6 identify the high correlation between the motion of the eyes and the corresponding eyelid movements as a possible extension to their gaze model. While some subsequent gaze models have incorporated some form of eyelid animation to complement gaze motion 7-9 , eyelid animation has played a secondary role. Hence, the implementation details of realistic human eyelid dynamics has been left undefined. This paper presents two parametric models generating physiologically-accurate lid saccade and blink animations for virtual characters. The models are detailed algorithmically, together with an example implementation for avatar-mediated communication between users of networked immersive CAVE TM -like systems. The models are then validated against current methods of eyelid animation, including motion capture and linear interpolation, before discussion, limitations and future work are addressed.

show abstract

Section: Discussionmentioning

confidence: 99%

Eyelid kinematics for virtual characters

Steptoe

Oyekoya²,

Steed³

2010

Computer Animation & Virtual

View full text Add to dashboard Cite

show abstract

“…Here in the physical level controlling collision detection mechanism is used. This method help to avoid stuck on any obstacle [15].…”

Section: Autonomous Motion Controlmentioning

confidence: 99%

Eye gaze behavior of virtual agent in gaming environment by using artificial intelligence

Das

Hasan

2014

2013 International Conference on Electrical Information and Communication Technology (EICT)

View full text Add to dashboard Cite

In the gaming environment, building natural looking avatar is a challenging task. An avatar represents a human character which includes speech, action, and eye movement in a virtual world. The movement and the expression of eye modeling is cognitive function. In order to assess virtual agent's eye gaze behavior on the basis of cognitive and emotional characteristics, this paper presents an experimental simulation to identify perfection of the eye gaze behavior. For this reason, this paper splits eye behavior into few levels by using CADIA Populus. But the goal of this research work is to focus on gaze behavior. In addition, it briefly describes the cognitive activities based on different cases. Furthermore this paper introduces an integrated framework for modeling the interaction of agent with the immersive environment. Finally, the gaze strategy and some simulation results from previous studies have been discussed to provide a concrete idea about gaze behavioral science in gaming environment using artificial intelligence.

show abstract

“…Researchers have explored a wide variety of devices and techniques for avatar control, including using the mouse [15], keyboard [21], gamepad [24], data glove [8], head and hand tracker [2], eye tracker [4,22], hand gestures [14], full body actions [20], and brain activities [16,23]. Some of these control methods are intended for immersive virtual environments with head-mounted displays; we limit our scope to desktop CVEs, where users look at the virtual world through a computer monitor.…”

Section: Controlling Avatars In Desktop Cvesmentioning

confidence: 99%

Controlling an avatar's pointing gestures in desktop collaborative virtual environments

Wong

Gutwin

2012

Proceedings of the 17th ACM International Conference on Supporting Group Work

View full text Add to dashboard Cite

Collaborative Virtual Environments (CVEs) allow people to interact with each other in virtual worlds through computergenerated avatars. Avatars are much less expressive than real bodies, and one main limitation is their lack of support for nonverbal communication such as pointing gestures. Part of the problem is that these gestures must be created through an input device, but the user is already busy controlling the avatar's location, rotation, and view direction. Pointing gestures are only useful for collaborative communication if they can be controlled simultaneously with all other avatar actions. To determine whether there are input configurations that make pointing gestures feasible, we carried out a study that compared five different widely-available input devices in three non-verbal communication tasks. We found that users were able to successfully incorporate pointing gestures into tasks that already involved moving, turning, and looking, but that there were significant and substantial differences between devices. Two configurations performed best: a mode-switched version of standard mouse-and-keyboard control, and a direct-pointing scheme using a Wii remote. There were also minor effects of gender and video-game experience. Our study suggests that users will be able to successfully create free pointing gestures in CVEs, greatly improving the communicative richness of these environments.

show abstract

Eye Tracking for Avatar Eye Gaze Control During Object-Focused Multiparty Interaction in Immersive Collaborative Virtual Environments

Cited by 39 publications

References 28 publications

Eyelid kinematics for virtual characters

Eyelid kinematics for virtual characters

Eye gaze behavior of virtual agent in gaming environment by using artificial intelligence

Controlling an avatar's pointing gestures in desktop collaborative virtual environments

Contact Info

Product

Resources

About