Head and Eye Movement as Pointing Modalities for Eyewear Computers

Jalaliniya, Shahram; Mardanbeigi, Diako; Pederson, Thomas; Hansen, Dan Witzner

doi:10.1109/bsn.workshops.2014.14

Cited by 33 publications

(20 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Gaze has been found to be faster than hand pointing, especially for distant objects [52]. A range of works have compared eye and head pointing showing that eye gaze is faster and less strenuous, while head pointing is often preferred as more stable, controlled and accurate [5,10,18,23,44]. As in 2D contexts, eye pointing can be combined with fast manual confirmation by click or hand gesture [41,46], or with dwell time or other specific eye movement for hands-free selection [20,31,42].…”

Section: Gaze Interaction In 3d Environmentsmentioning

confidence: 99%

“…In Eye-SeeThrough, head movement controls a toolglass that can be moved over gaze-fixated targets [29]. Other work has supplemented eye pointing with subsequent refinement of the selection by head movement [18,19,22,49]. Recently,Pinpointing compared head versus eyes as primary pointing modes, and a variety of techniques for subsequent selection refinement [23].…”

Section: Combination Of Eye and Head Movementmentioning

confidence: 99%

See 1 more Smart Citation

Eye&Head

Sidenmark

Gellersen

2019

Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

Eye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and identify design principles for Eye&Head gaze interaction. We introduce three novel techniques that build on the distinction of head-supported versus eyes-only gaze, to enable dynamic coupling of gaze and pointer, hover interaction, visual exploration around pre-selections, and iterative and fast confirmation of targets. We demonstrate Eye&Head interaction on applications in virtual reality, and evaluate our techniques against baselines in pointing and confirmation studies. Our results show that Eye&Head techniques enable novel gaze behaviours that provide users with more control and flexibility in fast gaze pointing and selection.

show abstract

Section: Gaze Interaction In 3d Environmentsmentioning

confidence: 99%

Section: Combination Of Eye and Head Movementmentioning

confidence: 99%

Eye&Head

Sidenmark

Gellersen

2019

Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

show abstract

“…a big advantage. We investigated the performance and usability of eye movements for pointing towards graphical user interfaces on a head-mounted displays (HMD) compared to head pointing (translating head movements to the pointer position) and a trackball mouse [21]. Our study revealed the higher speed of eye pointing compared to the other pointing modalities while, however, the inaccuracy of gaze tracking on the small HMD led to lower usability of the eye pointing technique.…”

Section: Magic Pointing: Implicit Use Of Gaze For Interaction With Wpasmentioning

confidence: 98%

A Wearable Personal Assistant for Surgeons – Design, Evaluation, and Future Prospects

Jalaliniya¹,

Pederson²,

Mardanbegi³

2017

EAI Endorsed Trans Perv Health Tech

Self Cite

View full text Add to dashboard Cite

In this paper, we present our body-and-mind-centric approach for the design of wearable personal assistants (WPAs) motivated by the fact that such devices are likely to play an increasing role in everyday life. We also report on the utility of such a device for orthopedic surgeons in hospitals. A prototype of the WPA was developed on Google Glass for supporting surgeons in three different scenarios: (1) touch-less interaction with medical images, (2) tele-presence during surgeries, and (3) mobile access to Electronic Patient Records (EPR) during ward rounds. We evaluated the system in a clinical simulation facility and found that while the WPA can be a viable solution for touch-less interaction and remote collaborations during surgeries, using the WPA in the ward rounds might interfere with social interaction between clinicians and patients. Finally, we present our ongoing exploration of gaze and gesture as alternative input modalities for WPAs inspired by the hospital study.

show abstract

“…Another approach is to use trackpad-like interaction, with a dedicated device held in the hand [39,33], on the body [15,6,5,47,16] or the environment [14,56]. Finally, the use of eye-tracking or head-tracking is also possible [21,39].…”

Section: Pointing With Eyewearmentioning

confidence: 99%

“…Only a few previous works specifically investigated pointing on eyewear. The work of Jalaliniya et al on head and eye tracking [21], or Hsieh et al on gloves [17] are examples. However, as far as we know, none of these works comprehensively tackle social acceptability and formally investigate pointing performance under realistic urban movement, or used exotic, unrealistically bulky hardware.…”

Section: Pointing With Eyewearmentioning

confidence: 99%

A Comparative Study of Pointing Techniques for Eyewear Using a Simulated Pedestrian Environment

Roy

Zakaria

Perrault

et al. 2019

Human-Computer Interaction – INTERACT 2019

View full text Add to dashboard Cite

Eyewear displays allow users to interact with virtual content displayed over real-world vision, in active situations like standing and walking. Pointing techniques for eyewear displays have been proposed, but their social acceptability, efficiency, and situation awareness remain to be assessed. Using a novel street-walking simulator, we conducted an empirical study of target acquisition while standing and walking under different levels of street crowdedness. We evaluated three phone-based eyewear pointing techniques: indirect touch on a touchscreen, and two in-air techniques using relative device rotations around forward and a downward axes. Direct touch on a phone, without eyewear, was used as a control condition. Results showed that indirect touch was the most efficient and socially acceptable technique, and that in-air pointing was inefficient when walking. Interestingly, the eyewear displays did not improve situation awareness compared to the control condition. We discuss implications for eyewear interaction design.

show abstract

Head and Eye Movement as Pointing Modalities for Eyewear Computers

Cited by 33 publications

References 9 publications

Eye&Head

Eye&Head

A Wearable Personal Assistant for Surgeons – Design, Evaluation, and Future Prospects

A Comparative Study of Pointing Techniques for Eyewear Using a Simulated Pedestrian Environment

Contact Info

Product

Resources

About