Pointing by gaze, head, and foot in a head-mounted display

Minakata, Katsumi; Hansen, John Paulin; MacKenzie, I. Scott; Bækgaard, Per; Rajanna, Vijay

doi:10.1145/3317956.3318150

Cited by 29 publications

(16 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Sidenmark and Gellersen [24] have demonstrated that eye-head interaction in virtual reality applications leads to fast gaze pointing and selection. Although those studies [21][22][23][24][25][26] examined the effectiveness of an eye gaze input system combined with key input or speech, they did not compare the system with one involving only an eye-gaze interface. That is, these studies did not aim at developing a system that could be executed with only an eye-gaze interface.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Development of an Eye-Gaze Input System With High Speed and Accuracy through Target Prediction Based on Homing Eye Movements

et al. 2021

View full text Add to dashboard Cite

In this study, a method to predict a target on the basis of the trajectory of eye movements and to increase the pointing speed while maintaining high predictive accuracy is proposed. First, a predictive method based on ballistic (fast) eye movements (Approach 1) was evaluated in terms of pointing speed and predictive accuracy. In Approach 1, the so-called Midas touch problem (pointing to an unintended target) occurred, particularly when a small number of samples was used to predict a target. Therefore, to overcome the poor predictive accuracy of Approach 1, we developed a new predictive method (Approach 2) using homing (slow) eye movements rather than ballistic (fast) eye movements. Approach 2 overcame the disadvantage (inaccurate prediction) of Approach 1 by shortening the pointing time while maintaining high predictive accuracy.INDEX TERMS eye-gaze input, target predictive method, ballistic eye movement, homing eye movement, pointing time, predictive accuracy, Midas touch

show abstract

Section: Discussionmentioning

confidence: 99%

“…Recent studies on eye-gaze interfaces [21][22][23][24][25][26] have demonstrated the effectiveness of such interfaces. Sidenmark and Gellersen [24] have demonstrated that eyehead interaction in virtual reality applications provides users with faster pointing and selection.…”

Section: Introductionmentioning

confidence: 99%

Development of an Eye-Gaze Input System With High Speed and Accuracy through Target Prediction Based on Homing Eye Movements

et al. 2021

View full text Add to dashboard Cite

show abstract

“…However, it may be possible, that the pointer would be easier to control using different techniques. Minataka et al [23] compared head pointing with gaze position tracking and foot gestures and identified head pointing as the most efficient interaction method for pointing tasks. However, hand gestures, as implemented by Feng et al [15], were not included in their experiment.…”

Section: Discussionmentioning

confidence: 99%

HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training

et al. 2020

View full text Add to dashboard Cite

Purpose In laparoscopic surgery training, experts guide novice physicians to desired instrument positions or indicate relevant areas of interest. These instructions are usually given via verbal communication or using physical pointing devices. To facilitate a sterile work flow and to improve training, new guiding methods are needed. This work proposes to use optical see-through augmented reality to visualize an interactive virtual pointer on the laparoscopic. Methods After an interdisciplinary development, the pointer’s applicability and feasibility for training was evaluated and it was compared to a standard condition based on verbal and gestural communication only. In this study, ten surgical trainees were guided by an experienced trainer during cholecystectomies on a laparoscopic training simulator. All trainees completed a virtual cholecystectomy with and without the interactive virtual pointer in alternating order. Measures included procedure time, economy of movement and error rates. Results Results of standardized variables revealed significantly improved economy of movement (p = 0.047) and error rates (p = 0.047), as well as an overall improved user performance (Total z-score; p = 0.031) in conditions using the proposed method. Conclusion The proposed HoloPointer is a feasible and applicable tool for laparoscopic surgery training. It improved objective performance metrics without prolongation of the task completion time in this pre-clinical setup.

show abstract

“…Using RGB and RGB-D camera sensors, it is also possible to determine the users' body location in space and use that information to select menu items or objects that are closer to users [48] or in front of the users [33]. Two studies used the users' feet to control a platform that acted like a mouse depending on the direction and angle of the feet on the platform, allowing the control of the direction of a virtual pointer [4,75]. Lastly, a single study was found where the users were able to perform the selection by eye gazing to an element and confirming the selection contracting the muscles of their arms [83], which was made possible using an electromyograph (EMG).…”

Section: Interaction Interfacesmentioning

confidence: 99%

Hands-free interaction in immersive virtual reality: A systematic review

Monteiro

Gonçalves

Coelho

et al. 2021

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Hands are the most important tool to interact with virtual environments, and they should be available to perform the most critical tasks. For example, a surgeon in VR should keep his/her hands on the instruments and be able to do secondary tasks without performing a disruptive event to the operative task. In this common scenario, one can observe that hands are not available for interaction. The goal of this systematic review is to survey the literature and identify which hands-free interfaces are used, the performed interaction tasks, what metrics are used for interface evaluation, and the results of such evaluations. From 80 studies that met the eligibility criteria, the voice is the most studied interface, followed by the eye and head gaze. Some novel interfaces were brain interfaces and face expressions. System control and selection represent most of the interaction tasks studied and most studies evaluate interfaces for usability. Despite the best interface depending on the task and study, the voice was found to be versatile and showed good results amongst the studies. More research is recommended to improve the practical use of the interfaces and to evaluate the interfaces more formally.

show abstract

Pointing by gaze, head, and foot in a head-mounted display

Cited by 29 publications

References 35 publications

Development of an Eye-Gaze Input System With High Speed and Accuracy through Target Prediction Based on Homing Eye Movements

Development of an Eye-Gaze Input System With High Speed and Accuracy through Target Prediction Based on Homing Eye Movements

HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training

Hands-free interaction in immersive virtual reality: A systematic review

Contact Info

Product

Resources

About